2024-03-09T14:10:09.606 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-09T14:10:09.606 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470 --verbose --description rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} --name cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/orig.config.yaml 2024-03-09T14:10:09.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T14:10:09.751 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470 branch: wip-rgw-account-v3 description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7588470' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-account-v3 ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: wip-iam-user-apis git_remote: https://github.com/cbodley/ slow_backend: true storage classes: LUKEWARM, FROZEN selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-account-v3 sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 owner: scheduled_cbodley@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3347 sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-account-v3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrb6FTGJtDvBDWaeFF1C3SQqO9EKUCouJTkcJ9+56Y6H/XYPLqkVR4R0B3BEikUo6hCvhO/xEF22R960rgmtf0= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORt1zEJxAmg3WQdBX57TaeAzDsYGXN2P4AN6ZmxH+bEcJC24GUG3feFvTF8Zl1SRljfJIdrvg4g+Ii8y/XB1yg= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-09_13:26:09 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-09T14:10:09.751 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa; will attempt to use it 2024-03-09T14:10:09.752 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks 2024-03-09T14:10:09.752 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-09T14:10:09.753 INFO:teuthology.task.internal:Checking packages... 2024-03-09T14:10:09.777 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c00d9c609fb42a2a25f1c196bed064ca8bb02413' 2024-03-09T14:10:09.777 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-09T14:10:09.777 INFO:teuthology.packaging:ref: None 2024-03-09T14:10:09.777 INFO:teuthology.packaging:tag: None 2024-03-09T14:10:09.777 INFO:teuthology.packaging:branch: wip-rgw-account-v3 2024-03-09T14:10:09.777 INFO:teuthology.packaging:sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:10:09.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-account-v3 2024-03-09T14:10:10.021 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2079.gc00d9c60 2024-03-09T14:10:10.022 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-09T14:10:10.036 INFO:teuthology.task.internal:no buildpackages task found 2024-03-09T14:10:10.036 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-09T14:10:10.165 INFO:teuthology.task.internal:Saving configuration 2024-03-09T14:10:10.183 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-09T14:10:10.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T14:10:10.270 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:04:52.586235', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrb6FTGJtDvBDWaeFF1C3SQqO9EKUCouJTkcJ9+56Y6H/XYPLqkVR4R0B3BEikUo6hCvhO/xEF22R960rgmtf0='} 2024-03-09T14:10:10.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:04:52.583043', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORt1zEJxAmg3WQdBX57TaeAzDsYGXN2P4AN6ZmxH+bEcJC24GUG3feFvTF8Zl1SRljfJIdrvg4g+Ii8y/XB1yg='} 2024-03-09T14:10:10.291 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-09T14:10:10.375 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-09T14:10:10.376 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-09T14:10:10.376 INFO:teuthology.run_tasks:Running task console_log... 2024-03-09T14:10:10.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c072c10d0>, signals=[15]) 2024-03-09T14:10:10.507 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-09T14:10:10.540 INFO:teuthology.task.internal:Opening connections... 2024-03-09T14:10:10.541 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:10:10.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:10:10.645 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:10:10.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:10:10.735 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-09T14:10:10.746 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-03-09T14:10:10.763 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-03-09T14:10:10.763 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-03-09T14:10:10.820 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T14:10:10.821 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-09T14:10:10.821 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T14:10:10.821 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-03-09T14:10:10.846 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-03-09T14:10:10.863 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-03-09T14:10:10.864 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-03-09T14:10:10.920 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T14:10:10.921 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-09T14:10:10.921 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T14:10:10.921 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-03-09T14:10:10.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-09T14:10:10.961 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-09T14:10:11.043 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-09T14:10:11.043 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-03-09T14:10:11.046 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-03-09T14:10:11.062 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-09T14:10:11.084 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-09T14:10:11.084 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-03-09T14:10:11.103 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-03-09T14:10:11.131 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-09T14:10:11.186 INFO:teuthology.run_tasks:Running task kernel... 2024-03-09T14:10:11.218 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-09T14:10:11.219 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-09T14:10:11.219 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-09T14:10:11.219 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-09T14:10:11.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:10:11.236 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-03-09T14:10:11.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:10:11.237 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-03-09T14:10:11.293 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-361.el9.x86_64 2024-03-09T14:10:11.294 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.14.0-361.el9.x86_64 2024-03-09T14:10:11.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum install -y kernel 2024-03-09T14:10:11.295 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2024-03-09T14:10:11.295 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-361.el9.x86_64 2024-03-09T14:10:11.295 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-03-09T14:10:13.543 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.7 MB 00:00 2024-03-09T14:10:13.550 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-09T14:10:14.918 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-03-09T14:10:14.984 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-03-09T14:10:16.050 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-03-09T14:10:16.950 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-03-09T14:10:19.992 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 19 MB 00:01 2024-03-09T14:10:20.534 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-03-09T14:10:25.460 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.1 MB 00:01 2024-03-09T14:10:27.077 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-03-09T14:10:28.162 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-03-09T14:10:32.026 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 782 kB/s | 6.1 MB 00:08 2024-03-09T14:10:33.362 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-09T14:10:34.310 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2024-03-09T14:10:35.262 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-03-09T14:10:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-09T14:10:35.686 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-09T14:10:35.786 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-03-09T14:10:35.789 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-09T14:10:35.789 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-03-09T14:10:35.789 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-09T14:10:35.789 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-03-09T14:10:35.789 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-03-09T14:10:35.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:10:35.791 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 100 M 2024-03-09T14:10:35.791 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 123 M 2024-03-09T14:10:35.791 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-03-09T14:10:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 1.4 MB/s | 6.0 MB 00:04 2024-03-09T14:10:40.178 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-09T14:10:42.385 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-09T14:10:42.385 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-09T14:10:42.483 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-03-09T14:10:42.488 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-03-09T14:10:42.488 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-03-09T14:10:42.488 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout:Install 4 Packages 2024-03-09T14:10:42.489 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:10:42.490 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 100 M 2024-03-09T14:10:42.490 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 123 M 2024-03-09T14:10:42.490 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-03-09T14:10:43.488 INFO:teuthology.orchestra.run.smithi159.stdout:(1/4): kernel-core-5.14.0-427.el9.x86_64.rpm 24 MB/s | 21 MB 00:00 2024-03-09T14:10:43.771 INFO:teuthology.orchestra.run.smithi159.stdout:(2/4): kernel-5.14.0-427.el9.x86_64.rpm 5.2 MB/s | 6.0 MB 00:01 2024-03-09T14:10:44.296 INFO:teuthology.orchestra.run.smithi159.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 23 MB/s | 39 MB 00:01 2024-03-09T14:10:44.755 INFO:teuthology.orchestra.run.smithi159.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 26 MB/s | 33 MB 00:01 2024-03-09T14:10:44.757 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:10:44.758 INFO:teuthology.orchestra.run.smithi159.stdout:Total 44 MB/s | 100 MB 00:02 2024-03-09T14:10:45.646 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-03-09T14:10:46.045 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-03-09T14:10:46.045 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-03-09T14:10:47.400 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-03-09T14:10:47.400 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-03-09T14:10:50.378 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-03-09T14:10:51.027 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:10:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:10:53.993 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:10:54.175 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:10:57.895 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 971 kB/s | 21 MB 00:21 2024-03-09T14:10:58.931 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:10:59.052 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:03.852 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:18.976 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 879 kB/s | 33 MB 00:38 2024-03-09T14:11:20.385 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 905 kB/s | 39 MB 00:44 2024-03-09T14:11:20.385 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:11:20.385 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.2 MB/s | 100 MB 00:44 2024-03-09T14:11:21.305 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-03-09T14:11:21.737 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-03-09T14:11:21.737 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-03-09T14:11:23.150 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-03-09T14:11:23.150 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-03-09T14:11:26.021 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-03-09T14:11:26.691 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:11:26.826 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:11:29.744 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:11:29.919 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:11:33.185 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:33.185 INFO:teuthology.orchestra.run.smithi159.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-09T14:11:33.186 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:11:33.270 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:33.730 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:33.730 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:11:33.730 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:11:33.730 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:11:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:11:34.185 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-03-09T14:11:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-09T14:11:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-09T14:11:34.185 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-09T14:11:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-09T14:11:34.186 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:11:34.186 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-03-09T14:11:34.724 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:11:34.871 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:11:34.872 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:11:34.872 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-09T14:11:34.872 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-09T14:11:34.872 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-09T14:11:34.872 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-09T14:11:34.872 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2024-03-09T14:11:34.872 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:11:34.994 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:11:34.994 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:11:34.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-03-09T14:11:35.025 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 68.el9 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8264254 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-09T14:11:35.036 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:11:35.037 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-03-09T14:11:35.038 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-09T14:11:35.038 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 5.14.0-427.el9.x86_64 2024-03-09T14:11:35.039 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-09T14:11:35.156 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:11:35.672 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-03-09T14:11:37.034 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-09T14:11:37.070 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-03-09T14:11:37.073 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-03-09T14:11:37.088 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.qhFVeKk8jM 2024-03-09T14:11:37.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qhFVeKk8jM 2024-03-09T14:11:37.156 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.qhFVeKk8jM 2024-03-09T14:11:37.293 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.qhFVeKk8jM is 6KB 2024-03-09T14:11:37.340 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.qhFVeKk8jM 2024-03-09T14:11:37.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-03-09T14:11:37.425 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-09T14:11:37.425 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-09T14:11:37.425 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-09T14:11:37.425 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-09T14:11:37.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-09T14:11:37.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-03-09T14:11:40.285 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:12:07.586 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-09T14:12:07.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:12:07.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:12:10.891 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:12:10.892 INFO:teuthology.orchestra.run.smithi046.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-09T14:12:10.892 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:12:10.979 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:12:11.444 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:12:11.444 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-09T14:12:11.445 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-09T14:12:11.445 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-09T14:12:11.890 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-09T14:12:11.890 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:12:11.890 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-03-09T14:12:11.890 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-09T14:12:11.891 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-09T14:12:11.891 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-09T14:12:11.891 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-09T14:12:11.891 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:12:11.891 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-03-09T14:12:12.432 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:12:12.588 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:12:12.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:12:12.588 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-09T14:12:12.588 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-09T14:12:12.588 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-09T14:12:12.588 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-09T14:12:12.588 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-03-09T14:12:12.588 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-03-09T14:12:12.715 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-09T14:12:12.715 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-09T14:12:12.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-03-09T14:12:12.758 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-03-09T14:12:12.759 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:12:12.760 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-03-09T14:12:12.761 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-09T14:12:12.761 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-427.el9.x86_64 2024-03-09T14:12:12.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-09T14:12:13.535 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-03-09T14:12:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31212]) leaked on vgs invocation. Parent PID 18139: grub2-probe 2024-03-09T14:12:15.237 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[29176]) leaked on vgs invocation. Parent PID 18139: grub2-probe 2024-03-09T14:12:15.269 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[31212]) leaked on vgs invocation. Parent PID 18139: grub2-probe 2024-03-09T14:12:15.269 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[29176]) leaked on vgs invocation. Parent PID 18139: grub2-probe 2024-03-09T14:12:15.513 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-09T14:12:15.526 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-03-09T14:12:15.528 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-03-09T14:12:15.543 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.8sb5iHZdv3 2024-03-09T14:12:15.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8sb5iHZdv3 2024-03-09T14:12:15.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.8sb5iHZdv3 2024-03-09T14:12:15.768 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.8sb5iHZdv3 is 6KB 2024-03-09T14:12:15.816 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.8sb5iHZdv3 2024-03-09T14:12:15.830 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-03-09T14:12:15.898 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-09T14:12:15.898 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-09T14:12:15.898 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-09T14:12:15.898 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-09T14:12:15.899 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-09T14:12:16.043 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-03-09T14:12:26.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-09T14:12:35.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:12:35.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:12:38.078 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-03-09T14:12:46.053 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-09T14:12:46.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:12:46.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:12:50.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:12:50.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:13:04.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-09T14:13:13.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:13:13.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:13:16.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-09T14:13:28.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:13:28.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:13:46.911 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-03-09T14:13:50.086 DEBUG:teuthology.orchestra.remote:timed out 2024-03-09T14:14:01.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:14:01.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:14:02.546 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-03-09T14:14:03.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:14:03.023 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-09T14:14:03.023 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-03-09T14:14:03.038 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-427.el9.x86_64 2024-03-09T14:14:03.038 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-09T14:14:03.038 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-09T14:14:03.039 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-09T14:14:04.039 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-09T14:14:04.039 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-09T14:14:04.147 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-03-09T14:14:04.216 DEBUG:teuthology.parallel:result is None 2024-03-09T14:14:05.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:14:05.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:14:05.534 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-03-09T14:14:05.932 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:14:05.932 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-09T14:14:05.932 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-03-09T14:14:05.948 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-427.el9.x86_64 2024-03-09T14:14:05.948 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-09T14:14:05.948 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-09T14:14:05.948 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-09T14:14:06.949 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-09T14:14:06.949 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-09T14:14:07.036 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2024-03-09T14:14:07.070 DEBUG:teuthology.parallel:result is None 2024-03-09T14:14:07.070 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-09T14:14:07.080 INFO:teuthology.task.internal:Creating test directory... 2024-03-09T14:14:07.081 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-09T14:14:07.084 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-09T14:14:07.100 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-09T14:14:07.117 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-09T14:14:07.151 INFO:teuthology.task.internal:Creating archive directory... 2024-03-09T14:14:07.151 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-09T14:14:07.153 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-09T14:14:07.181 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-09T14:14:07.191 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-09T14:14:07.192 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-09T14:14:07.208 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-09T14:14:07.256 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:14:07.265 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:14:07.270 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:14:07.278 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:14:07.280 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-09T14:14:07.286 INFO:teuthology.task.internal:Configuring sudo... 2024-03-09T14:14:07.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-09T14:14:07.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-09T14:14:07.341 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-09T14:14:07.351 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-09T14:14:07.352 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-09T14:14:07.354 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-09T14:14:07.398 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:14:07.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:14:07.489 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:14:07.568 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:14:07.610 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:14:07.610 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-09T14:14:07.677 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:14:07.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:14:07.774 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:14:07.856 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:14:07.899 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:14:07.900 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-09T14:14:07.967 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-03-09T14:14:07.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-03-09T14:14:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T14:14:08.066 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T14:14:08.535 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-09T14:14:08.543 INFO:teuthology.task.internal:Starting timer... 2024-03-09T14:14:08.543 INFO:teuthology.run_tasks:Running task pcp... 2024-03-09T14:14:08.588 INFO:teuthology.run_tasks:Running task selinux... 2024-03-09T14:14:08.620 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-09T14:14:08.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-03-09T14:14:08.679 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-03-09T14:14:08.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-03-09T14:14:08.740 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-03-09T14:14:08.742 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-09T14:14:08.742 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-03-09T14:14:08.758 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-03-09T14:14:08.758 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-03-09T14:14:08.778 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-03-09T14:14:08.778 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2024-03-09T14:14:08.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T14:14:08.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:14:08.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T14:14:08.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:14:08.853 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-09T14:14:08.853 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-03-09T14:14:08.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-03-09T14:14:08.972 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-09T14:14:08.981 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-09T14:14:08.998 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-09T14:14:08.999 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-09T14:18:29.732 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2024-03-09T14:18:29.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:18:29.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:18:29.825 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-03-09T14:18:29.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-03-09T14:18:29.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:18:29.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:18:29.995 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-03-09T14:18:30.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-03-09T14:18:30.031 INFO:teuthology.run_tasks:Running task clock... 2024-03-09T14:18:30.041 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-09T14:18:30.042 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-09T14:18:30.042 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T14:18:30.045 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-09T14:18:30.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T14:18:30.077 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-09T14:18:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-09T14:18:30.101 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-09T14:18:30.118 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-09T14:18:30.124 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-03-09T14:18:30.139 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-03-09T14:18:30.147 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-03-09T14:18:30.155 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-09T14:18:30.160 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-03-09T14:18:30.172 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-09T14:18:30.178 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-09T14:18:30.194 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-09T14:18:30.228 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-03-09T14:18:30.232 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T14:18:30.232 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-03-09T14:18:30.232 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.232 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.232 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.232 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.249 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-03-09T14:18:30.253 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T14:18:30.253 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-03-09T14:18:30.253 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.253 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.253 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.253 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T14:18:30.254 INFO:teuthology.run_tasks:Running task install... 2024-03-09T14:18:30.264 DEBUG:teuthology.task.install:project ceph 2024-03-09T14:18:30.264 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}} 2024-03-09T14:18:30.264 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'} 2024-03-09T14:18:30.264 INFO:teuthology.task.install:Using flavor: default 2024-03-09T14:18:30.272 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-09T14:18:30.273 INFO:teuthology.task.install:extra packages: [] 2024-03-09T14:18:30.273 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'tag': None, 'wait_for_package': False} 2024-03-09T14:18:30.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:18:30.276 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'tag': None, 'wait_for_package': False} 2024-03-09T14:18:30.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:18:30.423 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/ 2024-03-09T14:18:30.424 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2079.gc00d9c60 2024-03-09T14:18:30.499 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/ 2024-03-09T14:18:30.499 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2079.gc00d9c60 2024-03-09T14:18:30.607 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-09T14:18:30.607 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:18:30.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-09T14:18:30.609 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-09T14:18:30.610 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:18:30.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-09T14:18:30.638 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-09T14:18:30.638 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c00d9c609fb42a2a25f1c196bed064ca8bb02413/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-09T14:18:30.639 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-03-09T14:18:30.639 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c00d9c609fb42a2a25f1c196bed064ca8bb02413/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-09T14:18:30.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-09T14:18:30.709 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-09T14:18:30.787 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-09T14:18:30.791 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-09T14:18:30.853 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-03-09T14:18:30.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-03-09T14:18:30.858 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-03-09T14:18:30.859 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-03-09T14:18:31.098 INFO:teuthology.orchestra.run.smithi046.stdout:74 files removed 2024-03-09T14:18:31.113 INFO:teuthology.orchestra.run.smithi159.stdout:74 files removed 2024-03-09T14:18:31.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-09T14:18:31.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-03-09T14:18:31.825 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 220 kB/s | 82 kB 00:00 2024-03-09T14:18:31.926 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 182 kB/s | 82 kB 00:00 2024-03-09T14:18:32.309 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-03-09T14:18:32.393 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 24 kB/s | 10 kB 00:00 2024-03-09T14:18:32.718 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2024-03-09T14:18:32.726 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-09T14:18:33.137 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-09T14:18:33.187 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-09T14:18:34.605 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 7.5 MB/s | 2.0 MB 00:00 2024-03-09T14:18:34.612 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-03-09T14:18:35.486 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-03-09T14:18:35.595 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-09T14:18:37.656 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-03-09T14:18:37.918 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-03-09T14:18:42.452 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.1 MB 00:01 2024-03-09T14:18:42.804 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.1 MB 00:01 2024-03-09T14:18:44.125 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2024-03-09T14:18:44.247 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 15 kB 00:00 2024-03-09T14:18:45.377 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-03-09T14:18:45.718 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-09T14:18:50.343 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-09T14:18:50.782 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-09T14:18:52.863 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:18:52.864 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:18:52.971 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout:=========================================================================================================== 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout:=========================================================================================================== 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 6.6 k 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.4 M 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 888 k 2024-03-09T14:18:53.004 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 145 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 1.5 M 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 139 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 1.8 M 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 7.4 M 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 49 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 10 M 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 48 M 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 264 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 749 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 31 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 745 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 127 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-09T14:18:53.005 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 162 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 321 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 299 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 99 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 85 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 170 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-03-09T14:18:53.006 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.4 M 2024-03-09T14:18:53.007 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:18:53.007 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-03-09T14:18:53.007 INFO:teuthology.orchestra.run.smithi159.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-09T14:18:53.007 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-09T14:18:53.008 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-09T14:18:53.009 INFO:teuthology.orchestra.run.smithi159.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 20 M 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 34 k 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 2.1 M 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 248 k 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 4.7 M 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 17 M 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 16 k 2024-03-09T14:18:53.010 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 25 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 baseos 262 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.011 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-09T14:18:53.012 INFO:teuthology.orchestra.run.smithi159.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-09T14:18:53.013 INFO:teuthology.orchestra.run.smithi159.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-09T14:18:53.014 INFO:teuthology.orchestra.run.smithi159.stdout: libX11-xcb x86_64 1.7.0-8.el9 CentOS-AppStream 9.8 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.015 INFO:teuthology.orchestra.run.smithi159.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 163 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-09T14:18:53.016 INFO:teuthology.orchestra.run.smithi159.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-09T14:18:53.017 INFO:teuthology.orchestra.run.smithi159.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 501 k 2024-03-09T14:18:53.018 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.3 M 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-09T14:18:53.019 INFO:teuthology.orchestra.run.smithi159.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-09T14:18:53.020 INFO:teuthology.orchestra.run.smithi159.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-09T14:18:53.021 INFO:teuthology.orchestra.run.smithi159.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libEGL x86_64 23.3.3-1.el9 appstream 127 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libGL x86_64 23.3.3-1.el9 appstream 168 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libgbm x86_64 23.3.3-1.el9 appstream 38 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libglapi x86_64 23.3.3-1.el9 appstream 44 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-09T14:18:53.022 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-03-09T14:18:53.023 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: poppler x86_64 21.01.0-19.el9 appstream 1.1 M 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-09T14:18:53.024 INFO:teuthology.orchestra.run.smithi159.stdout: poppler-glib x86_64 21.01.0-19.el9 appstream 152 k 2024-03-09T14:18:53.025 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-09T14:18:53.025 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-09T14:18:53.025 INFO:teuthology.orchestra.run.smithi159.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-09T14:18:53.025 INFO:teuthology.orchestra.run.smithi159.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-09T14:18:53.025 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-09T14:18:53.025 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 45 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 131 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-09T14:18:53.026 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-09T14:18:53.027 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.028 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-09T14:18:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-09T14:18:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-09T14:18:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-09T14:18:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-09T14:18:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-09T14:18:53.029 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-09T14:18:53.030 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-09T14:18:53.031 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-09T14:18:53.032 INFO:teuthology.orchestra.run.smithi159.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: tzdata-java noarch 2024a-1.el9 appstream 230 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-09T14:18:53.033 INFO:teuthology.orchestra.run.smithi159.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-09T14:18:53.034 INFO:teuthology.orchestra.run.smithi159.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-09T14:18:53.035 INFO:teuthology.orchestra.run.smithi159.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout:=========================================================================================================== 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout:Install 282 Packages 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 2 Packages 2024-03-09T14:18:53.036 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:18:53.037 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 297 M 2024-03-09T14:18:53.037 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-03-09T14:18:53.404 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:18:53.406 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-09T14:18:53.519 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-03-09T14:18:53.543 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================== 2024-03-09T14:18:53.543 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-03-09T14:18:53.543 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================== 2024-03-09T14:18:53.544 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-03-09T14:18:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 6.6 k 2024-03-09T14:18:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.4 M 2024-03-09T14:18:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 888 k 2024-03-09T14:18:53.544 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 145 k 2024-03-09T14:18:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 1.5 M 2024-03-09T14:18:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 139 k 2024-03-09T14:18:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 1.8 M 2024-03-09T14:18:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 7.4 M 2024-03-09T14:18:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 49 k 2024-03-09T14:18:53.545 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 10 M 2024-03-09T14:18:53.546 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 48 M 2024-03-09T14:18:53.546 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 264 k 2024-03-09T14:18:53.546 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 749 k 2024-03-09T14:18:53.546 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 31 k 2024-03-09T14:18:53.546 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 745 k 2024-03-09T14:18:53.546 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 127 k 2024-03-09T14:18:53.547 INFO:teuthology.orchestra.run.smithi046.stdout: maven noarch 1:3.6.3-15.el9 CentOS-AppStream 17 k 2024-03-09T14:18:53.547 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 162 k 2024-03-09T14:18:53.547 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 321 k 2024-03-09T14:18:53.547 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 299 k 2024-03-09T14:18:53.547 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 99 k 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 85 k 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 170 k 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.4 M 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 3.1 M 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-03-09T14:18:53.548 INFO:teuthology.orchestra.run.smithi046.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: alsa-lib x86_64 1.2.10-2.el9 appstream 523 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-cli noarch 1.4-17.el9 CentOS-AppStream 70 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-codec noarch 1.15-7.el9 CentOS-AppStream 301 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-io noarch 1:2.8.0-8.el9 CentOS-AppStream 282 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 CentOS-AppStream 558 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: atinject noarch 1.0.3-6.el9 CentOS-AppStream 22 k 2024-03-09T14:18:53.549 INFO:teuthology.orchestra.run.smithi046.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: cdi-api noarch 2.0.2-6.el9 CentOS-AppStream 52 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 20 M 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 34 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 2.1 M 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 248 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 4.7 M 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 17 M 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2079.gc00d9c60.el9 ceph-noarch 16 k 2024-03-09T14:18:53.550 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 25 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: cups-libs x86_64 1:2.3.3op2-24.el9 baseos 262 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-09T14:18:53.551 INFO:teuthology.orchestra.run.smithi046.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: google-guice noarch 4.2.3-9.el9 CentOS-AppStream 472 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: guava noarch 30.1-6.el9 CentOS-AppStream 2.3 M 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: httpcomponents-client noarch 4.5.13-3.el9 CentOS-AppStream 656 k 2024-03-09T14:18:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: httpcomponents-core noarch 4.4.13-7.el9 CentOS-AppStream 630 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jakarta-annotations noarch 1.3.5-13.el9 CentOS-AppStream 44 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jansi x86_64 2.3.3-6.el9 CentOS-AppStream 108 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: java-11-openjdk x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 439 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: java-11-openjdk-headless x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 40 M 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 CentOS-AppStream 23 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jsoup noarch 1.13.1-10.el9 CentOS-AppStream 376 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: jsr-305 noarch 3.0.2-6.el9 CentOS-AppStream 31 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2024-03-09T14:18:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: libX11-xcb x86_64 1.7.0-8.el9 CentOS-AppStream 9.8 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 163 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libdrm x86_64 2.4.117-1.el9 appstream 161 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2024-03-09T14:18:53.555 INFO:teuthology.orchestra.run.smithi046.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 501 k 2024-03-09T14:18:53.556 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 5.3 M 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libtiff x86_64 4.4.0-12.el9 appstream 198 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2024-03-09T14:18:53.557 INFO:teuthology.orchestra.run.smithi046.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: maven-lib noarch 1:3.6.3-15.el9 CentOS-AppStream 1.5 M 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 CentOS-AppStream 7.9 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: maven-resolver noarch 1:1.6.1-10.el9 CentOS-AppStream 512 k 2024-03-09T14:18:53.558 INFO:teuthology.orchestra.run.smithi046.stdout: maven-shared-utils noarch 3.3.4-3.el9 CentOS-AppStream 150 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: maven-wagon noarch 3.4.2-7.el9 CentOS-AppStream 111 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libEGL x86_64 23.3.3-1.el9 appstream 127 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libGL x86_64 23.3.3-1.el9 appstream 168 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libgbm x86_64 23.3.3-1.el9 appstream 38 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libglapi x86_64 23.3.3-1.el9 appstream 44 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2024-03-09T14:18:53.559 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: osinfo-db noarch 20231215-1.el9 appstream 521 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: ostree-libs x86_64 2024.4-3.el9 appstream 487 k 2024-03-09T14:18:53.560 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-cipher noarch 1.7-27.el9 CentOS-AppStream 25 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-classworlds noarch 2.6.0-11.el9 CentOS-AppStream 59 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 CentOS-AppStream 17 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-interpolation noarch 1.26-11.el9 CentOS-AppStream 79 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 CentOS-AppStream 33 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-utils noarch 3.3.0-10.el9 CentOS-AppStream 253 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: poppler x86_64 21.01.0-19.el9 appstream 1.1 M 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: poppler-glib x86_64 21.01.0-19.el9 appstream 152 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-09T14:18:53.561 INFO:teuthology.orchestra.run.smithi046.stdout: publicsuffix-list noarch 20210518-3.el9 CentOS-AppStream 82 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 45 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-2079.gc00d9c60.el9 ceph 131 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-09T14:18:53.562 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-09T14:18:53.563 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-09T14:18:53.564 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-09T14:18:53.565 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-09T14:18:53.566 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-09T14:18:53.566 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-09T14:18:53.566 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-09T14:18:53.566 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-09T14:18:53.566 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-09T14:18:53.566 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-09T14:18:53.567 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-09T14:18:53.568 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: sisu noarch 1:0.3.4-10.el9 CentOS-AppStream 509 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: slf4j noarch 1.7.30-13.el9 CentOS-AppStream 68 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2024-03-09T14:18:53.569 INFO:teuthology.orchestra.run.smithi046.stdout: tzdata-java noarch 2024a-1.el9 appstream 230 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2024-03-09T14:18:53.570 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: java-11-openjdk-devel x86_64 1:11.0.18.0.10-3.el9 CentOS-AppStream 3.3 M 2024-03-09T14:18:53.571 INFO:teuthology.orchestra.run.smithi046.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: tracker-miners x86_64 3.1.2-4.el9 CentOS-AppStream 893 k 2024-03-09T14:18:53.572 INFO:teuthology.orchestra.run.smithi046.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout:=========================================================================================================== 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout:Install 282 Packages 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:18:53.573 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 297 M 2024-03-09T14:18:53.574 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-03-09T14:18:53.886 INFO:teuthology.orchestra.run.smithi159.stdout:(1/284): ceph-19.0.0-2079.gc00d9c60.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-03-09T14:18:54.236 INFO:teuthology.orchestra.run.smithi159.stdout:(2/284): ceph-fuse-19.0.0-2079.gc00d9c60.el9.x8 2.5 MB/s | 888 kB 00:00 2024-03-09T14:18:54.303 INFO:teuthology.orchestra.run.smithi159.stdout:(3/284): ceph-immutable-object-cache-19.0.0-207 2.1 MB/s | 145 kB 00:00 2024-03-09T14:18:54.458 INFO:teuthology.orchestra.run.smithi046.stdout:(1/284): ceph-19.0.0-2079.gc00d9c60.el9.x86_64. 31 kB/s | 6.6 kB 00:00 2024-03-09T14:18:54.737 INFO:teuthology.orchestra.run.smithi159.stdout:(4/284): ceph-mds-19.0.0-2079.gc00d9c60.el9.x86 4.9 MB/s | 2.1 MB 00:00 2024-03-09T14:18:54.933 INFO:teuthology.orchestra.run.smithi046.stdout:(2/284): ceph-fuse-19.0.0-2079.gc00d9c60.el9.x8 1.8 MB/s | 888 kB 00:00 2024-03-09T14:18:54.987 INFO:teuthology.orchestra.run.smithi159.stdout:(5/284): ceph-base-19.0.0-2079.gc00d9c60.el9.x8 4.0 MB/s | 5.4 MB 00:01 2024-03-09T14:18:55.000 INFO:teuthology.orchestra.run.smithi046.stdout:(3/284): ceph-immutable-object-cache-19.0.0-207 2.1 MB/s | 145 kB 00:00 2024-03-09T14:18:55.062 INFO:teuthology.orchestra.run.smithi159.stdout:(6/284): ceph-mgr-19.0.0-2079.gc00d9c60.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-03-09T14:18:55.751 INFO:teuthology.orchestra.run.smithi046.stdout:(4/284): ceph-mds-19.0.0-2079.gc00d9c60.el9.x86 2.8 MB/s | 2.1 MB 00:00 2024-03-09T14:18:55.754 INFO:teuthology.orchestra.run.smithi159.stdout:(7/284): ceph-mon-19.0.0-2079.gc00d9c60.el9.x86 6.1 MB/s | 4.7 MB 00:00 2024-03-09T14:18:56.051 INFO:teuthology.orchestra.run.smithi046.stdout:(5/284): ceph-base-19.0.0-2079.gc00d9c60.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-03-09T14:18:56.276 INFO:teuthology.orchestra.run.smithi046.stdout:(6/284): ceph-mgr-19.0.0-2079.gc00d9c60.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-03-09T14:18:57.096 INFO:teuthology.orchestra.run.smithi159.stdout:(8/284): ceph-common-19.0.0-2079.gc00d9c60.el9. 5.9 MB/s | 20 MB 00:03 2024-03-09T14:18:57.180 INFO:teuthology.orchestra.run.smithi159.stdout:(9/284): ceph-selinux-19.0.0-2079.gc00d9c60.el9 302 kB/s | 25 kB 00:00 2024-03-09T14:18:57.397 INFO:teuthology.orchestra.run.smithi159.stdout:(10/284): ceph-radosgw-19.0.0-2079.gc00d9c60.el 6.2 MB/s | 10 MB 00:01 2024-03-09T14:18:57.480 INFO:teuthology.orchestra.run.smithi159.stdout:(11/284): libcephfs-devel-19.0.0-2079.gc00d9c60 375 kB/s | 31 kB 00:00 2024-03-09T14:18:57.665 INFO:teuthology.orchestra.run.smithi159.stdout:(12/284): libcephfs2-19.0.0-2079.gc00d9c60.el9. 4.0 MB/s | 745 kB 00:00 2024-03-09T14:18:57.906 INFO:teuthology.orchestra.run.smithi159.stdout:(13/284): ceph-osd-19.0.0-2079.gc00d9c60.el9.x8 5.9 MB/s | 17 MB 00:02 2024-03-09T14:18:57.931 INFO:teuthology.orchestra.run.smithi159.stdout:(14/284): libcephsqlite-19.0.0-2079.gc00d9c60.e 611 kB/s | 163 kB 00:00 2024-03-09T14:18:57.989 INFO:teuthology.orchestra.run.smithi159.stdout:(15/284): librados-devel-19.0.0-2079.gc00d9c60. 1.5 MB/s | 127 kB 00:00 2024-03-09T14:18:58.031 INFO:teuthology.orchestra.run.smithi159.stdout:(16/284): libradosstriper1-19.0.0-2079.gc00d9c6 4.9 MB/s | 501 kB 00:00 2024-03-09T14:18:58.109 INFO:teuthology.orchestra.run.smithi046.stdout:(7/284): ceph-mon-19.0.0-2079.gc00d9c60.el9.x86 2.3 MB/s | 4.7 MB 00:02 2024-03-09T14:18:58.123 INFO:teuthology.orchestra.run.smithi159.stdout:(17/284): python3-ceph-argparse-19.0.0-2079.gc0 492 kB/s | 45 kB 00:00 2024-03-09T14:18:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:(18/284): python3-ceph-common-19.0.0-2079.gc00d 1.3 MB/s | 131 kB 00:00 2024-03-09T14:18:58.324 INFO:teuthology.orchestra.run.smithi159.stdout:(19/284): python3-cephfs-19.0.0-2079.gc00d9c60. 1.6 MB/s | 162 kB 00:00 2024-03-09T14:18:58.432 INFO:teuthology.orchestra.run.smithi159.stdout:(20/284): python3-rados-19.0.0-2079.gc00d9c60.e 2.9 MB/s | 321 kB 00:00 2024-03-09T14:18:58.549 INFO:teuthology.orchestra.run.smithi159.stdout:(21/284): python3-rbd-19.0.0-2079.gc00d9c60.el9 2.5 MB/s | 299 kB 00:00 2024-03-09T14:18:58.650 INFO:teuthology.orchestra.run.smithi159.stdout:(22/284): python3-rgw-19.0.0-2079.gc00d9c60.el9 994 kB/s | 99 kB 00:00 2024-03-09T14:18:58.750 INFO:teuthology.orchestra.run.smithi159.stdout:(23/284): rbd-fuse-19.0.0-2079.gc00d9c60.el9.x8 852 kB/s | 85 kB 00:00 2024-03-09T14:18:58.867 INFO:teuthology.orchestra.run.smithi159.stdout:(24/284): librgw2-19.0.0-2079.gc00d9c60.el9.x86 6.0 MB/s | 5.3 MB 00:00 2024-03-09T14:18:58.967 INFO:teuthology.orchestra.run.smithi159.stdout:(25/284): rbd-nbd-19.0.0-2079.gc00d9c60.el9.x86 1.7 MB/s | 170 kB 00:00 2024-03-09T14:18:59.059 INFO:teuthology.orchestra.run.smithi159.stdout:(26/284): ceph-grafana-dashboards-19.0.0-2079.g 371 kB/s | 34 kB 00:00 2024-03-09T14:18:59.151 INFO:teuthology.orchestra.run.smithi159.stdout:(27/284): ceph-mgr-cephadm-19.0.0-2079.gc00d9c6 1.5 MB/s | 139 kB 00:00 2024-03-09T14:18:59.218 INFO:teuthology.orchestra.run.smithi046.stdout:(8/284): ceph-common-19.0.0-2079.gc00d9c60.el9. 4.1 MB/s | 20 MB 00:04 2024-03-09T14:18:59.227 INFO:teuthology.orchestra.run.smithi159.stdout:(28/284): rbd-mirror-19.0.0-2079.gc00d9c60.el9. 6.5 MB/s | 3.1 MB 00:00 2024-03-09T14:18:59.293 INFO:teuthology.orchestra.run.smithi046.stdout:(9/284): ceph-selinux-19.0.0-2079.gc00d9c60.el9 337 kB/s | 25 kB 00:00 2024-03-09T14:18:59.485 INFO:teuthology.orchestra.run.smithi159.stdout:(29/284): ceph-mgr-dashboard-19.0.0-2079.gc00d9 5.4 MB/s | 1.8 MB 00:00 2024-03-09T14:18:59.602 INFO:teuthology.orchestra.run.smithi159.stdout:(30/284): ceph-mgr-modules-core-19.0.0-2079.gc0 2.1 MB/s | 248 kB 00:00 2024-03-09T14:18:59.710 INFO:teuthology.orchestra.run.smithi159.stdout:(31/284): ceph-mgr-rook-19.0.0-2079.gc00d9c60.e 455 kB/s | 49 kB 00:00 2024-03-09T14:18:59.811 INFO:teuthology.orchestra.run.smithi159.stdout:(32/284): ceph-prometheus-alerts-19.0.0-2079.gc 164 kB/s | 16 kB 00:00 2024-03-09T14:18:59.928 INFO:teuthology.orchestra.run.smithi159.stdout:(33/284): ceph-volume-19.0.0-2079.gc00d9c60.el9 2.2 MB/s | 264 kB 00:00 2024-03-09T14:19:00.137 INFO:teuthology.orchestra.run.smithi159.stdout:(34/284): cephadm-19.0.0-2079.gc00d9c60.el9.noa 3.5 MB/s | 749 kB 00:00 2024-03-09T14:19:00.270 INFO:teuthology.orchestra.run.smithi159.stdout:(35/284): adwaita-cursor-theme-40.1.1-3.el9.noa 4.6 MB/s | 625 kB 00:00 2024-03-09T14:19:00.504 INFO:teuthology.orchestra.run.smithi159.stdout:(36/284): ceph-mgr-diskprediction-local-19.0.0- 5.8 MB/s | 7.4 MB 00:01 2024-03-09T14:19:00.610 INFO:teuthology.orchestra.run.smithi046.stdout:(10/284): ceph-osd-19.0.0-2079.gc00d9c60.el9.x8 3.9 MB/s | 17 MB 00:04 2024-03-09T14:19:00.613 INFO:teuthology.orchestra.run.smithi159.stdout:(37/284): adwaita-icon-theme-40.1.1-3.el9.noarc 31 MB/s | 11 MB 00:00 2024-03-09T14:19:00.638 INFO:teuthology.orchestra.run.smithi159.stdout:(38/284): apache-commons-cli-1.4-17.el9.noarch. 530 kB/s | 70 kB 00:00 2024-03-09T14:19:00.663 INFO:teuthology.orchestra.run.smithi159.stdout:(39/284): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 301 kB 00:00 2024-03-09T14:19:00.685 INFO:teuthology.orchestra.run.smithi046.stdout:(11/284): libcephfs-devel-19.0.0-2079.gc00d9c60 417 kB/s | 31 kB 00:00 2024-03-09T14:19:00.688 INFO:teuthology.orchestra.run.smithi159.stdout:(40/284): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 282 kB 00:00 2024-03-09T14:19:00.714 INFO:teuthology.orchestra.run.smithi159.stdout:(41/284): apache-commons-lang3-3.12.0-6.el9.noa 11 MB/s | 558 kB 00:00 2024-03-09T14:19:00.739 INFO:teuthology.orchestra.run.smithi159.stdout:(42/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-03-09T14:19:00.764 INFO:teuthology.orchestra.run.smithi159.stdout:(43/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.5 MB/s | 176 kB 00:00 2024-03-09T14:19:00.781 INFO:teuthology.orchestra.run.smithi159.stdout:(44/284): atinject-1.0.3-6.el9.noarch.rpm 532 kB/s | 22 kB 00:00 2024-03-09T14:19:00.806 INFO:teuthology.orchestra.run.smithi159.stdout:(45/284): atk-2.36.0-5.el9.x86_64.rpm 6.3 MB/s | 270 kB 00:00 2024-03-09T14:19:00.819 INFO:teuthology.orchestra.run.smithi046.stdout:(12/284): ceph-radosgw-19.0.0-2079.gc00d9c60.el 3.7 MB/s | 10 MB 00:02 2024-03-09T14:19:00.832 INFO:teuthology.orchestra.run.smithi159.stdout:(46/284): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-03-09T14:19:00.857 INFO:teuthology.orchestra.run.smithi159.stdout:(47/284): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 52 kB 00:00 2024-03-09T14:19:00.883 INFO:teuthology.orchestra.run.smithi159.stdout:(48/284): colord-libs-1.4.5-4.el9.x86_64.rpm 4.4 MB/s | 228 kB 00:00 2024-03-09T14:19:00.894 INFO:teuthology.orchestra.run.smithi046.stdout:(13/284): libcephfs2-19.0.0-2079.gc00d9c60.el9. 3.5 MB/s | 745 kB 00:00 2024-03-09T14:19:00.907 INFO:teuthology.orchestra.run.smithi159.stdout:(49/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 544 kB/s | 27 kB 00:00 2024-03-09T14:19:00.919 INFO:teuthology.orchestra.run.smithi046.stdout:(14/284): libcephsqlite-19.0.0-2079.gc00d9c60.e 1.6 MB/s | 163 kB 00:00 2024-03-09T14:19:00.933 INFO:teuthology.orchestra.run.smithi159.stdout:(50/284): dconf-0.40.0-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-09T14:19:00.958 INFO:teuthology.orchestra.run.smithi159.stdout:(51/284): exempi-2.6.0-0.2.20211007gite23c213.e 10 MB/s | 524 kB 00:00 2024-03-09T14:19:00.961 INFO:teuthology.orchestra.run.smithi046.stdout:(15/284): librados-devel-19.0.0-2079.gc00d9c60. 1.9 MB/s | 127 kB 00:00 2024-03-09T14:19:00.992 INFO:teuthology.orchestra.run.smithi159.stdout:(52/284): exiv2-0.27.5-2.el9.x86_64.rpm 17 MB/s | 978 kB 00:00 2024-03-09T14:19:01.026 INFO:teuthology.orchestra.run.smithi159.stdout:(53/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 12 MB/s | 780 kB 00:00 2024-03-09T14:19:01.028 INFO:teuthology.orchestra.run.smithi046.stdout:(16/284): libradosstriper1-19.0.0-2079.gc00d9c6 4.5 MB/s | 501 kB 00:00 2024-03-09T14:19:01.051 INFO:teuthology.orchestra.run.smithi159.stdout:(54/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.5 MB/s | 324 kB 00:00 2024-03-09T14:19:01.084 INFO:teuthology.orchestra.run.smithi159.stdout:(55/284): flatpak-1.12.8-1.el9.x86_64.rpm 29 MB/s | 1.7 MB 00:00 2024-03-09T14:19:01.095 INFO:teuthology.orchestra.run.smithi046.stdout:(17/284): python3-ceph-argparse-19.0.0-2079.gc0 677 kB/s | 45 kB 00:00 2024-03-09T14:19:01.110 INFO:teuthology.orchestra.run.smithi159.stdout:(56/284): flatpak-selinux-1.12.8-1.el9.noarch.r 358 kB/s | 20 kB 00:00 2024-03-09T14:19:01.135 INFO:teuthology.orchestra.run.smithi159.stdout:(57/284): flatpak-session-helper-1.12.8-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-03-09T14:19:01.154 INFO:teuthology.orchestra.run.smithi046.stdout:(18/284): python3-ceph-common-19.0.0-2079.gc00d 2.2 MB/s | 131 kB 00:00 2024-03-09T14:19:01.160 INFO:teuthology.orchestra.run.smithi159.stdout:(58/284): flexiblas-3.0.4-8.el9.x86_64.rpm 631 kB/s | 32 kB 00:00 2024-03-09T14:19:01.227 INFO:teuthology.orchestra.run.smithi159.stdout:(59/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-03-09T14:19:01.229 INFO:teuthology.orchestra.run.smithi046.stdout:(19/284): python3-cephfs-19.0.0-2079.gc00d9c60. 2.1 MB/s | 162 kB 00:00 2024-03-09T14:19:01.253 INFO:teuthology.orchestra.run.smithi159.stdout:(60/284): flexiblas-openblas-openmp-3.0.4-8.el9 191 kB/s | 17 kB 00:00 2024-03-09T14:19:01.278 INFO:teuthology.orchestra.run.smithi159.stdout:(61/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.6 MB/s | 84 kB 00:00 2024-03-09T14:19:01.303 INFO:teuthology.orchestra.run.smithi159.stdout:(62/284): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-03-09T14:19:01.329 INFO:teuthology.orchestra.run.smithi046.stdout:(20/284): python3-rados-19.0.0-2079.gc00d9c60.e 3.1 MB/s | 321 kB 00:00 2024-03-09T14:19:01.337 INFO:teuthology.orchestra.run.smithi159.stdout:(63/284): giflib-5.2.1-9.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-03-09T14:19:01.362 INFO:teuthology.orchestra.run.smithi159.stdout:(64/284): google-guice-4.2.3-9.el9.noarch.rpm 7.8 MB/s | 472 kB 00:00 2024-03-09T14:19:01.388 INFO:teuthology.orchestra.run.smithi159.stdout:(65/284): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-03-09T14:19:01.396 INFO:teuthology.orchestra.run.smithi046.stdout:(21/284): python3-rbd-19.0.0-2079.gc00d9c60.el9 4.4 MB/s | 299 kB 00:00 2024-03-09T14:19:01.413 INFO:teuthology.orchestra.run.smithi159.stdout:(66/284): gsm-1.0.19-6.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-03-09T14:19:01.455 INFO:teuthology.orchestra.run.smithi046.stdout:(22/284): python3-rgw-19.0.0-2079.gc00d9c60.el9 1.7 MB/s | 99 kB 00:00 2024-03-09T14:19:01.471 INFO:teuthology.orchestra.run.smithi159.stdout:(67/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 17 MB/s | 1.4 MB 00:00 2024-03-09T14:19:01.497 INFO:teuthology.orchestra.run.smithi159.stdout:(68/284): gtk-update-icon-cache-3.24.31-2.el9.x 419 kB/s | 34 kB 00:00 2024-03-09T14:19:01.530 INFO:teuthology.orchestra.run.smithi046.stdout:(23/284): rbd-fuse-19.0.0-2079.gc00d9c60.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-09T14:19:01.614 INFO:teuthology.orchestra.run.smithi159.stdout:(69/284): gtk3-3.24.31-2.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-03-09T14:19:01.672 INFO:teuthology.orchestra.run.smithi159.stdout:(70/284): guava-30.1-6.el9.noarch.rpm 13 MB/s | 2.3 MB 00:00 2024-03-09T14:19:01.698 INFO:teuthology.orchestra.run.smithi159.stdout:(71/284): hicolor-icon-theme-0.17-13.el9.noarch 806 kB/s | 65 kB 00:00 2024-03-09T14:19:01.723 INFO:teuthology.orchestra.run.smithi159.stdout:(72/284): httpcomponents-client-4.5.13-3.el9.no 13 MB/s | 656 kB 00:00 2024-03-09T14:19:01.748 INFO:teuthology.orchestra.run.smithi159.stdout:(73/284): httpcomponents-core-4.4.13-7.el9.noar 13 MB/s | 630 kB 00:00 2024-03-09T14:19:01.832 INFO:teuthology.orchestra.run.smithi159.stdout:(74/284): iso-codes-4.6.0-3.el9.noarch.rpm 31 MB/s | 3.3 MB 00:00 2024-03-09T14:19:01.962 INFO:teuthology.orchestra.run.smithi046.stdout:(24/284): librgw2-19.0.0-2079.gc00d9c60.el9.x86 5.3 MB/s | 5.3 MB 00:00 2024-03-09T14:19:01.963 INFO:teuthology.orchestra.run.smithi159.stdout:(75/284): jakarta-annotations-1.3.5-13.el9.noar 412 kB/s | 44 kB 00:00 2024-03-09T14:19:01.963 INFO:teuthology.orchestra.run.smithi159.stdout:(76/284): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-09T14:19:01.963 INFO:teuthology.orchestra.run.smithi159.stdout:(77/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 8.6 MB/s | 439 kB 00:00 2024-03-09T14:19:01.983 INFO:teuthology.orchestra.run.smithi159.stdout:(78/284): java-11-openjdk-devel-11.0.18.0.10-3. 33 MB/s | 3.3 MB 00:00 2024-03-09T14:19:02.022 INFO:teuthology.orchestra.run.smithi046.stdout:(25/284): rbd-nbd-19.0.0-2079.gc00d9c60.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-09T14:19:02.081 INFO:teuthology.orchestra.run.smithi046.stdout:(26/284): rbd-mirror-19.0.0-2079.gc00d9c60.el9. 5.6 MB/s | 3.1 MB 00:00 2024-03-09T14:19:02.098 INFO:teuthology.orchestra.run.smithi046.stdout:(27/284): ceph-grafana-dashboards-19.0.0-2079.g 451 kB/s | 34 kB 00:00 2024-03-09T14:19:02.142 INFO:teuthology.orchestra.run.smithi159.stdout:(79/284): javapackages-filesystem-6.0.0-4.el9.n 67 kB/s | 10 kB 00:00 2024-03-09T14:19:02.165 INFO:teuthology.orchestra.run.smithi046.stdout:(28/284): ceph-mgr-cephadm-19.0.0-2079.gc00d9c6 1.6 MB/s | 139 kB 00:00 2024-03-09T14:19:02.317 INFO:teuthology.orchestra.run.smithi159.stdout:(80/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 301 kB/s | 52 kB 00:00 2024-03-09T14:19:02.515 INFO:teuthology.orchestra.run.smithi046.stdout:(29/284): ceph-mgr-dashboard-19.0.0-2079.gc00d9 4.3 MB/s | 1.8 MB 00:00 2024-03-09T14:19:02.599 INFO:teuthology.orchestra.run.smithi046.stdout:(30/284): ceph-mgr-modules-core-19.0.0-2079.gc0 2.9 MB/s | 248 kB 00:00 2024-03-09T14:19:02.657 INFO:teuthology.orchestra.run.smithi046.stdout:(31/284): ceph-mgr-rook-19.0.0-2079.gc00d9c60.e 848 kB/s | 49 kB 00:00 2024-03-09T14:19:02.724 INFO:teuthology.orchestra.run.smithi046.stdout:(32/284): ceph-prometheus-alerts-19.0.0-2079.gc 247 kB/s | 16 kB 00:00 2024-03-09T14:19:02.791 INFO:teuthology.orchestra.run.smithi046.stdout:(33/284): ceph-volume-19.0.0-2079.gc00d9c60.el9 3.9 MB/s | 264 kB 00:00 2024-03-09T14:19:02.792 INFO:teuthology.orchestra.run.smithi159.stdout:(81/284): java-11-openjdk-headless-11.0.18.0.10 45 MB/s | 40 MB 00:00 2024-03-09T14:19:02.809 INFO:teuthology.orchestra.run.smithi159.stdout:(82/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 47 kB/s | 23 kB 00:00 2024-03-09T14:19:02.843 INFO:teuthology.orchestra.run.smithi159.stdout:(83/284): jsoup-1.13.1-10.el9.noarch.rpm 7.4 MB/s | 376 kB 00:00 2024-03-09T14:19:02.860 INFO:teuthology.orchestra.run.smithi159.stdout:(84/284): jsr-305-3.0.2-6.el9.noarch.rpm 620 kB/s | 31 kB 00:00 2024-03-09T14:19:02.885 INFO:teuthology.orchestra.run.smithi159.stdout:(85/284): lcms2-2.12-3.el9.x86_64.rpm 3.9 MB/s | 166 kB 00:00 2024-03-09T14:19:02.902 INFO:teuthology.orchestra.run.smithi159.stdout:(86/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 236 kB/s | 9.8 kB 00:00 2024-03-09T14:19:02.919 INFO:teuthology.orchestra.run.smithi159.stdout:(87/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 687 kB/s | 23 kB 00:00 2024-03-09T14:19:02.936 INFO:teuthology.orchestra.run.smithi159.stdout:(88/284): libXcursor-1.2.0-7.el9.x86_64.rpm 885 kB/s | 30 kB 00:00 2024-03-09T14:19:02.941 INFO:teuthology.orchestra.run.smithi046.stdout:(34/284): cephadm-19.0.0-2079.gc00d9c60.el9.noa 4.9 MB/s | 749 kB 00:00 2024-03-09T14:19:02.961 INFO:teuthology.orchestra.run.smithi159.stdout:(89/284): libXdamage-1.1.5-7.el9.x86_64.rpm 520 kB/s | 22 kB 00:00 2024-03-09T14:19:02.978 INFO:teuthology.orchestra.run.smithi159.stdout:(90/284): libXfixes-5.0.3-16.el9.x86_64.rpm 448 kB/s | 19 kB 00:00 2024-03-09T14:19:02.995 INFO:teuthology.orchestra.run.smithi159.stdout:(91/284): libXi-1.7.10-8.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-03-09T14:19:03.012 INFO:teuthology.orchestra.run.smithi159.stdout:(92/284): libXinerama-1.1.4-10.el9.x86_64.rpm 415 kB/s | 14 kB 00:00 2024-03-09T14:19:03.029 INFO:teuthology.orchestra.run.smithi159.stdout:(93/284): libXrandr-1.5.2-8.el9.x86_64.rpm 820 kB/s | 27 kB 00:00 2024-03-09T14:19:03.055 INFO:teuthology.orchestra.run.smithi159.stdout:(94/284): libXtst-1.2.3-16.el9.x86_64.rpm 489 kB/s | 20 kB 00:00 2024-03-09T14:19:03.075 INFO:teuthology.orchestra.run.smithi046.stdout:(35/284): adwaita-cursor-theme-40.1.1-3.el9.noa 4.6 MB/s | 625 kB 00:00 2024-03-09T14:19:03.080 INFO:teuthology.orchestra.run.smithi159.stdout:(95/284): libXv-1.0.11-16.el9.x86_64.rpm 359 kB/s | 18 kB 00:00 2024-03-09T14:19:03.106 INFO:teuthology.orchestra.run.smithi159.stdout:(96/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 354 kB/s | 18 kB 00:00 2024-03-09T14:19:03.130 INFO:teuthology.orchestra.run.smithi159.stdout:(97/284): libasyncns-0.8-22.el9.x86_64.rpm 585 kB/s | 29 kB 00:00 2024-03-09T14:19:03.156 INFO:teuthology.orchestra.run.smithi159.stdout:(98/284): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2024-03-09T14:19:03.181 INFO:teuthology.orchestra.run.smithi159.stdout:(99/284): libcanberra-gtk3-0.30-27.el9.x86_64.r 611 kB/s | 31 kB 00:00 2024-03-09T14:19:03.292 INFO:teuthology.orchestra.run.smithi046.stdout:(36/284): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-03-09T14:19:03.400 INFO:teuthology.orchestra.run.smithi046.stdout:(37/284): adwaita-icon-theme-40.1.1-3.el9.noarc 33 MB/s | 11 MB 00:00 2024-03-09T14:19:03.426 INFO:teuthology.orchestra.run.smithi046.stdout:(38/284): apache-commons-cli-1.4-17.el9.noarch. 527 kB/s | 70 kB 00:00 2024-03-09T14:19:03.451 INFO:teuthology.orchestra.run.smithi046.stdout:(39/284): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 301 kB 00:00 2024-03-09T14:19:03.476 INFO:teuthology.orchestra.run.smithi046.stdout:(40/284): apache-commons-io-2.8.0-8.el9.noarch. 5.5 MB/s | 282 kB 00:00 2024-03-09T14:19:03.510 INFO:teuthology.orchestra.run.smithi046.stdout:(41/284): apache-commons-lang3-3.12.0-6.el9.noa 9.3 MB/s | 558 kB 00:00 2024-03-09T14:19:03.527 INFO:teuthology.orchestra.run.smithi046.stdout:(42/284): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-03-09T14:19:03.552 INFO:teuthology.orchestra.run.smithi046.stdout:(43/284): at-spi2-core-2.40.3-1.el9.x86_64.rpm 4.1 MB/s | 176 kB 00:00 2024-03-09T14:19:03.577 INFO:teuthology.orchestra.run.smithi046.stdout:(44/284): atinject-1.0.3-6.el9.noarch.rpm 444 kB/s | 22 kB 00:00 2024-03-09T14:19:03.603 INFO:teuthology.orchestra.run.smithi046.stdout:(45/284): atk-2.36.0-5.el9.x86_64.rpm 5.2 MB/s | 270 kB 00:00 2024-03-09T14:19:03.606 INFO:teuthology.orchestra.run.smithi159.stdout:(100/284): ceph-test-19.0.0-2079.gc00d9c60.el9. 7.5 MB/s | 48 MB 00:06 2024-03-09T14:19:03.628 INFO:teuthology.orchestra.run.smithi046.stdout:(46/284): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-03-09T14:19:03.631 INFO:teuthology.orchestra.run.smithi159.stdout:(101/284): libepoxy-1.5.5-4.el9.x86_64.rpm 506 kB/s | 240 kB 00:00 2024-03-09T14:19:03.653 INFO:teuthology.orchestra.run.smithi046.stdout:(47/284): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 52 kB 00:00 2024-03-09T14:19:03.657 INFO:teuthology.orchestra.run.smithi159.stdout:(102/284): libexif-0.6.22-6.el9.x86_64.rpm 906 kB/s | 431 kB 00:00 2024-03-09T14:19:03.678 INFO:teuthology.orchestra.run.smithi046.stdout:(48/284): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 228 kB 00:00 2024-03-09T14:19:03.682 INFO:teuthology.orchestra.run.smithi159.stdout:(103/284): libfontenc-1.1.3-17.el9.x86_64.rpm 405 kB/s | 30 kB 00:00 2024-03-09T14:19:03.704 INFO:teuthology.orchestra.run.smithi046.stdout:(49/284): copy-jdk-configs-4.0-3.el9.noarch.rpm 543 kB/s | 27 kB 00:00 2024-03-09T14:19:03.707 INFO:teuthology.orchestra.run.smithi159.stdout:(104/284): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 134 kB 00:00 2024-03-09T14:19:03.729 INFO:teuthology.orchestra.run.smithi046.stdout:(50/284): dconf-0.40.0-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-09T14:19:03.732 INFO:teuthology.orchestra.run.smithi159.stdout:(105/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 82 kB 00:00 2024-03-09T14:19:03.754 INFO:teuthology.orchestra.run.smithi046.stdout:(51/284): exempi-2.6.0-0.2.20211007gite23c213.e 10 MB/s | 524 kB 00:00 2024-03-09T14:19:03.758 INFO:teuthology.orchestra.run.smithi159.stdout:(106/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 474 kB/s | 36 kB 00:00 2024-03-09T14:19:03.783 INFO:teuthology.orchestra.run.smithi159.stdout:(107/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 141 kB 00:00 2024-03-09T14:19:03.796 INFO:teuthology.orchestra.run.smithi046.stdout:(52/284): exiv2-0.27.5-2.el9.x86_64.rpm 14 MB/s | 978 kB 00:00 2024-03-09T14:19:03.808 INFO:teuthology.orchestra.run.smithi159.stdout:(108/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 78 kB 00:00 2024-03-09T14:19:03.822 INFO:teuthology.orchestra.run.smithi046.stdout:(53/284): exiv2-libs-0.27.5-2.el9.x86_64.rpm 12 MB/s | 780 kB 00:00 2024-03-09T14:19:03.834 INFO:teuthology.orchestra.run.smithi159.stdout:(109/284): libgsf-1.14.47-5.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-03-09T14:19:03.847 INFO:teuthology.orchestra.run.smithi046.stdout:(54/284): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 6.5 MB/s | 324 kB 00:00 2024-03-09T14:19:03.850 INFO:teuthology.orchestra.run.smithi159.stdout:(110/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 908 kB/s | 61 kB 00:00 2024-03-09T14:19:03.867 INFO:teuthology.orchestra.run.smithi159.stdout:(111/284): libldac-2.0.2.3-10.el9.x86_64.rpm 692 kB/s | 40 kB 00:00 2024-03-09T14:19:03.884 INFO:teuthology.orchestra.run.smithi159.stdout:(112/284): libogg-1.3.4-6.el9.x86_64.rpm 985 kB/s | 32 kB 00:00 2024-03-09T14:19:03.889 INFO:teuthology.orchestra.run.smithi046.stdout:(55/284): flatpak-1.12.8-1.el9.x86_64.rpm 25 MB/s | 1.7 MB 00:00 2024-03-09T14:19:03.901 INFO:teuthology.orchestra.run.smithi159.stdout:(113/284): libnotify-0.7.9-8.el9.x86_64.rpm 851 kB/s | 43 kB 00:00 2024-03-09T14:19:03.914 INFO:teuthology.orchestra.run.smithi046.stdout:(56/284): flatpak-selinux-1.12.8-1.el9.noarch.r 318 kB/s | 20 kB 00:00 2024-03-09T14:19:03.926 INFO:teuthology.orchestra.run.smithi159.stdout:(114/284): libosinfo-1.10.0-1.el9.x86_64.rpm 5.2 MB/s | 312 kB 00:00 2024-03-09T14:19:03.939 INFO:teuthology.orchestra.run.smithi046.stdout:(57/284): flatpak-session-helper-1.12.8-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-03-09T14:19:03.951 INFO:teuthology.orchestra.run.smithi159.stdout:(115/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 159 kB 00:00 2024-03-09T14:19:03.968 INFO:teuthology.orchestra.run.smithi159.stdout:(116/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-09T14:19:03.973 INFO:teuthology.orchestra.run.smithi046.stdout:(58/284): flexiblas-3.0.4-8.el9.x86_64.rpm 540 kB/s | 32 kB 00:00 2024-03-09T14:19:03.994 INFO:teuthology.orchestra.run.smithi159.stdout:(117/284): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-03-09T14:19:04.010 INFO:teuthology.orchestra.run.smithi159.stdout:(118/284): libsbc-1.4-9.el9.x86_64.rpm 762 kB/s | 44 kB 00:00 2024-03-09T14:19:04.027 INFO:teuthology.orchestra.run.smithi159.stdout:(119/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 1.1 MB/s | 36 kB 00:00 2024-03-09T14:19:04.053 INFO:teuthology.orchestra.run.smithi159.stdout:(120/284): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-03-09T14:19:04.066 INFO:teuthology.orchestra.run.smithi046.stdout:(59/284): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-09T14:19:04.078 INFO:teuthology.orchestra.run.smithi159.stdout:(121/284): libtracker-sparql-3.1.2-3.el9.x86_64 4.6 MB/s | 316 kB 00:00 2024-03-09T14:19:04.084 INFO:teuthology.orchestra.run.smithi046.stdout:(60/284): flexiblas-openblas-openmp-3.0.4-8.el9 161 kB/s | 17 kB 00:00 2024-03-09T14:19:04.103 INFO:teuthology.orchestra.run.smithi159.stdout:(122/284): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 143 kB 00:00 2024-03-09T14:19:04.107 INFO:teuthology.orchestra.run.smithi046.stdout:(61/284): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 2.0 MB/s | 84 kB 00:00 2024-03-09T14:19:04.133 INFO:teuthology.orchestra.run.smithi046.stdout:(62/284): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-03-09T14:19:04.149 INFO:teuthology.orchestra.run.smithi046.stdout:(63/284): giflib-5.2.1-9.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-03-09T14:19:04.157 INFO:teuthology.orchestra.run.smithi159.stdout:(123/284): libvorbis-1.3.7-5.el9.x86_64.rpm 2.4 MB/s | 192 kB 00:00 2024-03-09T14:19:04.174 INFO:teuthology.orchestra.run.smithi046.stdout:(64/284): google-guice-4.2.3-9.el9.noarch.rpm 11 MB/s | 472 kB 00:00 2024-03-09T14:19:04.179 INFO:teuthology.orchestra.run.smithi159.stdout:(124/284): libwayland-client-1.21.0-1.el9.x86_6 322 kB/s | 32 kB 00:00 2024-03-09T14:19:04.196 INFO:teuthology.orchestra.run.smithi159.stdout:(125/284): libwayland-cursor-1.21.0-1.el9.x86_6 199 kB/s | 18 kB 00:00 2024-03-09T14:19:04.200 INFO:teuthology.orchestra.run.smithi046.stdout:(65/284): graphene-1.10.6-2.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-09T14:19:04.213 INFO:teuthology.orchestra.run.smithi159.stdout:(126/284): libwayland-egl-1.21.0-1.el9.x86_64.r 352 kB/s | 12 kB 00:00 2024-03-09T14:19:04.230 INFO:teuthology.orchestra.run.smithi159.stdout:(127/284): libwayland-server-1.21.0-1.el9.x86_6 810 kB/s | 41 kB 00:00 2024-03-09T14:19:04.230 INFO:teuthology.orchestra.run.smithi046.stdout:(66/284): gsm-1.0.19-6.el9.x86_64.rpm 594 kB/s | 33 kB 00:00 2024-03-09T14:19:04.255 INFO:teuthology.orchestra.run.smithi159.stdout:(128/284): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 276 kB 00:00 2024-03-09T14:19:04.267 INFO:teuthology.orchestra.run.smithi046.stdout:(67/284): gstreamer1-1.22.1-2.el9.x86_64.rpm 21 MB/s | 1.4 MB 00:00 2024-03-09T14:19:04.272 INFO:teuthology.orchestra.run.smithi159.stdout:(129/284): libxshmfence-1.3-10.el9.x86_64.rpm 281 kB/s | 12 kB 00:00 2024-03-09T14:19:04.292 INFO:teuthology.orchestra.run.smithi046.stdout:(68/284): gtk-update-icon-cache-3.24.31-2.el9.x 578 kB/s | 34 kB 00:00 2024-03-09T14:19:04.297 INFO:teuthology.orchestra.run.smithi159.stdout:(130/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.9 MB/s | 132 kB 00:00 2024-03-09T14:19:04.314 INFO:teuthology.orchestra.run.smithi159.stdout:(131/284): low-memory-monitor-2.1-4.el9.x86_64. 594 kB/s | 35 kB 00:00 2024-03-09T14:19:04.339 INFO:teuthology.orchestra.run.smithi159.stdout:(132/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2024-03-09T14:19:04.364 INFO:teuthology.orchestra.run.smithi159.stdout:(133/284): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-09T14:19:04.390 INFO:teuthology.orchestra.run.smithi159.stdout:(134/284): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2024-03-09T14:19:04.401 INFO:teuthology.orchestra.run.smithi046.stdout:(69/284): gtk3-3.24.31-2.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-03-09T14:19:04.406 INFO:teuthology.orchestra.run.smithi159.stdout:(135/284): maven-3.6.3-15.el9.noarch.rpm 250 kB/s | 17 kB 00:00 2024-03-09T14:19:04.424 INFO:teuthology.orchestra.run.smithi159.stdout:(136/284): maven-openjdk11-3.6.3-15.el9.noarch. 238 kB/s | 7.9 kB 00:00 2024-03-09T14:19:04.457 INFO:teuthology.orchestra.run.smithi159.stdout:(137/284): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-03-09T14:19:04.460 INFO:teuthology.orchestra.run.smithi046.stdout:(70/284): guava-30.1-6.el9.noarch.rpm 14 MB/s | 2.3 MB 00:00 2024-03-09T14:19:04.482 INFO:teuthology.orchestra.run.smithi159.stdout:(138/284): maven-resolver-1.6.1-10.el9.noarch.r 6.6 MB/s | 512 kB 00:00 2024-03-09T14:19:04.485 INFO:teuthology.orchestra.run.smithi046.stdout:(71/284): hicolor-icon-theme-0.17-13.el9.noarch 807 kB/s | 65 kB 00:00 2024-03-09T14:19:04.508 INFO:teuthology.orchestra.run.smithi159.stdout:(139/284): maven-shared-utils-3.3.4-3.el9.noarc 1.8 MB/s | 150 kB 00:00 2024-03-09T14:19:04.510 INFO:teuthology.orchestra.run.smithi046.stdout:(72/284): httpcomponents-client-4.5.13-3.el9.no 13 MB/s | 656 kB 00:00 2024-03-09T14:19:04.533 INFO:teuthology.orchestra.run.smithi159.stdout:(140/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 630 kB/s | 31 kB 00:00 2024-03-09T14:19:04.544 INFO:teuthology.orchestra.run.smithi046.stdout:(73/284): httpcomponents-core-4.4.13-7.el9.noar 11 MB/s | 630 kB 00:00 2024-03-09T14:19:04.558 INFO:teuthology.orchestra.run.smithi159.stdout:(141/284): maven-wagon-3.4.2-7.el9.noarch.rpm 1.4 MB/s | 111 kB 00:00 2024-03-09T14:19:04.611 INFO:teuthology.orchestra.run.smithi046.stdout:(74/284): iso-codes-4.6.0-3.el9.noarch.rpm 33 MB/s | 3.3 MB 00:00 2024-03-09T14:19:04.616 INFO:teuthology.orchestra.run.smithi159.stdout:(142/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.0 MB/s | 217 kB 00:00 2024-03-09T14:19:04.638 INFO:teuthology.orchestra.run.smithi046.stdout:(75/284): jakarta-annotations-1.3.5-13.el9.noar 494 kB/s | 44 kB 00:00 2024-03-09T14:19:04.642 INFO:teuthology.orchestra.run.smithi159.stdout:(143/284): openblas-0.3.21-2.el9.x86_64.rpm 314 kB/s | 34 kB 00:00 2024-03-09T14:19:04.661 INFO:teuthology.orchestra.run.smithi046.stdout:(76/284): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-09T14:19:04.686 INFO:teuthology.orchestra.run.smithi046.stdout:(77/284): java-11-openjdk-11.0.18.0.10-3.el9.x8 8.6 MB/s | 439 kB 00:00 2024-03-09T14:19:04.762 INFO:teuthology.orchestra.run.smithi046.stdout:(78/284): java-11-openjdk-devel-11.0.18.0.10-3. 33 MB/s | 3.3 MB 00:00 2024-03-09T14:19:04.962 INFO:teuthology.orchestra.run.smithi046.stdout:(79/284): javapackages-filesystem-6.0.0-4.el9.n 53 kB/s | 10 kB 00:00 2024-03-09T14:19:05.146 INFO:teuthology.orchestra.run.smithi046.stdout:(80/284): jbigkit-libs-2.1-23.el9.x86_64.rpm 286 kB/s | 52 kB 00:00 2024-03-09T14:19:05.292 INFO:teuthology.orchestra.run.smithi159.stdout:(144/284): openblas-openmp-0.3.21-2.el9.x86_64. 6.5 MB/s | 4.7 MB 00:00 2024-03-09T14:19:05.317 INFO:teuthology.orchestra.run.smithi159.stdout:(145/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 231 kB/s | 162 kB 00:00 2024-03-09T14:19:05.343 INFO:teuthology.orchestra.run.smithi159.stdout:(146/284): opus-1.3.1-10.el9.x86_64.rpm 284 kB/s | 199 kB 00:00 2024-03-09T14:19:05.368 INFO:teuthology.orchestra.run.smithi159.stdout:(147/284): orc-0.4.31-6.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-03-09T14:19:05.393 INFO:teuthology.orchestra.run.smithi159.stdout:(148/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.3 MB/s | 68 kB 00:00 2024-03-09T14:19:05.410 INFO:teuthology.orchestra.run.smithi159.stdout:(149/284): p11-kit-server-0.24.1-2.el9.x86_64.r 2.9 MB/s | 198 kB 00:00 2024-03-09T14:19:05.435 INFO:teuthology.orchestra.run.smithi159.stdout:(150/284): plexus-cipher-1.7-27.el9.noarch.rpm 372 kB/s | 25 kB 00:00 2024-03-09T14:19:05.460 INFO:teuthology.orchestra.run.smithi159.stdout:(151/284): plexus-classworlds-2.6.0-11.el9.noar 885 kB/s | 59 kB 00:00 2024-03-09T14:19:05.486 INFO:teuthology.orchestra.run.smithi159.stdout:(152/284): plexus-containers-component-annotati 346 kB/s | 17 kB 00:00 2024-03-09T14:19:05.511 INFO:teuthology.orchestra.run.smithi159.stdout:(153/284): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 79 kB 00:00 2024-03-09T14:19:05.513 INFO:teuthology.orchestra.run.smithi046.stdout:(81/284): java-11-openjdk-headless-11.0.18.0.10 48 MB/s | 40 MB 00:00 2024-03-09T14:19:05.528 INFO:teuthology.orchestra.run.smithi159.stdout:(154/284): plexus-sec-dispatcher-1.4-37.el9.noa 487 kB/s | 33 kB 00:00 2024-03-09T14:19:05.538 INFO:teuthology.orchestra.run.smithi046.stdout:(82/284): jcl-over-slf4j-1.7.30-13.el9.noarch.r 59 kB/s | 23 kB 00:00 2024-03-09T14:19:05.570 INFO:teuthology.orchestra.run.smithi159.stdout:(155/284): plexus-utils-3.3.0-10.el9.noarch.rpm 4.2 MB/s | 253 kB 00:00 2024-03-09T14:19:05.572 INFO:teuthology.orchestra.run.smithi046.stdout:(83/284): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 376 kB 00:00 2024-03-09T14:19:05.597 INFO:teuthology.orchestra.run.smithi046.stdout:(84/284): jsr-305-3.0.2-6.el9.noarch.rpm 532 kB/s | 31 kB 00:00 2024-03-09T14:19:05.622 INFO:teuthology.orchestra.run.smithi046.stdout:(85/284): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 166 kB 00:00 2024-03-09T14:19:05.648 INFO:teuthology.orchestra.run.smithi046.stdout:(86/284): libX11-xcb-1.7.0-8.el9.x86_64.rpm 197 kB/s | 9.8 kB 00:00 2024-03-09T14:19:05.673 INFO:teuthology.orchestra.run.smithi046.stdout:(87/284): libXcomposite-0.4.5-7.el9.x86_64.rpm 459 kB/s | 23 kB 00:00 2024-03-09T14:19:05.698 INFO:teuthology.orchestra.run.smithi046.stdout:(88/284): libXcursor-1.2.0-7.el9.x86_64.rpm 591 kB/s | 30 kB 00:00 2024-03-09T14:19:05.703 INFO:teuthology.orchestra.run.smithi159.stdout:(156/284): poppler-data-0.4.9-9.el9.noarch.rpm 9.5 MB/s | 1.8 MB 00:00 2024-03-09T14:19:05.724 INFO:teuthology.orchestra.run.smithi046.stdout:(89/284): libXdamage-1.1.5-7.el9.x86_64.rpm 435 kB/s | 22 kB 00:00 2024-03-09T14:19:05.746 INFO:teuthology.orchestra.run.smithi159.stdout:(157/284): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-03-09T14:19:05.749 INFO:teuthology.orchestra.run.smithi046.stdout:(90/284): libXfixes-5.0.3-16.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-03-09T14:19:05.762 INFO:teuthology.orchestra.run.smithi159.stdout:(158/284): publicsuffix-list-20210518-3.el9.noa 426 kB/s | 82 kB 00:00 2024-03-09T14:19:05.774 INFO:teuthology.orchestra.run.smithi046.stdout:(91/284): libXi-1.7.10-8.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2024-03-09T14:19:05.788 INFO:teuthology.orchestra.run.smithi159.stdout:(159/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.9 MB/s | 666 kB 00:00 2024-03-09T14:19:05.799 INFO:teuthology.orchestra.run.smithi046.stdout:(92/284): libXinerama-1.1.4-10.el9.x86_64.rpm 280 kB/s | 14 kB 00:00 2024-03-09T14:19:05.825 INFO:teuthology.orchestra.run.smithi046.stdout:(93/284): libXrandr-1.5.2-8.el9.x86_64.rpm 545 kB/s | 27 kB 00:00 2024-03-09T14:19:05.850 INFO:teuthology.orchestra.run.smithi046.stdout:(94/284): libXtst-1.2.3-16.el9.x86_64.rpm 408 kB/s | 20 kB 00:00 2024-03-09T14:19:05.875 INFO:teuthology.orchestra.run.smithi046.stdout:(95/284): libXv-1.0.11-16.el9.x86_64.rpm 361 kB/s | 18 kB 00:00 2024-03-09T14:19:05.900 INFO:teuthology.orchestra.run.smithi046.stdout:(96/284): libXxf86vm-1.1.4-18.el9.x86_64.rpm 354 kB/s | 18 kB 00:00 2024-03-09T14:19:05.926 INFO:teuthology.orchestra.run.smithi046.stdout:(97/284): libasyncns-0.8-22.el9.x86_64.rpm 587 kB/s | 29 kB 00:00 2024-03-09T14:19:05.951 INFO:teuthology.orchestra.run.smithi046.stdout:(98/284): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2024-03-09T14:19:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:(99/284): libcanberra-gtk3-0.30-27.el9.x86_64.r 614 kB/s | 31 kB 00:00 2024-03-09T14:19:06.002 INFO:teuthology.orchestra.run.smithi046.stdout:(100/284): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 240 kB 00:00 2024-03-09T14:19:06.005 INFO:teuthology.orchestra.run.smithi159.stdout:(160/284): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-03-09T14:19:06.022 INFO:teuthology.orchestra.run.smithi159.stdout:(161/284): python3-jsonpatch-1.21-16.el9.noarch 94 kB/s | 24 kB 00:00 2024-03-09T14:19:06.035 INFO:teuthology.orchestra.run.smithi046.stdout:(101/284): libexif-0.6.22-6.el9.x86_64.rpm 7.2 MB/s | 431 kB 00:00 2024-03-09T14:19:06.038 INFO:teuthology.orchestra.run.smithi159.stdout:(162/284): python3-jsonpointer-2.0-4.el9.noarch 72 kB/s | 18 kB 00:00 2024-03-09T14:19:06.056 INFO:teuthology.orchestra.run.smithi159.stdout:(163/284): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-09T14:19:06.060 INFO:teuthology.orchestra.run.smithi046.stdout:(102/284): libfontenc-1.1.3-17.el9.x86_64.rpm 518 kB/s | 30 kB 00:00 2024-03-09T14:19:06.072 INFO:teuthology.orchestra.run.smithi159.stdout:(164/284): python3-markupsafe-1.1.1-12.el9.x86_ 958 kB/s | 32 kB 00:00 2024-03-09T14:19:06.086 INFO:teuthology.orchestra.run.smithi046.stdout:(103/284): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 82 kB 00:00 2024-03-09T14:19:06.111 INFO:teuthology.orchestra.run.smithi046.stdout:(104/284): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 134 kB 00:00 2024-03-09T14:19:06.128 INFO:teuthology.orchestra.run.smithi046.stdout:(105/284): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 859 kB/s | 36 kB 00:00 2024-03-09T14:19:06.153 INFO:teuthology.orchestra.run.smithi046.stdout:(106/284): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 3.3 MB/s | 141 kB 00:00 2024-03-09T14:19:06.178 INFO:teuthology.orchestra.run.smithi046.stdout:(107/284): libgsf-1.14.47-5.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-03-09T14:19:06.189 INFO:teuthology.orchestra.run.smithi159.stdout:(165/284): python3-numpy-1.20.1-5.el9.x86_64.rp 32 MB/s | 4.8 MB 00:00 2024-03-09T14:19:06.204 INFO:teuthology.orchestra.run.smithi046.stdout:(108/284): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 78 kB 00:00 2024-03-09T14:19:06.215 INFO:teuthology.orchestra.run.smithi159.stdout:(166/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.3 MB/s | 217 kB 00:00 2024-03-09T14:19:06.229 INFO:teuthology.orchestra.run.smithi046.stdout:(109/284): libiptcdata-1.0.5-9.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-03-09T14:19:06.248 INFO:teuthology.orchestra.run.smithi159.stdout:(167/284): python3-oauthlib-3.1.1-5.el9.noarch. 1.0 MB/s | 174 kB 00:00 2024-03-09T14:19:06.254 INFO:teuthology.orchestra.run.smithi046.stdout:(110/284): libldac-2.0.2.3-10.el9.x86_64.rpm 800 kB/s | 40 kB 00:00 2024-03-09T14:19:06.273 INFO:teuthology.orchestra.run.smithi159.stdout:(168/284): python3-packaging-20.9-5.el9.noarch. 829 kB/s | 69 kB 00:00 2024-03-09T14:19:06.280 INFO:teuthology.orchestra.run.smithi046.stdout:(111/284): libnotify-0.7.9-8.el9.x86_64.rpm 843 kB/s | 43 kB 00:00 2024-03-09T14:19:06.290 INFO:teuthology.orchestra.run.smithi159.stdout:(169/284): python3-prettytable-0.7.2-27.el9.noa 991 kB/s | 41 kB 00:00 2024-03-09T14:19:06.305 INFO:teuthology.orchestra.run.smithi046.stdout:(112/284): libogg-1.3.4-6.el9.x86_64.rpm 649 kB/s | 32 kB 00:00 2024-03-09T14:19:06.315 INFO:teuthology.orchestra.run.smithi159.stdout:(170/284): python3-protobuf-3.14.0-13.el9.noarc 3.5 MB/s | 238 kB 00:00 2024-03-09T14:19:06.330 INFO:teuthology.orchestra.run.smithi046.stdout:(113/284): libosinfo-1.10.0-1.el9.x86_64.rpm 6.1 MB/s | 312 kB 00:00 2024-03-09T14:19:06.340 INFO:teuthology.orchestra.run.smithi159.stdout:(171/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.9 MB/s | 132 kB 00:00 2024-03-09T14:19:06.356 INFO:teuthology.orchestra.run.smithi046.stdout:(114/284): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-09T14:19:06.357 INFO:teuthology.orchestra.run.smithi159.stdout:(172/284): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-09T14:19:06.381 INFO:teuthology.orchestra.run.smithi046.stdout:(115/284): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-09T14:19:06.386 INFO:teuthology.orchestra.run.smithi159.stdout:(173/284): python3-pyasn1-modules-0.4.8-6.el9.n 3.1 MB/s | 211 kB 00:00 2024-03-09T14:19:06.400 INFO:teuthology.orchestra.run.smithi159.stdout:(174/284): python3-requests-oauthlib-1.3.0-12.e 731 kB/s | 43 kB 00:00 2024-03-09T14:19:06.414 INFO:teuthology.orchestra.run.smithi046.stdout:(116/284): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-09T14:19:06.440 INFO:teuthology.orchestra.run.smithi046.stdout:(117/284): libsbc-1.4-9.el9.x86_64.rpm 763 kB/s | 44 kB 00:00 2024-03-09T14:19:06.473 INFO:teuthology.orchestra.run.smithi046.stdout:(118/284): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-03-09T14:19:06.499 INFO:teuthology.orchestra.run.smithi046.stdout:(119/284): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 619 kB/s | 36 kB 00:00 2024-03-09T14:19:06.524 INFO:teuthology.orchestra.run.smithi046.stdout:(120/284): libtracker-sparql-3.1.2-3.el9.x86_64 6.2 MB/s | 316 kB 00:00 2024-03-09T14:19:06.549 INFO:teuthology.orchestra.run.smithi046.stdout:(121/284): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 143 kB 00:00 2024-03-09T14:19:06.574 INFO:teuthology.orchestra.run.smithi046.stdout:(122/284): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-03-09T14:19:06.600 INFO:teuthology.orchestra.run.smithi046.stdout:(123/284): libwayland-client-1.21.0-1.el9.x86_6 648 kB/s | 32 kB 00:00 2024-03-09T14:19:06.625 INFO:teuthology.orchestra.run.smithi046.stdout:(124/284): libwayland-cursor-1.21.0-1.el9.x86_6 365 kB/s | 18 kB 00:00 2024-03-09T14:19:06.650 INFO:teuthology.orchestra.run.smithi046.stdout:(125/284): libwayland-egl-1.21.0-1.el9.x86_64.r 235 kB/s | 12 kB 00:00 2024-03-09T14:19:06.676 INFO:teuthology.orchestra.run.smithi046.stdout:(126/284): libwayland-server-1.21.0-1.el9.x86_6 813 kB/s | 41 kB 00:00 2024-03-09T14:19:06.701 INFO:teuthology.orchestra.run.smithi046.stdout:(127/284): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 276 kB 00:00 2024-03-09T14:19:06.726 INFO:teuthology.orchestra.run.smithi046.stdout:(128/284): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 132 kB 00:00 2024-03-09T14:19:06.751 INFO:teuthology.orchestra.run.smithi046.stdout:(129/284): libxshmfence-1.3-10.el9.x86_64.rpm 230 kB/s | 12 kB 00:00 2024-03-09T14:19:06.809 INFO:teuthology.orchestra.run.smithi159.stdout:(175/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-03-09T14:19:06.825 INFO:teuthology.orchestra.run.smithi159.stdout:(176/284): python3-toml-0.10.2-6.el9.noarch.rpm 91 kB/s | 39 kB 00:00 2024-03-09T14:19:06.842 INFO:teuthology.orchestra.run.smithi159.stdout:(177/284): rtkit-0.11-28.el9.x86_64.rpm 125 kB/s | 55 kB 00:00 2024-03-09T14:19:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:(130/284): low-memory-monitor-2.1-4.el9.x86_64. 278 kB/s | 35 kB 00:00 2024-03-09T14:19:06.876 INFO:teuthology.orchestra.run.smithi159.stdout:(178/284): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 509 kB 00:00 2024-03-09T14:19:06.901 INFO:teuthology.orchestra.run.smithi159.stdout:(179/284): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 68 kB 00:00 2024-03-09T14:19:06.926 INFO:teuthology.orchestra.run.smithi159.stdout:(180/284): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-03-09T14:19:06.944 INFO:teuthology.orchestra.run.smithi046.stdout:(131/284): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 282 kB 00:00 2024-03-09T14:19:06.960 INFO:teuthology.orchestra.run.smithi159.stdout:(181/284): sound-theme-freedesktop-0.8-17.el9.n 4.4 MB/s | 377 kB 00:00 2024-03-09T14:19:06.969 INFO:teuthology.orchestra.run.smithi046.stdout:(132/284): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-03-09T14:19:06.985 INFO:teuthology.orchestra.run.smithi159.stdout:(182/284): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 130 kB 00:00 2024-03-09T14:19:06.994 INFO:teuthology.orchestra.run.smithi046.stdout:(133/284): lua-posix-35.0-8.el9.x86_64.rpm 2.6 MB/s | 131 kB 00:00 2024-03-09T14:19:07.011 INFO:teuthology.orchestra.run.smithi159.stdout:(183/284): tracker-3.1.2-3.el9.x86_64.rpm 6.3 MB/s | 537 kB 00:00 2024-03-09T14:19:07.021 INFO:teuthology.orchestra.run.smithi046.stdout:(134/284): maven-3.6.3-15.el9.noarch.rpm 334 kB/s | 17 kB 00:00 2024-03-09T14:19:07.045 INFO:teuthology.orchestra.run.smithi159.stdout:(184/284): tracker-miners-3.1.2-4.el9.x86_64.rp 11 MB/s | 893 kB 00:00 2024-03-09T14:19:07.053 INFO:teuthology.orchestra.run.smithi046.stdout:(135/284): maven-lib-3.6.3-15.el9.noarch.rpm 25 MB/s | 1.5 MB 00:00 2024-03-09T14:19:07.069 INFO:teuthology.orchestra.run.smithi159.stdout:(185/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 911 kB/s | 52 kB 00:00 2024-03-09T14:19:07.079 INFO:teuthology.orchestra.run.smithi046.stdout:(136/284): maven-openjdk11-3.6.3-15.el9.noarch. 142 kB/s | 7.9 kB 00:00 2024-03-09T14:19:07.095 INFO:teuthology.orchestra.run.smithi159.stdout:(186/284): upower-0.99.11-11.el9.x86_64.rpm 2.0 MB/s | 168 kB 00:00 2024-03-09T14:19:07.112 INFO:teuthology.orchestra.run.smithi046.stdout:(137/284): maven-resolver-1.6.1-10.el9.noarch.r 8.6 MB/s | 512 kB 00:00 2024-03-09T14:19:07.120 INFO:teuthology.orchestra.run.smithi159.stdout:(187/284): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 305 kB 00:00 2024-03-09T14:19:07.137 INFO:teuthology.orchestra.run.smithi046.stdout:(138/284): maven-shared-utils-3.3.4-3.el9.noarc 2.5 MB/s | 150 kB 00:00 2024-03-09T14:19:07.146 INFO:teuthology.orchestra.run.smithi159.stdout:(188/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-03-09T14:19:07.163 INFO:teuthology.orchestra.run.smithi046.stdout:(139/284): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 111 kB 00:00 2024-03-09T14:19:07.179 INFO:teuthology.orchestra.run.smithi159.stdout:(189/284): wireplumber-libs-0.4.14-1.el9.x86_64 4.0 MB/s | 337 kB 00:00 2024-03-09T14:19:07.188 INFO:teuthology.orchestra.run.smithi046.stdout:(140/284): mkfontscale-1.2.1-3.el9.x86_64.rpm 622 kB/s | 31 kB 00:00 2024-03-09T14:19:07.206 INFO:teuthology.orchestra.run.smithi159.stdout:(190/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 496 kB/s | 41 kB 00:00 2024-03-09T14:19:07.214 INFO:teuthology.orchestra.run.smithi046.stdout:(141/284): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-09T14:19:07.230 INFO:teuthology.orchestra.run.smithi159.stdout:(191/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.5 MB/s | 130 kB 00:00 2024-03-09T14:19:07.239 INFO:teuthology.orchestra.run.smithi046.stdout:(142/284): openblas-0.3.21-2.el9.x86_64.rpm 689 kB/s | 34 kB 00:00 2024-03-09T14:19:07.263 INFO:teuthology.orchestra.run.smithi159.stdout:(192/284): xkeyboard-config-2.33-2.el9.noarch.r 9.1 MB/s | 780 kB 00:00 2024-03-09T14:19:07.288 INFO:teuthology.orchestra.run.smithi159.stdout:(193/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 758 kB/s | 63 kB 00:00 2024-03-09T14:19:07.313 INFO:teuthology.orchestra.run.smithi159.stdout:(194/284): ModemManager-glib-1.20.2-1.el9.x86_6 6.5 MB/s | 334 kB 00:00 2024-03-09T14:19:07.347 INFO:teuthology.orchestra.run.smithi159.stdout:(195/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.8 MB/s | 499 kB 00:00 2024-03-09T14:19:07.348 INFO:teuthology.orchestra.run.smithi046.stdout:(143/284): openblas-openmp-0.3.21-2.el9.x86_64. 36 MB/s | 4.7 MB 00:00 2024-03-09T14:19:07.373 INFO:teuthology.orchestra.run.smithi046.stdout:(144/284): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.2 MB/s | 162 kB 00:00 2024-03-09T14:19:07.374 INFO:teuthology.orchestra.run.smithi159.stdout:(196/284): bluez-libs-5.64-1.el9.x86_64.rpm 997 kB/s | 83 kB 00:00 2024-03-09T14:19:07.397 INFO:teuthology.orchestra.run.smithi159.stdout:(197/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 593 kB/s | 49 kB 00:00 2024-03-09T14:19:07.398 INFO:teuthology.orchestra.run.smithi046.stdout:(145/284): opus-1.3.1-10.el9.x86_64.rpm 3.9 MB/s | 199 kB 00:00 2024-03-09T14:19:07.423 INFO:teuthology.orchestra.run.smithi159.stdout:(198/284): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-09T14:19:07.423 INFO:teuthology.orchestra.run.smithi046.stdout:(146/284): orc-0.4.31-6.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-03-09T14:19:07.440 INFO:teuthology.orchestra.run.smithi159.stdout:(199/284): libpciaccess-0.16-6.el9.x86_64.rpm 398 kB/s | 27 kB 00:00 2024-03-09T14:19:07.448 INFO:teuthology.orchestra.run.smithi046.stdout:(147/284): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.3 MB/s | 68 kB 00:00 2024-03-09T14:19:07.465 INFO:teuthology.orchestra.run.smithi159.stdout:(200/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.3 MB/s | 90 kB 00:00 2024-03-09T14:19:07.474 INFO:teuthology.orchestra.run.smithi046.stdout:(148/284): p11-kit-server-0.24.1-2.el9.x86_64.r 3.9 MB/s | 198 kB 00:00 2024-03-09T14:19:07.490 INFO:teuthology.orchestra.run.smithi159.stdout:(201/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-09T14:19:07.499 INFO:teuthology.orchestra.run.smithi046.stdout:(149/284): plexus-cipher-1.7-27.el9.noarch.rpm 496 kB/s | 25 kB 00:00 2024-03-09T14:19:07.523 INFO:teuthology.orchestra.run.smithi159.stdout:(202/284): python3-cryptography-36.0.1-4.el9.x8 14 MB/s | 1.1 MB 00:00 2024-03-09T14:19:07.524 INFO:teuthology.orchestra.run.smithi046.stdout:(150/284): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 59 kB 00:00 2024-03-09T14:19:07.549 INFO:teuthology.orchestra.run.smithi159.stdout:(203/284): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-09T14:19:07.549 INFO:teuthology.orchestra.run.smithi046.stdout:(151/284): plexus-containers-component-annotati 347 kB/s | 17 kB 00:00 2024-03-09T14:19:07.574 INFO:teuthology.orchestra.run.smithi159.stdout:(204/284): python3-pycparser-2.20-6.el9.noarch. 1.5 MB/s | 124 kB 00:00 2024-03-09T14:19:07.575 INFO:teuthology.orchestra.run.smithi046.stdout:(152/284): plexus-interpolation-1.26-11.el9.noa 1.5 MB/s | 79 kB 00:00 2024-03-09T14:19:07.600 INFO:teuthology.orchestra.run.smithi159.stdout:(205/284): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-03-09T14:19:07.600 INFO:teuthology.orchestra.run.smithi046.stdout:(153/284): plexus-sec-dispatcher-1.4-37.el9.noa 650 kB/s | 33 kB 00:00 2024-03-09T14:19:07.626 INFO:teuthology.orchestra.run.smithi046.stdout:(154/284): plexus-utils-3.3.0-10.el9.noarch.rpm 5.0 MB/s | 253 kB 00:00 2024-03-09T14:19:07.665 INFO:teuthology.orchestra.run.smithi159.stdout:(206/284): jq-1.6-16.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2024-03-09T14:19:07.668 INFO:teuthology.orchestra.run.smithi046.stdout:(155/284): poppler-data-0.4.9-9.el9.noarch.rpm 27 MB/s | 1.8 MB 00:00 2024-03-09T14:19:07.701 INFO:teuthology.orchestra.run.smithi046.stdout:(156/284): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-03-09T14:19:07.718 INFO:teuthology.orchestra.run.smithi046.stdout:(157/284): publicsuffix-list-20210518-3.el9.noa 1.7 MB/s | 82 kB 00:00 2024-03-09T14:19:07.723 INFO:teuthology.orchestra.run.smithi159.stdout:(207/284): libgfortran-11.4.1-3.el9.x86_64.rpm 6.4 MB/s | 803 kB 00:00 2024-03-09T14:19:07.749 INFO:teuthology.orchestra.run.smithi159.stdout:(208/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 1.3 MB/s | 262 kB 00:00 2024-03-09T14:19:07.768 INFO:teuthology.orchestra.run.smithi046.stdout:(158/284): pulseaudio-libs-15.0-2.el9.x86_64.rp 9.8 MB/s | 666 kB 00:00 2024-03-09T14:19:07.792 INFO:teuthology.orchestra.run.smithi159.stdout:(209/284): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-03-09T14:19:07.833 INFO:teuthology.orchestra.run.smithi159.stdout:(210/284): python3-requests-2.25.1-8.el9.noarch 1.1 MB/s | 125 kB 00:00 2024-03-09T14:19:07.894 INFO:teuthology.orchestra.run.smithi046.stdout:(159/284): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-03-09T14:19:07.911 INFO:teuthology.orchestra.run.smithi046.stdout:(160/284): python3-jsonpatch-1.21-16.el9.noarch 175 kB/s | 24 kB 00:00 2024-03-09T14:19:07.925 INFO:teuthology.orchestra.run.smithi159.stdout:(211/284): avahi-glib-0.8-12.el9.x86_64.rpm 111 kB/s | 15 kB 00:00 2024-03-09T14:19:07.927 INFO:teuthology.orchestra.run.smithi046.stdout:(161/284): python3-jsonpointer-2.0-4.el9.noarch 543 kB/s | 18 kB 00:00 2024-03-09T14:19:07.953 INFO:teuthology.orchestra.run.smithi046.stdout:(162/284): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-09T14:19:07.970 INFO:teuthology.orchestra.run.smithi046.stdout:(163/284): python3-markupsafe-1.1.1-12.el9.x86_ 759 kB/s | 32 kB 00:00 2024-03-09T14:19:08.128 INFO:teuthology.orchestra.run.smithi046.stdout:(164/284): python3-numpy-1.20.1-5.el9.x86_64.rp 27 MB/s | 4.8 MB 00:00 2024-03-09T14:19:08.135 INFO:teuthology.orchestra.run.smithi159.stdout:(212/284): flac-libs-1.3.3-12.el9.x86_64.rpm 726 kB/s | 218 kB 00:00 2024-03-09T14:19:08.154 INFO:teuthology.orchestra.run.smithi046.stdout:(165/284): python3-numpy-f2py-1.20.1-5.el9.x86_ 1.2 MB/s | 217 kB 00:00 2024-03-09T14:19:08.175 INFO:teuthology.orchestra.run.smithi159.stdout:(213/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 1.2 MB/s | 523 kB 00:00 2024-03-09T14:19:08.179 INFO:teuthology.orchestra.run.smithi046.stdout:(166/284): python3-oauthlib-3.1.1-5.el9.noarch. 3.4 MB/s | 174 kB 00:00 2024-03-09T14:19:08.204 INFO:teuthology.orchestra.run.smithi046.stdout:(167/284): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 69 kB 00:00 2024-03-09T14:19:08.234 INFO:teuthology.orchestra.run.smithi159.stdout:(214/284): libdrm-2.4.117-1.el9.x86_64.rpm 1.6 MB/s | 161 kB 00:00 2024-03-09T14:19:08.293 INFO:teuthology.orchestra.run.smithi159.stdout:(215/284): libsndfile-1.0.31-8.el9.x86_64.rpm 1.7 MB/s | 206 kB 00:00 2024-03-09T14:19:08.351 INFO:teuthology.orchestra.run.smithi159.stdout:(216/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 2.1 MB/s | 127 kB 00:00 2024-03-09T14:19:08.376 INFO:teuthology.orchestra.run.smithi159.stdout:(217/284): libtiff-4.4.0-12.el9.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-03-09T14:19:08.427 INFO:teuthology.orchestra.run.smithi159.stdout:(218/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 755 kB/s | 38 kB 00:00 2024-03-09T14:19:08.452 INFO:teuthology.orchestra.run.smithi159.stdout:(219/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 1.6 MB/s | 168 kB 00:00 2024-03-09T14:19:08.477 INFO:teuthology.orchestra.run.smithi159.stdout:(220/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 883 kB/s | 44 kB 00:00 2024-03-09T14:19:08.611 INFO:teuthology.orchestra.run.smithi159.stdout:(221/284): gstreamer1-plugins-base-1.22.1-2.el9 3.3 MB/s | 2.2 MB 00:00 2024-03-09T14:19:08.621 INFO:teuthology.orchestra.run.smithi046.stdout:(168/284): ceph-test-19.0.0-2079.gc00d9c60.el9. 5.2 MB/s | 48 MB 00:09 2024-03-09T14:19:08.636 INFO:teuthology.orchestra.run.smithi159.stdout:(222/284): ostree-libs-2024.4-3.el9.x86_64.rpm 3.0 MB/s | 487 kB 00:00 2024-03-09T14:19:08.655 INFO:teuthology.orchestra.run.smithi046.stdout:(169/284): python3-prettytable-0.7.2-27.el9.noa 87 kB/s | 41 kB 00:00 2024-03-09T14:19:08.678 INFO:teuthology.orchestra.run.smithi159.stdout:(223/284): osinfo-db-20231215-1.el9.noarch.rpm 2.3 MB/s | 521 kB 00:00 2024-03-09T14:19:08.688 INFO:teuthology.orchestra.run.smithi046.stdout:(170/284): python3-protobuf-3.14.0-13.el9.noarc 492 kB/s | 238 kB 00:00 2024-03-09T14:19:08.703 INFO:teuthology.orchestra.run.smithi159.stdout:(224/284): pipewire-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 107 kB 00:00 2024-03-09T14:19:08.714 INFO:teuthology.orchestra.run.smithi046.stdout:(171/284): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.2 MB/s | 132 kB 00:00 2024-03-09T14:19:08.729 INFO:teuthology.orchestra.run.smithi159.stdout:(225/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 622 kB/s | 57 kB 00:00 2024-03-09T14:19:08.739 INFO:teuthology.orchestra.run.smithi046.stdout:(172/284): python3-pyasn1-modules-0.4.8-6.el9.n 2.5 MB/s | 211 kB 00:00 2024-03-09T14:19:08.762 INFO:teuthology.orchestra.run.smithi159.stdout:(226/284): pipewire-jack-audio-connection-kit-1 157 kB/s | 9.1 kB 00:00 2024-03-09T14:19:08.764 INFO:teuthology.orchestra.run.smithi046.stdout:(173/284): python3-pytz-2021.1-5.el9.noarch.rpm 633 kB/s | 47 kB 00:00 2024-03-09T14:19:08.789 INFO:teuthology.orchestra.run.smithi046.stdout:(174/284): python3-requests-oauthlib-1.3.0-12.e 858 kB/s | 43 kB 00:00 2024-03-09T14:19:08.795 INFO:teuthology.orchestra.run.smithi159.stdout:(227/284): pipewire-jack-audio-connection-kit-l 1.4 MB/s | 135 kB 00:00 2024-03-09T14:19:08.829 INFO:teuthology.orchestra.run.smithi159.stdout:(228/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.8 MB/s | 192 kB 00:00 2024-03-09T14:19:08.897 INFO:teuthology.orchestra.run.smithi159.stdout:(229/284): poppler-glib-21.01.0-19.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-03-09T14:19:08.923 INFO:teuthology.orchestra.run.smithi046.stdout:(175/284): python3-toml-0.10.2-6.el9.noarch.rpm 248 kB/s | 39 kB 00:00 2024-03-09T14:19:08.997 INFO:teuthology.orchestra.run.smithi159.stdout:(230/284): python3-devel-3.9.17-2.el9.x86_64.rp 2.4 MB/s | 245 kB 00:00 2024-03-09T14:19:09.063 INFO:teuthology.orchestra.run.smithi159.stdout:(231/284): python3-jinja2-2.11.3-5.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-03-09T14:19:09.090 INFO:teuthology.orchestra.run.smithi046.stdout:(176/284): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-09T14:19:09.124 INFO:teuthology.orchestra.run.smithi046.stdout:(177/284): rtkit-0.11-28.el9.x86_64.rpm 165 kB/s | 55 kB 00:00 2024-03-09T14:19:09.139 INFO:teuthology.orchestra.run.smithi159.stdout:(232/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 4.7 MB/s | 1.9 MB 00:00 2024-03-09T14:19:09.149 INFO:teuthology.orchestra.run.smithi046.stdout:(178/284): sisu-0.3.4-10.el9.noarch.rpm 2.2 MB/s | 509 kB 00:00 2024-03-09T14:19:09.172 INFO:teuthology.orchestra.run.smithi159.stdout:(233/284): poppler-21.01.0-19.el9.x86_64.rpm 2.8 MB/s | 1.1 MB 00:00 2024-03-09T14:19:09.174 INFO:teuthology.orchestra.run.smithi046.stdout:(179/284): slf4j-1.7.30-13.el9.noarch.rpm 811 kB/s | 68 kB 00:00 2024-03-09T14:19:09.197 INFO:teuthology.orchestra.run.smithi159.stdout:(234/284): qatlib-23.11.0-1.el9.x86_64.rpm 1.6 MB/s | 216 kB 00:00 2024-03-09T14:19:09.200 INFO:teuthology.orchestra.run.smithi046.stdout:(180/284): sound-theme-freedesktop-0.8-17.el9.n 7.3 MB/s | 377 kB 00:00 2024-03-09T14:19:09.223 INFO:teuthology.orchestra.run.smithi159.stdout:(235/284): qatlib-service-23.11.0-1.el9.x86_64. 417 kB/s | 35 kB 00:00 2024-03-09T14:19:09.225 INFO:teuthology.orchestra.run.smithi046.stdout:(181/284): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-03-09T14:19:09.248 INFO:teuthology.orchestra.run.smithi159.stdout:(236/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-03-09T14:19:09.251 INFO:teuthology.orchestra.run.smithi046.stdout:(182/284): totem-pl-parser-3.26.6-2.el9.x86_64. 1.7 MB/s | 130 kB 00:00 2024-03-09T14:19:09.273 INFO:teuthology.orchestra.run.smithi159.stdout:(237/284): tzdata-java-2024a-1.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-09T14:19:09.284 INFO:teuthology.orchestra.run.smithi046.stdout:(183/284): tracker-3.1.2-3.el9.x86_64.rpm 6.3 MB/s | 537 kB 00:00 2024-03-09T14:19:09.307 INFO:teuthology.orchestra.run.smithi159.stdout:(238/284): lua-devel-5.4.4-4.el9.x86_64.rpm 382 kB/s | 22 kB 00:00 2024-03-09T14:19:09.310 INFO:teuthology.orchestra.run.smithi046.stdout:(184/284): ttmkfdir-3.0.9-65.el9.x86_64.rpm 905 kB/s | 52 kB 00:00 2024-03-09T14:19:09.349 INFO:teuthology.orchestra.run.smithi159.stdout:(239/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.0 MB/s | 385 kB 00:00 2024-03-09T14:19:09.351 INFO:teuthology.orchestra.run.smithi046.stdout:(185/284): tracker-miners-3.1.2-4.el9.x86_64.rp 8.8 MB/s | 893 kB 00:00 2024-03-09T14:19:09.369 INFO:teuthology.orchestra.run.smithi046.stdout:(186/284): upower-0.99.11-11.el9.x86_64.rpm 2.0 MB/s | 168 kB 00:00 2024-03-09T14:19:09.394 INFO:teuthology.orchestra.run.smithi046.stdout:(187/284): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 305 kB 00:00 2024-03-09T14:19:09.419 INFO:teuthology.orchestra.run.smithi046.stdout:(188/284): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-03-09T14:19:09.441 INFO:teuthology.orchestra.run.smithi159.stdout:(240/284): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-03-09T14:19:09.444 INFO:teuthology.orchestra.run.smithi046.stdout:(189/284): wireplumber-libs-0.4.14-1.el9.x86_64 4.4 MB/s | 337 kB 00:00 2024-03-09T14:19:09.461 INFO:teuthology.orchestra.run.smithi046.stdout:(190/284): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 625 kB/s | 41 kB 00:00 2024-03-09T14:19:09.503 INFO:teuthology.orchestra.run.smithi046.stdout:(191/284): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 780 kB 00:00 2024-03-09T14:19:09.516 INFO:teuthology.orchestra.run.smithi159.stdout:(241/284): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-03-09T14:19:09.528 INFO:teuthology.orchestra.run.smithi046.stdout:(192/284): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.5 MB/s | 130 kB 00:00 2024-03-09T14:19:09.541 INFO:teuthology.orchestra.run.smithi159.stdout:(242/284): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-03-09T14:19:09.545 INFO:teuthology.orchestra.run.smithi046.stdout:(193/284): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 63 kB 00:00 2024-03-09T14:19:09.567 INFO:teuthology.orchestra.run.smithi159.stdout:(243/284): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-03-09T14:19:09.570 INFO:teuthology.orchestra.run.smithi046.stdout:(194/284): xorg-x11-fonts-Type1-7.5-33.el9.noar 7.3 MB/s | 499 kB 00:00 2024-03-09T14:19:09.600 INFO:teuthology.orchestra.run.smithi159.stdout:(244/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 783 kB/s | 26 kB 00:00 2024-03-09T14:19:09.604 INFO:teuthology.orchestra.run.smithi046.stdout:(195/284): bluez-libs-5.64-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-03-09T14:19:09.626 INFO:teuthology.orchestra.run.smithi159.stdout:(245/284): liboath-2.6.7-2.el9.x86_64.rpm 831 kB/s | 49 kB 00:00 2024-03-09T14:19:09.629 INFO:teuthology.orchestra.run.smithi046.stdout:(196/284): ModemManager-glib-1.20.2-1.el9.x86_6 3.9 MB/s | 334 kB 00:00 2024-03-09T14:19:09.646 INFO:teuthology.orchestra.run.smithi046.stdout:(197/284): bubblewrap-0.4.1-6.el9.x86_64.rpm 654 kB/s | 49 kB 00:00 2024-03-09T14:19:09.651 INFO:teuthology.orchestra.run.smithi159.stdout:(246/284): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-09T14:19:09.671 INFO:teuthology.orchestra.run.smithi046.stdout:(198/284): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2024-03-09T14:19:09.688 INFO:teuthology.orchestra.run.smithi046.stdout:(199/284): libpciaccess-0.16-6.el9.x86_64.rpm 640 kB/s | 27 kB 00:00 2024-03-09T14:19:09.693 INFO:teuthology.orchestra.run.smithi159.stdout:(247/284): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-03-09T14:19:09.713 INFO:teuthology.orchestra.run.smithi046.stdout:(200/284): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.3 MB/s | 90 kB 00:00 2024-03-09T14:19:09.739 INFO:teuthology.orchestra.run.smithi046.stdout:(201/284): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-09T14:19:09.764 INFO:teuthology.orchestra.run.smithi046.stdout:(202/284): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-03-09T14:19:09.806 INFO:teuthology.orchestra.run.smithi046.stdout:(203/284): python3-cryptography-36.0.1-4.el9.x8 12 MB/s | 1.1 MB 00:00 2024-03-09T14:19:09.831 INFO:teuthology.orchestra.run.smithi046.stdout:(204/284): python3-pycparser-2.20-6.el9.noarch. 1.3 MB/s | 124 kB 00:00 2024-03-09T14:19:09.835 INFO:teuthology.orchestra.run.smithi159.stdout:(248/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-03-09T14:19:09.856 INFO:teuthology.orchestra.run.smithi046.stdout:(205/284): python3-urllib3-1.26.5-5.el9.noarch. 2.0 MB/s | 187 kB 00:00 2024-03-09T14:19:09.868 INFO:teuthology.orchestra.run.smithi159.stdout:(249/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-03-09T14:19:09.902 INFO:teuthology.orchestra.run.smithi159.stdout:(250/284): python3-asyncssh-2.13.2-4.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-03-09T14:19:09.919 INFO:teuthology.orchestra.run.smithi159.stdout:(251/284): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-03-09T14:19:09.936 INFO:teuthology.orchestra.run.smithi159.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 448 kB/s | 15 kB 00:00 2024-03-09T14:19:09.978 INFO:teuthology.orchestra.run.smithi159.stdout:(253/284): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-03-09T14:19:10.053 INFO:teuthology.orchestra.run.smithi159.stdout:(254/284): python3-google-auth-2.28.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-09T14:19:10.078 INFO:teuthology.orchestra.run.smithi159.stdout:(255/284): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-03-09T14:19:10.195 INFO:teuthology.orchestra.run.smithi159.stdout:(256/284): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-03-09T14:19:10.237 INFO:teuthology.orchestra.run.smithi159.stdout:(257/284): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-03-09T14:19:10.279 INFO:teuthology.orchestra.run.smithi159.stdout:(258/284): python3-jaraco-classes-3.2.1-5.el9.n 426 kB/s | 18 kB 00:00 2024-03-09T14:19:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:(259/284): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-03-09T14:19:10.446 INFO:teuthology.orchestra.run.smithi159.stdout:(260/284): python3-jaraco-functools-3.5.0-2.el9 390 kB/s | 19 kB 00:00 2024-03-09T14:19:10.490 INFO:teuthology.orchestra.run.smithi159.stdout:(261/284): python3-jaraco-text-3.2.0-6.el9.noar 452 kB/s | 20 kB 00:00 2024-03-09T14:19:10.549 INFO:teuthology.orchestra.run.smithi159.stdout:(262/284): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-03-09T14:19:10.591 INFO:teuthology.orchestra.run.smithi159.stdout:(263/284): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-03-09T14:19:10.633 INFO:teuthology.orchestra.run.smithi159.stdout:(264/284): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-03-09T14:19:10.675 INFO:teuthology.orchestra.run.smithi159.stdout:(265/284): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-03-09T14:19:10.748 INFO:teuthology.orchestra.run.smithi046.stdout:(206/284): jq-1.6-16.el9.x86_64.rpm 204 kB/s | 187 kB 00:00 2024-03-09T14:19:10.815 INFO:teuthology.orchestra.run.smithi046.stdout:(207/284): cups-libs-2.3.3op2-24.el9.x86_64.rpm 266 kB/s | 262 kB 00:00 2024-03-09T14:19:10.958 INFO:teuthology.orchestra.run.smithi159.stdout:(266/284): python3-pecan-1.4.2-3.el9.noarch.rpm 961 kB/s | 272 kB 00:00 2024-03-09T14:19:11.184 INFO:teuthology.orchestra.run.smithi159.stdout:(267/284): python3-portend-3.1.0-2.el9.noarch.r 73 kB/s | 16 kB 00:00 2024-03-09T14:19:11.209 INFO:teuthology.orchestra.run.smithi159.stdout:(268/284): python3-kubernetes-26.1.0-2.el9.noar 1.4 MB/s | 1.0 MB 00:00 2024-03-09T14:19:11.293 INFO:teuthology.orchestra.run.smithi159.stdout:(269/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 829 kB/s | 90 kB 00:00 2024-03-09T14:19:11.318 INFO:teuthology.orchestra.run.smithi159.stdout:(270/284): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2024-03-09T14:19:11.343 INFO:teuthology.orchestra.run.smithi159.stdout:(271/284): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-03-09T14:19:11.369 INFO:teuthology.orchestra.run.smithi159.stdout:(272/284): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-03-09T14:19:11.394 INFO:teuthology.orchestra.run.smithi159.stdout:(273/284): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-03-09T14:19:11.419 INFO:teuthology.orchestra.run.smithi159.stdout:(274/284): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-09T14:19:11.432 INFO:teuthology.orchestra.run.smithi046.stdout:(208/284): libgfortran-11.4.1-3.el9.x86_64.rpm 510 kB/s | 803 kB 00:01 2024-03-09T14:19:11.462 INFO:teuthology.orchestra.run.smithi159.stdout:(275/284): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-09T14:19:11.486 INFO:teuthology.orchestra.run.smithi159.stdout:(276/284): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-09T14:19:11.528 INFO:teuthology.orchestra.run.smithi159.stdout:(277/284): python3-zc-lockfile-2.0-10.el9.noarc 481 kB/s | 20 kB 00:00 2024-03-09T14:19:11.553 INFO:teuthology.orchestra.run.smithi159.stdout:(278/284): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-03-09T14:19:11.557 INFO:teuthology.orchestra.run.smithi046.stdout:(209/284): python3-requests-2.25.1-8.el9.noarch 168 kB/s | 125 kB 00:00 2024-03-09T14:19:11.607 INFO:teuthology.orchestra.run.smithi046.stdout:(210/284): libquadmath-11.4.1-3.el9.x86_64.rpm 227 kB/s | 195 kB 00:00 2024-03-09T14:19:11.612 INFO:teuthology.orchestra.run.smithi159.stdout:(279/284): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-09T14:19:11.637 INFO:teuthology.orchestra.run.smithi159.stdout:(280/284): s3cmd-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 206 kB 00:00 2024-03-09T14:19:11.824 INFO:teuthology.orchestra.run.smithi046.stdout:(211/284): avahi-glib-0.8-12.el9.x86_64.rpm 55 kB/s | 15 kB 00:00 2024-03-09T14:19:11.913 INFO:teuthology.orchestra.run.smithi159.stdout:(281/284): thrift-0.15.0-2.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-03-09T14:19:12.004 INFO:teuthology.orchestra.run.smithi159.stdout:(282/284): libarrow-9.0.0-10.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-03-09T14:19:12.050 INFO:teuthology.orchestra.run.smithi046.stdout:(212/284): alsa-lib-1.2.10-2.el9.x86_64.rpm 848 kB/s | 523 kB 00:00 2024-03-09T14:19:12.155 INFO:teuthology.orchestra.run.smithi159.stdout:(283/284): librados2-19.0.0-2079.gc00d9c60.el9. 6.5 MB/s | 3.4 MB 00:00 2024-03-09T14:19:12.158 INFO:teuthology.orchestra.run.smithi046.stdout:(213/284): libdrm-2.4.117-1.el9.x86_64.rpm 1.5 MB/s | 161 kB 00:00 2024-03-09T14:19:12.184 INFO:teuthology.orchestra.run.smithi046.stdout:(214/284): flac-libs-1.3.3-12.el9.x86_64.rpm 379 kB/s | 218 kB 00:00 2024-03-09T14:19:12.267 INFO:teuthology.orchestra.run.smithi046.stdout:(215/284): libsndfile-1.0.31-8.el9.x86_64.rpm 1.9 MB/s | 206 kB 00:00 2024-03-09T14:19:12.376 INFO:teuthology.orchestra.run.smithi046.stdout:(216/284): libtiff-4.4.0-12.el9.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2024-03-09T14:19:12.388 INFO:teuthology.orchestra.run.smithi159.stdout:(284/284): librbd1-19.0.0-2079.gc00d9c60.el9.x8 6.6 MB/s | 3.1 MB 00:00 2024-03-09T14:19:12.391 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:19:12.392 INFO:teuthology.orchestra.run.smithi159.stdout:Total 15 MB/s | 297 MB 00:19 2024-03-09T14:19:12.401 INFO:teuthology.orchestra.run.smithi046.stdout:(217/284): mesa-libEGL-23.3.3-1.el9.x86_64.rpm 952 kB/s | 127 kB 00:00 2024-03-09T14:19:12.493 INFO:teuthology.orchestra.run.smithi046.stdout:(218/284): mesa-libGL-23.3.3-1.el9.x86_64.rpm 1.4 MB/s | 168 kB 00:00 2024-03-09T14:19:12.527 INFO:teuthology.orchestra.run.smithi046.stdout:(219/284): mesa-libgbm-23.3.3-1.el9.x86_64.rpm 300 kB/s | 38 kB 00:00 2024-03-09T14:19:12.627 INFO:teuthology.orchestra.run.smithi046.stdout:(220/284): gstreamer1-plugins-base-1.22.1-2.el9 2.8 MB/s | 2.2 MB 00:00 2024-03-09T14:19:12.652 INFO:teuthology.orchestra.run.smithi046.stdout:(221/284): mesa-libglapi-23.3.3-1.el9.x86_64.rp 279 kB/s | 44 kB 00:00 2024-03-09T14:19:12.677 INFO:teuthology.orchestra.run.smithi046.stdout:(222/284): osinfo-db-20231215-1.el9.noarch.rpm 3.4 MB/s | 521 kB 00:00 2024-03-09T14:19:12.736 INFO:teuthology.orchestra.run.smithi046.stdout:(223/284): ostree-libs-2024.4-3.el9.x86_64.rpm 4.4 MB/s | 487 kB 00:00 2024-03-09T14:19:12.761 INFO:teuthology.orchestra.run.smithi046.stdout:(224/284): pipewire-1.0.1-1.el9.x86_64.rpm 981 kB/s | 107 kB 00:00 2024-03-09T14:19:12.786 INFO:teuthology.orchestra.run.smithi046.stdout:(225/284): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 526 kB/s | 57 kB 00:00 2024-03-09T14:19:12.794 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-03-09T14:19:12.837 INFO:teuthology.orchestra.run.smithi046.stdout:(226/284): pipewire-jack-audio-connection-kit-1 91 kB/s | 9.1 kB 00:00 2024-03-09T14:19:12.870 INFO:teuthology.orchestra.run.smithi046.stdout:(227/284): pipewire-jack-audio-connection-kit-l 1.2 MB/s | 135 kB 00:00 2024-03-09T14:19:12.945 INFO:teuthology.orchestra.run.smithi046.stdout:(228/284): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.7 MB/s | 192 kB 00:00 2024-03-09T14:19:12.959 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-03-09T14:19:12.960 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-03-09T14:19:13.004 INFO:teuthology.orchestra.run.smithi046.stdout:(229/284): pipewire-libs-1.0.1-1.el9.x86_64.rpm 8.8 MB/s | 1.9 MB 00:00 2024-03-09T14:19:13.054 INFO:teuthology.orchestra.run.smithi046.stdout:(230/284): poppler-glib-21.01.0-19.el9.x86_64.r 1.4 MB/s | 152 kB 00:00 2024-03-09T14:19:13.113 INFO:teuthology.orchestra.run.smithi046.stdout:(231/284): python3-devel-3.9.17-2.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2024-03-09T14:19:13.171 INFO:teuthology.orchestra.run.smithi046.stdout:(232/284): poppler-21.01.0-19.el9.x86_64.rpm 3.5 MB/s | 1.1 MB 00:00 2024-03-09T14:19:13.197 INFO:teuthology.orchestra.run.smithi046.stdout:(233/284): python3-jinja2-2.11.3-5.el9.noarch.r 1.7 MB/s | 248 kB 00:00 2024-03-09T14:19:13.214 INFO:teuthology.orchestra.run.smithi046.stdout:(234/284): qatlib-23.11.0-1.el9.x86_64.rpm 2.1 MB/s | 216 kB 00:00 2024-03-09T14:19:13.272 INFO:teuthology.orchestra.run.smithi046.stdout:(235/284): qatlib-service-23.11.0-1.el9.x86_64. 347 kB/s | 35 kB 00:00 2024-03-09T14:19:13.297 INFO:teuthology.orchestra.run.smithi046.stdout:(236/284): qatzip-libs-1.1.2-2.el9.x86_64.rpm 444 kB/s | 44 kB 00:00 2024-03-09T14:19:13.331 INFO:teuthology.orchestra.run.smithi046.stdout:(237/284): tzdata-java-2024a-1.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-09T14:19:13.381 INFO:teuthology.orchestra.run.smithi046.stdout:(238/284): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.5 MB/s | 385 kB 00:00 2024-03-09T14:19:13.773 INFO:teuthology.orchestra.run.smithi046.stdout:(239/284): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-03-09T14:19:13.848 INFO:teuthology.orchestra.run.smithi046.stdout:(240/284): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-03-09T14:19:13.874 INFO:teuthology.orchestra.run.smithi046.stdout:(241/284): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-03-09T14:19:13.907 INFO:teuthology.orchestra.run.smithi046.stdout:(242/284): grpc-data-1.46.7-10.el9.noarch.rpm 331 kB/s | 19 kB 00:00 2024-03-09T14:19:13.999 INFO:teuthology.orchestra.run.smithi046.stdout:(243/284): libarrow-doc-9.0.0-10.el9.noarch.rpm 404 kB/s | 26 kB 00:00 2024-03-09T14:19:14.058 INFO:teuthology.orchestra.run.smithi046.stdout:(244/284): liboath-2.6.7-2.el9.x86_64.rpm 832 kB/s | 49 kB 00:00 2024-03-09T14:19:14.108 INFO:teuthology.orchestra.run.smithi046.stdout:(245/284): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-09T14:19:14.178 INFO:teuthology.orchestra.run.smithi046.stdout:(246/284): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-03-09T14:19:14.283 INFO:teuthology.orchestra.run.smithi046.stdout:(247/284): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2024-03-09T14:19:14.359 INFO:teuthology.orchestra.run.smithi046.stdout:(248/284): python3-asyncssh-2.13.2-4.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-03-09T14:19:14.418 INFO:teuthology.orchestra.run.smithi046.stdout:(249/284): libarrow-9.0.0-10.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-03-09T14:19:14.434 INFO:teuthology.orchestra.run.smithi046.stdout:(250/284): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-03-09T14:19:14.551 INFO:teuthology.orchestra.run.smithi046.stdout:(251/284): python3-cachetools-4.2.4-1.el9.noarc 241 kB/s | 32 kB 00:00 2024-03-09T14:19:14.577 INFO:teuthology.orchestra.run.smithi046.stdout:(252/284): python3-certifi-2021.10.8-2.el9.noar 105 kB/s | 15 kB 00:00 2024-03-09T14:19:14.610 INFO:teuthology.orchestra.run.smithi046.stdout:(253/284): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-03-09T14:19:14.677 INFO:teuthology.orchestra.run.smithi046.stdout:(254/284): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-03-09T14:19:14.702 INFO:teuthology.orchestra.run.smithi046.stdout:(255/284): python3-google-auth-2.28.0-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-09T14:19:14.761 INFO:teuthology.orchestra.run.smithi046.stdout:(256/284): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-09T14:19:14.811 INFO:teuthology.orchestra.run.smithi046.stdout:(257/284): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-03-09T14:19:14.837 INFO:teuthology.orchestra.run.smithi046.stdout:(258/284): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-03-09T14:19:14.871 INFO:teuthology.orchestra.run.smithi046.stdout:(259/284): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-03-09T14:19:14.896 INFO:teuthology.orchestra.run.smithi046.stdout:(260/284): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-03-09T14:19:14.929 INFO:teuthology.orchestra.run.smithi046.stdout:(261/284): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-03-09T14:19:14.955 INFO:teuthology.orchestra.run.smithi046.stdout:(262/284): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-03-09T14:19:15.021 INFO:teuthology.orchestra.run.smithi046.stdout:(263/284): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-03-09T14:19:15.080 INFO:teuthology.orchestra.run.smithi046.stdout:(264/284): protobuf-compiler-3.14.0-13.el9.x86_ 494 kB/s | 863 kB 00:01 2024-03-09T14:19:15.105 INFO:teuthology.orchestra.run.smithi046.stdout:(265/284): python3-logutils-0.3.5-21.el9.noarch 307 kB/s | 46 kB 00:00 2024-03-09T14:19:15.131 INFO:teuthology.orchestra.run.smithi046.stdout:(266/284): python3-more-itertools-8.12.0-2.el9. 731 kB/s | 79 kB 00:00 2024-03-09T14:19:15.181 INFO:teuthology.orchestra.run.smithi046.stdout:(267/284): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-09T14:19:15.223 INFO:teuthology.orchestra.run.smithi046.stdout:(268/284): python3-portend-3.1.0-2.el9.noarch.r 255 kB/s | 16 kB 00:00 2024-03-09T14:19:15.248 INFO:teuthology.orchestra.run.smithi046.stdout:(269/284): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-09T14:19:15.282 INFO:teuthology.orchestra.run.smithi046.stdout:(270/284): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-03-09T14:19:15.307 INFO:teuthology.orchestra.run.smithi046.stdout:(271/284): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-03-09T14:19:15.332 INFO:teuthology.orchestra.run.smithi046.stdout:(272/284): python3-natsort-7.1.1-5.el9.noarch.r 229 kB/s | 58 kB 00:00 2024-03-09T14:19:15.357 INFO:teuthology.orchestra.run.smithi046.stdout:(273/284): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-03-09T14:19:15.383 INFO:teuthology.orchestra.run.smithi046.stdout:(274/284): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-03-09T14:19:15.424 INFO:teuthology.orchestra.run.smithi046.stdout:(275/284): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-03-09T14:19:15.450 INFO:teuthology.orchestra.run.smithi046.stdout:(276/284): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-09T14:19:15.475 INFO:teuthology.orchestra.run.smithi046.stdout:(277/284): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-09T14:19:15.508 INFO:teuthology.orchestra.run.smithi046.stdout:(278/284): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-03-09T14:19:15.523 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-03-09T14:19:15.523 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-03-09T14:19:15.534 INFO:teuthology.orchestra.run.smithi046.stdout:(279/284): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-03-09T14:19:15.567 INFO:teuthology.orchestra.run.smithi046.stdout:(280/284): s3cmd-2.4.0-1.el9.noarch.rpm 3.4 MB/s | 206 kB 00:00 2024-03-09T14:19:15.601 INFO:teuthology.orchestra.run.smithi046.stdout:(281/284): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-03-09T14:19:15.652 INFO:teuthology.orchestra.run.smithi046.stdout:(282/284): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-03-09T14:19:16.676 INFO:teuthology.orchestra.run.smithi046.stdout:(283/284): librbd1-19.0.0-2079.gc00d9c60.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-03-09T14:19:16.835 INFO:teuthology.orchestra.run.smithi046.stdout:(284/284): librados2-19.0.0-2079.gc00d9c60.el9. 2.7 MB/s | 3.4 MB 00:01 2024-03-09T14:19:16.843 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:19:16.843 INFO:teuthology.orchestra.run.smithi046.stdout:Total 13 MB/s | 297 MB 00:23 2024-03-09T14:19:17.240 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-03-09T14:19:17.419 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-03-09T14:19:17.419 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-03-09T14:19:20.054 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-03-09T14:19:20.054 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-03-09T14:19:25.200 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-09T14:19:25.366 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-09T14:19:25.529 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-03-09T14:19:25.631 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-09T14:19:25.669 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 2/286 2024-03-09T14:19:25.693 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/286 2024-03-09T14:19:25.733 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXi-1.7.10-8.el9.x86_64 4/286 2024-03-09T14:19:25.786 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-09T14:19:25.819 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-09T14:19:25.846 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-09T14:19:25.998 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-09T14:19:26.332 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-09T14:19:26.387 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:19:26.524 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:19:26.563 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:19:26.651 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:19:26.683 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:19:26.730 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-09T14:19:26.769 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-09T14:19:26.797 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-09T14:19:26.821 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-09T14:19:26.852 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/286 2024-03-09T14:19:26.878 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/286 2024-03-09T14:19:26.908 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 19/286 2024-03-09T14:19:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-09T14:19:27.145 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-09T14:19:27.181 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-09T14:19:27.217 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-09T14:19:27.245 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:19:27.332 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:19:27.355 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:19:27.409 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:19:27.434 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-09T14:19:27.457 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:19:27.472 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:19:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:19:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:19:27.827 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-09T14:19:27.930 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-09T14:19:27.964 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-09T14:19:27.989 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-09T14:19:28.026 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 33/286 2024-03-09T14:19:28.069 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/286 2024-03-09T14:19:28.104 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/286 2024-03-09T14:19:28.179 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 36/286 2024-03-09T14:19:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 37/286 2024-03-09T14:19:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 38/286 2024-03-09T14:19:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-15.el9.x86_64 39/286 2024-03-09T14:19:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 40/286 2024-03-09T14:19:28.436 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 41/286 2024-03-09T14:19:28.480 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 42/286 2024-03-09T14:19:28.507 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 43/286 2024-03-09T14:19:28.530 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-09T14:19:28.563 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-09T14:19:28.589 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-09T14:19:28.618 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-09T14:19:28.650 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-09T14:19:28.675 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-09T14:19:28.723 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-09T14:19:28.748 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:19:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:19:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 52/286 2024-03-09T14:19:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 53/286 2024-03-09T14:19:28.942 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 54/286 2024-03-09T14:19:29.016 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-09T14:19:29.159 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-09T14:19:29.211 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-09T14:19:29.747 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-09T14:19:29.833 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-09T14:19:29.867 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-09T14:19:29.873 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-03-09T14:19:29.930 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-09T14:19:29.965 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-09T14:19:30.002 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-09T14:19:30.031 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-09T14:19:30.045 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 1/1 2024-03-09T14:19:30.104 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-09T14:19:30.158 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-09T14:19:30.183 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-09T14:19:30.217 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-03-09T14:19:30.218 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-09T14:19:30.256 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 69/286 2024-03-09T14:19:30.287 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-09T14:19:30.321 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/286 2024-03-09T14:19:30.323 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-09T14:19:30.363 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-09T14:19:30.366 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : alsa-lib-1.2.10-2.el9.x86_64 2/286 2024-03-09T14:19:30.398 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/286 2024-03-09T14:19:30.422 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-09T14:19:30.429 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXi-1.7.10-8.el9.x86_64 4/286 2024-03-09T14:19:30.465 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-09T14:19:30.483 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/286 2024-03-09T14:19:30.501 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-09T14:19:30.517 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/286 2024-03-09T14:19:30.541 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/286 2024-03-09T14:19:30.557 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-09T14:19:30.591 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/286 2024-03-09T14:19:30.632 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-09T14:19:30.677 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-09T14:19:30.714 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-09T14:19:30.762 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-09T14:19:30.806 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-09T14:19:30.848 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-09T14:19:30.987 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-09T14:19:31.004 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/286 2024-03-09T14:19:31.033 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-09T14:19:31.042 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:19:31.075 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-09T14:19:31.166 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:19:31.170 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-09T14:19:31.193 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:19:31.208 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-09T14:19:31.248 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-09T14:19:31.290 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-09T14:19:31.290 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:19:31.314 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-09T14:19:31.322 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:19:31.366 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/286 2024-03-09T14:19:31.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/286 2024-03-09T14:19:31.404 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-09T14:19:31.415 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/286 2024-03-09T14:19:31.442 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/286 2024-03-09T14:19:31.473 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/286 2024-03-09T14:19:31.499 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/286 2024-03-09T14:19:31.534 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-09T14:19:31.535 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 19/286 2024-03-09T14:19:31.674 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/286 2024-03-09T14:19:31.713 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-09T14:19:31.794 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/286 2024-03-09T14:19:31.820 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : tzdata-java-2024a-1.el9.noarch 94/286 2024-03-09T14:19:31.832 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/286 2024-03-09T14:19:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 95/286 2024-03-09T14:19:31.870 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/286 2024-03-09T14:19:31.898 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:19:32.003 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:19:32.032 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:19:32.094 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 25/286 2024-03-09T14:19:32.122 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/286 2024-03-09T14:19:32.144 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:19:32.159 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 27/286 2024-03-09T14:19:32.319 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:19:32.352 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 28/286 2024-03-09T14:19:32.359 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-09T14:19:32.404 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : osinfo-db-20231215-1.el9.noarch 97/286 2024-03-09T14:19:32.439 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 98/286 2024-03-09T14:19:32.471 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 29/286 2024-03-09T14:19:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/286 2024-03-09T14:19:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/286 2024-03-09T14:19:32.570 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 30/286 2024-03-09T14:19:32.609 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 31/286 2024-03-09T14:19:32.634 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/286 2024-03-09T14:19:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : mesa-libglapi-23.3.3-1.el9.x86_64 33/286 2024-03-09T14:19:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/286 2024-03-09T14:19:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/286 2024-03-09T14:19:32.750 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/286 2024-03-09T14:19:32.793 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/286 2024-03-09T14:19:32.828 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cups-libs-1:2.3.3op2-24.el9.x86_64 36/286 2024-03-09T14:19:32.886 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 37/286 2024-03-09T14:19:32.926 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/286 2024-03-09T14:19:32.927 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 38/286 2024-03-09T14:19:32.966 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 39/286 2024-03-09T14:19:32.967 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 104/286 2024-03-09T14:19:33.001 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 105/286 2024-03-09T14:19:33.029 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 106/286 2024-03-09T14:19:33.051 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 40/286 2024-03-09T14:19:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 107/286 2024-03-09T14:19:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 108/286 2024-03-09T14:19:33.090 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 41/286 2024-03-09T14:19:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 109/286 2024-03-09T14:19:33.133 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 42/286 2024-03-09T14:19:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 110/286 2024-03-09T14:19:33.157 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 43/286 2024-03-09T14:19:33.166 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 111/286 2024-03-09T14:19:33.194 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 44/286 2024-03-09T14:19:33.199 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 112/286 2024-03-09T14:19:33.230 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 45/286 2024-03-09T14:19:33.231 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 113/286 2024-03-09T14:19:33.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 46/286 2024-03-09T14:19:33.261 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 114/286 2024-03-09T14:19:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 47/286 2024-03-09T14:19:33.346 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 48/286 2024-03-09T14:19:33.370 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 49/286 2024-03-09T14:19:33.403 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 50/286 2024-03-09T14:19:33.436 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:19:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 115/286 2024-03-09T14:19:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 116/286 2024-03-09T14:19:33.513 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:19:33.545 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 117/286 2024-03-09T14:19:33.552 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 52/286 2024-03-09T14:19:33.575 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 118/286 2024-03-09T14:19:33.596 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 53/286 2024-03-09T14:19:33.616 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 119/286 2024-03-09T14:19:33.637 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 54/286 2024-03-09T14:19:33.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:19:33.658 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:19:33.658 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-09T14:19:33.658 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:19:33.716 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/286 2024-03-09T14:19:33.733 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 121/286 2024-03-09T14:19:33.783 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 122/286 2024-03-09T14:19:33.809 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:19:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:19:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 124/286 2024-03-09T14:19:33.865 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/286 2024-03-09T14:19:33.925 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/286 2024-03-09T14:19:34.237 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:19:34.281 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:19:34.292 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:19:34.293 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-09T14:19:34.293 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:19:34.337 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 126/286 2024-03-09T14:19:34.414 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 127/286 2024-03-09T14:19:34.447 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 128/286 2024-03-09T14:19:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 129/286 2024-03-09T14:19:34.496 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/286 2024-03-09T14:19:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 130/286 2024-03-09T14:19:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 131/286 2024-03-09T14:19:34.580 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/286 2024-03-09T14:19:34.612 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 60/286 2024-03-09T14:19:34.647 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 132/286 2024-03-09T14:19:34.675 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 61/286 2024-03-09T14:19:34.711 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/286 2024-03-09T14:19:34.739 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/286 2024-03-09T14:19:34.744 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 133/286 2024-03-09T14:19:34.768 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/286 2024-03-09T14:19:34.788 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 134/286 2024-03-09T14:19:34.819 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 135/286 2024-03-09T14:19:34.844 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/286 2024-03-09T14:19:34.867 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 136/286 2024-03-09T14:19:34.879 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 66/286 2024-03-09T14:19:34.904 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/286 2024-03-09T14:19:34.940 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/286 2024-03-09T14:19:34.966 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 137/286 2024-03-09T14:19:34.978 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 69/286 2024-03-09T14:19:35.008 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/286 2024-03-09T14:19:35.021 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 138/286 2024-03-09T14:19:35.036 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/286 2024-03-09T14:19:35.074 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 72/286 2024-03-09T14:19:35.126 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/286 2024-03-09T14:19:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/286 2024-03-09T14:19:35.197 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/286 2024-03-09T14:19:35.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/286 2024-03-09T14:19:35.354 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/286 2024-03-09T14:19:35.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 78/286 2024-03-09T14:19:35.427 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 79/286 2024-03-09T14:19:35.475 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/286 2024-03-09T14:19:35.520 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/286 2024-03-09T14:19:35.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/286 2024-03-09T14:19:35.704 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/286 2024-03-09T14:19:35.746 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/286 2024-03-09T14:19:35.769 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 139/286 2024-03-09T14:19:35.788 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 85/286 2024-03-09T14:19:35.809 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 140/286 2024-03-09T14:19:35.843 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 141/286 2024-03-09T14:19:35.881 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 142/286 2024-03-09T14:19:35.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/286 2024-03-09T14:19:35.931 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 87/286 2024-03-09T14:19:35.971 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/286 2024-03-09T14:19:36.004 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/286 2024-03-09T14:19:36.029 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 90/286 2024-03-09T14:19:36.068 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 143/286 2024-03-09T14:19:36.104 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 144/286 2024-03-09T14:19:36.112 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/286 2024-03-09T14:19:36.144 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 145/286 2024-03-09T14:19:36.193 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 146/286 2024-03-09T14:19:36.240 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 147/286 2024-03-09T14:19:36.245 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/286 2024-03-09T14:19:36.274 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : orc-0.4.31-6.el9.x86_64 148/286 2024-03-09T14:19:36.306 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 149/286 2024-03-09T14:19:36.441 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/286 2024-03-09T14:19:36.483 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-09T14:19:36.513 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-09T14:19:36.554 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : tzdata-java-2024a-1.el9.noarch 94/286 2024-03-09T14:19:36.593 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 95/286 2024-03-09T14:19:36.599 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 152/286 2024-03-09T14:19:37.118 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ostree-libs-2024.4-3.el9.x86_64 96/286 2024-03-09T14:19:37.167 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : osinfo-db-20231215-1.el9.noarch 97/286 2024-03-09T14:19:37.202 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 98/286 2024-03-09T14:19:37.262 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 99/286 2024-03-09T14:19:37.263 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 153/286 2024-03-09T14:19:37.317 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 100/286 2024-03-09T14:19:37.371 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 154/286 2024-03-09T14:19:37.525 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 101/286 2024-03-09T14:19:37.573 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 102/286 2024-03-09T14:19:37.722 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 103/286 2024-03-09T14:19:37.771 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 104/286 2024-03-09T14:19:37.812 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 105/286 2024-03-09T14:19:37.849 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 106/286 2024-03-09T14:19:37.880 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 107/286 2024-03-09T14:19:37.909 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 108/286 2024-03-09T14:19:37.934 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : mesa-libgbm-23.3.3-1.el9.x86_64 109/286 2024-03-09T14:19:37.962 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 110/286 2024-03-09T14:19:37.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : mesa-libEGL-23.3.3-1.el9.x86_64 111/286 2024-03-09T14:19:38.012 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 112/286 2024-03-09T14:19:38.044 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 113/286 2024-03-09T14:19:38.066 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 114/286 2024-03-09T14:19:38.280 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 115/286 2024-03-09T14:19:38.325 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 116/286 2024-03-09T14:19:38.358 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 117/286 2024-03-09T14:19:38.388 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 118/286 2024-03-09T14:19:38.429 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 119/286 2024-03-09T14:19:38.458 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:19:38.469 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 120/286 2024-03-09T14:19:38.470 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-03-09T14:19:38.470 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:19:38.553 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 121/286 2024-03-09T14:19:38.605 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 122/286 2024-03-09T14:19:38.629 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:19:38.638 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 155/286 2024-03-09T14:19:38.653 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 123/286 2024-03-09T14:19:38.681 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 124/286 2024-03-09T14:19:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 156/286 2024-03-09T14:19:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 157/286 2024-03-09T14:19:38.824 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-16.el9.x86_64 158/286 2024-03-09T14:19:38.860 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-09T14:19:39.082 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:19:39.109 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:19:39.121 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 125/286 2024-03-09T14:19:39.121 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-03-09T14:19:39.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:19:39.157 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 126/286 2024-03-09T14:19:39.239 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 127/286 2024-03-09T14:19:39.276 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 128/286 2024-03-09T14:19:39.309 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 129/286 2024-03-09T14:19:39.352 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 130/286 2024-03-09T14:19:39.385 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 131/286 2024-03-09T14:19:39.481 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 132/286 2024-03-09T14:19:39.570 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 133/286 2024-03-09T14:19:39.617 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 134/286 2024-03-09T14:19:39.648 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 135/286 2024-03-09T14:19:39.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 136/286 2024-03-09T14:19:39.748 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-09T14:19:39.789 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:19:39.810 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 137/286 2024-03-09T14:19:39.860 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 138/286 2024-03-09T14:19:40.138 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:19:40.179 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-09T14:19:40.209 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-09T14:19:40.237 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-09T14:19:40.272 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-09T14:19:40.308 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-09T14:19:40.336 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-09T14:19:40.362 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-09T14:19:40.388 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-09T14:19:40.412 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-09T14:19:40.438 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-09T14:19:40.464 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-09T14:19:40.491 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-09T14:19:40.522 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-09T14:19:40.549 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-09T14:19:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-09T14:19:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-09T14:19:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-09T14:19:40.648 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 139/286 2024-03-09T14:19:40.677 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-09T14:19:40.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 140/286 2024-03-09T14:19:40.711 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-09T14:19:40.731 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 141/286 2024-03-09T14:19:40.748 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-09T14:19:40.765 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 142/286 2024-03-09T14:19:40.786 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-09T14:19:40.820 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-09T14:19:40.865 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-09T14:19:40.896 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-09T14:19:40.919 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-09T14:19:40.962 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 143/286 2024-03-09T14:19:40.972 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-09T14:19:41.000 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 144/286 2024-03-09T14:19:41.014 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-09T14:19:41.041 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 145/286 2024-03-09T14:19:41.044 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:19:41.055 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:19:41.056 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-09T14:19:41.056 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:19:41.091 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 146/286 2024-03-09T14:19:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-09T14:19:41.127 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 147/286 2024-03-09T14:19:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-09T14:19:41.161 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : orc-0.4.31-6.el9.x86_64 148/286 2024-03-09T14:19:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-09T14:19:41.194 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 149/286 2024-03-09T14:19:41.376 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 150/286 2024-03-09T14:19:41.400 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 151/286 2024-03-09T14:19:41.472 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 152/286 2024-03-09T14:19:41.489 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-09T14:19:41.515 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:19:41.605 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:19:41.638 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 195/286 2024-03-09T14:19:41.667 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-09T14:19:42.040 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:19:42.071 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:19:42.089 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:19:42.121 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-09T14:19:42.155 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 153/286 2024-03-09T14:19:42.182 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-09T14:19:42.213 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-09T14:19:42.237 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-09T14:19:42.278 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 154/286 2024-03-09T14:19:42.279 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-09T14:19:42.302 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:19:42.598 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:19:42.637 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-09T14:19:42.665 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-09T14:19:42.691 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-09T14:19:42.719 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-09T14:19:42.752 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-09T14:19:42.776 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-09T14:19:42.801 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-09T14:19:42.826 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-09T14:19:42.854 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-09T14:19:42.883 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-09T14:19:42.966 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-09T14:19:43.191 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-09T14:19:43.330 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-09T14:19:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-09T14:19:43.604 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 155/286 2024-03-09T14:19:43.695 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 156/286 2024-03-09T14:19:43.724 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 157/286 2024-03-09T14:19:43.770 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 158/286 2024-03-09T14:19:43.806 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-posix-35.0-8.el9.x86_64 159/286 2024-03-09T14:19:43.988 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-09T14:19:44.114 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-09T14:19:44.172 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-09T14:19:44.197 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-09T14:19:44.226 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-09T14:19:44.299 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-09T14:19:44.343 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-09T14:19:44.368 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:19:44.387 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:19:44.496 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-09T14:19:44.542 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-09T14:19:44.568 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-09T14:19:44.599 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-09T14:19:44.623 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:19:44.729 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 160/286 2024-03-09T14:19:44.768 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:19:45.136 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 161/286 2024-03-09T14:19:45.167 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 162/286 2024-03-09T14:19:45.197 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : slf4j-1.7.30-13.el9.noarch 163/286 2024-03-09T14:19:45.224 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : atinject-1.0.3-6.el9.noarch 164/286 2024-03-09T14:19:45.259 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 165/286 2024-03-09T14:19:45.297 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 166/286 2024-03-09T14:19:45.315 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 167/286 2024-03-09T14:19:45.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 168/286 2024-03-09T14:19:45.369 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 169/286 2024-03-09T14:19:45.391 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 170/286 2024-03-09T14:19:45.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 171/286 2024-03-09T14:19:45.443 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 172/286 2024-03-09T14:19:45.470 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 173/286 2024-03-09T14:19:45.501 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 174/286 2024-03-09T14:19:45.530 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 175/286 2024-03-09T14:19:45.555 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 176/286 2024-03-09T14:19:45.591 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 177/286 2024-03-09T14:19:45.622 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 178/286 2024-03-09T14:19:45.656 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 179/286 2024-03-09T14:19:45.690 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jansi-2.3.3-6.el9.x86_64 180/286 2024-03-09T14:19:45.718 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jsoup-1.13.1-10.el9.noarch 181/286 2024-03-09T14:19:45.758 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 182/286 2024-03-09T14:19:45.800 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 183/286 2024-03-09T14:19:45.843 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 184/286 2024-03-09T14:19:45.875 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : guava-30.1-6.el9.noarch 185/286 2024-03-09T14:19:45.898 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : google-guice-4.2.3-9.el9.noarch 186/286 2024-03-09T14:19:45.953 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 187/286 2024-03-09T14:19:45.985 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 188/286 2024-03-09T14:19:46.017 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:19:46.027 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 189/286 2024-03-09T14:19:46.028 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-03-09T14:19:46.028 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:19:46.086 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 190/286 2024-03-09T14:19:46.110 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 191/286 2024-03-09T14:19:46.130 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libsbc-1.4-9.el9.x86_64 192/286 2024-03-09T14:19:46.450 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 193/286 2024-03-09T14:19:46.485 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:19:46.577 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 194/286 2024-03-09T14:19:46.609 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 195/286 2024-03-09T14:19:46.638 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 196/286 2024-03-09T14:19:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:19:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:19:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 197/286 2024-03-09T14:19:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 198/286 2024-03-09T14:19:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 199/286 2024-03-09T14:19:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 200/286 2024-03-09T14:19:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 201/286 2024-03-09T14:19:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 202/286 2024-03-09T14:19:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:19:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 203/286 2024-03-09T14:19:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libexif-0.6.22-6.el9.x86_64 204/286 2024-03-09T14:19:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 205/286 2024-03-09T14:19:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libasyncns-0.8-22.el9.x86_64 206/286 2024-03-09T14:19:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 207/286 2024-03-09T14:19:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 208/286 2024-03-09T14:19:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : mesa-libGL-23.3.3-1.el9.x86_64 209/286 2024-03-09T14:19:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXv-1.0.11-16.el9.x86_64 210/286 2024-03-09T14:19:48.373 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 211/286 2024-03-09T14:19:48.401 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 212/286 2024-03-09T14:19:48.442 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 213/286 2024-03-09T14:19:48.488 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtiff-4.4.0-12.el9.x86_64 214/286 2024-03-09T14:19:48.521 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 215/286 2024-03-09T14:19:48.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 216/286 2024-03-09T14:19:48.604 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : poppler-21.01.0-19.el9.x86_64 217/286 2024-03-09T14:19:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 218/286 2024-03-09T14:19:49.234 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 219/286 2024-03-09T14:19:49.284 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 220/286 2024-03-09T14:19:49.310 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 221/286 2024-03-09T14:19:49.338 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gsm-1.0.19-6.el9.x86_64 222/286 2024-03-09T14:19:49.414 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 223/286 2024-03-09T14:19:49.454 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 224/286 2024-03-09T14:19:49.478 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:19:49.496 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 225/286 2024-03-09T14:19:49.619 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : graphene-1.10.6-2.el9.x86_64 226/286 2024-03-09T14:19:49.662 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 227/286 2024-03-09T14:19:49.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : giflib-5.2.1-9.el9.x86_64 228/286 2024-03-09T14:19:49.739 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 229/286 2024-03-09T14:19:49.762 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:19:57.435 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:19:57.492 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-09T14:19:57.554 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 232/286 2024-03-09T14:19:57.588 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 233/286 2024-03-09T14:19:57.989 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:19:58.029 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:19:58.042 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:19:58.042 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-09T14:19:58.042 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:19:58.312 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 235/286 2024-03-09T14:19:58.342 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:19:58.364 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:19:58.876 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:19:58.917 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:19:58.954 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-09T14:19:59.001 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-09T14:19:59.068 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-09T14:19:59.098 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:19:59.203 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:19:59.253 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:19:59.268 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:19:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-09T14:19:59.782 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:19:59.813 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:19:59.885 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:19:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 246/286 2024-03-09T14:20:02.182 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:20:02.212 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:20:02.755 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:20:02.799 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:20:02.889 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:20:02.889 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-09T14:20:02.889 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-09T14:20:02.889 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:02.917 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:20:02.929 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 230/286 2024-03-09T14:20:03.000 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 231/286 2024-03-09T14:20:03.069 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 232/286 2024-03-09T14:20:03.100 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 233/286 2024-03-09T14:20:03.533 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:20:03.564 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:20:03.579 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 234/286 2024-03-09T14:20:03.579 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-03-09T14:20:03.580 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:03.843 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 235/286 2024-03-09T14:20:03.880 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:20:03.900 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 236/286 2024-03-09T14:20:04.325 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:20:04.363 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 237/286 2024-03-09T14:20:04.400 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 238/286 2024-03-09T14:20:04.458 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 239/286 2024-03-09T14:20:04.524 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 240/286 2024-03-09T14:20:04.561 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:20:04.677 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 241/286 2024-03-09T14:20:04.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:20:04.747 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 242/286 2024-03-09T14:20:04.798 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 243/286 2024-03-09T14:20:05.294 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:20:05.326 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:20:05.390 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 245/286 2024-03-09T14:20:05.420 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 246/286 2024-03-09T14:20:07.741 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:20:07.775 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:20:08.339 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 247/286 2024-03-09T14:20:08.387 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:20:08.474 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 248/286 2024-03-09T14:20:08.474 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-09T14:20:08.474 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-09T14:20:08.474 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:08.504 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:20:12.261 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-03-09T14:20:12.262 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:12.433 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:20:12.449 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:20:12.449 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:12.449 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-09T14:20:12.449 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:13.884 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:20:13.910 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:20:13.910 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:13.910 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-09T14:20:13.910 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:20:13.910 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:20:13.910 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:14.121 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:20:14.141 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:20:14.141 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:14.142 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-09T14:20:14.142 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:20:14.142 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:20:14.142 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:14.585 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:20:14.608 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:20:14.608 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:14.608 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-09T14:20:14.608 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:20:14.609 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:20:14.609 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:17.498 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-09T14:20:17.587 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-09T14:20:17.630 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-09T14:20:17.658 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:20:17.848 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:20:17.899 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-09T14:20:17.923 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:20:17.990 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:20:18.026 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:20:18.036 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:20:18.068 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:20:18.095 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:20:18.119 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-09T14:20:18.290 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 249/286 2024-03-09T14:20:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-03-09T14:20:18.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:18.455 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:20:18.469 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 250/286 2024-03-09T14:20:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-09T14:20:18.470 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:18.503 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:20:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:20:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 264/286 2024-03-09T14:20:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 265/286 2024-03-09T14:20:18.674 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:20:18.911 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:20:18.941 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:20:19.910 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:20:19.934 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:20:19.989 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:20:20.014 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 251/286 2024-03-09T14:20:20.014 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:20.014 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-09T14:20:20.014 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:20:20.014 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-09T14:20:20.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:20.035 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:20:20.204 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 269/286 2024-03-09T14:20:20.231 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:20:20.253 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 252/286 2024-03-09T14:20:20.253 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:20.253 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-09T14:20:20.253 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:20:20.254 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-09T14:20:20.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:20.260 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:20:20.283 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:20:20.283 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:20.283 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-09T14:20:20.284 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:20:20.284 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:20:20.284 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:20.339 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:20:20.347 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:20:20.715 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:20:20.737 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 253/286 2024-03-09T14:20:20.738 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:20.738 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-09T14:20:20.738 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:20:20.738 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-09T14:20:20.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:21.241 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 272/286 2024-03-09T14:20:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:20:21.293 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:20:21.293 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:21.293 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-09T14:20:21.294 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:20:21.294 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:20:21.294 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:21.338 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:20:21.360 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:20:21.360 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:21.360 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-09T14:20:21.360 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:21.655 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:20:21.678 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:20:21.678 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:21.678 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-09T14:20:21.678 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:20:21.678 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:20:21.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:23.862 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 254/286 2024-03-09T14:20:23.951 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 255/286 2024-03-09T14:20:23.996 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 256/286 2024-03-09T14:20:24.022 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:20:24.208 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 257/286 2024-03-09T14:20:24.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 258/286 2024-03-09T14:20:24.278 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:20:24.345 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 259/286 2024-03-09T14:20:24.381 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:20:24.391 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 260/286 2024-03-09T14:20:24.415 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:20:24.436 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 261/286 2024-03-09T14:20:24.466 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 262/286 2024-03-09T14:20:24.933 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:20:24.963 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 263/286 2024-03-09T14:20:24.997 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 264/286 2024-03-09T14:20:25.059 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 265/286 2024-03-09T14:20:25.087 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:20:25.332 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 266/286 2024-03-09T14:20:25.363 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:20:26.152 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 276/286 2024-03-09T14:20:26.180 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-09T14:20:26.229 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-09T14:20:26.252 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:20:26.267 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:20:26.267 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-09T14:20:26.267 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:26.319 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 280/286 2024-03-09T14:20:26.350 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 281/286 2024-03-09T14:20:26.387 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 267/286 2024-03-09T14:20:26.413 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:20:26.446 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 282/286 2024-03-09T14:20:26.501 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:20:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 268/286 2024-03-09T14:20:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-09T14:20:26.533 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:20:26.625 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:20:26.625 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:26.692 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 269/286 2024-03-09T14:20:26.723 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:20:26.725 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:26.742 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-09T14:20:26.745 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 270/286 2024-03-09T14:20:26.745 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:26.746 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-09T14:20:26.746 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:20:26.746 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-09T14:20:26.746 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:26.748 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-09T14:20:26.756 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-09T14:20:26.765 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-09T14:20:26.766 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:20:26.766 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:20:26.766 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:26.791 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:20:26.801 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 271/286 2024-03-09T14:20:26.837 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-09T14:20:26.905 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-09T14:20:27.739 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 272/286 2024-03-09T14:20:27.767 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:20:27.789 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 273/286 2024-03-09T14:20:27.789 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:27.790 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-09T14:20:27.790 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:20:27.790 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:20:27.790 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:27.834 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:20:27.856 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 274/286 2024-03-09T14:20:27.856 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:27.856 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-09T14:20:27.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:28.210 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:20:28.232 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 275/286 2024-03-09T14:20:28.233 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-09T14:20:28.233 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-09T14:20:28.233 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:20:28.233 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-09T14:20:28.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:32.990 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 276/286 2024-03-09T14:20:33.019 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 277/286 2024-03-09T14:20:33.068 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 278/286 2024-03-09T14:20:33.107 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:20:33.121 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 279/286 2024-03-09T14:20:33.121 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-03-09T14:20:33.122 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:33.174 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 280/286 2024-03-09T14:20:33.205 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 281/286 2024-03-09T14:20:33.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 282/286 2024-03-09T14:20:33.375 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:20:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 284/286 2024-03-09T14:20:33.405 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:20:33.452 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:33.452 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 1/286 2024-03-09T14:20:33.452 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2/286 2024-03-09T14:20:33.452 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 3/286 2024-03-09T14:20:33.452 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 4/286 2024-03-09T14:20:33.452 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 5/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 6/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 7/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 8/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 9/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 13/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 14/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 15/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 16/286 2024-03-09T14:20:33.453 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 17/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 18/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 19/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 20/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 21/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 22/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 23/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 25/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 26/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 27/286 2024-03-09T14:20:33.454 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 28/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 29/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 30/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 31/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 32/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 33/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 34/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 35/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 36/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-09T14:20:33.455 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 39/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 40/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 41/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 42/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 43/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 44/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : atinject-1.0.3-6.el9.noarch 45/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : atk-2.36.0-5.el9.x86_64 46/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 47/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 48/286 2024-03-09T14:20:33.456 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 49/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 50/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 52/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 53/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 54/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 55/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 56/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 57/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 58/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 59/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 60/286 2024-03-09T14:20:33.457 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 62/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 63/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 64/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 65/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 66/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 67/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 68/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 69/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 70/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : guava-30.1-6.el9.noarch 71/286 2024-03-09T14:20:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 72/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 73/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 74/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 75/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 76/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 77/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 78/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 79/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 80/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 81/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 82/286 2024-03-09T14:20:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 83/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 84/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 85/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lcms2-2.12-3.el9.x86_64 86/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 87/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 88/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 89/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 90/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 91/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 92/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 93/286 2024-03-09T14:20:33.460 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 94/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 95/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 96/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 97/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 98/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 99/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 100/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 101/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 102/286 2024-03-09T14:20:33.461 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 103/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 104/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 105/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 106/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 107/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 108/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 109/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 110/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 111/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 112/286 2024-03-09T14:20:33.462 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 113/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 114/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 115/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 116/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 117/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsbc-1.4-9.el9.x86_64 118/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 119/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 120/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 121/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 122/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 123/286 2024-03-09T14:20:33.463 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 124/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 125/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 126/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 127/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 128/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 129/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 130/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 131/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 132/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 133/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 134/286 2024-03-09T14:20:33.464 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 135/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 136/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 137/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 138/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 139/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 140/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 141/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 142/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 143/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 144/286 2024-03-09T14:20:33.465 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 145/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : opus-1.3.1-10.el9.x86_64 146/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : orc-0.4.31-6.el9.x86_64 147/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 148/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 149/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 150/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 151/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 152/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 153/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 154/286 2024-03-09T14:20:33.466 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 155/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 156/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 157/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 158/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 159/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 160/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 161/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 162/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 163/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 164/286 2024-03-09T14:20:33.467 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 165/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 166/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 167/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 168/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 169/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 170/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 171/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 172/286 2024-03-09T14:20:33.468 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 173/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 174/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 175/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 176/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rtkit-0.11-28.el9.x86_64 177/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 178/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 179/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 180/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 181/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 182/286 2024-03-09T14:20:33.469 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 183/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 184/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 185/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : upower-0.99.11-11.el9.x86_64 186/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 187/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 188/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 189/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 190/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 191/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 192/286 2024-03-09T14:20:33.470 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 193/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 194/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 195/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 196/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 197/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 198/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 199/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 200/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 201/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 202/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 203/286 2024-03-09T14:20:33.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 204/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 205/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 206/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-16.el9.x86_64 207/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 208/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 209/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 210/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 211/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 212/286 2024-03-09T14:20:33.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 213/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 214/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 215/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 216/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 217/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 218/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 219/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 220/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 221/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 222/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 223/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 224/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 225/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 226/286 2024-03-09T14:20:33.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 227/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 228/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 229/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 230/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 231/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 232/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 233/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 234/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 235/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 236/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 237/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 238/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-09T14:20:33.474 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-09T14:20:33.475 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-09T14:20:33.476 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:20:33.477 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-09T14:20:33.478 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 285/286 2024-03-09T14:20:33.497 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 285/286 2024-03-09T14:20:33.497 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:33.579 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:33.605 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 286/286 2024-03-09T14:20:33.610 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 286/286 2024-03-09T14:20:33.618 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 286/286 2024-03-09T14:20:33.627 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 286/286 2024-03-09T14:20:33.627 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:20:33.627 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-03-09T14:20:33.627 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:33.675 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 286/286 2024-03-09T14:20:33.746 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 286/286 2024-03-09T14:20:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-09T14:20:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-09T14:20:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-09T14:20:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-09T14:20:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-09T14:20:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-09T14:20:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: atinject-1.0.3-6.el9.noarch 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: atk-2.36.0-5.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-09T14:20:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-09T14:20:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: guava-30.1-6.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:20:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: jq-1.6-16.el9.x86_64 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: lcms2-2.12-3.el9.x86_64 2024-03-09T14:20:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-09T14:20:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-09T14:20:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libsbc-1.4-9.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-09T14:20:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-09T14:20:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-09T14:20:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: opus-1.3.1-10.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: orc-0.4.31-6.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-09T14:20:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-09T14:20:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-09T14:20:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-09T14:20:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-09T14:20:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-09T14:20:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-3.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: rtkit-0.11-28.el9.x86_64 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-09T14:20:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: upower-0.99.11-11.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-09T14:20:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-09T14:20:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-09T14:20:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-09T14:20:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-09T14:20:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-09T14:20:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-09T14:20:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-09T14:20:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:36.981 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-03-09T14:20:37.404 DEBUG:teuthology.parallel:result is None 2024-03-09T14:20:40.164 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:40.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 1/286 2024-03-09T14:20:40.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2/286 2024-03-09T14:20:40.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 3/286 2024-03-09T14:20:40.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 4/286 2024-03-09T14:20:40.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2079.gc00d9 5/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 6/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 7/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 8/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 9/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 10/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 11/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 12/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_ 13/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 14/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 15/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_6 16/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86 17/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 18/286 2024-03-09T14:20:40.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el 19/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9. 20/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_6 21/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 22/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 23/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 24/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 25/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 26/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 27/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60. 28/286 2024-03-09T14:20:40.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noa 29/286 2024-03-09T14:20:40.188 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.n 30/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00 31/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el 32/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 33/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.e 34/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 35/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 36/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 37/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 38/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 39/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 40/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 41/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 42/286 2024-03-09T14:20:40.189 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 43/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 44/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : atinject-1.0.3-6.el9.noarch 45/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : atk-2.36.0-5.el9.x86_64 46/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 47/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 48/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 49/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 50/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 51/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 52/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 53/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 54/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 55/286 2024-03-09T14:20:40.190 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 56/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 57/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 58/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 59/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 60/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 62/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 63/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 64/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 65/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 66/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 67/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 68/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 69/286 2024-03-09T14:20:40.191 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 70/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : guava-30.1-6.el9.noarch 71/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 72/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 73/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 74/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 75/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 76/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 77/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 78/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_6 79/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x8 80/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 81/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 82/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 83/286 2024-03-09T14:20:40.192 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 84/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 85/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lcms2-2.12-3.el9.x86_64 86/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 87/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 88/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 89/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 90/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 91/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 92/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 93/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 94/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 95/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 96/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 97/286 2024-03-09T14:20:40.193 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 98/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 99/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 100/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 101/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 102/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 103/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 104/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 105/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 106/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 107/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 108/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 109/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 110/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 111/286 2024-03-09T14:20:40.194 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 112/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 113/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 114/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 115/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 116/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 117/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsbc-1.4-9.el9.x86_64 118/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 119/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 120/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 121/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 122/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 123/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 124/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 125/286 2024-03-09T14:20:40.195 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 126/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 127/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 128/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 129/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 130/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 131/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 132/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 133/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 134/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 135/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 136/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 137/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 138/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 139/286 2024-03-09T14:20:40.196 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 140/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 141/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 142/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 143/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 144/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 145/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : opus-1.3.1-10.el9.x86_64 146/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : orc-0.4.31-6.el9.x86_64 147/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 148/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 149/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 150/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 151/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 152/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 153/286 2024-03-09T14:20:40.197 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 154/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 155/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 156/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 157/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 158/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 159/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 160/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 161/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 162/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 163/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 164/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 165/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 166/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 167/286 2024-03-09T14:20:40.198 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 168/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 169/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 170/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 171/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 172/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 173/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 174/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 175/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 176/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rtkit-0.11-28.el9.x86_64 177/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 178/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 179/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 180/286 2024-03-09T14:20:40.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 181/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 182/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 183/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 184/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 185/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : upower-0.99.11-11.el9.x86_64 186/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 187/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 188/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 189/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 190/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 191/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 192/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 193/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 194/286 2024-03-09T14:20:40.200 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 195/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 196/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 197/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 198/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 199/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 200/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 201/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 202/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 203/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 204/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 205/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cups-libs-1:2.3.3op2-24.el9.x86_64 206/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 207/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 208/286 2024-03-09T14:20:40.201 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 209/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 210/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : alsa-lib-1.2.10-2.el9.x86_64 211/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 212/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 213/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 214/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 215/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 216/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtiff-4.4.0-12.el9.x86_64 217/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : mesa-libEGL-23.3.3-1.el9.x86_64 218/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : mesa-libGL-23.3.3-1.el9.x86_64 219/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : mesa-libgbm-23.3.3-1.el9.x86_64 220/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : mesa-libglapi-23.3.3-1.el9.x86_64 221/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : osinfo-db-20231215-1.el9.noarch 222/286 2024-03-09T14:20:40.202 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ostree-libs-2024.4-3.el9.x86_64 223/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 224/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 225/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 226/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 227/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 228/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 229/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 230/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 231/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 232/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 233/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 234/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 235/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 236/286 2024-03-09T14:20:40.203 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : tzdata-java-2024a-1.el9.noarch 237/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 238/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 239/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 240/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 241/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 242/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 243/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 244/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 245/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 246/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 247/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 248/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 249/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 250/286 2024-03-09T14:20:40.204 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 251/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 252/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 253/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 254/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 255/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 256/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 257/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 258/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 259/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 260/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 261/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 262/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 263/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 264/286 2024-03-09T14:20:40.205 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 265/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 266/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 267/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 268/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 269/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 270/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 271/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 272/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 273/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 274/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 275/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 276/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 277/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 278/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 279/286 2024-03-09T14:20:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 280/286 2024-03-09T14:20:40.207 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 281/286 2024-03-09T14:20:40.207 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 282/286 2024-03-09T14:20:40.207 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 283/286 2024-03-09T14:20:40.207 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 284/286 2024-03-09T14:20:40.207 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 285/286 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 286/286 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-03-09T14:20:44.058 INFO:teuthology.orchestra.run.smithi046.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: alsa-lib-1.2.10-2.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: atinject-1.0.3-6.el9.noarch 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: atk-2.36.0-5.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: avahi-glib-0.8-12.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: bluez-libs-5.64-1.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-09T14:20:44.059 INFO:teuthology.orchestra.run.smithi046.stdout: bubblewrap-0.4.1-6.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: cdi-api-2.0.2-6.el9.noarch 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.060 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-2079.gc00d9c60.el9.noarch 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: cups-libs-1:2.3.3op2-24.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: dconf-0.40.0-6.el9.x86_64 2024-03-09T14:20:44.061 INFO:teuthology.orchestra.run.smithi046.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: exiv2-0.27.5-2.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flatpak-1.12.8-1.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2024-03-09T14:20:44.062 INFO:teuthology.orchestra.run.smithi046.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: giflib-5.2.1-9.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: google-guice-4.2.3-9.el9.noarch 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: graphene-1.10.6-2.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: gsm-1.0.19-6.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: gtk3-3.24.31-2.el9.x86_64 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: guava-30.1-6.el9.noarch 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-03-09T14:20:44.063 INFO:teuthology.orchestra.run.smithi046.stdout: iso-codes-4.6.0-3.el9.noarch 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jansi-2.3.3-6.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: java-11-openjdk-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: java-11-openjdk-devel-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: java-11-openjdk-headless-1:11.0.18.0.10-3.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-16.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jsoup-1.13.1-10.el9.noarch 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: jsr-305-3.0.2-6.el9.noarch 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: lcms2-2.12-3.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2024-03-09T14:20:44.064 INFO:teuthology.orchestra.run.smithi046.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXi-1.7.10-8.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXtst-1.2.3-16.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXv-1.0.11-16.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libasyncns-0.8-22.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libcanberra-0.30-27.el9.x86_64 2024-03-09T14:20:44.065 INFO:teuthology.orchestra.run.smithi046.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libdrm-2.4.117-1.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libexif-0.6.22-6.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-03-09T14:20:44.066 INFO:teuthology.orchestra.run.smithi046.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libgsf-1.14.47-5.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libgxps-0.3.2-3.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libiptcdata-1.0.5-9.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libnotify-0.7.9-8.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-03-09T14:20:44.067 INFO:teuthology.orchestra.run.smithi046.stdout: libpciaccess-0.16-6.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libsbc-1.4-9.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libtiff-4.4.0-12.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-03-09T14:20:44.068 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libwebp-1.2.0-8.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: libxshmfence-1.3-10.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-03-09T14:20:44.069 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: lua-posix-35.0-8.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: maven-1:3.6.3-15.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libEGL-23.3.3-1.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libGL-23.3.3-1.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libgbm-23.3.3-1.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: mesa-libglapi-23.3.3-1.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-03-09T14:20:44.070 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: opus-1.3.1-10.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: orc-0.4.31-6.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: osinfo-db-20231215-1.el9.noarch 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: ostree-libs-2024.4-3.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-1.0.1-1.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-03-09T14:20:44.071 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-cipher-1.7-27.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: poppler-21.01.0-19.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: poppler-data-0.4.9-9.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: poppler-glib-21.01.0-19.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-03-09T14:20:44.072 INFO:teuthology.orchestra.run.smithi046.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-09T14:20:44.073 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-09T14:20:44.074 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-09T14:20:44.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-09T14:20:44.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.077 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-2079.gc00d9c60.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: rtkit-0.11-28.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: s3cmd-2.4.0-1.el9.noarch 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: sisu-1:0.3.4-10.el9.noarch 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: slf4j-1.7.30-13.el9.noarch 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: tracker-3.1.2-3.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-03-09T14:20:44.078 INFO:teuthology.orchestra.run.smithi046.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: tzdata-java-2024a-1.el9.noarch 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: upower-0.99.11-11.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-03-09T14:20:44.079 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-09T14:20:44.080 INFO:teuthology.orchestra.run.smithi046.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-03-09T14:20:44.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:44.080 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-03-09T14:20:44.522 DEBUG:teuthology.parallel:result is None 2024-03-09T14:20:44.522 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:20:44.743 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-09T14:20:44.844 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-2079.gc00d9c60.el9 2024-03-09T14:20:44.845 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2079.gc00d9c60.el9 2024-03-09T14:20:44.845 INFO:teuthology.task.install:The correct ceph version 19.0.0-2079.gc00d9c60 is installed. 2024-03-09T14:20:44.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:20:44.995 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-09T14:20:45.110 INFO:teuthology.orchestra.run.smithi159.stdout:19.0.0-2079.gc00d9c60.el9 2024-03-09T14:20:45.111 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2079.gc00d9c60.el9 2024-03-09T14:20:45.111 INFO:teuthology.task.install:The correct ceph version 19.0.0-2079.gc00d9c60 is installed. 2024-03-09T14:20:45.112 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-09T14:20:45.113 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:45.113 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-09T14:20:45.158 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:45.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-09T14:20:45.206 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-09T14:20:45.206 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:45.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-03-09T14:20:45.246 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-09T14:20:45.325 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:45.325 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-03-09T14:20:45.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-09T14:20:45.450 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-09T14:20:45.451 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:45.451 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-09T14:20:45.490 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-09T14:20:45.570 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:45.570 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-09T14:20:45.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-09T14:20:45.691 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-09T14:20:45.692 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:45.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-03-09T14:20:45.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-09T14:20:45.813 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:45.813 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-03-09T14:20:45.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-09T14:20:45.934 INFO:teuthology.run_tasks:Running task ceph... 2024-03-09T14:20:46.024 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-09T14:20:46.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-03-09T14:20:46.026 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2024-03-09T14:20:46.065 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-09T14:20:46.065 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-09T14:20:46.106 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-09T14:20:46.146 INFO:tasks.ceph:Creating extra log directories... 2024-03-09T14:20:46.146 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-09T14:20:46.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-09T14:20:46.236 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-09T14:20:46.236 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-09T14:20:46.236 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470', 'branch': 'wip-rgw-account-v3', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7588470', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-account-v3'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'wip-iam-user-apis', 'git_remote': 'https://github.com/cbodley/', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-account-v3', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3347, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-account-v3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrb6FTGJtDvBDWaeFF1C3SQqO9EKUCouJTkcJ9+56Y6H/XYPLqkVR4R0B3BEikUo6hCvhO/xEF22R960rgmtf0=', 'smithi159.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORt1zEJxAmg3WQdBX57TaeAzDsYGXN2P4AN6ZmxH+bEcJC24GUG3feFvTF8Zl1SRljfJIdrvg4g+Ii8y/XB1yg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-09_13:26:09', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-09T14:20:46.237 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-09T14:20:46.264 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-09T14:20:46.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-03-09T14:20:46.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2024-03-09T14:20:46.373 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:46.373 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-03-09T14:20:46.435 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-09T14:20:46.435 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 799 Links: 1 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-09 14:20:34.598484584 +0000 2024-03-09T14:20:46.502 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-09 14:18:08.008560390 +0000 2024-03-09T14:20:46.503 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-09 14:18:08.008560390 +0000 2024-03-09T14:20:46.503 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-09 14:18:08.008560390 +0000 2024-03-09T14:20:46.503 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-09T14:20:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-09T14:20:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-09T14:20:46.579 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 8.2945e-05 s, 6.2 MB/s 2024-03-09T14:20:46.580 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-09T14:20:46.648 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 817 Links: 1 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-09 14:20:34.598484584 +0000 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-09 14:18:08.345557188 +0000 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-09 14:18:08.345557188 +0000 2024-03-09T14:20:46.715 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-09 14:18:08.345557188 +0000 2024-03-09T14:20:46.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-09T14:20:46.792 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-09T14:20:46.793 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-09T14:20:46.793 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.4429e-05 s, 5.4 MB/s 2024-03-09T14:20:46.794 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-09T14:20:46.861 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-03-09T14:20:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-09T14:20:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:46.927 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 838 Links: 1 2024-03-09T14:20:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-09 14:20:34.599484574 +0000 2024-03-09T14:20:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-09 14:18:08.687553939 +0000 2024-03-09T14:20:46.928 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-09 14:18:08.687553939 +0000 2024-03-09T14:20:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-09 14:18:08.687553939 +0000 2024-03-09T14:20:46.928 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-09T14:20:47.005 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-09T14:20:47.005 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-09T14:20:47.005 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.5089e-05 s, 5.4 MB/s 2024-03-09T14:20:47.006 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-09T14:20:47.073 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 857 Links: 1 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-03-09 14:20:34.599484574 +0000 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-03-09 14:18:09.035550632 +0000 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-03-09 14:18:09.035550632 +0000 2024-03-09T14:20:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-03-09 14:18:09.035550632 +0000 2024-03-09T14:20:47.141 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-09T14:20:47.218 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-03-09T14:20:47.218 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-03-09T14:20:47.218 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 7.4885e-05 s, 6.8 MB/s 2024-03-09T14:20:47.219 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-09T14:20:47.286 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:20:47.286 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:47.286 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-03-09T14:20:47.320 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-09T14:20:47.320 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-03-09T14:20:47.390 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-09 14:20:27.820115295 +0000 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-09 14:17:59.305042392 +0000 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-09 14:17:59.305042392 +0000 2024-03-09T14:20:47.391 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-09 14:17:59.305042392 +0000 2024-03-09T14:20:47.391 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-09T14:20:47.473 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-09T14:20:47.474 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-09T14:20:47.474 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000209293 s, 2.4 MB/s 2024-03-09T14:20:47.475 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-09T14:20:47.545 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-09 14:20:27.820115295 +0000 2024-03-09T14:20:47.615 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-09 14:17:59.648036271 +0000 2024-03-09T14:20:47.616 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-09 14:17:59.648036271 +0000 2024-03-09T14:20:47.616 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-09 14:17:59.648036271 +0000 2024-03-09T14:20:47.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-09T14:20:47.693 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-09T14:20:47.693 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-09T14:20:47.693 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000225586 s, 2.3 MB/s 2024-03-09T14:20:47.694 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-09T14:20:47.763 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-03-09T14:20:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-09T14:20:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:47.829 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-09T14:20:47.830 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:47.830 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:47.830 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-09 14:20:27.821115278 +0000 2024-03-09T14:20:47.830 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-09 14:18:00.000029989 +0000 2024-03-09T14:20:47.830 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-09 14:18:00.000029989 +0000 2024-03-09T14:20:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-09 14:18:00.000029989 +0000 2024-03-09T14:20:47.830 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-09T14:20:47.907 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-09T14:20:47.908 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-09T14:20:47.908 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000209529 s, 2.4 MB/s 2024-03-09T14:20:47.909 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-09T14:20:47.977 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-03-09T14:20:48.045 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-09T14:20:48.045 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:20:48.045 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-09T14:20:48.045 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:20:48.046 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-03-09T14:20:48.046 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-03-09 14:20:27.821115278 +0000 2024-03-09T14:20:48.046 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-03-09 14:18:00.338023957 +0000 2024-03-09T14:20:48.046 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-03-09 14:18:00.338023957 +0000 2024-03-09T14:20:48.046 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-03-09 14:18:00.338023957 +0000 2024-03-09T14:20:48.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-09T14:20:48.124 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-03-09T14:20:48.124 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-03-09T14:20:48.124 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000214433 s, 2.4 MB/s 2024-03-09T14:20:48.125 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-09T14:20:48.195 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:20:48.195 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-09T14:20:48.195 INFO:tasks.ceph:Generating config... 2024-03-09T14:20:48.196 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-09T14:20:48.196 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-03-09T14:20:48.196 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-03-09T14:20:48.196 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-03-09T14:20:48.196 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:20:48.196 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-09T14:20:48.197 INFO:tasks.ceph:[client] setuser = ceph 2024-03-09T14:20:48.197 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-03-09T14:20:48.197 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-03-09T14:20:48.197 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-03-09T14:20:48.197 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-03-09T14:20:48.197 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-03-09T14:20:48.197 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-03-09T14:20:48.197 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-09T14:20:48.198 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-09T14:20:48.198 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-09T14:20:48.198 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-09T14:20:48.198 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-09T14:20:48.198 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-09T14:20:48.198 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-09T14:20:48.199 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-03-09T14:20:48.202 INFO:tasks.ceph:Setting up mon.a... 2024-03-09T14:20:48.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-09T14:20:48.265 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-03-09T14:20:48.268 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-09T14:20:48.326 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:20:48.364 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.c', '[v2:172.21.15.46:3301,v1:172.21.15.46:6790]'), ('mon.b', '172.21.15.159')] 2024-03-09T14:20:48.366 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],172.21.15.159', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-03-09T14:20:48.367 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:48.367 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-09T14:20:48.430 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --addv c '[v2:172.21.15.46:3301,v1:172.21.15.46:6790]' --add b 172.21.15.159 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:20:48.526 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:20:48.527 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-03-09T14:20:48.528 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-03-09T14:20:48.528 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:20:48.528 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:20:48.528 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:20:48.528 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-09T14:20:48.529 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-09T14:20:48.555 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 89924d1c-8381-4c0c-aba2-532d86495bef... 2024-03-09T14:20:48.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-09T14:20:48.598 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.658 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.659 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.660 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],172.21.15.159" 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: mon client directed command retry = 5 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: ms inject socket failures = 5000 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: osd heartbeat grace = 40 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: osd_max_pg_log_entries = 10 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: osd_min_pg_log_entries = 10 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: rgw override bucket index max shards = 1 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-03-09T14:20:48.661 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.662 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: bdev async discard = True 2024-03-09T14:20:48.663 INFO:teuthology.orchestra.run.smithi046.stdout: bdev enable discard = True 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore allocator = bitmap 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 1/20 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 1/20 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 4/10 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: osd fast shutdown = False 2024-03-09T14:20:48.664 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: osd shutdown pgref assert = True 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-03-09T14:20:48.665 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.666 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd crush smoke test = False 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-03-09T14:20:48.667 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: debug rgw = 20 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw bucket counters cache = True 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw crypt require ssl = False 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw crypt s3 kms backend = testing 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw max chunk size = 4194304 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw obj stripe size = 6291456 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw s3 auth use sts = True 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw sts key = abcdefghijklmnop 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw torrent flag = True 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: rgw user counters cache = True 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: setgroup = ceph 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout: setuser = ceph 2024-03-09T14:20:48.668 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2024-03-09T14:20:48.669 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.670 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2024-03-09T14:20:48.671 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.46,[v2:172.21.15.46:3301,v1:172.21.15.46:6790],172.21.15.159" 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: mon client directed command retry = 5 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: ms inject socket failures = 5000 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: osd heartbeat grace = 40 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: osd_max_pg_log_entries = 10 2024-03-09T14:20:48.672 INFO:teuthology.orchestra.run.smithi159.stdout: osd_min_pg_log_entries = 10 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: rgw override bucket index max shards = 1 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd mclock profile = high_recovery_ops 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2024-03-09T14:20:48.673 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug trim objects = true 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2024-03-09T14:20:48.674 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: bdev async discard = True 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: bdev enable discard = True 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore allocator = bitmap 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 1/20 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 1/20 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 4/10 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2024-03-09T14:20:48.675 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: osd fast shutdown = False 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: osd shutdown pgref assert = True 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:20:48.676 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-09T14:20:48.677 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: # 1m isn't quite enough 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: mon_down_mkfs_grace = 2m 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_filestore_osds = false 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd crush smoke test = False 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2024-03-09T14:20:48.678 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: debug rgw = 20 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw bucket counters cache = True 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw crypt require ssl = False 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw crypt s3 kms backend = testing 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw max chunk size = 4194304 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw obj stripe size = 6291456 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw s3 auth use sts = True 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw sts key = abcdefghijklmnop 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw torrent flag = True 2024-03-09T14:20:48.679 INFO:teuthology.orchestra.run.smithi159.stdout: rgw user counters cache = True 2024-03-09T14:20:48.680 INFO:teuthology.orchestra.run.smithi159.stdout: setgroup = ceph 2024-03-09T14:20:48.680 INFO:teuthology.orchestra.run.smithi159.stdout: setuser = ceph 2024-03-09T14:20:48.680 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2024-03-09T14:20:48.680 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2024-03-09T14:20:48.680 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2024-03-09T14:20:48.681 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-09T14:20:48.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-09T14:20:48.788 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-09T14:20:48.788 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:48.788 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-09T14:20:48.814 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:48.818 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-09T14:20:48.880 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:20:48.880 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:48.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-09T14:20:48.881 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:20:48.972 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:20:48.972 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:49.038 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:20:49.038 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:49.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-09T14:20:49.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:20:49.091 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:20:49.091 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:49.159 INFO:tasks.ceph:Setting up mon nodes... 2024-03-09T14:20:49.159 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-09T14:20:49.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-09T14:20:49.227 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-09T14:20:49.228 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-09T14:20:49.305 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-09T14:20:49.307 INFO:tasks.ceph:Setting up mds nodes... 2024-03-09T14:20:49.307 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-09T14:20:49.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-09T14:20:49.361 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-09T14:20:49.376 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-09T14:20:49.432 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-09T14:20:49.446 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-09T14:20:49.447 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-09T14:20:49.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-09T14:20:49.485 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:20:49.486 INFO:tasks.ceph:role: osd.0 2024-03-09T14:20:49.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:20:49.486 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-09T14:20:49.564 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:20:49.564 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:20:49.565 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:20:49.596 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-09T14:20:49.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-09T14:20:49.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-09T14:20:49.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-09T14:20:49.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-09T14:20:49.844 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:20:49.845 INFO:tasks.ceph:role: osd.1 2024-03-09T14:20:49.845 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:20:49.845 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:20:49.923 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:20:49.955 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-09T14:20:49.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-09T14:20:49.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-09T14:20:50.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-09T14:20:50.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-09T14:20:50.205 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:20:50.205 INFO:tasks.ceph:role: osd.2 2024-03-09T14:20:50.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:20:50.206 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-09T14:20:50.284 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:20:50.284 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:20:50.284 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:20:50.285 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:20:50.317 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-09T14:20:50.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-09T14:20:50.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-09T14:20:50.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-09T14:20:50.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-09T14:20:50.563 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:20:50.563 INFO:tasks.ceph:role: osd.3 2024-03-09T14:20:50.563 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:20:50.563 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-09T14:20:50.641 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:20:50.641 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:20:50.641 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:20:50.642 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:20:50.674 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-03-09T14:20:50.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-03-09T14:20:50.676 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-09T14:20:50.757 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-09T14:20:50.840 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:50.942+0000 7fb80880c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-09T14:20:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:50.942+0000 7fb80880c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-09T14:20:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:50.942+0000 7fb80880c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:20:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:50.942+0000 7fb80880c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:20:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:50.942+0000 7fb80880c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:20:50.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:50.943+0000 7fb80880c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-09T14:20:53.800 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-09T14:20:53.845 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:53.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:53.906+0000 7fb72fc11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-09T14:20:53.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:53.906+0000 7fb72fc11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-09T14:20:53.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:53.906+0000 7fb72fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:20:53.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:53.906+0000 7fb72fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:20:53.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:53.906+0000 7fb72fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:20:53.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:53.906+0000 7fb72fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-09T14:20:56.754 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-09T14:20:56.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:56.901+0000 7f979dfac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-09T14:20:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:56.901+0000 7f979dfac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-09T14:20:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:56.901+0000 7f979dfac640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:20:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:56.901+0000 7f979dfac640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:20:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:56.901+0000 7f979dfac640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:20:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:56.902+0000 7f979dfac640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-09T14:20:59.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-09T14:20:59.798 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:20:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:59.860+0000 7f9bc9349640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-09T14:20:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:59.860+0000 7f9bc9349640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-09T14:20:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:59.860+0000 7f9bc9349640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:20:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:59.860+0000 7f9bc9349640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:20:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:59.860+0000 7f9bc9349640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:20:59.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:20:59.860+0000 7f9bc9349640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-09T14:21:02.710 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-09T14:21:02.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-09T14:21:02.807 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:21:02.807 INFO:tasks.ceph:role: osd.4 2024-03-09T14:21:02.807 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:21:02.808 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-09T14:21:02.857 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:21:02.857 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:21:02.858 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:21:03.375 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-03-09T14:21:03.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-03-09T14:21:03.378 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-09T14:21:03.485 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-09T14:21:03.536 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-09T14:21:03.578 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:21:03.579 INFO:tasks.ceph:role: osd.5 2024-03-09T14:21:03.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:21:03.579 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:21:03.667 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:21:03.668 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:21:03.668 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:21:03.668 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:21:04.137 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-03-09T14:21:04.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-03-09T14:21:04.139 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-09T14:21:04.201 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-09T14:21:04.245 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-09T14:21:04.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:21:04.285 INFO:tasks.ceph:role: osd.6 2024-03-09T14:21:04.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:21:04.285 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:21:04.373 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:21:04.374 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:21:04.374 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:21:04.374 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:21:04.877 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-03-09T14:21:04.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-03-09T14:21:04.879 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-09T14:21:04.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-09T14:21:05.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-09T14:21:05.117 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:21:05.118 INFO:tasks.ceph:role: osd.7 2024-03-09T14:21:05.118 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:21:05.118 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-09T14:21:05.205 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:21:05.206 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:21:05.707 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-03-09T14:21:05.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-03-09T14:21:05.709 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-09T14:21:05.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-09T14:21:05.860 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:21:05.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:05.929+0000 7f1f88e0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-09T14:21:05.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:05.929+0000 7f1f88e0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-09T14:21:05.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:05.929+0000 7f1f88e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:21:05.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:05.929+0000 7f1f88e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:21:05.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:05.929+0000 7f1f88e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:21:05.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:05.929+0000 7f1f88e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-09T14:21:08.788 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-09T14:21:08.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:21:08.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:08.897+0000 7f4db4d23640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-09T14:21:08.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:08.897+0000 7f4db4d23640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-09T14:21:08.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:08.897+0000 7f4db4d23640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:21:08.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:08.897+0000 7f4db4d23640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:21:08.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:08.897+0000 7f4db4d23640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:21:08.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:08.897+0000 7f4db4d23640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-09T14:21:11.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-09T14:21:11.793 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:21:11.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:11.894+0000 7f3abd21f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-09T14:21:11.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:11.894+0000 7f3abd21f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-09T14:21:11.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:11.894+0000 7f3abd21f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:21:11.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:11.894+0000 7f3abd21f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:21:11.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:11.894+0000 7f3abd21f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:21:11.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:11.895+0000 7f3abd21f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-09T14:21:14.743 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-09T14:21:14.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:21:14.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:14.887+0000 7f75c63e1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-09T14:21:14.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:14.888+0000 7f75c63e1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-09T14:21:14.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:14.888+0000 7f75c63e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:21:14.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:14.888+0000 7f75c63e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:21:14.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:14.888+0000 7f75c63e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:21:14.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-03-09T14:21:14.888+0000 7f75c63e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-09T14:21:17.735 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-09T14:21:17.780 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-09T14:21:17.781 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:17.781 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-09T14:21:17.826 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:17.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-09T14:21:17.909 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:17.909 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-09T14:21:17.990 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:17.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-09T14:21:18.071 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:18.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-09T14:21:18.151 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:18.151 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-09T14:21:18.198 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:18.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-09T14:21:18.282 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:18.283 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-09T14:21:18.364 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:18.364 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-09T14:21:18.445 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:18.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-09T14:21:18.524 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:18.524 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-09T14:21:18.552 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:18.553 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-09T14:21:18.591 INFO:tasks.ceph:Adding keys to all mons... 2024-03-09T14:21:18.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-09T14:21:18.595 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-09T14:21:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-03-09T14:21:18.634 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBBcOxl5s+GDRAAp3ihUOIhs7Bik97nVOdkdQ== 2024-03-09T14:21:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-03-09T14:21:18.634 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBCcOxlE4o6OBAA/HjqYhSixUVbYOFJWWZeaA== 2024-03-09T14:21:18.634 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBFcOxlyMkSNhAAHXi45b9nvjnI6sIP8emDdA== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBIcOxlmEDKNRAA3FNgmz7UGlNyZlsZirbi7g== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBLcOxlC9tSMxAAVZTS+xMeJ/H79LgQWOlC1w== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBBcOxlS+U4EhAA+EiTqm7aCq3F7BvhHjTYOQ== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBRcOxlCuhpNxAAq6A/41rQFSfj6Tb64rreyw== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBUcOxlW36BNRAA1vNJkScTu/cMeGGjg9s9oA== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBXcOxlhRVWNRAAxuNWarknIla9OofYcGIkBA== 2024-03-09T14:21:18.635 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-03-09T14:21:18.636 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBacOxl3jT0NBAAtEOcodycOkKvXnocjTAvHQ== 2024-03-09T14:21:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-03-09T14:21:18.636 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBBcOxl/diSFRAAfR9QNn83MdCz1BCjVJ5+mw== 2024-03-09T14:21:18.636 INFO:teuthology.orchestra.run.smithi046.stdout:[client.1] 2024-03-09T14:21:18.636 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBBcOxlZfrCGRAASM8YlWlGcYyLgvINlwU+xw== 2024-03-09T14:21:18.669 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2024-03-09T14:21:18.669 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBBcOxl5s+GDRAAp3ihUOIhs7Bik97nVOdkdQ== 2024-03-09T14:21:18.669 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2024-03-09T14:21:18.669 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBCcOxlE4o6OBAA/HjqYhSixUVbYOFJWWZeaA== 2024-03-09T14:21:18.669 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2024-03-09T14:21:18.669 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBFcOxlyMkSNhAAHXi45b9nvjnI6sIP8emDdA== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBIcOxlmEDKNRAA3FNgmz7UGlNyZlsZirbi7g== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBLcOxlC9tSMxAAVZTS+xMeJ/H79LgQWOlC1w== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBBcOxlS+U4EhAA+EiTqm7aCq3F7BvhHjTYOQ== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBRcOxlCuhpNxAAq6A/41rQFSfj6Tb64rreyw== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBUcOxlW36BNRAA1vNJkScTu/cMeGGjg9s9oA== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBXcOxlhRVWNRAAxuNWarknIla9OofYcGIkBA== 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2024-03-09T14:21:18.670 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBacOxl3jT0NBAAtEOcodycOkKvXnocjTAvHQ== 2024-03-09T14:21:18.671 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-03-09T14:21:18.671 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBBcOxl/diSFRAAfR9QNn83MdCz1BCjVJ5+mw== 2024-03-09T14:21:18.671 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2024-03-09T14:21:18.671 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBBcOxlZfrCGRAASM8YlWlGcYyLgvINlwU+xw== 2024-03-09T14:21:18.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:21:18.679 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:21:18.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.910 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:18.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:21:19.041 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:21:19.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.108 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.180 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.246 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:21:19.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:21:19.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:21:19.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:21:19.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:21:19.517 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-09T14:21:19.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-09T14:21:19.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:21:19.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-09T14:21:19.705 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-09T14:21:19.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:21:19.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-09T14:21:19.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-09T14:21:19.974 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:21:20.084 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-09T14:21:20.124 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:21:20.126 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:21:20.191 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-09T14:21:20.192 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-09T14:21:20.192 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-09T14:21:20.194 INFO:tasks.ceph.mon.a:Started 2024-03-09T14:21:20.194 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-09T14:21:20.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-09T14:21:20.196 INFO:tasks.ceph.mon.c:Started 2024-03-09T14:21:20.196 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-09T14:21:20.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-09T14:21:20.234 INFO:tasks.ceph.mon.b:Started 2024-03-09T14:21:20.235 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-09T14:21:20.235 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-09T14:21:20.235 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-09T14:21:20.239 INFO:tasks.ceph.mgr.y:Started 2024-03-09T14:21:20.239 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-09T14:21:20.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-09T14:21:20.241 INFO:tasks.ceph.mgr.x:Started 2024-03-09T14:21:20.241 INFO:tasks.ceph:Setting crush tunables to default 2024-03-09T14:21:20.241 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-03-09T14:21:25.644 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-03-09T14:21:25.656 INFO:tasks.ceph:check_enable_crimson: False 2024-03-09T14:21:25.656 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-09T14:21:25.656 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:25.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-09T14:21:25.697 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:25.697 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-09T14:21:25.777 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:25.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-09T14:21:25.857 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:25.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-09T14:21:25.938 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:25.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-09T14:21:25.978 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:25.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-09T14:21:26.057 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:26.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-09T14:21:26.063 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.063+0000 7f0bca816040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-09T14:21:26.075 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.074+0000 7f2f0f82e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-09T14:21:26.102 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-03-09T14:21:26.102 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-09T14:21:26.120 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.120+0000 7f0bca816040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-09T14:21:26.130 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.129+0000 7f2f0f82e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-09T14:21:26.159 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 1a8de056-1d4c-4f3d-8586-238749c02150 0 2024-03-09T14:21:26.395 INFO:teuthology.orchestra.run.smithi159.stdout:0 2024-03-09T14:21:26.407 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new c885198f-13e0-4c5e-bfe9-6a282f8836c1 1 2024-03-09T14:21:26.610 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-03-09T14:21:26.621 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 921d827a-3f2c-43e8-9b40-45f1c78dcb20 2 2024-03-09T14:21:26.664 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.664+0000 7f0bca816040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-09T14:21:26.680 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.679+0000 7f2f0f82e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-09T14:21:26.720 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.720+0000 7f0bca816040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-09T14:21:26.737 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.735+0000 7f2f0f82e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-09T14:21:26.767 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.767+0000 7f0bca816040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-09T14:21:26.783 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.782+0000 7f2f0f82e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-09T14:21:26.822 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.822+0000 7f0bca816040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-09T14:21:26.822 INFO:teuthology.orchestra.run.smithi159.stdout:2 2024-03-09T14:21:26.833 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 92109eeb-4d9e-40fd-b178-d2c555f0bc33 3 2024-03-09T14:21:26.839 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.838+0000 7f2f0f82e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-09T14:21:26.866 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.867+0000 7f0bca816040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-09T14:21:26.883 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:26.882+0000 7f2f0f82e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-09T14:21:26.988 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:26.988+0000 7f0bca816040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-09T14:21:27.003 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.002+0000 7f2f0f82e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-09T14:21:27.060 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.060+0000 7f0bca816040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-09T14:21:27.066 INFO:teuthology.orchestra.run.smithi159.stdout:3 2024-03-09T14:21:27.076 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.075+0000 7f2f0f82e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-09T14:21:27.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64 4 2024-03-09T14:21:27.109 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.109+0000 7f0bca816040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-09T14:21:27.124 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.123+0000 7f2f0f82e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-09T14:21:27.164 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.164+0000 7f0bca816040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-09T14:21:27.178 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.177+0000 7f2f0f82e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-09T14:21:27.214 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.214+0000 7f0bca816040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-09T14:21:27.227 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.226+0000 7f2f0f82e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-09T14:21:27.277 INFO:teuthology.orchestra.run.smithi159.stdout:4 2024-03-09T14:21:27.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new f2ab3d51-dcaf-4a02-a770-19d4f28e83f1 5 2024-03-09T14:21:27.525 INFO:teuthology.orchestra.run.smithi159.stdout:5 2024-03-09T14:21:27.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new b8a1609f-2e25-4fdf-bdcc-529d13bb799e 6 2024-03-09T14:21:27.610 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.610+0000 7f0bca816040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-09T14:21:27.623 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.622+0000 7f2f0f82e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-09T14:21:27.734 INFO:teuthology.orchestra.run.smithi159.stdout:6 2024-03-09T14:21:27.745 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 3139dc31-a486-4cba-b9d6-0383b8db1857 7 2024-03-09T14:21:27.748 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.749+0000 7f0bca816040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-09T14:21:27.764 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.763+0000 7f2f0f82e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-09T14:21:27.871 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.871+0000 7f0bca816040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-09T14:21:27.892 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.891+0000 7f2f0f82e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-09T14:21:27.918 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:27.918+0000 7f0bca816040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-09T14:21:27.939 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:27.938+0000 7f2f0f82e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-09T14:21:27.942 INFO:teuthology.orchestra.run.smithi159.stdout:7 2024-03-09T14:21:27.953 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-09T14:21:27.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-09T14:21:27.956 INFO:tasks.ceph.osd.0:Started 2024-03-09T14:21:27.956 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-09T14:21:27.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-09T14:21:27.958 INFO:tasks.ceph.osd.1:Started 2024-03-09T14:21:27.958 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-09T14:21:27.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-09T14:21:27.961 INFO:tasks.ceph.osd.2:Started 2024-03-09T14:21:27.961 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-09T14:21:27.961 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-09T14:21:27.963 INFO:tasks.ceph.osd.3:Started 2024-03-09T14:21:27.963 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-09T14:21:27.963 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-09T14:21:27.996 INFO:tasks.ceph.osd.4:Started 2024-03-09T14:21:27.996 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-09T14:21:27.997 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-09T14:21:27.999 INFO:tasks.ceph.osd.5:Started 2024-03-09T14:21:27.999 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-09T14:21:27.999 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-09T14:21:28.001 INFO:tasks.ceph.osd.6:Started 2024-03-09T14:21:28.001 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-09T14:21:28.001 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-09T14:21:28.003 INFO:tasks.ceph.osd.7:Started 2024-03-09T14:21:28.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:21:28.046 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:28.046+0000 7f0bca816040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:21:28.078 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:28.076+0000 7f2f0f82e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:21:28.151 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:28.151+0000 7f0bca816040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-09T14:21:28.181 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:28.180+0000 7f2f0f82e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-09T14:21:28.211 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:28.211 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","created":"2024-03-09T14:21:25.531865+0000","modified":"2024-03-09T14:21:27.940854+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:21:27.940854+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a8de056-1d4c-4f3d-8586-238749c02150","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c885198f-13e0-4c5e-bfe9-6a282f8836c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"921d827a-3f2c-43e8-9b40-45f1c78dcb20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92109eeb-4d9e-40fd-b178-d2c555f0bc33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2ab3d51-dcaf-4a02-a770-19d4f28e83f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8a1609f-2e25-4fdf-bdcc-529d13bb799e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3139dc31-a486-4cba-b9d6-0383b8db1857","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:21:28.223 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-09T14:21:28.223 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-09T14:21:28.304 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:28.304+0000 7f0bca816040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:21:28.343 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:28.342+0000 7f2f0f82e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:21:28.346 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:28.346+0000 7f0bca816040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-09T14:21:28.387 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:28.386+0000 7f2f0f82e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-09T14:21:28.501 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:28.501+0000 7f0bca816040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-09T14:21:28.548 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:28.547+0000 7f2f0f82e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-09T14:21:28.589 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-09T14:21:28.587+0000 7fc3b6c0f640 -1 Falling back to public interface 2024-03-09T14:21:28.597 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-09T14:21:28.595+0000 7f036021e640 -1 Falling back to public interface 2024-03-09T14:21:28.597 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-09T14:21:28.595+0000 7f3b2641c640 -1 Falling back to public interface 2024-03-09T14:21:28.597 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-09T14:21:28.595+0000 7f589681c640 -1 Falling back to public interface 2024-03-09T14:21:28.598 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-09T14:21:28.596+0000 7f3b24d9e640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6811/0: (98) Address already in use 2024-03-09T14:21:28.598 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-09T14:21:28.596+0000 7f3b24d9e640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6817/0: (98) Address already in use 2024-03-09T14:21:28.616 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-03-09T14:21:28.616+0000 7ff2a0f49640 -1 Falling back to public interface 2024-03-09T14:21:28.620 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-03-09T14:21:28.620+0000 7f540c8c8640 -1 Falling back to public interface 2024-03-09T14:21:28.639 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-03-09T14:21:28.639+0000 7f1d9cc8b640 -1 Falling back to public interface 2024-03-09T14:21:28.647 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-03-09T14:21:28.647+0000 7fde652c8640 -1 Falling back to public interface 2024-03-09T14:21:29.030 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:21:29.208 INFO:teuthology.misc.health.smithi046.stdout: 2024-03-09T14:21:29.209 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","created":"2024-03-09T14:21:25.531865+0000","modified":"2024-03-09T14:21:27.940854+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:21:27.940854+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a8de056-1d4c-4f3d-8586-238749c02150","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c885198f-13e0-4c5e-bfe9-6a282f8836c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"921d827a-3f2c-43e8-9b40-45f1c78dcb20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92109eeb-4d9e-40fd-b178-d2c555f0bc33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2ab3d51-dcaf-4a02-a770-19d4f28e83f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b8a1609f-2e25-4fdf-bdcc-529d13bb799e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3139dc31-a486-4cba-b9d6-0383b8db1857","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:21:29.219 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-09T14:21:29.334 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:29.334+0000 7f0bca816040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-09T14:21:29.398 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:29.397+0000 7f2f0f82e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-09T14:21:29.612 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:29.612+0000 7f0bca816040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-09T14:21:29.663 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:29.663+0000 7f0bca816040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-09T14:21:29.686 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:29.685+0000 7f2f0f82e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-09T14:21:29.740 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:29.738+0000 7f2f0f82e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-09T14:21:29.780 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-03-09T14:21:29.780+0000 7f0bca816040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-09T14:21:29.859 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:29.858+0000 7f2f0f82e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-09T14:21:30.883 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:30.882+0000 7f2eafdd5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-09T14:21:30.884 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-03-09T14:21:30.883+0000 7f2eafdd5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-09T14:21:32.037 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-09T14:21:32.036+0000 7fc3b6c0f640 -1 osd.2 0 log_to_monitors true 2024-03-09T14:21:32.103 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-09T14:21:32.102+0000 7f036021e640 -1 osd.3 0 log_to_monitors true 2024-03-09T14:21:32.112 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-09T14:21:32.111+0000 7f589681c640 -1 osd.1 0 log_to_monitors true 2024-03-09T14:21:32.113 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-09T14:21:32.111+0000 7f3b2641c640 -1 osd.0 0 log_to_monitors true 2024-03-09T14:21:32.172 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-03-09T14:21:32.171+0000 7fde652c8640 -1 osd.6 0 log_to_monitors true 2024-03-09T14:21:32.174 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-03-09T14:21:32.173+0000 7f1d9cc8b640 -1 osd.7 0 log_to_monitors true 2024-03-09T14:21:32.177 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-03-09T14:21:32.176+0000 7f540c8c8640 -1 osd.5 0 log_to_monitors true 2024-03-09T14:21:32.181 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-03-09T14:21:32.180+0000 7ff2a0f49640 -1 osd.4 0 log_to_monitors true 2024-03-09T14:21:35.248 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-09T14:21:35.247+0000 7f58919e9640 -1 osd.1 0 waiting for initial osdmap 2024-03-09T14:21:35.263 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-09T14:21:35.262+0000 7f035b2db640 -1 osd.3 0 waiting for initial osdmap 2024-03-09T14:21:35.264 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-03-09T14:21:35.263+0000 7f588a01b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.275 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-03-09T14:21:35.274+0000 7f035390d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.285 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-09T14:21:35.284+0000 7f3b21562640 -1 osd.0 0 waiting for initial osdmap 2024-03-09T14:21:35.297 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-03-09T14:21:35.296+0000 7f3b19b94640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.328 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-09T14:21:35.327+0000 7fc3b1e70640 -1 osd.2 0 waiting for initial osdmap 2024-03-09T14:21:35.338 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-03-09T14:21:35.337+0000 7fc3aa4a2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.899 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-03-09T14:21:35.898+0000 7f1d983fc640 -1 osd.7 0 waiting for initial osdmap 2024-03-09T14:21:35.905 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-03-09T14:21:35.904+0000 7f1d90a2e640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.933 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-03-09T14:21:35.932+0000 7ff29def2640 -1 osd.4 0 waiting for initial osdmap 2024-03-09T14:21:35.946 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-03-09T14:21:35.945+0000 7fde60a39640 -1 osd.6 0 waiting for initial osdmap 2024-03-09T14:21:35.951 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-03-09T14:21:35.950+0000 7ff294cec640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.955 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-03-09T14:21:35.955+0000 7fde5906b640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:35.961 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-03-09T14:21:35.958+0000 7f5408039640 -1 osd.5 0 waiting for initial osdmap 2024-03-09T14:21:35.970 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-03-09T14:21:35.969+0000 7f540066b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:21:36.025 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:21:36.334 INFO:teuthology.misc.health.smithi046.stdout: 2024-03-09T14:21:36.334 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":13,"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","created":"2024-03-09T14:21:25.531865+0000","modified":"2024-03-09T14:21:36.275755+0000","last_up_change":"2024-03-09T14:21:36.275755+0000","last_in_change":"2024-03-09T14:21:27.940854+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a8de056-1d4c-4f3d-8586-238749c02150","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6812","nonce":3412775629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6818","nonce":3412775629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6829","nonce":3412775629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6823","nonce":3412775629}]},"public_addr":"172.21.15.46:6812/3412775629","cluster_addr":"172.21.15.46:6818/3412775629","heartbeat_back_addr":"172.21.15.46:6829/3412775629","heartbeat_front_addr":"172.21.15.46:6823/3412775629","state":["exists","up"]},{"osd":1,"uuid":"c885198f-13e0-4c5e-bfe9-6a282f8836c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6813","nonce":222930770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6820","nonce":222930770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6831","nonce":222930770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6827","nonce":222930770}]},"public_addr":"172.21.15.46:6813/222930770","cluster_addr":"172.21.15.46:6820/222930770","heartbeat_back_addr":"172.21.15.46:6831/222930770","heartbeat_front_addr":"172.21.15.46:6827/222930770","state":["exists","up"]},{"osd":2,"uuid":"921d827a-3f2c-43e8-9b40-45f1c78dcb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6801","nonce":4147138312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6803","nonce":4147138312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6807","nonce":4147138312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6805","nonce":4147138312}]},"public_addr":"172.21.15.46:6801/4147138312","cluster_addr":"172.21.15.46:6803/4147138312","heartbeat_back_addr":"172.21.15.46:6807/4147138312","heartbeat_front_addr":"172.21.15.46:6805/4147138312","state":["exists","up"]},{"osd":3,"uuid":"92109eeb-4d9e-40fd-b178-d2c555f0bc33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6811","nonce":2698338376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6817","nonce":2698338376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6828","nonce":2698338376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6822","nonce":2698338376}]},"public_addr":"172.21.15.46:6811/2698338376","cluster_addr":"172.21.15.46:6817/2698338376","heartbeat_back_addr":"172.21.15.46:6828/2698338376","heartbeat_front_addr":"172.21.15.46:6822/2698338376","state":["exists","up"]},{"osd":4,"uuid":"c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6801","nonce":405397884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6803","nonce":405397884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6807","nonce":405397884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6805","nonce":405397884}]},"public_addr":"172.21.15.159:6801/405397884","cluster_addr":"172.21.15.159:6803/405397884","heartbeat_back_addr":"172.21.15.159:6807/405397884","heartbeat_front_addr":"172.21.15.159:6805/405397884","state":["exists","up"]},{"osd":5,"uuid":"f2ab3d51-dcaf-4a02-a770-19d4f28e83f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6809","nonce":2219836914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6811","nonce":2219836914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6815","nonce":2219836914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6813","nonce":2219836914}]},"public_addr":"172.21.15.159:6809/2219836914","cluster_addr":"172.21.15.159:6811/2219836914","heartbeat_back_addr":"172.21.15.159:6815/2219836914","heartbeat_front_addr":"172.21.15.159:6813/2219836914","state":["exists","up"]},{"osd":6,"uuid":"b8a1609f-2e25-4fdf-bdcc-529d13bb799e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6825","nonce":4253518115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6827","nonce":4253518115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6831","nonce":4253518115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6829","nonce":4253518115}]},"public_addr":"172.21.15.159:6825/4253518115","cluster_addr":"172.21.15.159:6827/4253518115","heartbeat_back_addr":"172.21.15.159:6831/4253518115","heartbeat_front_addr":"172.21.15.159:6829/4253518115","state":["exists","up"]},{"osd":7,"uuid":"3139dc31-a486-4cba-b9d6-0383b8db1857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6817","nonce":3641282602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6819","nonce":3641282602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6823","nonce":3641282602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6821","nonce":3641282602}]},"public_addr":"172.21.15.159:6817/3641282602","cluster_addr":"172.21.15.159:6819/3641282602","heartbeat_back_addr":"172.21.15.159:6823/3641282602","heartbeat_front_addr":"172.21.15.159:6821/3641282602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:21:36.346 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-09T14:21:36.346 INFO:tasks.ceph:Creating RBD pool 2024-03-09T14:21:36.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-09T14:21:37.278 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'rbd' created 2024-03-09T14:21:37.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-09T14:21:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-09T14:21:38.298 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-09T14:21:38.299 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-09T14:21:38.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-09T14:21:38.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-09T14:21:38.299 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-09T14:21:38.658 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:38.669 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2436891488},{"type":"v1","addr":"172.21.15.46:6833","nonce":2436891488}]},"active_addr":"172.21.15.46:6833/2436891488","active_change":"2024-03-09T14:21:29.873532+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2076075895}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1415478040}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3316075433}]}]} 2024-03-09T14:21:38.673 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-09T14:21:38.673 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-09T14:21:38.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:21:38.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:38.980 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":15,"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","created":"2024-03-09T14:21:25.531865+0000","modified":"2024-03-09T14:21:38.278811+0000","last_up_change":"2024-03-09T14:21:36.275755+0000","last_in_change":"2024-03-09T14:21:27.940854+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-09T14:21:36.654759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-03-09T14:21:37.905367+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a8de056-1d4c-4f3d-8586-238749c02150","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6812","nonce":3412775629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6818","nonce":3412775629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6829","nonce":3412775629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6823","nonce":3412775629}]},"public_addr":"172.21.15.46:6812/3412775629","cluster_addr":"172.21.15.46:6818/3412775629","heartbeat_back_addr":"172.21.15.46:6829/3412775629","heartbeat_front_addr":"172.21.15.46:6823/3412775629","state":["exists","up"]},{"osd":1,"uuid":"c885198f-13e0-4c5e-bfe9-6a282f8836c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6813","nonce":222930770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6820","nonce":222930770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6831","nonce":222930770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6827","nonce":222930770}]},"public_addr":"172.21.15.46:6813/222930770","cluster_addr":"172.21.15.46:6820/222930770","heartbeat_back_addr":"172.21.15.46:6831/222930770","heartbeat_front_addr":"172.21.15.46:6827/222930770","state":["exists","up"]},{"osd":2,"uuid":"921d827a-3f2c-43e8-9b40-45f1c78dcb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6801","nonce":4147138312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6803","nonce":4147138312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6807","nonce":4147138312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6805","nonce":4147138312}]},"public_addr":"172.21.15.46:6801/4147138312","cluster_addr":"172.21.15.46:6803/4147138312","heartbeat_back_addr":"172.21.15.46:6807/4147138312","heartbeat_front_addr":"172.21.15.46:6805/4147138312","state":["exists","up"]},{"osd":3,"uuid":"92109eeb-4d9e-40fd-b178-d2c555f0bc33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6811","nonce":2698338376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6817","nonce":2698338376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6828","nonce":2698338376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6822","nonce":2698338376}]},"public_addr":"172.21.15.46:6811/2698338376","cluster_addr":"172.21.15.46:6817/2698338376","heartbeat_back_addr":"172.21.15.46:6828/2698338376","heartbeat_front_addr":"172.21.15.46:6822/2698338376","state":["exists","up"]},{"osd":4,"uuid":"c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6801","nonce":405397884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6803","nonce":405397884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6807","nonce":405397884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6805","nonce":405397884}]},"public_addr":"172.21.15.159:6801/405397884","cluster_addr":"172.21.15.159:6803/405397884","heartbeat_back_addr":"172.21.15.159:6807/405397884","heartbeat_front_addr":"172.21.15.159:6805/405397884","state":["exists","up"]},{"osd":5,"uuid":"f2ab3d51-dcaf-4a02-a770-19d4f28e83f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6809","nonce":2219836914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6811","nonce":2219836914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6815","nonce":2219836914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6813","nonce":2219836914}]},"public_addr":"172.21.15.159:6809/2219836914","cluster_addr":"172.21.15.159:6811/2219836914","heartbeat_back_addr":"172.21.15.159:6815/2219836914","heartbeat_front_addr":"172.21.15.159:6813/2219836914","state":["exists","up"]},{"osd":6,"uuid":"b8a1609f-2e25-4fdf-bdcc-529d13bb799e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6825","nonce":4253518115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6827","nonce":4253518115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6831","nonce":4253518115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6829","nonce":4253518115}]},"public_addr":"172.21.15.159:6825/4253518115","cluster_addr":"172.21.15.159:6827/4253518115","heartbeat_back_addr":"172.21.15.159:6831/4253518115","heartbeat_front_addr":"172.21.15.159:6829/4253518115","state":["exists","up"]},{"osd":7,"uuid":"3139dc31-a486-4cba-b9d6-0383b8db1857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6817","nonce":3641282602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6819","nonce":3641282602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6823","nonce":3641282602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6821","nonce":3641282602}]},"public_addr":"172.21.15.159:6817/3641282602","cluster_addr":"172.21.15.159:6819/3641282602","heartbeat_back_addr":"172.21.15.159:6823/3641282602","heartbeat_front_addr":"172.21.15.159:6821/3641282602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.075588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.079403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.045153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.109902+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.178720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.171691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.197741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.194970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:21:38.992 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-09T14:21:38.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:21:39.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:39.302 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","created":"2024-03-09T14:21:25.531865+0000","modified":"2024-03-09T14:21:39.282423+0000","last_up_change":"2024-03-09T14:21:36.275755+0000","last_in_change":"2024-03-09T14:21:27.940854+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-09T14:21:36.654759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-03-09T14:21:37.905367+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a8de056-1d4c-4f3d-8586-238749c02150","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6812","nonce":3412775629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6818","nonce":3412775629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6829","nonce":3412775629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6823","nonce":3412775629}]},"public_addr":"172.21.15.46:6812/3412775629","cluster_addr":"172.21.15.46:6818/3412775629","heartbeat_back_addr":"172.21.15.46:6829/3412775629","heartbeat_front_addr":"172.21.15.46:6823/3412775629","state":["exists","up"]},{"osd":1,"uuid":"c885198f-13e0-4c5e-bfe9-6a282f8836c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6813","nonce":222930770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6820","nonce":222930770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6831","nonce":222930770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6827","nonce":222930770}]},"public_addr":"172.21.15.46:6813/222930770","cluster_addr":"172.21.15.46:6820/222930770","heartbeat_back_addr":"172.21.15.46:6831/222930770","heartbeat_front_addr":"172.21.15.46:6827/222930770","state":["exists","up"]},{"osd":2,"uuid":"921d827a-3f2c-43e8-9b40-45f1c78dcb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6801","nonce":4147138312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6803","nonce":4147138312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6807","nonce":4147138312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6805","nonce":4147138312}]},"public_addr":"172.21.15.46:6801/4147138312","cluster_addr":"172.21.15.46:6803/4147138312","heartbeat_back_addr":"172.21.15.46:6807/4147138312","heartbeat_front_addr":"172.21.15.46:6805/4147138312","state":["exists","up"]},{"osd":3,"uuid":"92109eeb-4d9e-40fd-b178-d2c555f0bc33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6811","nonce":2698338376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6817","nonce":2698338376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6828","nonce":2698338376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6822","nonce":2698338376}]},"public_addr":"172.21.15.46:6811/2698338376","cluster_addr":"172.21.15.46:6817/2698338376","heartbeat_back_addr":"172.21.15.46:6828/2698338376","heartbeat_front_addr":"172.21.15.46:6822/2698338376","state":["exists","up"]},{"osd":4,"uuid":"c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6801","nonce":405397884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6803","nonce":405397884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6807","nonce":405397884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6805","nonce":405397884}]},"public_addr":"172.21.15.159:6801/405397884","cluster_addr":"172.21.15.159:6803/405397884","heartbeat_back_addr":"172.21.15.159:6807/405397884","heartbeat_front_addr":"172.21.15.159:6805/405397884","state":["exists","up"]},{"osd":5,"uuid":"f2ab3d51-dcaf-4a02-a770-19d4f28e83f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6809","nonce":2219836914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6811","nonce":2219836914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6815","nonce":2219836914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6813","nonce":2219836914}]},"public_addr":"172.21.15.159:6809/2219836914","cluster_addr":"172.21.15.159:6811/2219836914","heartbeat_back_addr":"172.21.15.159:6815/2219836914","heartbeat_front_addr":"172.21.15.159:6813/2219836914","state":["exists","up"]},{"osd":6,"uuid":"b8a1609f-2e25-4fdf-bdcc-529d13bb799e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6825","nonce":4253518115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6827","nonce":4253518115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6831","nonce":4253518115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6829","nonce":4253518115}]},"public_addr":"172.21.15.159:6825/4253518115","cluster_addr":"172.21.15.159:6827/4253518115","heartbeat_back_addr":"172.21.15.159:6831/4253518115","heartbeat_front_addr":"172.21.15.159:6829/4253518115","state":["exists","up"]},{"osd":7,"uuid":"3139dc31-a486-4cba-b9d6-0383b8db1857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6817","nonce":3641282602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6819","nonce":3641282602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6823","nonce":3641282602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6821","nonce":3641282602}]},"public_addr":"172.21.15.159:6817/3641282602","cluster_addr":"172.21.15.159:6819/3641282602","heartbeat_back_addr":"172.21.15.159:6823/3641282602","heartbeat_front_addr":"172.21.15.159:6821/3641282602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.075588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.079403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.045153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.109902+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.178720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.171691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.197741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.194970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:21:39.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-09T14:21:39.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-09T14:21:39.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-09T14:21:39.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-09T14:21:39.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-09T14:21:39.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-09T14:21:39.317 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-09T14:21:39.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-09T14:21:39.590 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:39.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-09T14:21:39.591 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:39.592 INFO:teuthology.orchestra.run.smithi046.stdout:55834574850 2024-03-09T14:21:39.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-09T14:21:39.593 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:39.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-09T14:21:39.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-09T14:21:39.595 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-03-09T14:21:39.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-09T14:21:39.596 INFO:teuthology.orchestra.run.smithi046.stdout:55834574850 2024-03-09T14:21:39.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-09T14:21:39.597 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:39.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-09T14:21:39.598 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:39.599 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-09T14:21:40.262 INFO:teuthology.orchestra.run.smithi046.stdout:55834574850 2024-03-09T14:21:40.303 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:40.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2024-03-09T14:21:40.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2024-03-09T14:21:40.328 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:40.329 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:40.330 INFO:teuthology.orchestra.run.smithi046.stdout:55834574850 2024-03-09T14:21:40.330 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:40.331 INFO:teuthology.orchestra.run.smithi046.stdout:55834574853 2024-03-09T14:21:40.346 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:40.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.6 2024-03-09T14:21:40.348 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:40.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2024-03-09T14:21:40.352 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:40.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2024-03-09T14:21:40.355 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:40.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-03-09T14:21:40.355 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:40.358 INFO:teuthology.orchestra.run.smithi046.stdout:55834574850 2024-03-09T14:21:40.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2024-03-09T14:21:40.362 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:40.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.7 2024-03-09T14:21:40.372 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:41.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-09T14:21:41.615 INFO:teuthology.orchestra.run.smithi046.stdout:55834574851 2024-03-09T14:21:41.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2024-03-09T14:21:41.629 DEBUG:teuthology.parallel:result is None 2024-03-09T14:21:41.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-09T14:21:41.630 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:21:41.934 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:41.935 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T14:21:41.946 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-09T14:21:41.880370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233908,"kb_used_data":1096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740812,"statfs":{"total":773094113280,"available":772854591488,"internally_reserved":0,"allocated":1122304,"data_stored":315792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.296382+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T14:21:38.296382+0000","last_peered":"2024-03-09T14:21:38.296382+0000","last_clean":"2024-03-09T14:21:38.296382+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T14:21:38.296382+0000","last_undegraded":"2024-03-09T14:21:38.296382+0000","last_fullsized":"2024-03-09T14:21:38.296382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:23.330856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.160653+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T14:21:39.160653+0000","last_peered":"2024-03-09T14:21:39.160653+0000","last_clean":"2024-03-09T14:21:39.160653+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T14:21:39.160653+0000","last_undegraded":"2024-03-09T14:21:39.160653+0000","last_fullsized":"2024-03-09T14:21:39.160653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:59.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285850+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T14:21:39.285850+0000","last_peered":"2024-03-09T14:21:39.285850+0000","last_clean":"2024-03-09T14:21:39.285850+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T14:21:39.285850+0000","last_undegraded":"2024-03-09T14:21:39.285850+0000","last_fullsized":"2024-03-09T14:21:39.285850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285817+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T14:21:39.285817+0000","last_peered":"2024-03-09T14:21:39.285817+0000","last_clean":"2024-03-09T14:21:39.285817+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T14:21:39.285817+0000","last_undegraded":"2024-03-09T14:21:39.285817+0000","last_fullsized":"2024-03-09T14:21:39.285817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2024-03-09T14:21:39.287903+0000","last_change":"2024-03-09T14:21:39.287903+0000","last_active":"2024-03-09T14:21:38.278811+0000","last_peered":"2024-03-09T14:21:38.278811+0000","last_clean":"2024-03-09T14:21:38.278811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-09T14:21:39.287903+0000","last_undegraded":"2024-03-09T14:21:39.287903+0000","last_fullsized":"2024-03-09T14:21:39.287903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.292443+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T14:21:38.292443+0000","last_peered":"2024-03-09T14:21:38.292443+0000","last_clean":"2024-03-09T14:21:38.292443+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T14:21:38.292443+0000","last_undegraded":"2024-03-09T14:21:38.292443+0000","last_fullsized":"2024-03-09T14:21:38.292443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:53.531996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287796+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T14:21:39.287796+0000","last_peered":"2024-03-09T14:21:39.287796+0000","last_clean":"2024-03-09T14:21:39.287796+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T14:21:39.287796+0000","last_undegraded":"2024-03-09T14:21:39.287796+0000","last_fullsized":"2024-03-09T14:21:39.287796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285632+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T14:21:39.285632+0000","last_peered":"2024-03-09T14:21:39.285632+0000","last_clean":"2024-03-09T14:21:39.285632+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T14:21:39.285632+0000","last_undegraded":"2024-03-09T14:21:39.285632+0000","last_fullsized":"2024-03-09T14:21:39.285632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287752+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T14:21:39.287752+0000","last_peered":"2024-03-09T14:21:39.287752+0000","last_clean":"2024-03-09T14:21:39.287752+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T14:21:39.287752+0000","last_undegraded":"2024-03-09T14:21:39.287752+0000","last_fullsized":"2024-03-09T14:21:39.287752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:21:41.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:21:42.254 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:42.255 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T14:21:42.266 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-09T14:21:41.880370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233908,"kb_used_data":1096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740812,"statfs":{"total":773094113280,"available":772854591488,"internally_reserved":0,"allocated":1122304,"data_stored":315792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.296382+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T14:21:38.296382+0000","last_peered":"2024-03-09T14:21:38.296382+0000","last_clean":"2024-03-09T14:21:38.296382+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T14:21:38.296382+0000","last_undegraded":"2024-03-09T14:21:38.296382+0000","last_fullsized":"2024-03-09T14:21:38.296382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:23.330856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.160653+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T14:21:39.160653+0000","last_peered":"2024-03-09T14:21:39.160653+0000","last_clean":"2024-03-09T14:21:39.160653+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T14:21:39.160653+0000","last_undegraded":"2024-03-09T14:21:39.160653+0000","last_fullsized":"2024-03-09T14:21:39.160653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:59.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285850+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T14:21:39.285850+0000","last_peered":"2024-03-09T14:21:39.285850+0000","last_clean":"2024-03-09T14:21:39.285850+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T14:21:39.285850+0000","last_undegraded":"2024-03-09T14:21:39.285850+0000","last_fullsized":"2024-03-09T14:21:39.285850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285817+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T14:21:39.285817+0000","last_peered":"2024-03-09T14:21:39.285817+0000","last_clean":"2024-03-09T14:21:39.285817+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T14:21:39.285817+0000","last_undegraded":"2024-03-09T14:21:39.285817+0000","last_fullsized":"2024-03-09T14:21:39.285817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2024-03-09T14:21:39.287903+0000","last_change":"2024-03-09T14:21:39.287903+0000","last_active":"2024-03-09T14:21:38.278811+0000","last_peered":"2024-03-09T14:21:38.278811+0000","last_clean":"2024-03-09T14:21:38.278811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-09T14:21:39.287903+0000","last_undegraded":"2024-03-09T14:21:39.287903+0000","last_fullsized":"2024-03-09T14:21:39.287903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.292443+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T14:21:38.292443+0000","last_peered":"2024-03-09T14:21:38.292443+0000","last_clean":"2024-03-09T14:21:38.292443+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T14:21:38.292443+0000","last_undegraded":"2024-03-09T14:21:38.292443+0000","last_fullsized":"2024-03-09T14:21:38.292443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:53.531996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287796+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T14:21:39.287796+0000","last_peered":"2024-03-09T14:21:39.287796+0000","last_clean":"2024-03-09T14:21:39.287796+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T14:21:39.287796+0000","last_undegraded":"2024-03-09T14:21:39.287796+0000","last_fullsized":"2024-03-09T14:21:39.287796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285632+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T14:21:39.285632+0000","last_peered":"2024-03-09T14:21:39.285632+0000","last_clean":"2024-03-09T14:21:39.285632+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T14:21:39.285632+0000","last_undegraded":"2024-03-09T14:21:39.285632+0000","last_fullsized":"2024-03-09T14:21:39.285632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287752+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T14:21:39.287752+0000","last_peered":"2024-03-09T14:21:39.287752+0000","last_clean":"2024-03-09T14:21:39.287752+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T14:21:39.287752+0000","last_undegraded":"2024-03-09T14:21:39.287752+0000","last_fullsized":"2024-03-09T14:21:39.287752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:21:42.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:21:42.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:42.572 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T14:21:42.583 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-09T14:21:41.880370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233908,"kb_used_data":1096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740812,"statfs":{"total":773094113280,"available":772854591488,"internally_reserved":0,"allocated":1122304,"data_stored":315792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.296382+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T14:21:38.296382+0000","last_peered":"2024-03-09T14:21:38.296382+0000","last_clean":"2024-03-09T14:21:38.296382+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T14:21:38.296382+0000","last_undegraded":"2024-03-09T14:21:38.296382+0000","last_fullsized":"2024-03-09T14:21:38.296382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:23.330856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.160653+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T14:21:39.160653+0000","last_peered":"2024-03-09T14:21:39.160653+0000","last_clean":"2024-03-09T14:21:39.160653+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T14:21:39.160653+0000","last_undegraded":"2024-03-09T14:21:39.160653+0000","last_fullsized":"2024-03-09T14:21:39.160653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:59.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285850+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T14:21:39.285850+0000","last_peered":"2024-03-09T14:21:39.285850+0000","last_clean":"2024-03-09T14:21:39.285850+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T14:21:39.285850+0000","last_undegraded":"2024-03-09T14:21:39.285850+0000","last_fullsized":"2024-03-09T14:21:39.285850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285817+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T14:21:39.285817+0000","last_peered":"2024-03-09T14:21:39.285817+0000","last_clean":"2024-03-09T14:21:39.285817+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T14:21:39.285817+0000","last_undegraded":"2024-03-09T14:21:39.285817+0000","last_fullsized":"2024-03-09T14:21:39.285817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2024-03-09T14:21:39.287903+0000","last_change":"2024-03-09T14:21:39.287903+0000","last_active":"2024-03-09T14:21:38.278811+0000","last_peered":"2024-03-09T14:21:38.278811+0000","last_clean":"2024-03-09T14:21:38.278811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-09T14:21:39.287903+0000","last_undegraded":"2024-03-09T14:21:39.287903+0000","last_fullsized":"2024-03-09T14:21:39.287903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.292443+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T14:21:38.292443+0000","last_peered":"2024-03-09T14:21:38.292443+0000","last_clean":"2024-03-09T14:21:38.292443+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T14:21:38.292443+0000","last_undegraded":"2024-03-09T14:21:38.292443+0000","last_fullsized":"2024-03-09T14:21:38.292443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:53.531996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287796+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T14:21:39.287796+0000","last_peered":"2024-03-09T14:21:39.287796+0000","last_clean":"2024-03-09T14:21:39.287796+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T14:21:39.287796+0000","last_undegraded":"2024-03-09T14:21:39.287796+0000","last_fullsized":"2024-03-09T14:21:39.287796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285632+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T14:21:39.285632+0000","last_peered":"2024-03-09T14:21:39.285632+0000","last_clean":"2024-03-09T14:21:39.285632+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T14:21:39.285632+0000","last_undegraded":"2024-03-09T14:21:39.285632+0000","last_fullsized":"2024-03-09T14:21:39.285632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287752+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T14:21:39.287752+0000","last_peered":"2024-03-09T14:21:39.287752+0000","last_clean":"2024-03-09T14:21:39.287752+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T14:21:39.287752+0000","last_undegraded":"2024-03-09T14:21:39.287752+0000","last_fullsized":"2024-03-09T14:21:39.287752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:21:42.584 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-03-09T14:21:42.584 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 16, 'state': 'creating+activating', 'last_fresh': '2024-03-09T14:21:39.287903+0000', 'last_change': '2024-03-09T14:21:39.287903+0000', 'last_active': '2024-03-09T14:21:38.278811+0000', 'last_peered': '2024-03-09T14:21:38.278811+0000', 'last_clean': '2024-03-09T14:21:38.278811+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-09T14:21:39.287903+0000', 'last_undegraded': '2024-03-09T14:21:39.287903+0000', 'last_fullsized': '2024-03-09T14:21:39.287903+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-09T14:21:38.278811+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-09T14:21:38.278811+0000', 'last_clean_scrub_stamp': '2024-03-09T14:21:38.278811+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-09T14:21:42.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-09T14:21:42.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:42.963 INFO:teuthology.orchestra.run.smithi046.stdout:{"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":17,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":17,"num_osds":8,"num_up_osds":8,"osd_up_since":1709994096,"num_in_osds":8,"osd_in_since":1709994087,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":8},{"state_name":"creating+activating","count":1}],"num_pgs":9,"num_pools":2,"num_objects":0,"data_bytes":0,"bytes_used":239521792,"bytes_avail":772854591488,"bytes_total":773094113280,"inactive_pgs_ratio":0.1111111119389534},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-09T14:21:25.533243+0000","services":{}},"progress_events":{}} 2024-03-09T14:21:42.975 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-03-09T14:21:42.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:21:43.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T14:21:43.290 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-09T14:21:41.880370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233908,"kb_used_data":1096,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740812,"statfs":{"total":773094113280,"available":772854591488,"internally_reserved":0,"allocated":1122304,"data_stored":315792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.296382+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T14:21:38.296382+0000","last_peered":"2024-03-09T14:21:38.296382+0000","last_clean":"2024-03-09T14:21:38.296382+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T14:21:38.296382+0000","last_undegraded":"2024-03-09T14:21:38.296382+0000","last_fullsized":"2024-03-09T14:21:38.296382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:23.330856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.160653+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T14:21:39.160653+0000","last_peered":"2024-03-09T14:21:39.160653+0000","last_clean":"2024-03-09T14:21:39.160653+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T14:21:39.160653+0000","last_undegraded":"2024-03-09T14:21:39.160653+0000","last_fullsized":"2024-03-09T14:21:39.160653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:59.815879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285850+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T14:21:39.285850+0000","last_peered":"2024-03-09T14:21:39.285850+0000","last_clean":"2024-03-09T14:21:39.285850+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T14:21:39.285850+0000","last_undegraded":"2024-03-09T14:21:39.285850+0000","last_fullsized":"2024-03-09T14:21:39.285850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285817+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T14:21:39.285817+0000","last_peered":"2024-03-09T14:21:39.285817+0000","last_clean":"2024-03-09T14:21:39.285817+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T14:21:39.285817+0000","last_undegraded":"2024-03-09T14:21:39.285817+0000","last_fullsized":"2024-03-09T14:21:39.285817+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2024-03-09T14:21:39.287903+0000","last_change":"2024-03-09T14:21:39.287903+0000","last_active":"2024-03-09T14:21:38.278811+0000","last_peered":"2024-03-09T14:21:38.278811+0000","last_clean":"2024-03-09T14:21:38.278811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-09T14:21:39.287903+0000","last_undegraded":"2024-03-09T14:21:39.287903+0000","last_fullsized":"2024-03-09T14:21:39.287903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-09T14:21:38.292443+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T14:21:38.292443+0000","last_peered":"2024-03-09T14:21:38.292443+0000","last_clean":"2024-03-09T14:21:38.292443+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T14:21:38.292443+0000","last_undegraded":"2024-03-09T14:21:38.292443+0000","last_fullsized":"2024-03-09T14:21:38.292443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:53.531996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287796+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T14:21:39.287796+0000","last_peered":"2024-03-09T14:21:39.287796+0000","last_clean":"2024-03-09T14:21:39.287796+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T14:21:39.287796+0000","last_undegraded":"2024-03-09T14:21:39.287796+0000","last_fullsized":"2024-03-09T14:21:39.287796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.285632+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T14:21:39.285632+0000","last_peered":"2024-03-09T14:21:39.285632+0000","last_clean":"2024-03-09T14:21:39.285632+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T14:21:39.285632+0000","last_undegraded":"2024-03-09T14:21:39.285632+0000","last_fullsized":"2024-03-09T14:21:39.285632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-09T14:21:39.287752+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T14:21:39.287752+0000","last_peered":"2024-03-09T14:21:39.287752+0000","last_clean":"2024-03-09T14:21:39.287752+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T14:21:39.287752+0000","last_undegraded":"2024-03-09T14:21:39.287752+0000","last_fullsized":"2024-03-09T14:21:39.287752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":41019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":131072,"data_stored":34839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:21:46.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:21:46.610 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:46.610 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T14:21:46.622 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-03-09T14:21:45.881186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235936,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738784,"statfs":{"total":773094113280,"available":772852514816,"internally_reserved":0,"allocated":2531328,"data_stored":1604136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000466"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.309879+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T14:21:40.309879+0000","last_peered":"2024-03-09T14:21:40.309879+0000","last_clean":"2024-03-09T14:21:40.309879+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T14:21:40.309879+0000","last_undegraded":"2024-03-09T14:21:40.309879+0000","last_fullsized":"2024-03-09T14:21:40.309879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:58.533776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.309880+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T14:21:40.309880+0000","last_peered":"2024-03-09T14:21:40.309880+0000","last_clean":"2024-03-09T14:21:40.309880+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T14:21:40.309880+0000","last_undegraded":"2024-03-09T14:21:40.309880+0000","last_fullsized":"2024-03-09T14:21:40.309880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:38.232466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.310758+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T14:21:40.310758+0000","last_peered":"2024-03-09T14:21:40.310758+0000","last_clean":"2024-03-09T14:21:40.310758+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T14:21:40.310758+0000","last_undegraded":"2024-03-09T14:21:40.310758+0000","last_fullsized":"2024-03-09T14:21:40.310758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.376501+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T14:21:40.376501+0000","last_peered":"2024-03-09T14:21:40.376501+0000","last_clean":"2024-03-09T14:21:40.376501+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T14:21:40.376501+0000","last_undegraded":"2024-03-09T14:21:40.376501+0000","last_fullsized":"2024-03-09T14:21:40.376501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:41.233387+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T14:21:41.233387+0000","last_peered":"2024-03-09T14:21:41.233387+0000","last_clean":"2024-03-09T14:21:41.233387+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T14:21:41.233387+0000","last_undegraded":"2024-03-09T14:21:41.233387+0000","last_fullsized":"2024-03-09T14:21:41.233387+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:25:40.528352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.376768+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T14:21:40.376768+0000","last_peered":"2024-03-09T14:21:40.376768+0000","last_clean":"2024-03-09T14:21:40.376768+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T14:21:40.376768+0000","last_undegraded":"2024-03-09T14:21:40.376768+0000","last_fullsized":"2024-03-09T14:21:40.376768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:14.047597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.301894+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T14:21:40.301894+0000","last_peered":"2024-03-09T14:21:40.301894+0000","last_clean":"2024-03-09T14:21:40.301894+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T14:21:40.301894+0000","last_undegraded":"2024-03-09T14:21:40.301894+0000","last_fullsized":"2024-03-09T14:21:40.301894+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.376634+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T14:21:40.376634+0000","last_peered":"2024-03-09T14:21:40.376634+0000","last_clean":"2024-03-09T14:21:40.376634+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T14:21:40.376634+0000","last_undegraded":"2024-03-09T14:21:40.376634+0000","last_fullsized":"2024-03-09T14:21:40.376634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-09T14:21:40.301897+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T14:21:40.301897+0000","last_peered":"2024-03-09T14:21:40.301897+0000","last_clean":"2024-03-09T14:21:40.301897+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T14:21:40.301897+0000","last_undegraded":"2024-03-09T14:21:40.301897+0000","last_fullsized":"2024-03-09T14:21:40.301897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":761856,"data_stored":643293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":761856,"data_stored":643293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":52925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:21:46.623 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-09T14:21:46.623 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-09T14:21:46.623 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-09T14:21:46.623 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-09T14:21:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:21:46.966 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-09T14:21:46.979 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-09T14:21:46.979 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-03-09T14:21:46.994 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-03-09T14:21:46.995 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-09T14:21:47.023 DEBUG:teuthology.orchestra.run.smithi046:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-03-09T14:21:47.621 INFO:teuthology.orchestra.run.smithi046.stderr:.....+.+........+....+..+...............+...+.+.....+.......+........+....+...+..+.......+.....+.+........+.+...+............+.....+.+.....+.........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+........+...+.......+..+.+.........+..+....+.........+...+...+..+............+.+...........+......+....+.....+...+.......+...+...+.....+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.........+.........+....+..+.+.....+............+..........+...+..+.+.....+......+...............+.............+...+.........+.........+.........+..+...+.+.........+.....+...+..........+..+.+.....+.+......+.........+.........+.....+.+...+..+...............+....+.....+....+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:21:48.964 INFO:teuthology.orchestra.run.smithi046.stderr:....+...+.....+...+...................+.....+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+..+...+....+.....+......+...+.+...+........+.........+.+..+..........+........+............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+.........+.+...+......+..+.........+...+.......+.....+....+..............+..........+..................+...+..+............+.......+...+...+............+..+...............+..................+..........+.....+................+..+...+.+...+.................+.+........+....+...............+.....+.+......+......+.....+........................+......+...............+...+.+...+...+........+....+............+...+..+...+......+.+....................+.........+.......+.................+...+...+.......+............+..+....+..+....+........+.......+...........+.......+..+.........+.........+......+....+...+..+...+.......+...+...+..+...+......+........................+.......+..+...+....+....................+...+...+...+.+...............+...........+...+............+.......+............+....................+.........+.........+...+.......+..+.+............+......+............+.....+............+.......+...+.....+.+..........................+.+..+.......+...............+.....+....+..+........................+....+.....................+........+......+......+...+.......+.....+.+.........+...+...........+......+....+..+....+...............+........+.+..+...+.+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:21:48.989 INFO:teuthology.orchestra.run.smithi046.stderr:----- 2024-03-09T14:21:48.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-03-09T14:21:49.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo update-ca-trust 2024-03-09T14:21:49.916 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-09T14:21:49.944 DEBUG:teuthology.orchestra.run.smithi046:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi046.front.sepia.ceph.com 2024-03-09T14:21:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:....+.....+.+.....+.........+.+.....+.+..+.......+........+.......+...+........+...+.........+...+....+...+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*............+............+..+......+...+.+.....+......+.......+...+..+.......+........+.+.....+.+......+...+..+.......+......+.....+.+.....+...+.+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+....+..+...+.+..............+.+.........+...+..................+.....+......+...+......+....+...........+.+...+...+............+...+.........+.....+.........+.......+..+...+.......+..+.+..+...............+.+..+...+.+.....+...............+...............+....+.................+.......+........+....+......+..+.+......+.....................+.........+...+...+........+......+..........+........+.+......+......+..+...+.......+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:21:50.199 INFO:teuthology.orchestra.run.smithi046.stderr:...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+...............+..........+.....+.........+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.............+...+..+.......+........+.............+...+.....+.+.....+.+..................+.....+......+.........+....+...+.....+.........+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:21:50.203 INFO:teuthology.orchestra.run.smithi046.stderr:----- 2024-03-09T14:21:50.206 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:21:50.207 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-09T14:21:50.273 DEBUG:teuthology.orchestra.run.smithi046:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-09T14:21:50.363 INFO:teuthology.orchestra.run.smithi046.stderr:Certificate request self-signature ok 2024-03-09T14:21:50.363 INFO:teuthology.orchestra.run.smithi046.stderr:subject=CN = smithi046.front.sepia.ceph.com 2024-03-09T14:21:50.374 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-09T14:21:50.401 DEBUG:teuthology.orchestra.run.smithi046:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-09T14:21:50.471 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-03-09T14:21:50.472 DEBUG:teuthology.orchestra.run.smithi046:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-09T14:21:50.539 INFO:teuthology.run_tasks:Running task rgw... 2024-03-09T14:21:50.553 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-03-09T14:21:50.553 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-09T14:21:50.554 INFO:tasks.rgw:Creating data pools 2024-03-09T14:21:50.554 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-09T14:21:50.554 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-03-09T14:21:51.337 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-03-09T14:21:53.333 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'default.rgw.buckets.data' created 2024-03-09T14:21:53.357 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-09T14:21:54.341 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-09T14:21:54.380 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-09T14:21:55.344 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'default.rgw.buckets.index' created 2024-03-09T14:21:55.368 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-09T14:21:56.342 INFO:teuthology.orchestra.run.smithi046.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-09T14:21:56.379 DEBUG:tasks.rgw:Pools created 2024-03-09T14:21:56.379 INFO:tasks.rgw:Configuring compression type = random 2024-03-09T14:21:56.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:21:56.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:21:56.379 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:21:56.505 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:21:56.505 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:21:58.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.407+0000 7f215c823640 0 -- 172.21.15.46:0/3357893635 >> [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] conn(0x7f203806a4c0 msgr2=0x7f203806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:21:58.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.411+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.412+0000 7f215d024640 0 -- 172.21.15.46:0/942736838 >> [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] conn(0x7f202406a5b0 msgr2=0x7f202406ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:21:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:21:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 realm 2024-03-09T14:21:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:21:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:21:58.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:21:58.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.413+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.414+0000 7f2160b20800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:21:58.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.414+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.415+0000 7f2160b20800 20 rados_obj.operate() r=0 bl.length=957 2024-03-09T14:21:58.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.416+0000 7f2160b20800 20 searching for the correct realm 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:21:58.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:21:58.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.428+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:21:58.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 20 zone default found 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 4 Realm: () 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.431+0000 7f2160b20800 20 zonegroup default 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.432+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:21:58.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.432+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:21:58.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:21:58.432+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:22:00.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:00.386+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:00.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:00.386+0000 7f2160b20800 20 rados->read ofs=0 len=0 2024-03-09T14:22:00.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:00.387+0000 7f2160b20800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:00.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:00.387+0000 7f2160b20800 20 started sync module instance, tier type = 2024-03-09T14:22:00.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:00.387+0000 7f2160b20800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=0 2024-03-09T14:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=1 2024-03-09T14:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=2 2024-03-09T14:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=3 2024-03-09T14:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=4 2024-03-09T14:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=5 2024-03-09T14:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.412+0000 7f2160b20800 20 add_watcher() i=6 2024-03-09T14:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.413+0000 7f2160b20800 20 add_watcher() i=7 2024-03-09T14:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.413+0000 7f2160b20800 2 all 8 watchers are set, enabling cache 2024-03-09T14:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.413+0000 7f2160b20800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-03-09T14:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.413+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-03-09T14:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.413+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-03-09T14:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-03-09T14:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.414+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-03-09T14:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.415+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-03-09T14:22:02.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-03-09T14:22:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-03-09T14:22:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.416+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-03-09T14:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-03-09T14:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.417+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.418+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.418+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.418+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.418+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.418+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.418+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-03-09T14:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-03-09T14:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.419+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.420+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-03-09T14:22:02.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.421+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-03-09T14:22:02.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-03-09T14:22:02.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.422+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.423+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.423+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.423+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-03-09T14:22:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.424+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.425+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.426+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-03-09T14:22:02.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-03-09T14:22:02.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-03-09T14:22:02.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-03-09T14:22:02.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.427+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.428+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-03-09T14:22:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.429+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-03-09T14:22:02.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.430+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.431+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.432+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-03-09T14:22:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.433+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.434+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-03-09T14:22:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.435+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.436+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.437+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.437+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.437+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.437+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-03-09T14:22:02.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.437+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.437+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.438+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-03-09T14:22:02.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.439+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-03-09T14:22:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.440+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.441+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.441+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.441+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.442+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-03-09T14:22:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.443+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.444+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-03-09T14:22:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.445+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.446+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.447+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.447+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.447+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.447+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.447+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.447+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-03-09T14:22:02.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.448+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-03-09T14:22:02.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.449+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-03-09T14:22:02.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.450+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-03-09T14:22:02.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.451+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.452+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-03-09T14:22:02.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.454+0000 7f2160b20800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:22:02.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.458+0000 7f200efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:22:02.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.458+0000 7f2160b20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:02.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:02.458+0000 7f2160b20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.390+0000 7f2160b20800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-03-09T14:22:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.390+0000 7f2160b20800 5 note: GC not initialized 2024-03-09T14:22:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.390+0000 7f200dfe3640 20 reqs_thread_entry: start 2024-03-09T14:22:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.390+0000 7f2160b20800 20 init_complete bucket index max shards: 1 2024-03-09T14:22:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.390+0000 7f2160b20800 20 Filter name: none 2024-03-09T14:22:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.390+0000 7f1f6f7fe640 20 reqs_thread_entry: start 2024-03-09T14:22:05.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.423+0000 7f200efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:22:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.426+0000 7f2160b20800 20 remove_watcher() i=0 2024-03-09T14:22:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.426+0000 7f2160b20800 2 removed watcher, disabling cache 2024-03-09T14:22:05.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.427+0000 7f2160b20800 20 remove_watcher() i=1 2024-03-09T14:22:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.429+0000 7f2160b20800 20 remove_watcher() i=2 2024-03-09T14:22:05.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.433+0000 7f2160b20800 20 remove_watcher() i=3 2024-03-09T14:22:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.434+0000 7f2160b20800 20 remove_watcher() i=4 2024-03-09T14:22:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.435+0000 7f2160b20800 20 remove_watcher() i=5 2024-03-09T14:22:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.436+0000 7f2160b20800 20 remove_watcher() i=6 2024-03-09T14:22:05.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.437+0000 7f2160b20800 20 remove_watcher() i=7 2024-03-09T14:22:05.460 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-03-09T14:22:05.460 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:22:05.460 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-09T14:22:05.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-09T14:22:05.460 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-03-09T14:22:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:22:05.524 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:22:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.547+0000 7f2d95a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:05.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.547+0000 7f2d95a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:05.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.550+0000 7f2bc7fff640 20 reqs_thread_entry: start 2024-03-09T14:22:05.567 INFO:teuthology.orchestra.run.smithi046.stdout:{"id":"9d9fb811-cdaf-478b-a06b-5596cde59126","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:22:05.567 DEBUG:tasks.util.rgw: json result: {'id': '9d9fb811-cdaf-478b-a06b-5596cde59126', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:22:05.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:22:05.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:22:05.567 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:22:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:22:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:22:05.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.651+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.652+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.652+0000 7f811132d800 20 realm 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.652+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.652+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.652+0000 7f811132d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.652+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.653+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.653+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:05.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.654+0000 7f811132d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:22:05.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.654+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.855+0000 7f811132d800 20 rados_obj.operate() r=0 bl.length=973 2024-03-09T14:22:05.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.855+0000 7f811132d800 20 searching for the correct realm 2024-03-09T14:22:05.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:05.857+0000 7f810cf7a640 0 -- 172.21.15.46:0/840670515 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f8104087020 msgr2=0x7f810403d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:22:06.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.063+0000 7f810c779640 0 -- 172.21.15.46:0/840670515 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f80fc08d040 msgr2=0x7f80fc08d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:22:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:06.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:06.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.071+0000 7f811132d800 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 zone default found 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 4 Realm: () 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 zonegroup default 2024-03-09T14:22:06.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 rados->read ofs=0 len=0 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 started sync module instance, tier type = 2024-03-09T14:22:06.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.072+0000 7f811132d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:22:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=0 2024-03-09T14:22:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=1 2024-03-09T14:22:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=2 2024-03-09T14:22:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=3 2024-03-09T14:22:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=4 2024-03-09T14:22:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=5 2024-03-09T14:22:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.082+0000 7f811132d800 20 add_watcher() i=6 2024-03-09T14:22:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.083+0000 7f811132d800 20 add_watcher() i=7 2024-03-09T14:22:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.083+0000 7f811132d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.085+0000 7f7fc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.085+0000 7f811132d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.085+0000 7f811132d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.085+0000 7f811132d800 5 note: GC not initialized 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.086+0000 7f7fc1fe3640 20 reqs_thread_entry: start 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.086+0000 7f811132d800 20 init_complete bucket index max shards: 1 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.086+0000 7f811132d800 20 Filter name: none 2024-03-09T14:22:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.086+0000 7f7f337fe640 20 reqs_thread_entry: start 2024-03-09T14:22:06.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.096+0000 7f7fc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:22:06.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.099+0000 7f811132d800 20 remove_watcher() i=0 2024-03-09T14:22:06.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.099+0000 7f811132d800 2 removed watcher, disabling cache 2024-03-09T14:22:06.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.100+0000 7f811132d800 20 remove_watcher() i=1 2024-03-09T14:22:06.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.101+0000 7f811132d800 20 remove_watcher() i=2 2024-03-09T14:22:06.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.102+0000 7f811132d800 20 remove_watcher() i=3 2024-03-09T14:22:06.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.103+0000 7f811132d800 20 remove_watcher() i=4 2024-03-09T14:22:06.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.104+0000 7f811132d800 20 remove_watcher() i=5 2024-03-09T14:22:06.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.105+0000 7f811132d800 20 remove_watcher() i=6 2024-03-09T14:22:06.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.106+0000 7f811132d800 20 remove_watcher() i=7 2024-03-09T14:22:06.116 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-03-09T14:22:06.116 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:22:06.117 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-03-09T14:22:06.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-09T14:22:06.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-09T14:22:06.117 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-03-09T14:22:06.175 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:22:06.175 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:22:06.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.198+0000 7f389f242800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:06.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.198+0000 7f389f242800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:06.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.201+0000 7f36e2ffd640 20 reqs_thread_entry: start 2024-03-09T14:22:06.215 INFO:teuthology.orchestra.run.smithi046.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-03-09T14:22:06.215 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-03-09T14:22:06.216 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-09T14:22:06.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-09T14:22:06.216 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-03-09T14:22:06.276 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:22:06.276 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:22:06.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.298+0000 7f4eb0667800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:06.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.298+0000 7f4eb0667800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:06.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.302+0000 7f4d70fe1640 20 reqs_thread_entry: start 2024-03-09T14:22:06.317 INFO:teuthology.orchestra.run.smithi046.stdout:{"id":"9d9fb811-cdaf-478b-a06b-5596cde59126","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:22:06.317 DEBUG:tasks.util.rgw: json result: {'id': '9d9fb811-cdaf-478b-a06b-5596cde59126', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:22:06.317 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-03-09T14:22:06.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-09T14:22:06.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-09T14:22:06.318 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-03-09T14:22:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:22:06.376 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:22:06.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.398+0000 7f0bff72d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:06.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.398+0000 7f0bff72d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:06.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.402+0000 7f0a41ffb640 20 reqs_thread_entry: start 2024-03-09T14:22:06.417 INFO:teuthology.orchestra.run.smithi046.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-03-09T14:22:06.417 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-03-09T14:22:06.417 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-09T14:22:06.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-09T14:22:06.417 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-03-09T14:22:06.478 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:22:06.478 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:22:06.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.500+0000 7faf3b29d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:22:06.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.500+0000 7faf3b29d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:22:06.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:22:06.504+0000 7fad7effd640 20 reqs_thread_entry: start 2024-03-09T14:22:06.519 INFO:teuthology.orchestra.run.smithi046.stdout:{"id":"9d9fb811-cdaf-478b-a06b-5596cde59126","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:22:06.520 DEBUG:tasks.util.rgw: json result: {'id': '9d9fb811-cdaf-478b-a06b-5596cde59126', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:22:06.520 INFO:tasks.rgw:Starting rgw... 2024-03-09T14:22:06.520 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-03-09T14:22:06.520 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-09T14:22:06.520 DEBUG:teuthology.orchestra.run.smithi046:> sudo echo -n https://smithi046.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-03-09T14:22:06.560 INFO:teuthology.orchestra.run.smithi046.stdout:https://smithi046.front.sepia.ceph.com:443 2024-03-09T14:22:06.561 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-03-09T14:22:06.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo keytool -import -alias smithi046.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-03-09T14:22:06.848 INFO:teuthology.orchestra.run.smithi046.stderr:Warning: use -cacerts option to access cacerts keystore 2024-03-09T14:22:07.000 INFO:teuthology.orchestra.run.smithi046.stderr:Certificate was added to keystore 2024-03-09T14:22:07.024 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-03-09T14:22:07.025 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-09T14:22:07.025 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-09T14:22:07.027 INFO:tasks.rgw.client.0:Started 2024-03-09T14:22:07.027 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:07.027 DEBUG:teuthology.orchestra.run.smithi046:> curl https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:07.093 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:22:07.093 INFO:teuthology.orchestra.run.smithi046.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:22:07.094 INFO:teuthology.orchestra.run.smithi046.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:22:07.094 INFO:teuthology.orchestra.run.smithi046.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:22:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:curl: (7) Failed to connect to smithi046.front.sepia.ceph.com port 443: Connection refused 2024-03-09T14:22:08.094 DEBUG:teuthology.orchestra.run.smithi046:> curl https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:08.125 INFO:teuthology.orchestra.run.smithi046.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:22:08.125 INFO:teuthology.orchestra.run.smithi046.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:22:08.125 INFO:teuthology.orchestra.run.smithi046.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:22:08.126 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:22:08.126 INFO:teuthology.orchestra.run.smithi046.stderr:curl: (7) Failed to connect to smithi046.front.sepia.ceph.com port 443: Connection refused 2024-03-09T14:22:10.127 DEBUG:teuthology.orchestra.run.smithi046:> curl https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:10.157 INFO:teuthology.orchestra.run.smithi046.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:22:10.157 INFO:teuthology.orchestra.run.smithi046.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:22:10.157 INFO:teuthology.orchestra.run.smithi046.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:22:10.158 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:22:10.159 INFO:teuthology.orchestra.run.smithi046.stderr:curl: (7) Failed to connect to smithi046.front.sepia.ceph.com port 443: Connection refused 2024-03-09T14:22:14.160 DEBUG:teuthology.orchestra.run.smithi046:> curl https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:14.191 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:22:14.191 INFO:teuthology.orchestra.run.smithi046.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:22:14.192 INFO:teuthology.orchestra.run.smithi046.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:22:14.192 INFO:teuthology.orchestra.run.smithi046.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:22:14.192 INFO:teuthology.orchestra.run.smithi046.stderr:curl: (7) Failed to connect to smithi046.front.sepia.ceph.com port 443: Connection refused 2024-03-09T14:22:22.193 DEBUG:teuthology.orchestra.run.smithi046:> curl https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:22.223 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:22:22.224 INFO:teuthology.orchestra.run.smithi046.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:22:22.224 INFO:teuthology.orchestra.run.smithi046.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:22:22.224 INFO:teuthology.orchestra.run.smithi046.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:22:22.224 INFO:teuthology.orchestra.run.smithi046.stderr:curl: (7) Failed to connect to smithi046.front.sepia.ceph.com port 443: Connection refused 2024-03-09T14:22:30.734 INFO:tasks.rgw.client.0.smithi046.stdout:2024-03-09T14:22:30.410+0000 a03a0c0 -1 ssl_private_key was not found: rgw/cert//default.key 2024-03-09T14:22:38.225 DEBUG:teuthology.orchestra.run.smithi046:> curl https://smithi046.front.sepia.ceph.com:443/ 2024-03-09T14:22:38.261 INFO:teuthology.orchestra.run.smithi046.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:22:38.261 INFO:teuthology.orchestra.run.smithi046.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:22:39.275 INFO:teuthology.orchestra.run.smithi046.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 184 0 --:--:-- 0:00:01 --:--:-- 184 2024-03-09T14:22:39.276 INFO:teuthology.orchestra.run.smithi046.stdout:anonymous 2024-03-09T14:22:39.277 INFO:teuthology.run_tasks:Running task tox... 2024-03-09T14:22:39.288 INFO:tasks.tox:Deploying tox from pip... 2024-03-09T14:22:39.289 DEBUG:teuthology.orchestra.run.smithi046:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-03-09T14:22:41.748 DEBUG:teuthology.orchestra.run.smithi046:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-03-09T14:22:42.315 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting tox==3.15.0 2024-03-09T14:22:42.394 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-03-09T14:22:42.542 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting six<2,>=1.14.0 2024-03-09T14:22:42.560 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:22:42.654 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting py<2,>=1.4.17 2024-03-09T14:22:42.672 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-03-09T14:22:42.796 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting packaging>=14 2024-03-09T14:22:42.813 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2024-03-09T14:22:42.887 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting toml>=0.9.4 2024-03-09T14:22:42.904 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-03-09T14:22:42.991 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting pluggy<1,>=0.12.0 2024-03-09T14:22:43.008 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-03-09T14:22:43.117 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting filelock<4,>=3.0.0 2024-03-09T14:22:43.135 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2024-03-09T14:22:43.430 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-03-09T14:22:43.466 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-03-09T14:22:43.729 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting platformdirs<5,>=3.9.1 2024-03-09T14:22:43.746 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-03-09T14:22:43.835 INFO:teuthology.orchestra.run.smithi046.stdout:Collecting distlib<1,>=0.3.7 2024-03-09T14:22:43.852 INFO:teuthology.orchestra.run.smithi046.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-03-09T14:22:43.971 INFO:teuthology.orchestra.run.smithi046.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-03-09T14:22:44.826 INFO:teuthology.orchestra.run.smithi046.stdout:Successfully installed distlib-0.3.8 filelock-3.13.1 packaging-23.2 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-03-09T14:22:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:WARNING: You are using pip version 21.2.3; however, version 24.0 is available. 2024-03-09T14:22:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-03-09T14:22:45.120 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:22:45.133 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:22:45.133 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:22:45.133 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:22:45.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:22:45.160 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:22:45.161 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:22:45.227 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:22:45.228 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:22:45.294 INFO:tasks.workunit:timeout=3h 2024-03-09T14:22:45.294 INFO:tasks.workunit:cleanup=True 2024-03-09T14:22:45.295 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:22:45.361 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:23:59.149 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 95% (11696/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-09T14:23:59.403 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:23:59.403 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.403 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:23:59.403 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:23:59.404 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:23:59.408 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:23:59.483 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:23:59.485 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:23:59.486 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:24:00.154 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:24:00.217 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:24:00.257 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:24:00.258 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:24:00.258 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:24:00.296 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:24:00.299 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:24:00.299 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:24:00.367 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-03-09T14:24:00.368 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-03-09T14:24:00.368 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-09T14:24:00.438 INFO:tasks.workunit.client.0.smithi046.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-09T14:24:00.439 INFO:tasks.workunit.client.0.smithi046.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:24:00.439 INFO:tasks.workunit.client.0.smithi046.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:24:03.157 INFO:tasks.workunit.client.0.smithi046.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:24:03.158 INFO:tasks.workunit.client.0.smithi046.stderr:++ deactivate nondestructive 2024-03-09T14:24:03.158 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:24:03.158 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:24:03.158 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:24:03.158 INFO:tasks.workunit.client.0.smithi046.stderr:++ hash -r 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ export VIRTUAL_ENV 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ export PATH 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -z '' ']' 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ PS1='(rgw) ' 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ export PS1 2024-03-09T14:24:03.159 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:24:03.160 INFO:tasks.workunit.client.0.smithi046.stderr:++ hash -r 2024-03-09T14:24:03.160 INFO:tasks.workunit.client.0.smithi046.stderr:+ pip install pip --upgrade 2024-03-09T14:24:03.394 INFO:tasks.workunit.client.0.smithi046.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-09T14:24:03.611 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting pip 2024-03-09T14:24:03.691 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:24:03.899 INFO:tasks.workunit.client.0.smithi046.stdout:Installing collected packages: pip 2024-03-09T14:24:03.899 INFO:tasks.workunit.client.0.smithi046.stdout: Attempting uninstall: pip 2024-03-09T14:24:03.899 INFO:tasks.workunit.client.0.smithi046.stdout: Found existing installation: pip 21.2.3 2024-03-09T14:24:04.053 INFO:tasks.workunit.client.0.smithi046.stdout: Uninstalling pip-21.2.3: 2024-03-09T14:24:04.059 INFO:tasks.workunit.client.0.smithi046.stdout: Successfully uninstalled pip-21.2.3 2024-03-09T14:24:05.082 INFO:tasks.workunit.client.0.smithi046.stdout:Successfully installed pip-24.0 2024-03-09T14:24:05.351 INFO:tasks.workunit.client.0.smithi046.stderr:+ pip install boto3 2024-03-09T14:24:06.309 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting boto3 2024-03-09T14:24:06.393 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:24:07.021 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:24:07.039 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:24:07.167 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:24:07.184 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:24:07.323 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:24:07.347 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:24:07.518 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:24:07.534 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:24:07.712 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:24:07.729 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-09T14:24:07.804 INFO:tasks.workunit.client.0.smithi046.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 536.5 kB/s eta 0:00:00 2024-03-09T14:24:07.999 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:24:08.016 INFO:tasks.workunit.client.0.smithi046.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:24:08.110 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:24:08.189 INFO:tasks.workunit.client.0.smithi046.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 1.7 MB/s eta 0:00:00 2024-03-09T14:24:08.212 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:24:08.733 INFO:tasks.workunit.client.0.smithi046.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 22.4 MB/s eta 0:00:00 2024-03-09T14:24:08.750 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:24:08.806 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:24:08.857 INFO:tasks.workunit.client.0.smithi046.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.1/82.1 kB 1.5 MB/s eta 0:00:00 2024-03-09T14:24:08.876 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:24:08.933 INFO:tasks.workunit.client.0.smithi046.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 4.0 MB/s eta 0:00:00 2024-03-09T14:24:08.952 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-09T14:24:09.017 INFO:tasks.workunit.client.0.smithi046.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 2.1 MB/s eta 0:00:00 2024-03-09T14:24:09.039 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:24:09.198 INFO:tasks.workunit.client.0.smithi046.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:24:10.286 INFO:tasks.workunit.client.0.smithi046.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-09T14:24:10.431 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-03-09T14:24:10.564 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-03-09T14:24:10.598 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:10.598 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:10.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.631+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 realm 2024-03-09T14:24:10.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:10.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.633+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.634+0000 7fd97dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:10.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.634+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.635+0000 7fd97dc13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:10.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.635+0000 7fd97dc13800 20 searching for the correct realm 2024-03-09T14:24:10.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.638+0000 7fd97bf10640 0 -- 172.21.15.46:0/969034036 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x5631dadbdcf0 msgr2=0x5631dadc0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:10.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.642+0000 7fd97af0e640 0 -- 172.21.15.46:0/969034036 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5631dadc5770 msgr2=0x5631dadc7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.646+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 zone default found 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 4 Realm: () 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 zonegroup default 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.647+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 started sync module instance, tier type = 2024-03-09T14:24:10.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.648+0000 7fd97dc13800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=0 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=1 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=2 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=3 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=4 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=5 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.658+0000 7fd97dc13800 20 add_watcher() i=6 2024-03-09T14:24:10.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.659+0000 7fd97dc13800 20 add_watcher() i=7 2024-03-09T14:24:10.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.659+0000 7fd97dc13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:10.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.661+0000 7fd831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:10.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.661+0000 7fd97dc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:10.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.661+0000 7fd97dc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:10.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.661+0000 7fd97dc13800 5 note: GC not initialized 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.661+0000 7fd830fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 20 Filter name: none 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd7aa7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-09T14:24:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.662+0000 7fd97dc13800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-09T14:24:10.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.664+0000 7fd97dc13800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-09T14:24:10.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.664+0000 7fd97dc13800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:24:10.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.664+0000 7fd97dc13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-03-09T14:24:10.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.665+0000 7fd85effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822656 cookie 94772125233344 notifier 4532 bl.length()=593 2024-03-09T14:24:10.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.665+0000 7fd85effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-09T14:24:10.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.665+0000 7fd85effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:24:10.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.689+0000 7fd97dc13800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-09T14:24:10.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.689+0000 7fd97dc13800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:24:10.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.689+0000 7fd97dc13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-03-09T14:24:10.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.690+0000 7fd85effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822656 cookie 94772125268368 notifier 4532 bl.length()=186 2024-03-09T14:24:10.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.690+0000 7fd85effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-09T14:24:10.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.690+0000 7fd85effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:24:10.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.692+0000 7fd831fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:10.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.695+0000 7fd97dc13800 20 remove_watcher() i=0 2024-03-09T14:24:10.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.695+0000 7fd97dc13800 2 removed watcher, disabling cache 2024-03-09T14:24:10.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.696+0000 7fd97dc13800 20 remove_watcher() i=1 2024-03-09T14:24:10.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.697+0000 7fd97dc13800 20 remove_watcher() i=2 2024-03-09T14:24:10.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.699+0000 7fd97dc13800 20 remove_watcher() i=3 2024-03-09T14:24:10.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.700+0000 7fd97dc13800 20 remove_watcher() i=4 2024-03-09T14:24:10.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.701+0000 7fd97dc13800 20 remove_watcher() i=5 2024-03-09T14:24:10.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.702+0000 7fd97dc13800 20 remove_watcher() i=6 2024-03-09T14:24:10.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:10.703+0000 7fd97dc13800 20 remove_watcher() i=7 2024-03-09T14:24:10.922 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:10.922 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:11.098 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:11.099 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:11.204 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:11.204 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:11.437 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:11.438 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:11.857 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:11.858 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:11.969 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:11.969 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.043 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.043 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.068 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.069 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.169 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.169 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.287 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.287 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.322 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.322 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.384 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.384 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.410 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.410 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.460 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.460 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.486 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.487 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.543 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:12.543 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:12.567 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: recalculated bucket check stats are correct 2024-03-09T14:24:12.567 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:12.568 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-09T14:24:12.596 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:12.596 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:12.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.630+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:12.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:12.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 realm 2024-03-09T14:24:12.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.631+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.632+0000 7f2d5181e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:12.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.632+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:12.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.633+0000 7f2d5181e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:12.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.633+0000 7f2d5181e800 20 searching for the correct realm 2024-03-09T14:24:12.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.636+0000 7f2d4eb19640 0 -- 172.21.15.46:0/2497349057 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f2d4002e410 msgr2=0x7f2d4002e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:12.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:12.842+0000 7f2d4f31a640 0 -- 172.21.15.46:0/2497349057 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f2d440a13e0 msgr2=0x7f2d440d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:13.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:13.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:13.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:13.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:13.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.049+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 zone default found 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 4 Realm: () 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 zonegroup default 2024-03-09T14:24:13.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.050+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.051+0000 7f2d5181e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.051+0000 7f2d5181e800 20 started sync module instance, tier type = 2024-03-09T14:24:13.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.051+0000 7f2d5181e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:13.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=0 2024-03-09T14:24:13.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=1 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=2 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=3 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=4 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=5 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.062+0000 7f2d5181e800 20 add_watcher() i=6 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.063+0000 7f2d5181e800 20 add_watcher() i=7 2024-03-09T14:24:13.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.063+0000 7f2d5181e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:13.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.065+0000 7f2c05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:13.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.065+0000 7f2d5181e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:13.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.065+0000 7f2d5181e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:13.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2d5181e800 5 note: GC not initialized 2024-03-09T14:24:13.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2c04fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:13.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2d5181e800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:13.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2d5181e800 20 Filter name: none 2024-03-09T14:24:13.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2b7e7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:13.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2d5181e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:13.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.066+0000 7f2d5181e800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:13.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:13.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:13.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:13.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:13.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:13.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:13.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.067+0000 7f2d5181e800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.068+0000 7f2d5181e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.068+0000 7f2d5181e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.068+0000 7f2d5181e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:24:13.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.068+0000 7f2d5181e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:24:13.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.071+0000 7f2c05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:13.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.073+0000 7f2d5181e800 20 remove_watcher() i=0 2024-03-09T14:24:13.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.073+0000 7f2d5181e800 2 removed watcher, disabling cache 2024-03-09T14:24:13.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.075+0000 7f2d5181e800 20 remove_watcher() i=1 2024-03-09T14:24:13.076 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.076+0000 7f2d5181e800 20 remove_watcher() i=2 2024-03-09T14:24:13.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.077+0000 7f2d5181e800 20 remove_watcher() i=3 2024-03-09T14:24:13.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.078+0000 7f2d5181e800 20 remove_watcher() i=4 2024-03-09T14:24:13.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.079+0000 7f2d5181e800 20 remove_watcher() i=5 2024-03-09T14:24:13.080 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.080+0000 7f2d5181e800 20 remove_watcher() i=6 2024-03-09T14:24:13.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.081+0000 7f2d5181e800 20 remove_watcher() i=7 2024-03-09T14:24:13.092 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-09T14:24:13.119 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:13.120 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:13.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.153+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 realm 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.155+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.156+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:13.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.156+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.157+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:13.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.157+0000 7f81c988c800 20 searching for the correct realm 2024-03-09T14:24:13.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.160+0000 7f81c7b89640 0 -- 172.21.15.46:0/3984636126 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x559f6baf3cd0 msgr2=0x559f6baf6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:13.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.164+0000 7f81c7388640 0 -- 172.21.15.46:0/3984636126 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f81bc05b040 msgr2=0x7f81bc089040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.168+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:13.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 zone default found 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 4 Realm: () 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 zonegroup default 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.169+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.170+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.170+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.170+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.170+0000 7f81c988c800 20 started sync module instance, tier type = 2024-03-09T14:24:13.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.170+0000 7f81c988c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=0 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=1 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=2 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=3 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=4 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=5 2024-03-09T14:24:13.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.181+0000 7f81c988c800 20 add_watcher() i=6 2024-03-09T14:24:13.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.182+0000 7f81c988c800 20 add_watcher() i=7 2024-03-09T14:24:13.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.182+0000 7f81c988c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.183+0000 7f807dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 5 note: GC not initialized 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f807cfe1640 20 reqs_thread_entry: start 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 Filter name: none 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f7ff67fc640 20 reqs_thread_entry: start 2024-03-09T14:24:13.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.184+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:13.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:13.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.185+0000 7f81c988c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:13.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.186+0000 7f81c988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.186+0000 7f81c988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.187+0000 7f807dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:13.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.189+0000 7f81c988c800 20 remove_watcher() i=0 2024-03-09T14:24:13.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.189+0000 7f81c988c800 2 removed watcher, disabling cache 2024-03-09T14:24:13.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.190+0000 7f81c988c800 20 remove_watcher() i=1 2024-03-09T14:24:13.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.191+0000 7f81c988c800 20 remove_watcher() i=2 2024-03-09T14:24:13.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.192+0000 7f81c988c800 20 remove_watcher() i=3 2024-03-09T14:24:13.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.193+0000 7f81c988c800 20 remove_watcher() i=4 2024-03-09T14:24:13.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.194+0000 7f81c988c800 20 remove_watcher() i=5 2024-03-09T14:24:13.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.195+0000 7f81c988c800 20 remove_watcher() i=6 2024-03-09T14:24:13.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.196+0000 7f81c988c800 20 remove_watcher() i=7 2024-03-09T14:24:13.206 INFO:tasks.workunit.client.0.smithi046.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 98, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-03-09T14:24:13.206 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check unlinked does not report normal entries 2024-03-09T14:24:13.207 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:13.207 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:24:13.239 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:13.239 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:13.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.273+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 realm 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.274+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.275+0000 7f3e0ea11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:13.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.275+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.276+0000 7f3e0ea11800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:13.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.276+0000 7f3e0ea11800 20 searching for the correct realm 2024-03-09T14:24:13.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.278+0000 7f3e097dd640 0 -- 172.21.15.46:0/518737097 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55c96b628b20 msgr2=0x55c96b62af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:13.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.282+0000 7f3e09fde640 0 -- 172.21.15.46:0/518737097 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f3e00039070 msgr2=0x7f3e000089c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:13.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:13.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:13.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:13.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:13.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:13.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:13.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.489+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 20 zone default found 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 4 Realm: () 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 20 zonegroup default 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.490+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.491+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.491+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.491+0000 7f3e0ea11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:13.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.491+0000 7f3e0ea11800 20 started sync module instance, tier type = 2024-03-09T14:24:13.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.491+0000 7f3e0ea11800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:13.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=0 2024-03-09T14:24:13.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=1 2024-03-09T14:24:13.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=2 2024-03-09T14:24:13.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=3 2024-03-09T14:24:13.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=4 2024-03-09T14:24:13.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=5 2024-03-09T14:24:13.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.504+0000 7f3e0ea11800 20 add_watcher() i=6 2024-03-09T14:24:13.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.505+0000 7f3e0ea11800 20 add_watcher() i=7 2024-03-09T14:24:13.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.505+0000 7f3e0ea11800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:13.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.506+0000 7f3cbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 5 note: GC not initialized 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3cba7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 20 Filter name: none 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3c2bfff640 20 reqs_thread_entry: start 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.507+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:13.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:13.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:13.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:13.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.508+0000 7f3e0ea11800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.509+0000 7f3e0ea11800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.509+0000 7f3e0ea11800 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:24:13.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.510+0000 7f3cbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:13.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.512+0000 7f3e0ea11800 20 remove_watcher() i=0 2024-03-09T14:24:13.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.512+0000 7f3e0ea11800 2 removed watcher, disabling cache 2024-03-09T14:24:13.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.514+0000 7f3e0ea11800 20 remove_watcher() i=1 2024-03-09T14:24:13.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.515+0000 7f3e0ea11800 20 remove_watcher() i=2 2024-03-09T14:24:13.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.516+0000 7f3e0ea11800 20 remove_watcher() i=3 2024-03-09T14:24:13.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.519+0000 7f3e0ea11800 20 remove_watcher() i=4 2024-03-09T14:24:13.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.520+0000 7f3e0ea11800 20 remove_watcher() i=5 2024-03-09T14:24:13.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.521+0000 7f3e0ea11800 20 remove_watcher() i=6 2024-03-09T14:24:13.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:13.522+0000 7f3e0ea11800 20 remove_watcher() i=7 2024-03-09T14:24:13.533 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:24:13.941 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:24:15.340 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:15.340 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:15.433 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:15.435 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:24:15.467 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:15.467 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:15.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.503+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.504+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.504+0000 7f5671412800 20 realm 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.504+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.505+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.505+0000 7f5671412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.505+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.505+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.505+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.506+0000 7f5671412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:15.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.506+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.507+0000 7f5671412800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:15.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.507+0000 7f5671412800 20 searching for the correct realm 2024-03-09T14:24:15.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.510+0000 7f566d282640 0 -- 172.21.15.46:0/1232076114 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55b203592be0 msgr2=0x55b2035950a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:15.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.514+0000 7f566ca81640 0 -- 172.21.15.46:0/1232076114 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f5660017070 msgr2=0x7f566001bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:15.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:15.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.519+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:15.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 zone default found 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 4 Realm: () 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 zonegroup default 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.520+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.521+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.521+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.521+0000 7f5671412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.521+0000 7f5671412800 20 started sync module instance, tier type = 2024-03-09T14:24:15.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.521+0000 7f5671412800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:15.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=0 2024-03-09T14:24:15.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=1 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=2 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=3 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=4 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=5 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.532+0000 7f5671412800 20 add_watcher() i=6 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.533+0000 7f5671412800 20 add_watcher() i=7 2024-03-09T14:24:15.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.533+0000 7f5671412800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:15.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.535+0000 7f5522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.535+0000 7f5671412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.535+0000 7f5671412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.535+0000 7f5671412800 5 note: GC not initialized 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f5521fe3640 20 reqs_thread_entry: start 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f5671412800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f5671412800 20 Filter name: none 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f54937fe640 20 reqs_thread_entry: start 2024-03-09T14:24:15.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f5671412800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:15.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.536+0000 7f5671412800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.537+0000 7f5671412800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:15.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.537+0000 7f5671412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:15.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.537+0000 7f5671412800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:15.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.537+0000 7f5671412800 20 INFO: main: starting shard=0 2024-03-09T14:24:15.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.537+0000 7f5671412800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:15.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.538+0000 7f5671412800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:24:15.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.538+0000 7f5671412800 20 INFO: main: done 2024-03-09T14:24:15.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.538+0000 7f5522fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:15.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.544+0000 7f5671412800 20 remove_watcher() i=0 2024-03-09T14:24:15.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.544+0000 7f5671412800 2 removed watcher, disabling cache 2024-03-09T14:24:15.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.545+0000 7f5671412800 20 remove_watcher() i=1 2024-03-09T14:24:15.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.546+0000 7f5671412800 20 remove_watcher() i=2 2024-03-09T14:24:15.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.548+0000 7f5671412800 20 remove_watcher() i=3 2024-03-09T14:24:15.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.549+0000 7f5671412800 20 remove_watcher() i=4 2024-03-09T14:24:15.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.550+0000 7f5671412800 20 remove_watcher() i=5 2024-03-09T14:24:15.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.551+0000 7f5671412800 20 remove_watcher() i=6 2024-03-09T14:24:15.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.552+0000 7f5671412800 20 remove_watcher() i=7 2024-03-09T14:24:15.564 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:15.564 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:15.590 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:15.590 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:15.672 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:15.673 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:24:15.703 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:15.703 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:15.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.737+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 realm 2024-03-09T14:24:15.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:15.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:15.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.739+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.740+0000 7f9fcf539800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:15.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.740+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:15.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.741+0000 7f9fcf539800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:15.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.741+0000 7f9fcf539800 20 searching for the correct realm 2024-03-09T14:24:15.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.741+0000 7f9fcbace640 0 -- 172.21.15.46:0/3076880864 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x555e67f78d20 msgr2=0x555e67f7b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:15.947 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:15.946+0000 7f9fcbace640 0 -- 172.21.15.46:0/3076880864 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f9fc0025070 msgr2=0x7f9fc000ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:16.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:16.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.156+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:16.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 zone default found 2024-03-09T14:24:16.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 4 Realm: () 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 zonegroup default 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.157+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.158+0000 7f9fcf539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.158+0000 7f9fcf539800 20 started sync module instance, tier type = 2024-03-09T14:24:16.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.158+0000 7f9fcf539800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:16.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=0 2024-03-09T14:24:16.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=1 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=2 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=3 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=4 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=5 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.170+0000 7f9fcf539800 20 add_watcher() i=6 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.171+0000 7f9fcf539800 20 add_watcher() i=7 2024-03-09T14:24:16.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.171+0000 7f9fcf539800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:16.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.173+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.173+0000 7f9fcf539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.173+0000 7f9fcf539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.173+0000 7f9fcf539800 5 note: GC not initialized 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9e80fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9fcf539800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9fcf539800 20 Filter name: none 2024-03-09T14:24:16.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9dfa7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:16.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9fcf539800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:16.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.174+0000 7f9fcf539800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.175+0000 7f9fcf539800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.175+0000 7f9fcf539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.175+0000 7f9fcf539800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.175+0000 7f9fcf539800 20 INFO: main: starting shard=0 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.175+0000 7f9fcf539800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.176+0000 7f9fcf539800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:24:16.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.176+0000 7f9fcf539800 20 INFO: main: done 2024-03-09T14:24:16.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.176+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:16.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.179+0000 7f9fcf539800 20 remove_watcher() i=0 2024-03-09T14:24:16.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.179+0000 7f9fcf539800 2 removed watcher, disabling cache 2024-03-09T14:24:16.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.180+0000 7f9fcf539800 20 remove_watcher() i=1 2024-03-09T14:24:16.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.181+0000 7f9fcf539800 20 remove_watcher() i=2 2024-03-09T14:24:16.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.183+0000 7f9fcf539800 20 remove_watcher() i=3 2024-03-09T14:24:16.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.184+0000 7f9fcf539800 20 remove_watcher() i=4 2024-03-09T14:24:16.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.185+0000 7f9fcf539800 20 remove_watcher() i=5 2024-03-09T14:24:16.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.186+0000 7f9fcf539800 20 remove_watcher() i=6 2024-03-09T14:24:16.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.187+0000 7f9fcf539800 20 remove_watcher() i=7 2024-03-09T14:24:16.199 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:16.199 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:16.224 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:16.224 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:16.249 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:16.249 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:16.331 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:16.332 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-09T14:24:16.364 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:16.364 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:16.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.397+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 realm 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.399+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.400+0000 7f8ad3013800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:16.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.400+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.401+0000 7f8ad3013800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:16.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.401+0000 7f8ad3013800 20 searching for the correct realm 2024-03-09T14:24:16.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.404+0000 7f8ace7cc640 0 -- 172.21.15.46:0/4155915941 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f8ac8064040 msgr2=0x7f8ac805e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:16.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.409+0000 7f8ace7cc640 0 -- 172.21.15.46:0/4155915941 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f8ac4035070 msgr2=0x7f8ac4018980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.615+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:16.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:16.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 zone default found 2024-03-09T14:24:16.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 4 Realm: () 2024-03-09T14:24:16.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 zonegroup default 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.616+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.617+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.617+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.617+0000 7f8ad3013800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.617+0000 7f8ad3013800 20 started sync module instance, tier type = 2024-03-09T14:24:16.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.617+0000 7f8ad3013800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:16.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=0 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=1 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=2 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=3 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=4 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=5 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.629+0000 7f8ad3013800 20 add_watcher() i=6 2024-03-09T14:24:16.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.630+0000 7f8ad3013800 20 add_watcher() i=7 2024-03-09T14:24:16.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.630+0000 7f8ad3013800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:16.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8984fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:16.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8ad3013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:16.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8ad3013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:16.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8ad3013800 5 note: GC not initialized 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f88ff7fe640 20 reqs_thread_entry: start 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8ad3013800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8ad3013800 20 Filter name: none 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f88fd7fa640 20 reqs_thread_entry: start 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.632+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 INFO: main: starting shard=0 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.633+0000 7f8ad3013800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:16.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.634+0000 7f8ad3013800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:24:16.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.634+0000 7f8ad3013800 20 INFO: main: done 2024-03-09T14:24:16.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.635+0000 7f8984fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:16.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.637+0000 7f8ad3013800 20 remove_watcher() i=0 2024-03-09T14:24:16.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.637+0000 7f8ad3013800 2 removed watcher, disabling cache 2024-03-09T14:24:16.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.639+0000 7f8ad3013800 20 remove_watcher() i=1 2024-03-09T14:24:16.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.640+0000 7f8ad3013800 20 remove_watcher() i=2 2024-03-09T14:24:16.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.641+0000 7f8ad3013800 20 remove_watcher() i=3 2024-03-09T14:24:16.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.642+0000 7f8ad3013800 20 remove_watcher() i=4 2024-03-09T14:24:16.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.643+0000 7f8ad3013800 20 remove_watcher() i=5 2024-03-09T14:24:16.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.644+0000 7f8ad3013800 20 remove_watcher() i=6 2024-03-09T14:24:16.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.645+0000 7f8ad3013800 20 remove_watcher() i=7 2024-03-09T14:24:16.657 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:16.657 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:16.681 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:16.681 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:16.760 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:16.761 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-09T14:24:16.791 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:16.791 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:16.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.824+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.825+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.825+0000 7f5d7d92a800 20 realm 2024-03-09T14:24:16.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.825+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.826+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.826+0000 7f5d7d92a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:16.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.826+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.826+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.826+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.827+0000 7f5d7d92a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:16.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.827+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.828+0000 7f5d7d92a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:16.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.828+0000 7f5d7d92a800 20 searching for the correct realm 2024-03-09T14:24:16.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.831+0000 7f5d79ec0640 0 -- 172.21.15.46:0/1050422992 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55e197ecc1c0 msgr2=0x55e197ece620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:16.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.835+0000 7f5d78ebe640 0 -- 172.21.15.46:0/1050422992 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55e197ed3c40 msgr2=0x55e197ed6030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.839+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 zone default found 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 4 Realm: () 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 zonegroup default 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.840+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.841+0000 7f5d7d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:16.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.841+0000 7f5d7d92a800 20 started sync module instance, tier type = 2024-03-09T14:24:16.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.841+0000 7f5d7d92a800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=0 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=1 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=2 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=3 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=4 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=5 2024-03-09T14:24:16.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=6 2024-03-09T14:24:16.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 20 add_watcher() i=7 2024-03-09T14:24:16.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.853+0000 7f5d7d92a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:16.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.855+0000 7f5c2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:16.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:16.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 5 note: GC not initialized 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5c2e7e4640 20 reqs_thread_entry: start 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 Filter name: none 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5b9ffff640 20 reqs_thread_entry: start 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:16.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.856+0000 7f5d7d92a800 20 rados->read ofs=0 len=0 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.857+0000 7f5d7d92a800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.857+0000 7f5d7d92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.857+0000 7f5d7d92a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.857+0000 7f5d7d92a800 20 INFO: main: starting shard=0 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.857+0000 7f5d7d92a800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.858+0000 7f5d7d92a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:24:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.858+0000 7f5d7d92a800 20 INFO: main: done 2024-03-09T14:24:16.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.858+0000 7f5c2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:16.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.861+0000 7f5d7d92a800 20 remove_watcher() i=0 2024-03-09T14:24:16.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.861+0000 7f5d7d92a800 2 removed watcher, disabling cache 2024-03-09T14:24:16.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.862+0000 7f5d7d92a800 20 remove_watcher() i=1 2024-03-09T14:24:16.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.863+0000 7f5d7d92a800 20 remove_watcher() i=2 2024-03-09T14:24:16.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.864+0000 7f5d7d92a800 20 remove_watcher() i=3 2024-03-09T14:24:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.865+0000 7f5d7d92a800 20 remove_watcher() i=4 2024-03-09T14:24:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.866+0000 7f5d7d92a800 20 remove_watcher() i=5 2024-03-09T14:24:16.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.867+0000 7f5d7d92a800 20 remove_watcher() i=6 2024-03-09T14:24:16.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:16.868+0000 7f5d7d92a800 20 remove_watcher() i=7 2024-03-09T14:24:16.880 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:16.880 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:16.903 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:24:17.305 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:24:17.707 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check unlinked finds unlistable entries 2024-03-09T14:24:17.707 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:17.708 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:24:17.739 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:17.739 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:17.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.772+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 realm 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.774+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.775+0000 7fc5af430800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:17.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.775+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.776+0000 7fc5af430800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:17.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.776+0000 7fc5af430800 20 searching for the correct realm 2024-03-09T14:24:17.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.780+0000 7fc5aaf31640 0 -- 172.21.15.46:0/2351737329 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7fc5a000b040 msgr2=0x7fc5a0057f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:17.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.986+0000 7fc5aa730640 0 -- 172.21.15.46:0/2351737329 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55d6b1101180 msgr2=0x55d6b11035b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.989+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:17.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 zone default found 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 4 Realm: () 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 zonegroup default 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.990+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.991+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.991+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:17.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.991+0000 7fc5af430800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:17.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.991+0000 7fc5af430800 20 started sync module instance, tier type = 2024-03-09T14:24:17.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:17.991+0000 7fc5af430800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:18.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=0 2024-03-09T14:24:18.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=1 2024-03-09T14:24:18.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=2 2024-03-09T14:24:18.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=3 2024-03-09T14:24:18.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=4 2024-03-09T14:24:18.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=5 2024-03-09T14:24:18.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.001+0000 7fc5af430800 20 add_watcher() i=6 2024-03-09T14:24:18.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.002+0000 7fc5af430800 20 add_watcher() i=7 2024-03-09T14:24:18.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.002+0000 7fc5af430800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:18.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc460fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:18.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc5af430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:18.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc5af430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:18.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc5af430800 5 note: GC not initialized 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc3db7fe640 20 reqs_thread_entry: start 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc5af430800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.004+0000 7fc5af430800 20 Filter name: none 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc3d97fa640 20 reqs_thread_entry: start 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:18.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.005+0000 7fc5af430800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.008+0000 7fc5af430800 1 NOTICE: finished shard 0 (4 entries found) 2024-03-09T14:24:18.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.008+0000 7fc5af430800 1 NOTICE: finished all shards (4 entries found) 2024-03-09T14:24:18.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.009+0000 7fc460fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:18.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.011+0000 7fc5af430800 20 remove_watcher() i=0 2024-03-09T14:24:18.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.011+0000 7fc5af430800 2 removed watcher, disabling cache 2024-03-09T14:24:18.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.013+0000 7fc5af430800 20 remove_watcher() i=1 2024-03-09T14:24:18.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.014+0000 7fc5af430800 20 remove_watcher() i=2 2024-03-09T14:24:18.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.016+0000 7fc5af430800 20 remove_watcher() i=3 2024-03-09T14:24:18.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.017+0000 7fc5af430800 20 remove_watcher() i=4 2024-03-09T14:24:18.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.018+0000 7fc5af430800 20 remove_watcher() i=5 2024-03-09T14:24:18.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.019+0000 7fc5af430800 20 remove_watcher() i=6 2024-03-09T14:24:18.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.020+0000 7fc5af430800 20 remove_watcher() i=7 2024-03-09T14:24:18.030 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: unlinked entries are not listable 2024-03-09T14:24:18.030 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:18.033 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.033 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.145 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-03-09T14:24:18.145 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:18.147 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.147 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.220 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.220 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.281 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-03-09T14:24:18.282 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:18.283 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:24:18.316 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:18.316 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:18.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.349+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 realm 2024-03-09T14:24:18.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:18.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.351+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.352+0000 7fe791331800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:18.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.352+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.353+0000 7fe791331800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:18.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.353+0000 7fe791331800 20 searching for the correct realm 2024-03-09T14:24:18.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.356+0000 7fe78d031640 0 -- 172.21.15.46:0/703144199 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fe78807d010 msgr2=0x7fe788077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:18.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.361+0000 7fe78d031640 0 -- 172.21.15.46:0/703144199 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fe7840d17a0 msgr2=0x7fe78409f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.568+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 zone default found 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 4 Realm: () 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 zonegroup default 2024-03-09T14:24:18.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.569+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.570+0000 7fe791331800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.570+0000 7fe791331800 20 started sync module instance, tier type = 2024-03-09T14:24:18.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.570+0000 7fe791331800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:18.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=0 2024-03-09T14:24:18.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=1 2024-03-09T14:24:18.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=2 2024-03-09T14:24:18.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=3 2024-03-09T14:24:18.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=4 2024-03-09T14:24:18.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=5 2024-03-09T14:24:18.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.584+0000 7fe791331800 20 add_watcher() i=6 2024-03-09T14:24:18.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.585+0000 7fe791331800 20 add_watcher() i=7 2024-03-09T14:24:18.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.585+0000 7fe791331800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:18.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.587+0000 7fe643fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:18.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.587+0000 7fe791331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:18.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.587+0000 7fe791331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:18.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.587+0000 7fe791331800 5 note: GC not initialized 2024-03-09T14:24:18.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe642fe5640 20 reqs_thread_entry: start 2024-03-09T14:24:18.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:18.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 20 Filter name: none 2024-03-09T14:24:18.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe640fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:18.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:18.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.588+0000 7fe791331800 20 rados->read ofs=0 len=0 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:18.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:18.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:18.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:18.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.589+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.590+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.591+0000 7fe791331800 20 get_obj_state: octx=0x55980eed5540 obj=check-bucket:c state=0x55980f1a40c8 s->prefetch_data=0 2024-03-09T14:24:18.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.591+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to nv1e6smj47ka69xhlqs8hv2oss9e3ej7 2024-03-09T14:24:18.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.591+0000 7fe791331800 20 get_obj_state_impl: setting s->olh_tag to h0hryqwf7f1ll8l9htgxx43h1z24hz35 2024-03-09T14:24:18.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.591+0000 7fe791331800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h0hryqwf7f1ll8l9htgxx43h1z24hz35 2024-03-09T14:24:18.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.593+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.596+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 20 olh_log_entry: epoch=3 op=3 key=c[QD.fuRKiQTp9gwzXDWF2i9TYgSQYUph] 2024-03-09T14:24:18.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 20 get_obj_state: octx=0x55980eed5540 obj=check-bucket:_:QD.fuRKiQTp9gwzXDWF2i9TYgSQYUph_c state=0x55980f1e0278 s->prefetch_data=0 2024-03-09T14:24:18.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 10 manifest: total_size = 22 2024-03-09T14:24:18.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17041415729142186274 2024-03-09T14:24:18.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 20 get_obj_state: octx=0x55980eed5540 obj=check-bucket:_:QD.fuRKiQTp9gwzXDWF2i9TYgSQYUph_c state=0x55980f1e0278 s->prefetch_data=0 2024-03-09T14:24:18.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 20 prepare_atomic_modification: state is not atomic. state=0x55980f1e0278 2024-03-09T14:24:18.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.597+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.604+0000 7fe670ff9640 20 handle_completion(): completion ok for obj=c[QD.fuRKiQTp9gwzXDWF2i9TYgSQYUph] 2024-03-09T14:24:18.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.604+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.604+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.606+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.606+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.607+0000 7fe791331800 20 get_obj_state: octx=0x55980eed5540 obj=check-bucket:d state=0x55980f19e538 s->prefetch_data=0 2024-03-09T14:24:18.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.607+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to n9f7c6vy75drt820m31bfvjq67la2oxh 2024-03-09T14:24:18.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.607+0000 7fe791331800 20 get_obj_state_impl: setting s->olh_tag to ahwpw2z7athdcmnjhfo64lrbfzdl6sc9 2024-03-09T14:24:18.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.607+0000 7fe791331800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ahwpw2z7athdcmnjhfo64lrbfzdl6sc9 2024-03-09T14:24:18.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.609+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.612+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 20 olh_log_entry: epoch=3 op=3 key=d[vvae5umF8PYMlO3yafHBaLQWVk7ZDVR] 2024-03-09T14:24:18.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 20 get_obj_state: octx=0x55980eed5540 obj=check-bucket:_:vvae5umF8PYMlO3yafHBaLQWVk7ZDVR_d state=0x55980f1e1288 s->prefetch_data=0 2024-03-09T14:24:18.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 10 manifest: total_size = 22 2024-03-09T14:24:18.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17943447822977204563 2024-03-09T14:24:18.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 20 get_obj_state: octx=0x55980eed5540 obj=check-bucket:_:vvae5umF8PYMlO3yafHBaLQWVk7ZDVR_d state=0x55980f1e1288 s->prefetch_data=0 2024-03-09T14:24:18.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 20 prepare_atomic_modification: state is not atomic. state=0x55980f1e1288 2024-03-09T14:24:18.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.613+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.618+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.618+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.618+0000 7fe670ff9640 20 handle_completion(): completion ok for obj=d[vvae5umF8PYMlO3yafHBaLQWVk7ZDVR] 2024-03-09T14:24:18.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.619+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.619+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.620+0000 7fe791331800 20 get_obj_state: octx=0x7fe788054ba0 obj=check-bucket:e state=0x55980f1e5cf8 s->prefetch_data=0 2024-03-09T14:24:18.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.620+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to qx11l39k50kz1ix2pnzr0ksmbe9cdsso 2024-03-09T14:24:18.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.620+0000 7fe791331800 20 get_obj_state_impl: setting s->olh_tag to 6vesjwziw0b4qgdbwj1rqwdwzljqjyjm 2024-03-09T14:24:18.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.620+0000 7fe791331800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6vesjwziw0b4qgdbwj1rqwdwzljqjyjm 2024-03-09T14:24:18.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.622+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.624+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-09T14:24:18.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 olh_log_entry: epoch=2 op=3 key=e[E.fvcHGFU90x-5KwAUsg3qeKmuItAqI] 2024-03-09T14:24:18.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 get_obj_state: octx=0x7fe788054ba0 obj=check-bucket:_:E.fvcHGFU90x-5KwAUsg3qeKmuItAqI_e state=0x55980f1a1568 s->prefetch_data=0 2024-03-09T14:24:18.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 10 manifest: total_size = 9 2024-03-09T14:24:18.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1695991418493747137 2024-03-09T14:24:18.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 get_obj_state: octx=0x7fe788054ba0 obj=check-bucket:_:E.fvcHGFU90x-5KwAUsg3qeKmuItAqI_e state=0x55980f1a1568 s->prefetch_data=0 2024-03-09T14:24:18.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 prepare_atomic_modification: state is not atomic. state=0x55980f1a1568 2024-03-09T14:24:18.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.625+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.629+0000 7fe670ff9640 20 handle_completion(): completion ok for obj=e[E.fvcHGFU90x-5KwAUsg3qeKmuItAqI] 2024-03-09T14:24:18.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.629+0000 7fe791331800 20 get_obj_state: octx=0x7fe788054ba0 obj=check-bucket:e state=0x55980f1e5cf8 s->prefetch_data=0 2024-03-09T14:24:18.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.629+0000 7fe791331800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6vesjwziw0b4qgdbwj1rqwdwzljqjyjm 2024-03-09T14:24:18.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.632+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.634+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.634+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.635+0000 7fe791331800 20 get_obj_state: octx=0x55980f1a2d50 obj=check-bucket:f state=0x55980f1e5cf8 s->prefetch_data=0 2024-03-09T14:24:18.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.635+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to arpav8mnfbgwl5p3dyvj17ix0bkwea7d 2024-03-09T14:24:18.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.635+0000 7fe791331800 20 get_obj_state_impl: setting s->olh_tag to vjnz27ghogw4mx4xjw4zpn8a73iukkzs 2024-03-09T14:24:18.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.635+0000 7fe791331800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vjnz27ghogw4mx4xjw4zpn8a73iukkzs 2024-03-09T14:24:18.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.636+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-09T14:24:18.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 olh_log_entry: epoch=2 op=3 key=f[JFPHPC3vR.fKFkYJEh32qPTOL5XWVem] 2024-03-09T14:24:18.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 get_obj_state: octx=0x55980f1a2d50 obj=check-bucket:_:JFPHPC3vR.fKFkYJEh32qPTOL5XWVem_f state=0x55980f1a1348 s->prefetch_data=0 2024-03-09T14:24:18.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 10 manifest: total_size = 9 2024-03-09T14:24:18.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12107627852929896926 2024-03-09T14:24:18.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 get_obj_state: octx=0x55980f1a2d50 obj=check-bucket:_:JFPHPC3vR.fKFkYJEh32qPTOL5XWVem_f state=0x55980f1a1348 s->prefetch_data=0 2024-03-09T14:24:18.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 prepare_atomic_modification: state is not atomic. state=0x55980f1a1348 2024-03-09T14:24:18.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.638+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.642+0000 7fe65ffff640 20 handle_completion(): completion ok for obj=f[JFPHPC3vR.fKFkYJEh32qPTOL5XWVem] 2024-03-09T14:24:18.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.643+0000 7fe791331800 20 get_obj_state: octx=0x55980f1a2d50 obj=check-bucket:f state=0x55980f1e5cf8 s->prefetch_data=0 2024-03-09T14:24:18.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.643+0000 7fe791331800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vjnz27ghogw4mx4xjw4zpn8a73iukkzs 2024-03-09T14:24:18.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.645+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.647+0000 7fe791331800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:18.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.647+0000 7fe791331800 1 NOTICE: finished shard 0 (4 entries removed) 2024-03-09T14:24:18.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.647+0000 7fe791331800 1 NOTICE: finished all shards (4 entries removed) 2024-03-09T14:24:18.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.648+0000 7fe643fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:18.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.650+0000 7fe791331800 20 remove_watcher() i=0 2024-03-09T14:24:18.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.650+0000 7fe791331800 2 removed watcher, disabling cache 2024-03-09T14:24:18.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.651+0000 7fe791331800 20 remove_watcher() i=1 2024-03-09T14:24:18.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.652+0000 7fe791331800 20 remove_watcher() i=2 2024-03-09T14:24:18.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.654+0000 7fe791331800 20 remove_watcher() i=3 2024-03-09T14:24:18.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.655+0000 7fe791331800 20 remove_watcher() i=4 2024-03-09T14:24:18.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.656+0000 7fe791331800 20 remove_watcher() i=5 2024-03-09T14:24:18.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.657+0000 7fe791331800 20 remove_watcher() i=6 2024-03-09T14:24:18.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:18.658+0000 7fe791331800 20 remove_watcher() i=7 2024-03-09T14:24:18.670 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.670 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.692 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.692 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.713 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.714 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.735 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.735 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.754 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check unlinked does not affect normal entries 2024-03-09T14:24:18.754 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:18.755 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.755 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.823 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.823 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.847 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.847 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.872 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.872 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.898 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:18.898 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:18.921 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-03-09T14:24:18.921 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:18.922 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:24:18.953 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:18.954 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:19.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.186+0000 7f35716fa640 0 --2- 172.21.15.46:0/3360313541 >> [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] conn(0x560e0b7e25d0 0x560e0b7e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:24:19.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.188+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 realm 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.189+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.190+0000 7f357593c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:19.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.190+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.191+0000 7f357593c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:19.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.191+0000 7f357593c800 20 searching for the correct realm 2024-03-09T14:24:19.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.193+0000 7f35716fa640 0 -- 172.21.15.46:0/3360313541 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f356c017020 msgr2=0x7f356c018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:19.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.196+0000 7f35716fa640 0 -- 172.21.15.46:0/3360313541 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f343c07fe40 msgr2=0x7f343c082230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.203+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:19.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 zone default found 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 4 Realm: () 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 zonegroup default 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.204+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.205+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.205+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.205+0000 7f357593c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.205+0000 7f357593c800 20 started sync module instance, tier type = 2024-03-09T14:24:19.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.205+0000 7f357593c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=0 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=1 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=2 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=3 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=4 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=5 2024-03-09T14:24:19.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.215+0000 7f357593c800 20 add_watcher() i=6 2024-03-09T14:24:19.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.216+0000 7f357593c800 20 add_watcher() i=7 2024-03-09T14:24:19.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.216+0000 7f357593c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:19.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.217+0000 7f34277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:19.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:19.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 5 note: GC not initialized 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f34267e4640 20 reqs_thread_entry: start 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 20 Filter name: none 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f3397fff640 20 reqs_thread_entry: start 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.218+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.219+0000 7f357593c800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.220+0000 7f357593c800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.220+0000 7f357593c800 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:24:19.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.221+0000 7f34277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:19.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.223+0000 7f357593c800 20 remove_watcher() i=0 2024-03-09T14:24:19.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.223+0000 7f357593c800 2 removed watcher, disabling cache 2024-03-09T14:24:19.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.225+0000 7f357593c800 20 remove_watcher() i=1 2024-03-09T14:24:19.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.226+0000 7f357593c800 20 remove_watcher() i=2 2024-03-09T14:24:19.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.227+0000 7f357593c800 20 remove_watcher() i=3 2024-03-09T14:24:19.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.229+0000 7f357593c800 20 remove_watcher() i=4 2024-03-09T14:24:19.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.230+0000 7f357593c800 20 remove_watcher() i=5 2024-03-09T14:24:19.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.231+0000 7f357593c800 20 remove_watcher() i=6 2024-03-09T14:24:19.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.232+0000 7f357593c800 20 remove_watcher() i=7 2024-03-09T14:24:19.244 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:19.245 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:19.368 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:19.368 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:19.419 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:24:19.448 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:19.448 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:19.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.668+0000 7f5ad5554640 0 --2- 172.21.15.46:0/3623402496 >> [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] conn(0x55a9c0f4f020 0x55a9c10d4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:24:19.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.683+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.684+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.684+0000 7f5ad992b800 20 realm 2024-03-09T14:24:19.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.685+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.685+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.685+0000 7f5ad992b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:19.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.685+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.685+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:19.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.685+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.686+0000 7f5ad992b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:19.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.686+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:19.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.687+0000 7f5ad992b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:19.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.687+0000 7f5ad992b800 20 searching for the correct realm 2024-03-09T14:24:19.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:19.890+0000 7f5ad5554640 0 -- 172.21.15.46:0/2750180641 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f5ad0026450 msgr2=0x7f5ad00268d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:20.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.096+0000 7f5ad4d53640 0 -- 172.21.15.46:0/2750180641 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f5ac807e060 msgr2=0x7f5ac8057e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.306+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:20.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:20.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 20 zone default found 2024-03-09T14:24:20.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 4 Realm: () 2024-03-09T14:24:20.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 20 zonegroup default 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.307+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 started sync module instance, tier type = 2024-03-09T14:24:20.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.308+0000 7f5ad992b800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=0 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=1 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=2 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=3 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=4 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=5 2024-03-09T14:24:20.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.321+0000 7f5ad992b800 20 add_watcher() i=6 2024-03-09T14:24:20.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.323+0000 7f5ad992b800 20 add_watcher() i=7 2024-03-09T14:24:20.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.323+0000 7f5ad992b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:20.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.325+0000 7f598b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.325+0000 7f5ad992b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.325+0000 7f5ad992b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.325+0000 7f5ad992b800 5 note: GC not initialized 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.325+0000 7f598a7e4640 20 reqs_thread_entry: start 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.325+0000 7f5ad992b800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.326+0000 7f5ad992b800 20 Filter name: none 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.326+0000 7f58fbfff640 20 reqs_thread_entry: start 2024-03-09T14:24:20.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.326+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.326+0000 7f5ad992b800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:20.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.326+0000 7f5ad992b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:20.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:20.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:20.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 INFO: main: starting shard=0 2024-03-09T14:24:20.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:20.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-09T14:24:20.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.327+0000 7f5ad992b800 20 INFO: main: done 2024-03-09T14:24:20.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.328+0000 7f598b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:20.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.331+0000 7f5ad992b800 20 remove_watcher() i=0 2024-03-09T14:24:20.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.331+0000 7f5ad992b800 2 removed watcher, disabling cache 2024-03-09T14:24:20.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.334+0000 7f5ad992b800 20 remove_watcher() i=1 2024-03-09T14:24:20.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.335+0000 7f5ad992b800 20 remove_watcher() i=2 2024-03-09T14:24:20.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.336+0000 7f5ad992b800 20 remove_watcher() i=3 2024-03-09T14:24:20.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.337+0000 7f5ad992b800 20 remove_watcher() i=4 2024-03-09T14:24:20.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.339+0000 7f5ad992b800 20 remove_watcher() i=5 2024-03-09T14:24:20.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.340+0000 7f5ad992b800 20 remove_watcher() i=6 2024-03-09T14:24:20.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.341+0000 7f5ad992b800 20 remove_watcher() i=7 2024-03-09T14:24:20.354 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:24:20.388 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:20.388 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:20.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.423+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 realm 2024-03-09T14:24:20.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:20.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.425+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.426+0000 7f756840f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:20.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.426+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.427+0000 7f756840f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:20.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.427+0000 7f756840f800 20 searching for the correct realm 2024-03-09T14:24:20.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.430+0000 7f7563bcc640 0 -- 172.21.15.46:0/2699841008 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f755c028040 msgr2=0x7f755c05cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:20.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.433+0000 7f7563bcc640 0 -- 172.21.15.46:0/2699841008 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f75580a9170 msgr2=0x7f75580be140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:20.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.439+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 zone default found 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 4 Realm: () 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 zonegroup default 2024-03-09T14:24:20.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.440+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.441+0000 7f756840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.441+0000 7f756840f800 20 started sync module instance, tier type = 2024-03-09T14:24:20.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.441+0000 7f756840f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:20.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=0 2024-03-09T14:24:20.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=1 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=2 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=3 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=4 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=5 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.453+0000 7f756840f800 20 add_watcher() i=6 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.454+0000 7f756840f800 20 add_watcher() i=7 2024-03-09T14:24:20.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.454+0000 7f756840f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:20.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f7419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f756840f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f756840f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f756840f800 5 note: GC not initialized 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f7418fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f756840f800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f756840f800 20 Filter name: none 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.456+0000 7f73927fc640 20 reqs_thread_entry: start 2024-03-09T14:24:20.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 INFO: main: starting shard=0 2024-03-09T14:24:20.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.457+0000 7f756840f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:20.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.458+0000 7f756840f800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-09T14:24:20.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.458+0000 7f756840f800 20 INFO: main: done 2024-03-09T14:24:20.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.459+0000 7f7419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:20.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.462+0000 7f756840f800 20 remove_watcher() i=0 2024-03-09T14:24:20.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.462+0000 7f756840f800 2 removed watcher, disabling cache 2024-03-09T14:24:20.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.463+0000 7f756840f800 20 remove_watcher() i=1 2024-03-09T14:24:20.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.464+0000 7f756840f800 20 remove_watcher() i=2 2024-03-09T14:24:20.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.465+0000 7f756840f800 20 remove_watcher() i=3 2024-03-09T14:24:20.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.466+0000 7f756840f800 20 remove_watcher() i=4 2024-03-09T14:24:20.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.467+0000 7f756840f800 20 remove_watcher() i=5 2024-03-09T14:24:20.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.468+0000 7f756840f800 20 remove_watcher() i=6 2024-03-09T14:24:20.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.469+0000 7f756840f800 20 remove_watcher() i=7 2024-03-09T14:24:20.479 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check olh finds leftover OLH entries 2024-03-09T14:24:20.479 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:20.480 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-09T14:24:20.510 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:20.510 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:20.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.543+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 realm 2024-03-09T14:24:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.545+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.546+0000 7f97a5b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:20.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.546+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.547+0000 7f97a5b1f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:20.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.547+0000 7f97a5b1f800 20 searching for the correct realm 2024-03-09T14:24:20.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.549+0000 7f97a0fe8640 0 -- 172.21.15.46:0/19148227 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55b98008eac0 msgr2=0x55b980090ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:20.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.553+0000 7f97a17e9640 0 -- 172.21.15.46:0/19148227 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9798066070 msgr2=0x7f97980a73f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:20.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:20.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:20.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.760+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:20.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 zone default found 2024-03-09T14:24:20.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 4 Realm: () 2024-03-09T14:24:20.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 zonegroup default 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.761+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.762+0000 7f97a5b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.762+0000 7f97a5b1f800 20 started sync module instance, tier type = 2024-03-09T14:24:20.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.762+0000 7f97a5b1f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:20.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=0 2024-03-09T14:24:20.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=1 2024-03-09T14:24:20.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=2 2024-03-09T14:24:20.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=3 2024-03-09T14:24:20.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=4 2024-03-09T14:24:20.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=5 2024-03-09T14:24:20.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.774+0000 7f97a5b1f800 20 add_watcher() i=6 2024-03-09T14:24:20.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.775+0000 7f97a5b1f800 20 add_watcher() i=7 2024-03-09T14:24:20.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.775+0000 7f97a5b1f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:20.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f96577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f97a5b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f97a5b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f97a5b1f800 5 note: GC not initialized 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f96567e4640 20 reqs_thread_entry: start 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f97a5b1f800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.777+0000 7f97a5b1f800 20 Filter name: none 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f95c7fff640 20 reqs_thread_entry: start 2024-03-09T14:24:20.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:20.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:20.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:20.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:20.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:20.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.778+0000 7f97a5b1f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.779+0000 7f97a5b1f800 1 NOTICE: finished shard 0 (2 entries found) 2024-03-09T14:24:20.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.779+0000 7f97a5b1f800 1 NOTICE: finished all shards (2 entries found) 2024-03-09T14:24:20.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.780+0000 7f96577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:20.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.782+0000 7f97a5b1f800 20 remove_watcher() i=0 2024-03-09T14:24:20.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.782+0000 7f97a5b1f800 2 removed watcher, disabling cache 2024-03-09T14:24:20.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.783+0000 7f97a5b1f800 20 remove_watcher() i=1 2024-03-09T14:24:20.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.784+0000 7f97a5b1f800 20 remove_watcher() i=2 2024-03-09T14:24:20.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.786+0000 7f97a5b1f800 20 remove_watcher() i=3 2024-03-09T14:24:20.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.787+0000 7f97a5b1f800 20 remove_watcher() i=4 2024-03-09T14:24:20.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.788+0000 7f97a5b1f800 20 remove_watcher() i=5 2024-03-09T14:24:20.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.789+0000 7f97a5b1f800 20 remove_watcher() i=6 2024-03-09T14:24:20.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.790+0000 7f97a5b1f800 20 remove_watcher() i=7 2024-03-09T14:24:20.800 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-03-09T14:24:20.800 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:20.801 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:24:20.832 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:20.832 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:20.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.866+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 realm 2024-03-09T14:24:20.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:20.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:20.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.868+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.869+0000 7f55a988c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:20.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.869+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:20.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.870+0000 7f55a988c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:20.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.870+0000 7f55a988c800 20 searching for the correct realm 2024-03-09T14:24:20.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.872+0000 7f55a6b87640 0 -- 172.21.15.46:0/342230426 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55ec03dbe180 msgr2=0x55ec03dc0590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:20.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:20.876+0000 7f55a7388640 0 -- 172.21.15.46:0/342230426 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f559c0be2e0 msgr2=0x7f559c076670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.082+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 zone default found 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 4 Realm: () 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 zonegroup default 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.083+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.084+0000 7f55a988c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.086 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.084+0000 7f55a988c800 20 started sync module instance, tier type = 2024-03-09T14:24:21.086 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.084+0000 7f55a988c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:21.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=0 2024-03-09T14:24:21.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=1 2024-03-09T14:24:21.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=2 2024-03-09T14:24:21.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=3 2024-03-09T14:24:21.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=4 2024-03-09T14:24:21.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=5 2024-03-09T14:24:21.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.095+0000 7f55a988c800 20 add_watcher() i=6 2024-03-09T14:24:21.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.096+0000 7f55a988c800 20 add_watcher() i=7 2024-03-09T14:24:21.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.096+0000 7f55a988c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:21.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.098+0000 7f545dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.098+0000 7f55a988c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:21.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.098+0000 7f55a988c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:21.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.098+0000 7f55a988c800 5 note: GC not initialized 2024-03-09T14:24:21.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.098+0000 7f545cfe1640 20 reqs_thread_entry: start 2024-03-09T14:24:21.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.098+0000 7f55a988c800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:21.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 20 Filter name: none 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f53d67fc640 20 reqs_thread_entry: start 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:21.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.099+0000 7f55a988c800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:21.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:21.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.100+0000 7f55a988c800 20 get_obj_state: octx=0x55ec03b29510 obj=check-bucket:c state=0x55ec03df57f8 s->prefetch_data=0 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.101+0000 7f55a988c800 20 get_obj_state: setting s->obj_tag to nv1e6smj47ka69xhlqs8hv2oss9e3ej7 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.101+0000 7f55a988c800 20 get_obj_state_impl: setting s->olh_tag to h0hryqwf7f1ll8l9htgxx43h1z24hz35 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.101+0000 7f55a988c800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.101+0000 7f55a988c800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.101+0000 7f55a988c800 20 olh_log_entry: epoch=4 op=3 key=c[oukEmROkEUyp8HlbXo5O9QYSz7w0-GC] 2024-03-09T14:24:21.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.101+0000 7f55a988c800 20 get_obj_state: octx=0x55ec03e2ecb0 obj=check-bucket:_:oukEmROkEUyp8HlbXo5O9QYSz7w0-GC_c state=0x55ec03e32508 s->prefetch_data=0 2024-03-09T14:24:21.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.103+0000 7f55a988c800 20 get_obj_state: octx=0x55ec03e2ecb0 obj=check-bucket:c state=0x55ec03df0288 s->prefetch_data=0 2024-03-09T14:24:21.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.103+0000 7f55a988c800 20 get_obj_state: setting s->obj_tag to nv1e6smj47ka69xhlqs8hv2oss9e3ej7 2024-03-09T14:24:21.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.103+0000 7f55a988c800 20 get_obj_state_impl: setting s->olh_tag to h0hryqwf7f1ll8l9htgxx43h1z24hz35 2024-03-09T14:24:21.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.103+0000 7f55a988c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=h0hryqwf7f1ll8l9htgxx43h1z24hz35 2024-03-09T14:24:21.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.110+0000 7f55a988c800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.113+0000 7f55a988c800 20 get_obj_state: octx=0x55ec03b29510 obj=check-bucket:d state=0x55ec03df57f8 s->prefetch_data=0 2024-03-09T14:24:21.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.113+0000 7f55a988c800 20 get_obj_state: setting s->obj_tag to n9f7c6vy75drt820m31bfvjq67la2oxh 2024-03-09T14:24:21.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.113+0000 7f55a988c800 20 get_obj_state_impl: setting s->olh_tag to ahwpw2z7athdcmnjhfo64lrbfzdl6sc9 2024-03-09T14:24:21.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.113+0000 7f55a988c800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.114+0000 7f55a988c800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-03-09T14:24:21.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.114+0000 7f55a988c800 20 olh_log_entry: epoch=4 op=3 key=d[RuTWYQlGsTJHg-DNkJ8mxCg9H2uyA9o] 2024-03-09T14:24:21.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.114+0000 7f55a988c800 20 get_obj_state: octx=0x55ec03e2ecb0 obj=check-bucket:_:RuTWYQlGsTJHg-DNkJ8mxCg9H2uyA9o_d state=0x55ec03df6828 s->prefetch_data=0 2024-03-09T14:24:21.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.115+0000 7f55a988c800 20 get_obj_state: octx=0x55ec03e2ecb0 obj=check-bucket:d state=0x55ec03df0de8 s->prefetch_data=0 2024-03-09T14:24:21.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.116+0000 7f55a988c800 20 get_obj_state: setting s->obj_tag to n9f7c6vy75drt820m31bfvjq67la2oxh 2024-03-09T14:24:21.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.116+0000 7f55a988c800 20 get_obj_state_impl: setting s->olh_tag to ahwpw2z7athdcmnjhfo64lrbfzdl6sc9 2024-03-09T14:24:21.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.116+0000 7f55a988c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ahwpw2z7athdcmnjhfo64lrbfzdl6sc9 2024-03-09T14:24:21.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.118+0000 7f55a988c800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.120+0000 7f55a988c800 1 NOTICE: finished shard 0 (2 entries removed) 2024-03-09T14:24:21.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.120+0000 7f55a988c800 1 NOTICE: finished all shards (2 entries removed) 2024-03-09T14:24:21.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.120+0000 7f545dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.123+0000 7f55a988c800 20 remove_watcher() i=0 2024-03-09T14:24:21.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.123+0000 7f55a988c800 2 removed watcher, disabling cache 2024-03-09T14:24:21.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.124+0000 7f55a988c800 20 remove_watcher() i=1 2024-03-09T14:24:21.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.125+0000 7f55a988c800 20 remove_watcher() i=2 2024-03-09T14:24:21.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.126+0000 7f55a988c800 20 remove_watcher() i=3 2024-03-09T14:24:21.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.127+0000 7f55a988c800 20 remove_watcher() i=4 2024-03-09T14:24:21.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.129+0000 7f55a988c800 20 remove_watcher() i=5 2024-03-09T14:24:21.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.129+0000 7f55a988c800 20 remove_watcher() i=6 2024-03-09T14:24:21.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.130+0000 7f55a988c800 20 remove_watcher() i=7 2024-03-09T14:24:21.142 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:24:21.171 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:21.171 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:21.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.203+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 realm 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.205+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.207+0000 7f4a1994b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.207+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.207+0000 7f4a1994b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:21.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.207+0000 7f4a1994b800 20 searching for the correct realm 2024-03-09T14:24:21.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.211+0000 7f4a16c4d640 0 -- 172.21.15.46:0/3368894441 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55f102dfff70 msgr2=0x55f102e02360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:21.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.214+0000 7f4a16c4d640 0 -- 172.21.15.46:0/3368894441 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x7f48e0078250 msgr2=0x7f48e007a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.218+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:21.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 zone default found 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 4 Realm: () 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 zonegroup default 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.219+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.220+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.220+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.220+0000 7f4a1994b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.220+0000 7f4a1994b800 20 started sync module instance, tier type = 2024-03-09T14:24:21.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.220+0000 7f4a1994b800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=0 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=1 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=2 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=3 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=4 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=5 2024-03-09T14:24:21.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.229+0000 7f4a1994b800 20 add_watcher() i=6 2024-03-09T14:24:21.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.230+0000 7f4a1994b800 20 add_watcher() i=7 2024-03-09T14:24:21.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.230+0000 7f4a1994b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:21.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.232+0000 7f48cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.232+0000 7f4a1994b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:21.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.232+0000 7f4a1994b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:21.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.232+0000 7f4a1994b800 5 note: GC not initialized 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f48ccfe1640 20 reqs_thread_entry: start 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f4a1994b800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f4a1994b800 20 Filter name: none 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f48467fc640 20 reqs_thread_entry: start 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f4a1994b800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:21.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.233+0000 7f4a1994b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 INFO: main: starting shard=0 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.234+0000 7f4a1994b800 20 INFO: main: done 2024-03-09T14:24:21.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.235+0000 7f48cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.237+0000 7f4a1994b800 20 remove_watcher() i=0 2024-03-09T14:24:21.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.237+0000 7f4a1994b800 2 removed watcher, disabling cache 2024-03-09T14:24:21.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.238+0000 7f4a1994b800 20 remove_watcher() i=1 2024-03-09T14:24:21.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.239+0000 7f4a1994b800 20 remove_watcher() i=2 2024-03-09T14:24:21.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.240+0000 7f4a1994b800 20 remove_watcher() i=3 2024-03-09T14:24:21.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.241+0000 7f4a1994b800 20 remove_watcher() i=4 2024-03-09T14:24:21.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.242+0000 7f4a1994b800 20 remove_watcher() i=5 2024-03-09T14:24:21.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.243+0000 7f4a1994b800 20 remove_watcher() i=6 2024-03-09T14:24:21.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.244+0000 7f4a1994b800 20 remove_watcher() i=7 2024-03-09T14:24:21.255 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:24:21.284 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:21.285 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:21.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.317+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 realm 2024-03-09T14:24:21.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:21.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.319+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.320+0000 7fbb4ac18800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.320+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.321+0000 7fbb4ac18800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:21.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.321+0000 7fbb4ac18800 20 searching for the correct realm 2024-03-09T14:24:21.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.324+0000 7fbb45a1c640 0 -- 172.21.15.46:0/719481202 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x56464f342020 msgr2=0x56464f344410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:21.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.327+0000 7fbb4621d640 0 -- 172.21.15.46:0/719481202 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fbb3c0cc250 msgr2=0x7fbb3c0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:21.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.533+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:21.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 zone default found 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 4 Realm: () 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 zonegroup default 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.534+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.535+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.535+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.535+0000 7fbb4ac18800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.535+0000 7fbb4ac18800 20 started sync module instance, tier type = 2024-03-09T14:24:21.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.535+0000 7fbb4ac18800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=0 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=1 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=2 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=3 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=4 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=5 2024-03-09T14:24:21.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.545+0000 7fbb4ac18800 20 add_watcher() i=6 2024-03-09T14:24:21.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.546+0000 7fbb4ac18800 20 add_watcher() i=7 2024-03-09T14:24:21.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.546+0000 7fbb4ac18800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:21.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fb9fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fbb4ac18800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:21.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fbb4ac18800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:21.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fbb4ac18800 5 note: GC not initialized 2024-03-09T14:24:21.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fb9777fe640 20 reqs_thread_entry: start 2024-03-09T14:24:21.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fbb4ac18800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.548+0000 7fbb4ac18800 20 Filter name: none 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fb9757fa640 20 reqs_thread_entry: start 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 INFO: main: starting shard=0 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.549+0000 7fbb4ac18800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.550+0000 7fbb4ac18800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.550+0000 7fbb4ac18800 20 INFO: main: done 2024-03-09T14:24:21.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.551+0000 7fb9fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.553+0000 7fbb4ac18800 20 remove_watcher() i=0 2024-03-09T14:24:21.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.553+0000 7fbb4ac18800 2 removed watcher, disabling cache 2024-03-09T14:24:21.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.554+0000 7fbb4ac18800 20 remove_watcher() i=1 2024-03-09T14:24:21.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.555+0000 7fbb4ac18800 20 remove_watcher() i=2 2024-03-09T14:24:21.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.556+0000 7fbb4ac18800 20 remove_watcher() i=3 2024-03-09T14:24:21.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.558+0000 7fbb4ac18800 20 remove_watcher() i=4 2024-03-09T14:24:21.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.559+0000 7fbb4ac18800 20 remove_watcher() i=5 2024-03-09T14:24:21.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.560+0000 7fbb4ac18800 20 remove_watcher() i=6 2024-03-09T14:24:21.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.561+0000 7fbb4ac18800 20 remove_watcher() i=7 2024-03-09T14:24:21.571 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-03-09T14:24:21.571 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:21.572 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-09T14:24:21.602 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:21.602 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:21.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.635+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.636+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.636+0000 7f2df1e39800 20 realm 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.636+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.636+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.636+0000 7f2df1e39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.636+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.637+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.637+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.637+0000 7f2df1e39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.637+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.638+0000 7f2df1e39800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:21.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.638+0000 7f2df1e39800 20 searching for the correct realm 2024-03-09T14:24:21.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.641+0000 7f2ded270640 0 -- 172.21.15.46:0/1154642639 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x558393ba36e0 msgr2=0x558393ba5b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:21.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.645+0000 7f2deca6f640 0 -- 172.21.15.46:0/1154642639 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f2de0089020 msgr2=0x7f2de00951b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:21.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.649+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 zone default found 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 4 Realm: () 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 zonegroup default 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.650+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.651+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.651+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.651+0000 7f2df1e39800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:21.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.651+0000 7f2df1e39800 20 started sync module instance, tier type = 2024-03-09T14:24:21.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.651+0000 7f2df1e39800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:21.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=0 2024-03-09T14:24:21.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=1 2024-03-09T14:24:21.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=2 2024-03-09T14:24:21.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=3 2024-03-09T14:24:21.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=4 2024-03-09T14:24:21.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=5 2024-03-09T14:24:21.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.660+0000 7f2df1e39800 20 add_watcher() i=6 2024-03-09T14:24:21.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.661+0000 7f2df1e39800 20 add_watcher() i=7 2024-03-09T14:24:21.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.661+0000 7f2df1e39800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:21.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2ca2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2df1e39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:21.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2df1e39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:21.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2df1e39800 5 note: GC not initialized 2024-03-09T14:24:21.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2ca1fe3640 20 reqs_thread_entry: start 2024-03-09T14:24:21.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2df1e39800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:21.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.663+0000 7f2df1e39800 20 Filter name: none 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2c137fe640 20 reqs_thread_entry: start 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:21.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 20 rados->read ofs=0 len=0 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.664+0000 7f2df1e39800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:21.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.665+0000 7f2df1e39800 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:24:21.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.665+0000 7f2df1e39800 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:24:21.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.666+0000 7f2ca2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:21.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.668+0000 7f2df1e39800 20 remove_watcher() i=0 2024-03-09T14:24:21.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.668+0000 7f2df1e39800 2 removed watcher, disabling cache 2024-03-09T14:24:21.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.669+0000 7f2df1e39800 20 remove_watcher() i=1 2024-03-09T14:24:21.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.670+0000 7f2df1e39800 20 remove_watcher() i=2 2024-03-09T14:24:21.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.671+0000 7f2df1e39800 20 remove_watcher() i=3 2024-03-09T14:24:21.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.672+0000 7f2df1e39800 20 remove_watcher() i=4 2024-03-09T14:24:21.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.673+0000 7f2df1e39800 20 remove_watcher() i=5 2024-03-09T14:24:21.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.674+0000 7f2df1e39800 20 remove_watcher() i=6 2024-03-09T14:24:21.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:21.675+0000 7f2df1e39800 20 remove_watcher() i=7 2024-03-09T14:24:21.685 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-03-09T14:24:21.685 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:21.687 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:21.687 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:21.712 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:21.712 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:21.735 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:21.736 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:21.802 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-03-09T14:24:21.802 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:24:21.802 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:21.802 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:21.868 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:21.869 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.067 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.068 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.130 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.130 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.154 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.155 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.205 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.205 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.230 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.230 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.294 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.294 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.318 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.318 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.369 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.369 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.395 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.395 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.449 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.449 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.473 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.473 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.524 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:22.524 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:22.548 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:24:22.946 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:24:24.350 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:24.351 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:24.435 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:24.436 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:24:24.468 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:24.468 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:24.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.505+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 realm 2024-03-09T14:24:24.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:24.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.507+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.508+0000 7f19e8c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:24.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.508+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.509+0000 7f19e8c0f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:24.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.509+0000 7f19e8c0f800 20 searching for the correct realm 2024-03-09T14:24:24.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.513+0000 7f19e4bcd640 0 -- 172.21.15.46:0/2482853182 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x561a37e62610 msgr2=0x561a37e64ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:24.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.516+0000 7f19e43cc640 0 -- 172.21.15.46:0/2482853182 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f19d8053400 msgr2=0x7f19d8053880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:24.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:24.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.522+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:24.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:24.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 zone default found 2024-03-09T14:24:24.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 4 Realm: () 2024-03-09T14:24:24.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 zonegroup default 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.523+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.524+0000 7f19e8c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.524+0000 7f19e8c0f800 20 started sync module instance, tier type = 2024-03-09T14:24:24.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.524+0000 7f19e8c0f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:24.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=0 2024-03-09T14:24:24.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=1 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=2 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=3 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=4 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=5 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.534+0000 7f19e8c0f800 20 add_watcher() i=6 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.535+0000 7f19e8c0f800 20 add_watcher() i=7 2024-03-09T14:24:24.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.535+0000 7f19e8c0f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:24.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.537+0000 7f189afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.537+0000 7f19e8c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.537+0000 7f19e8c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.537+0000 7f19e8c0f800 5 note: GC not initialized 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.537+0000 7f1899fdb640 20 reqs_thread_entry: start 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.538+0000 7f19e8c0f800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.538+0000 7f19e8c0f800 20 Filter name: none 2024-03-09T14:24:24.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.538+0000 7f180b7fe640 20 reqs_thread_entry: start 2024-03-09T14:24:24.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.538+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.538+0000 7f19e8c0f800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.538+0000 7f19e8c0f800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.539+0000 7f19e8c0f800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.539+0000 7f19e8c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.539+0000 7f19e8c0f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.539+0000 7f19e8c0f800 20 INFO: main: starting shard=0 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.539+0000 7f19e8c0f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.539+0000 7f19e8c0f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:24:24.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.540+0000 7f19e8c0f800 20 INFO: main: done 2024-03-09T14:24:24.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.540+0000 7f189afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:24.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.543+0000 7f19e8c0f800 20 remove_watcher() i=0 2024-03-09T14:24:24.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.543+0000 7f19e8c0f800 2 removed watcher, disabling cache 2024-03-09T14:24:24.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.544+0000 7f19e8c0f800 20 remove_watcher() i=1 2024-03-09T14:24:24.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.545+0000 7f19e8c0f800 20 remove_watcher() i=2 2024-03-09T14:24:24.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.546+0000 7f19e8c0f800 20 remove_watcher() i=3 2024-03-09T14:24:24.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.547+0000 7f19e8c0f800 20 remove_watcher() i=4 2024-03-09T14:24:24.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.548+0000 7f19e8c0f800 20 remove_watcher() i=5 2024-03-09T14:24:24.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.549+0000 7f19e8c0f800 20 remove_watcher() i=6 2024-03-09T14:24:24.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.550+0000 7f19e8c0f800 20 remove_watcher() i=7 2024-03-09T14:24:24.563 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:24.563 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:24.587 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:24.587 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:24.613 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:24.613 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:24.693 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:24.694 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:24:24.724 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:24.724 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:24.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.757+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 realm 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.759+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.760+0000 7f865af27800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:24.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.760+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.761+0000 7f865af27800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:24.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.761+0000 7f865af27800 20 searching for the correct realm 2024-03-09T14:24:24.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.764+0000 7f8657374640 0 -- 172.21.15.46:0/3507142739 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x558593efb3f0 msgr2=0x558593efd820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:24.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.768+0000 7f8656372640 0 -- 172.21.15.46:0/3507142739 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x558593f02e50 msgr2=0x558593f05240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.772+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 zone default found 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 4 Realm: () 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 zonegroup default 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.773+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.774+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.774+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.774+0000 7f865af27800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.774+0000 7f865af27800 20 started sync module instance, tier type = 2024-03-09T14:24:24.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.774+0000 7f865af27800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=0 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=1 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=2 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=3 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=4 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=5 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.784+0000 7f865af27800 20 add_watcher() i=6 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.785+0000 7f865af27800 20 add_watcher() i=7 2024-03-09T14:24:24.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.785+0000 7f865af27800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:24.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.786+0000 7f850d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:24.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:24.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 5 note: GC not initialized 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f8487fff640 20 reqs_thread_entry: start 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 Filter name: none 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f8485ffb640 20 reqs_thread_entry: start 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:24.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.787+0000 7f865af27800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 INFO: main: starting shard=0 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:24:24.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.788+0000 7f865af27800 20 INFO: main: done 2024-03-09T14:24:24.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.789+0000 7f850d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:24.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.791+0000 7f865af27800 20 remove_watcher() i=0 2024-03-09T14:24:24.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.791+0000 7f865af27800 2 removed watcher, disabling cache 2024-03-09T14:24:24.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.793+0000 7f865af27800 20 remove_watcher() i=1 2024-03-09T14:24:24.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.794+0000 7f865af27800 20 remove_watcher() i=2 2024-03-09T14:24:24.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.795+0000 7f865af27800 20 remove_watcher() i=3 2024-03-09T14:24:24.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.796+0000 7f865af27800 20 remove_watcher() i=4 2024-03-09T14:24:24.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.797+0000 7f865af27800 20 remove_watcher() i=5 2024-03-09T14:24:24.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.798+0000 7f865af27800 20 remove_watcher() i=6 2024-03-09T14:24:24.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.799+0000 7f865af27800 20 remove_watcher() i=7 2024-03-09T14:24:24.813 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:24.814 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:24.835 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:24.835 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:24.915 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:24.916 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-09T14:24:24.948 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:24.948 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:24.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.981+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 realm 2024-03-09T14:24:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:24.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.983+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.984+0000 7f9330d11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:24.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.984+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:24.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.985+0000 7f9330d11800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:24.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.985+0000 7f9330d11800 20 searching for the correct realm 2024-03-09T14:24:24.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.987+0000 7f932e013640 0 -- 172.21.15.46:0/2496548900 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55be1fc115d0 msgr2=0x55be1fc139c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:24.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:24.991+0000 7f932e814640 0 -- 172.21.15.46:0/2496548900 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f932405b070 msgr2=0x7f9324074930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:25.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:25.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:25.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:25.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.198+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 zone default found 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 4 Realm: () 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 zonegroup default 2024-03-09T14:24:25.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.199+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.200+0000 7f9330d11800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.200+0000 7f9330d11800 20 started sync module instance, tier type = 2024-03-09T14:24:25.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.200+0000 7f9330d11800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=0 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=1 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=2 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=3 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=4 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=5 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.209+0000 7f9330d11800 20 add_watcher() i=6 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.210+0000 7f9330d11800 20 add_watcher() i=7 2024-03-09T14:24:25.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.210+0000 7f9330d11800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:25.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.212+0000 7f91e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.212+0000 7f9330d11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.212+0000 7f9330d11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.212+0000 7f9330d11800 5 note: GC not initialized 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f915ffff640 20 reqs_thread_entry: start 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f9330d11800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f9330d11800 20 Filter name: none 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f915dffb640 20 reqs_thread_entry: start 2024-03-09T14:24:25.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f9330d11800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:25.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.213+0000 7f9330d11800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.214+0000 7f9330d11800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:25.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.214+0000 7f9330d11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:25.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.214+0000 7f9330d11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:25.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.214+0000 7f9330d11800 20 INFO: main: starting shard=0 2024-03-09T14:24:25.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.214+0000 7f9330d11800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:25.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.214+0000 7f9330d11800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:24:25.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.215+0000 7f9330d11800 20 INFO: main: done 2024-03-09T14:24:25.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.215+0000 7f91e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:25.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.218+0000 7f9330d11800 20 remove_watcher() i=0 2024-03-09T14:24:25.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.218+0000 7f9330d11800 2 removed watcher, disabling cache 2024-03-09T14:24:25.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.219+0000 7f9330d11800 20 remove_watcher() i=1 2024-03-09T14:24:25.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.220+0000 7f9330d11800 20 remove_watcher() i=2 2024-03-09T14:24:25.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.221+0000 7f9330d11800 20 remove_watcher() i=3 2024-03-09T14:24:25.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.222+0000 7f9330d11800 20 remove_watcher() i=4 2024-03-09T14:24:25.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.223+0000 7f9330d11800 20 remove_watcher() i=5 2024-03-09T14:24:25.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.224+0000 7f9330d11800 20 remove_watcher() i=6 2024-03-09T14:24:25.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.225+0000 7f9330d11800 20 remove_watcher() i=7 2024-03-09T14:24:25.238 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:25.238 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:25.261 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:25.261 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:25.343 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:24:25.344 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-09T14:24:25.375 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:25.376 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:25.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.408+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 realm 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.410+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.411+0000 7f3acdf3b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:25.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.411+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.412+0000 7f3acdf3b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:25.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.412+0000 7f3acdf3b800 20 searching for the correct realm 2024-03-09T14:24:25.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.415+0000 7f3aca4ce640 0 -- 172.21.15.46:0/57837780 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55c45140ea20 msgr2=0x55c451410ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:25.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.419+0000 7f3ac9ccd640 0 -- 172.21.15.46:0/57837780 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f3ac0083040 msgr2=0x7f3ac0084990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.424+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 zone default found 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 4 Realm: () 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 zonegroup default 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:25.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 started sync module instance, tier type = 2024-03-09T14:24:25.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.425+0000 7f3acdf3b800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=0 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=1 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=2 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=3 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=4 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=5 2024-03-09T14:24:25.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.438+0000 7f3acdf3b800 20 add_watcher() i=6 2024-03-09T14:24:25.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.439+0000 7f3acdf3b800 20 add_watcher() i=7 2024-03-09T14:24:25.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.439+0000 7f3acdf3b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:25.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.440+0000 7f397b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:25.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:25.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:25.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 5 note: GC not initialized 2024-03-09T14:24:25.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f397a7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:25.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:25.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 Filter name: none 2024-03-09T14:24:25.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f38ebfff640 20 reqs_thread_entry: start 2024-03-09T14:24:25.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.441+0000 7f3acdf3b800 20 rados->read ofs=0 len=0 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 INFO: main: starting shard=0 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:24:25.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.442+0000 7f3acdf3b800 20 INFO: main: done 2024-03-09T14:24:25.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.443+0000 7f397b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:25.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.445+0000 7f3acdf3b800 20 remove_watcher() i=0 2024-03-09T14:24:25.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.445+0000 7f3acdf3b800 2 removed watcher, disabling cache 2024-03-09T14:24:25.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.446+0000 7f3acdf3b800 20 remove_watcher() i=1 2024-03-09T14:24:25.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.447+0000 7f3acdf3b800 20 remove_watcher() i=2 2024-03-09T14:24:25.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.448+0000 7f3acdf3b800 20 remove_watcher() i=3 2024-03-09T14:24:25.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.450+0000 7f3acdf3b800 20 remove_watcher() i=4 2024-03-09T14:24:25.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.451+0000 7f3acdf3b800 20 remove_watcher() i=5 2024-03-09T14:24:25.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.452+0000 7f3acdf3b800 20 remove_watcher() i=6 2024-03-09T14:24:25.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:25.452+0000 7f3acdf3b800 20 remove_watcher() i=7 2024-03-09T14:24:25.464 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:25.465 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:25.491 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:24:25.901 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:24:26.299 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-09T14:24:26.326 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:26.327 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:26.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.361+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 realm 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:26.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.362+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:26.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.363+0000 7fbbe1daf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:26.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.363+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:26.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.364+0000 7fbbe1daf800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:26.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.364+0000 7fbbe1daf800 20 searching for the correct realm 2024-03-09T14:24:26.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.567+0000 7fbbdf0b1640 0 -- 172.21.15.46:0/1843038808 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fbbd0023070 msgr2=0x7fbbd0058400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:26.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:26.974+0000 7fbbdf8b2640 0 -- 172.21.15.46:0/1843038808 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fbbc80083b0 msgr2=0x7fbbc8008a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:27.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:27.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:27.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:27.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:27.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:27.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:27.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.182+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 zone default found 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 4 Realm: () 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 zonegroup default 2024-03-09T14:24:27.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.183+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.184+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.184+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.184+0000 7fbbe1daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.184+0000 7fbbe1daf800 20 started sync module instance, tier type = 2024-03-09T14:24:27.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.184+0000 7fbbe1daf800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:27.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=0 2024-03-09T14:24:27.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=1 2024-03-09T14:24:27.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=2 2024-03-09T14:24:27.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=3 2024-03-09T14:24:27.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=4 2024-03-09T14:24:27.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=5 2024-03-09T14:24:27.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.196+0000 7fbbe1daf800 20 add_watcher() i=6 2024-03-09T14:24:27.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.197+0000 7fbbe1daf800 20 add_watcher() i=7 2024-03-09T14:24:27.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.197+0000 7fbbe1daf800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:27.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.199+0000 7fba95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:27.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:27.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:27.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 5 note: GC not initialized 2024-03-09T14:24:27.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fba94fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:27.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:27.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 20 Filter name: none 2024-03-09T14:24:27.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fba0e7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:27.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:27.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.200+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:27.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.201+0000 7fbbe1daf800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.202+0000 7fbbe1daf800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.202+0000 7fbbe1daf800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.202+0000 7fbbe1daf800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:24:27.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.202+0000 7fbbe1daf800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:24:27.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.206+0000 7fba95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:27.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.209+0000 7fbbe1daf800 20 remove_watcher() i=0 2024-03-09T14:24:27.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.209+0000 7fbbe1daf800 2 removed watcher, disabling cache 2024-03-09T14:24:27.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.210+0000 7fbbe1daf800 20 remove_watcher() i=1 2024-03-09T14:24:27.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.212+0000 7fbbe1daf800 20 remove_watcher() i=2 2024-03-09T14:24:27.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.214+0000 7fbbe1daf800 20 remove_watcher() i=3 2024-03-09T14:24:27.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.215+0000 7fbbe1daf800 20 remove_watcher() i=4 2024-03-09T14:24:27.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.216+0000 7fbbe1daf800 20 remove_watcher() i=5 2024-03-09T14:24:27.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.217+0000 7fbbe1daf800 20 remove_watcher() i=6 2024-03-09T14:24:27.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.219+0000 7fbbe1daf800 20 remove_watcher() i=7 2024-03-09T14:24:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:24:27.271 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:27.271 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:27.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.304+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 realm 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.306+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.307+0000 7f2a81a9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:27.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.307+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.308+0000 7f2a81a9d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:27.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.308+0000 7f2a81a9d800 20 searching for the correct realm 2024-03-09T14:24:27.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.310+0000 7f2a7f599640 0 -- 172.21.15.46:0/3006718914 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x5588d0f216d0 msgr2=0x7f2a78019430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:27.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.515+0000 7f2a7ed98640 0 -- 172.21.15.46:0/3006718914 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f2a7006b060 msgr2=0x7f2a700b10c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:27.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.523+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 zone default found 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 4 Realm: () 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:27.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 zonegroup default 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.524+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.525+0000 7f2a81a9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.525+0000 7f2a81a9d800 20 started sync module instance, tier type = 2024-03-09T14:24:27.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.525+0000 7f2a81a9d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=0 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=1 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=2 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=3 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=4 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=5 2024-03-09T14:24:27.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.535+0000 7f2a81a9d800 20 add_watcher() i=6 2024-03-09T14:24:27.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.536+0000 7f2a81a9d800 20 add_watcher() i=7 2024-03-09T14:24:27.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.536+0000 7f2a81a9d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:27.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.537+0000 7f2935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 5 note: GC not initialized 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2934fe1640 20 reqs_thread_entry: start 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 20 Filter name: none 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f28ae7fc640 20 reqs_thread_entry: start 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:24:27.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.538+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 : miss 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 info.flags=0x17 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 to cache LRU end 2024-03-09T14:24:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:24:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:24:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1 2024-03-09T14:24:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.539+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.541+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.541+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:c state=0x5588d11a2698 s->prefetch_data=0 2024-03-09T14:24:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.541+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to 79vj9km7vp8rz8pmv08si6iv9e85n7xy 2024-03-09T14:24:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.541+0000 7f2a81a9d800 20 get_obj_state_impl: setting s->olh_tag to zy7jlg36m9asc3jmtgefagzabske3012 2024-03-09T14:24:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.541+0000 7f2a81a9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zy7jlg36m9asc3jmtgefagzabske3012 2024-03-09T14:24:27.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.543+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.545+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.545+0000 7f2a81a9d800 20 olh_log_entry: epoch=3 op=3 key=c[jzsBbKv.xO3q5glxC7ma6J0cNEVs2U3] 2024-03-09T14:24:27.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.545+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:jzsBbKv.xO3q5glxC7ma6J0cNEVs2U3_c state=0x5588d11d9bb8 s->prefetch_data=0 2024-03-09T14:24:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.546+0000 7f2a81a9d800 10 manifest: total_size = 22 2024-03-09T14:24:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.546+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.801370419590000559 2024-03-09T14:24:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.546+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:jzsBbKv.xO3q5glxC7ma6J0cNEVs2U3_c state=0x5588d11d9bb8 s->prefetch_data=0 2024-03-09T14:24:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.546+0000 7f2a81a9d800 20 prepare_atomic_modification: state is not atomic. state=0x5588d11d9bb8 2024-03-09T14:24:27.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.546+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.551+0000 7f2962ffd640 20 handle_completion(): completion ok for obj=c[jzsBbKv.xO3q5glxC7ma6J0cNEVs2U3] 2024-03-09T14:24:27.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.552+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.552+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.553+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.554+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.554+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:d state=0x5588d11a2698 s->prefetch_data=0 2024-03-09T14:24:27.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.554+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to bacwgjrlr6jpztx1j4h4k0vacokmeli5 2024-03-09T14:24:27.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.554+0000 7f2a81a9d800 20 get_obj_state_impl: setting s->olh_tag to opq74k4ufvzo1luetappyezz129o133a 2024-03-09T14:24:27.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.554+0000 7f2a81a9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=opq74k4ufvzo1luetappyezz129o133a 2024-03-09T14:24:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.556+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.558+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 20 olh_log_entry: epoch=3 op=3 key=d[3BySjVN7h2ribY6hrq6ytrdvEwXDogw] 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:3BySjVN7h2ribY6hrq6ytrdvEwXDogw_d state=0x5588d11d5b48 s->prefetch_data=0 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 10 manifest: total_size = 12 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1566092829112111136 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:3BySjVN7h2ribY6hrq6ytrdvEwXDogw_d state=0x5588d11d5b48 s->prefetch_data=0 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 20 prepare_atomic_modification: state is not atomic. state=0x5588d11d5b48 2024-03-09T14:24:27.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.559+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.564+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.564+0000 7f2962ffd640 20 handle_completion(): completion ok for obj=d[3BySjVN7h2ribY6hrq6ytrdvEwXDogw] 2024-03-09T14:24:27.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.564+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.566+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.566+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.566+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:e state=0x5588d11a2698 s->prefetch_data=0 2024-03-09T14:24:27.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.567+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to flldg12upfgljxnfmbm63s6gbt1xbpca 2024-03-09T14:24:27.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.567+0000 7f2a81a9d800 20 get_obj_state_impl: setting s->olh_tag to 8pi47joyyou46ma2j2gj1a0uhmrgflw1 2024-03-09T14:24:27.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.567+0000 7f2a81a9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8pi47joyyou46ma2j2gj1a0uhmrgflw1 2024-03-09T14:24:27.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.568+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.569+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-09T14:24:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 olh_log_entry: epoch=2 op=3 key=e[IYk-zr-IuU2EpRV3hsAojHEc5hlTUNC] 2024-03-09T14:24:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:IYk-zr-IuU2EpRV3hsAojHEc5hlTUNC_e state=0x5588d11d5b18 s->prefetch_data=0 2024-03-09T14:24:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 10 manifest: total_size = 22 2024-03-09T14:24:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3558314052879086622 2024-03-09T14:24:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:IYk-zr-IuU2EpRV3hsAojHEc5hlTUNC_e state=0x5588d11d5b18 s->prefetch_data=0 2024-03-09T14:24:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 prepare_atomic_modification: state is not atomic. state=0x5588d11d5b18 2024-03-09T14:24:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.570+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.574+0000 7f2962ffd640 20 handle_completion(): completion ok for obj=e[IYk-zr-IuU2EpRV3hsAojHEc5hlTUNC] 2024-03-09T14:24:27.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.574+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:e state=0x5588d11a2698 s->prefetch_data=0 2024-03-09T14:24:27.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.574+0000 7f2a81a9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8pi47joyyou46ma2j2gj1a0uhmrgflw1 2024-03-09T14:24:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.577+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.579+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.579+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.579+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:f state=0x5588d11a2698 s->prefetch_data=0 2024-03-09T14:24:27.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.580+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to f7s9x2mmf4z2n3xztokq9g52t0hmuhc0 2024-03-09T14:24:27.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.580+0000 7f2a81a9d800 20 get_obj_state_impl: setting s->olh_tag to zutkic4fu3nvu304fw2ismsrq6nubdm3 2024-03-09T14:24:27.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.580+0000 7f2a81a9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zutkic4fu3nvu304fw2ismsrq6nubdm3 2024-03-09T14:24:27.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.582+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.583+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-09T14:24:27.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 olh_log_entry: epoch=2 op=3 key=f[uYKIuFZCpIXBwkjAv5Mzwyeh.culmiU] 2024-03-09T14:24:27.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:uYKIuFZCpIXBwkjAv5Mzwyeh.culmiU_f state=0x5588d11d5b18 s->prefetch_data=0 2024-03-09T14:24:27.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 10 manifest: total_size = 12 2024-03-09T14:24:27.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13583067002011193989 2024-03-09T14:24:27.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:_:uYKIuFZCpIXBwkjAv5Mzwyeh.culmiU_f state=0x5588d11d5b18 s->prefetch_data=0 2024-03-09T14:24:27.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 prepare_atomic_modification: state is not atomic. state=0x5588d11d5b18 2024-03-09T14:24:27.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.584+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.588+0000 7f2962ffd640 20 handle_completion(): completion ok for obj=f[uYKIuFZCpIXBwkjAv5Mzwyeh.culmiU] 2024-03-09T14:24:27.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.589+0000 7f2a81a9d800 20 get_obj_state: octx=0x5588d0ece540 obj=check-bucket:f state=0x5588d11a2698 s->prefetch_data=0 2024-03-09T14:24:27.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.589+0000 7f2a81a9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zutkic4fu3nvu304fw2ismsrq6nubdm3 2024-03-09T14:24:27.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.592+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.593+0000 7f2a81a9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1.0 2024-03-09T14:24:27.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.593+0000 7f2a81a9d800 1 NOTICE: finished shard 0 (4 entries removed) 2024-03-09T14:24:27.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.593+0000 7f2a81a9d800 1 NOTICE: finished all shards (4 entries removed) 2024-03-09T14:24:27.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.594+0000 7f2935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:27.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.596+0000 7f2a81a9d800 20 remove_watcher() i=0 2024-03-09T14:24:27.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.596+0000 7f2a81a9d800 2 removed watcher, disabling cache 2024-03-09T14:24:27.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.598+0000 7f2a81a9d800 20 remove_watcher() i=1 2024-03-09T14:24:27.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.599+0000 7f2a81a9d800 20 remove_watcher() i=2 2024-03-09T14:24:27.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.600+0000 7f2a81a9d800 20 remove_watcher() i=3 2024-03-09T14:24:27.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.601+0000 7f2a81a9d800 20 remove_watcher() i=4 2024-03-09T14:24:27.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.602+0000 7f2a81a9d800 20 remove_watcher() i=5 2024-03-09T14:24:27.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.603+0000 7f2a81a9d800 20 remove_watcher() i=6 2024-03-09T14:24:27.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.604+0000 7f2a81a9d800 20 remove_watcher() i=7 2024-03-09T14:24:27.616 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:27.616 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:27.649 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:27.649 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:27.815 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-09T14:24:27.842 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:24:27.842 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:24:27.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.875+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 realm 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.877+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.878+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:27.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.878+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.879+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:24:27.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.879+0000 7f33b6e24800 20 searching for the correct realm 2024-03-09T14:24:27.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.881+0000 7f33b5121640 0 -- 172.21.15.46:0/99471545 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x5599fca3f0d0 msgr2=0x5599fca41590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:24:27.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.884+0000 7f33b4920640 0 -- 172.21.15.46:0/99471545 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f33a0055570 msgr2=0x7f33a0055c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:24:27.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:24:27.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:24:27.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:24:27.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.889+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:24:27.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 20 zone default found 2024-03-09T14:24:27.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 4 Realm: () 2024-03-09T14:24:27.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:24:27.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 20 zonegroup default 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.890+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.891+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.891+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.891+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.891+0000 7f33b6e24800 20 started sync module instance, tier type = 2024-03-09T14:24:27.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.891+0000 7f33b6e24800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=0 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=1 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=2 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=3 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=4 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=5 2024-03-09T14:24:27.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.902+0000 7f33b6e24800 20 add_watcher() i=6 2024-03-09T14:24:27.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.903+0000 7f33b6e24800 20 add_watcher() i=7 2024-03-09T14:24:27.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.903+0000 7f33b6e24800 2 all 8 watchers are set, enabling cache 2024-03-09T14:24:27.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.904+0000 7f326afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f33b6e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f33b6e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f33b6e24800 5 note: GC not initialized 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f3269fe3640 20 reqs_thread_entry: start 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f33b6e24800 20 init_complete bucket index max shards: 1 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f33b6e24800 20 Filter name: none 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f31db7fe640 20 reqs_thread_entry: start 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.905+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:27.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:27.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:24:27.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.906+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.907+0000 7f33b6e24800 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:24:27.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.907+0000 7f33b6e24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:24:27.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.907+0000 7f33b6e24800 20 rados->read ofs=0 len=0 2024-03-09T14:24:27.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.907+0000 7f33b6e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:24:27.909 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.908+0000 7f326afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:24:27.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.910+0000 7f33b6e24800 20 remove_watcher() i=0 2024-03-09T14:24:27.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.910+0000 7f33b6e24800 2 removed watcher, disabling cache 2024-03-09T14:24:27.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.911+0000 7f33b6e24800 20 remove_watcher() i=1 2024-03-09T14:24:27.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.912+0000 7f33b6e24800 20 remove_watcher() i=2 2024-03-09T14:24:27.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.913+0000 7f33b6e24800 20 remove_watcher() i=3 2024-03-09T14:24:27.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.914+0000 7f33b6e24800 20 remove_watcher() i=4 2024-03-09T14:24:27.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.915+0000 7f33b6e24800 20 remove_watcher() i=5 2024-03-09T14:24:27.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.916+0000 7f33b6e24800 20 remove_watcher() i=6 2024-03-09T14:24:27.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:24:27.917+0000 7f33b6e24800 20 remove_watcher() i=7 2024-03-09T14:24:27.927 INFO:tasks.workunit.client.0.smithi046.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-09T14:24:27.927 INFO:tasks.workunit.client.0.smithi046.stderr:Deleting bucket check-bucket 2024-03-09T14:24:27.929 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:27.929 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:27.955 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:24:27.955 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:24:28.085 INFO:tasks.workunit.client.0.smithi046.stderr:Completed bucket check tests 2024-03-09T14:24:28.085 INFO:tasks.workunit.client.0.smithi046.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-09T14:24:28.085 INFO:tasks.workunit.client.0.smithi046.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-09T14:24:28.085 INFO:tasks.workunit.client.0.smithi046.stdout:connected to https://localhost:443 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ deactivate 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ export PATH 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n '' ']' 2024-03-09T14:24:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:24:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:+ hash -r 2024-03-09T14:24:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n '' ']' 2024-03-09T14:24:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:24:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:24:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:+ unset -f deactivate 2024-03-09T14:24:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo OK. 2024-03-09T14:24:28.147 INFO:tasks.workunit.client.0.smithi046.stdout:OK. 2024-03-09T14:24:28.147 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:24:28.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:24:28.226 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-03-09T14:24:28.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:24:28.794 DEBUG:teuthology.parallel:result is None 2024-03-09T14:24:28.794 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:24:28.834 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:24:28.834 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:24:28.912 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:24:28.913 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:24:28.924 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:24:28.924 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:24:28.925 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:24:28.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:24:28.980 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:24:28.980 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:24:29.047 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:24:29.047 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:24:29.114 INFO:tasks.workunit:timeout=3h 2024-03-09T14:24:29.114 INFO:tasks.workunit:cleanup=True 2024-03-09T14:24:29.114 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:24:29.181 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:25:46.182 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 94% (11585/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.453 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:25:46.454 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:25:46.458 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:25:46.525 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:25:46.527 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:25:46.527 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:25:46.575 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:25:46.625 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:25:46.663 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:25:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:25:46.665 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:25:46.703 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:25:46.707 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:25:46.707 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:25:46.775 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-03-09T14:25:46.776 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-03-09T14:25:46.776 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-03-09T14:25:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:25:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:25:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:25:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 11 tests from ClsLock 2024-03-09T14:25:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-03-09T14:25:48.328 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:48.328 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: exclusive 2024-03-09T14:25:48.328 INFO:tasks.workunit.client.0.smithi046.stdout: tag: 2024-03-09T14:25:48.328 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:48.328 INFO:tasks.workunit.client.0.smithi046.stdout: client.5103 expiration=2024-03-09T14:27:48.323699+0000 addr=v1:172.21.15.46:0/499953513 cookie= 2024-03-09T14:25:48.334 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:48.335 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: shared 2024-03-09T14:25:48.335 INFO:tasks.workunit.client.0.smithi046.stdout: tag: 2024-03-09T14:25:48.335 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:48.335 INFO:tasks.workunit.client.0.smithi046.stdout: client.5103 expiration=2024-03-09T14:27:48.333734+0000 addr=v1:172.21.15.46:0/499953513 cookie= 2024-03-09T14:25:48.335 INFO:tasks.workunit.client.0.smithi046.stdout: client.5109 expiration=0.000000 addr=v1:172.21.15.46:0/1880414073 cookie= 2024-03-09T14:25:48.336 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:48.336 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: shared 2024-03-09T14:25:48.336 INFO:tasks.workunit.client.0.smithi046.stdout: tag: 2024-03-09T14:25:48.336 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:48.336 INFO:tasks.workunit.client.0.smithi046.stdout: client.5109 expiration=0.000000 addr=v1:172.21.15.46:0/1880414073 cookie= 2024-03-09T14:25:49.100 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestMultiLocking (2245 ms) 2024-03-09T14:25:49.101 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestMeta 2024-03-09T14:25:51.147 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:51.147 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: shared 2024-03-09T14:25:51.148 INFO:tasks.workunit.client.0.smithi046.stdout: tag: 2024-03-09T14:25:51.148 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:51.148 INFO:tasks.workunit.client.0.smithi046.stdout: client.5121 expiration=0.000000 addr=v1:172.21.15.46:0/4286998852 cookie= 2024-03-09T14:25:51.149 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:51.150 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: exclusive 2024-03-09T14:25:51.150 INFO:tasks.workunit.client.0.smithi046.stdout: tag: new_tag 2024-03-09T14:25:51.150 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:51.150 INFO:tasks.workunit.client.0.smithi046.stdout: client.5000 expiration=0.000000 addr=v1:172.21.15.46:0/2768480860 cookie= 2024-03-09T14:25:52.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestMeta (3012 ms) 2024-03-09T14:25:52.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestCookie 2024-03-09T14:25:54.137 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:54.137 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: exclusive 2024-03-09T14:25:54.137 INFO:tasks.workunit.client.0.smithi046.stdout: tag: 2024-03-09T14:25:54.137 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:54.139 INFO:tasks.workunit.client.0.smithi046.stdout:lock: mylock 2024-03-09T14:25:54.139 INFO:tasks.workunit.client.0.smithi046.stdout: lock_type: shared 2024-03-09T14:25:54.140 INFO:tasks.workunit.client.0.smithi046.stdout: tag: 2024-03-09T14:25:54.140 INFO:tasks.workunit.client.0.smithi046.stdout: lockers: 2024-03-09T14:25:54.140 INFO:tasks.workunit.client.0.smithi046.stdout: client.5130 expiration=0.000000 addr=v1:172.21.15.46:0/3793529574 cookie= 2024-03-09T14:25:54.140 INFO:tasks.workunit.client.0.smithi046.stdout: client.5130 expiration=0.000000 addr=v1:172.21.15.46:0/3793529574 cookie=new cookie 2024-03-09T14:25:55.129 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestCookie (3015 ms) 2024-03-09T14:25:55.129 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-03-09T14:25:58.145 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestMultipleLocks (3018 ms) 2024-03-09T14:25:58.146 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestLockDuration 2024-03-09T14:26:05.221 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestLockDuration (7076 ms) 2024-03-09T14:26:05.222 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-03-09T14:26:08.241 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestAssertLocked (3019 ms) 2024-03-09T14:26:08.241 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestSetCookie 2024-03-09T14:26:11.267 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestSetCookie (3024 ms) 2024-03-09T14:26:11.267 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestRenew 2024-03-09T14:26:32.313 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestRenew (21047 ms) 2024-03-09T14:26:32.313 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-03-09T14:26:38.391 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6079 ms) 2024-03-09T14:26:38.391 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-03-09T14:26:45.472 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7079 ms) 2024-03-09T14:26:45.472 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-03-09T14:26:53.501 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8032 ms) 2024-03-09T14:26:53.501 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 11 tests from ClsLock (66646 ms total) 2024-03-09T14:26:53.502 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:26:53.502 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:26:53.502 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 1 test suite ran. (66646 ms total) 2024-03-09T14:26:53.502 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 11 tests. 2024-03-09T14:26:53.505 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:26:53.505 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:26:53.590 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-03-09T14:26:53.591 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-03-09T14:26:53.591 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-03-09T14:26:53.634 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:26:53.635 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:26:53.635 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:26:53.635 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from cls_log 2024-03-09T14:26:53.635 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-03-09T14:26:56.527 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_log.test_log_add_same_time (2891 ms) 2024-03-09T14:26:56.527 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-03-09T14:26:59.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_log.test_log_add_different_time (3014 ms) 2024-03-09T14:26:59.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_log.trim_by_time 2024-03-09T14:27:02.558 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_log.trim_by_time (3018 ms) 2024-03-09T14:27:02.558 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_log.trim_by_marker 2024-03-09T14:27:05.573 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_log.trim_by_marker (3014 ms) 2024-03-09T14:27:05.573 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from cls_log (11939 ms total) 2024-03-09T14:27:05.573 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:27:05.573 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:27:05.573 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (11939 ms total) 2024-03-09T14:27:05.573 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-03-09T14:27:05.577 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:27:05.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:27:05.660 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-03-09T14:27:05.662 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-03-09T14:27:05.662 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-03-09T14:27:05.744 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:27:05.744 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 10 tests from 1 test suite. 2024-03-09T14:27:05.744 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:27:05.744 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from cls_refcount 2024-03-09T14:27:05.744 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_implicit 2024-03-09T14:27:08.590 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_implicit (2847 ms) 2024-03-09T14:27:08.591 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-03-09T14:27:11.607 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3016 ms) 2024-03-09T14:27:11.607 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_put_snap 2024-03-09T14:27:20.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_put_snap (9033 ms) 2024-03-09T14:27:20.641 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_explicit 2024-03-09T14:27:23.664 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_explicit (3024 ms) 2024-03-09T14:27:23.664 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.set 2024-03-09T14:27:26.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.set (3019 ms) 2024-03-09T14:27:26.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-03-09T14:27:33.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_implicit_ec (7028 ms) 2024-03-09T14:27:33.711 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-03-09T14:27:40.744 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7034 ms) 2024-03-09T14:27:40.744 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-03-09T14:27:52.855 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_put_snap_ec (12110 ms) 2024-03-09T14:27:52.855 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-03-09T14:27:59.873 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.test_explicit_ec (7018 ms) 2024-03-09T14:27:59.873 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_refcount.set_ec 2024-03-09T14:28:06.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_refcount.set_ec (7027 ms) 2024-03-09T14:28:06.900 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 10 tests from cls_refcount (61156 ms total) 2024-03-09T14:28:06.900 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:28:06.900 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:28:06.900 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 10 tests from 1 test suite ran. (61156 ms total) 2024-03-09T14:28:06.900 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 10 tests. 2024-03-09T14:28:06.902 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:28:06.903 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:28:06.986 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-03-09T14:28:06.987 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-03-09T14:28:06.987 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-03-09T14:28:07.069 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:28:07.069 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 16 tests from 1 test suite. 2024-03-09T14:28:07.069 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:28:07.069 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 16 tests from cls_rgw 2024-03-09T14:28:08.920 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_basic 2024-03-09T14:28:08.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_basic (46 ms) 2024-03-09T14:28:08.967 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-03-09T14:28:08.998 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-03-09T14:28:08.998 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_remove_object 2024-03-09T14:28:09.044 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_remove_object (46 ms) 2024-03-09T14:28:09.044 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_suggest 2024-03-09T14:28:10.537 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_suggest (1493 ms) 2024-03-09T14:28:10.537 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-03-09T14:28:10.545 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_suggest_complete (9 ms) 2024-03-09T14:28:10.545 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_list 2024-03-09T14:28:10.572 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_list (26 ms) 2024-03-09T14:28:10.572 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-03-09T14:28:29.339 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_list_delimited (18768 ms) 2024-03-09T14:28:29.339 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.bi_list 2024-03-09T14:28:29.409 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.bi_list (70 ms) 2024-03-09T14:28:29.409 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.gc_set 2024-03-09T14:28:29.419 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-03-09T14:28:29.419 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.gc_list 2024-03-09T14:28:29.429 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2024-03-09T14:28:29.429 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.gc_defer 2024-03-09T14:28:37.103 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.gc_defer (7675 ms) 2024-03-09T14:28:37.104 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.usage_basic 2024-03-09T14:28:37.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.usage_basic (101 ms) 2024-03-09T14:28:37.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-03-09T14:28:37.205 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-03-09T14:28:37.206 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.usage_clear 2024-03-09T14:28:37.299 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.usage_clear (94 ms) 2024-03-09T14:28:37.299 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-03-09T14:28:37.343 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.bi_log_trim (43 ms) 2024-03-09T14:28:37.343 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-03-09T14:28:37.358 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw.index_racing_removes (16 ms) 2024-03-09T14:28:38.111 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 16 tests from cls_rgw (28438 ms total) 2024-03-09T14:28:38.112 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:28:38.112 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:28:38.112 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 16 tests from 1 test suite ran. (31042 ms total) 2024-03-09T14:28:38.112 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 16 tests. 2024-03-09T14:28:38.114 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:28:38.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:28:38.198 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-03-09T14:28:38.199 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-03-09T14:28:38.200 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-03-09T14:28:38.283 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:28:38.283 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:28:38.283 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:28:38.283 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from cls_rgw_gc 2024-03-09T14:28:38.283 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.init 2024-03-09T14:28:40.121 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.init (1839 ms) 2024-03-09T14:28:40.122 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-03-09T14:28:40.143 INFO:tasks.workunit.client.0.smithi046.stderr:[ ] list info tag = chain-0 2024-03-09T14:28:40.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (22 ms) 2024-03-09T14:28:40.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-03-09T14:28:40.149 INFO:tasks.workunit.client.0.smithi046.stderr:[ ] next_marker is: = 0/4263 2024-03-09T14:28:40.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2024-03-09T14:28:40.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-03-09T14:28:40.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (11 ms) 2024-03-09T14:28:40.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-03-09T14:28:40.311 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (150 ms) 2024-03-09T14:28:40.311 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-03-09T14:28:40.322 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (12 ms) 2024-03-09T14:28:40.322 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-03-09T14:28:40.329 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-03-09T14:28:40.329 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-03-09T14:28:40.336 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (7 ms) 2024-03-09T14:28:40.336 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_gc.finalize 2024-03-09T14:28:41.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_gc.finalize (797 ms) 2024-03-09T14:28:41.135 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from cls_rgw_gc (2851 ms total) 2024-03-09T14:28:41.135 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:28:41.135 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:28:41.135 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 1 test suite ran. (2851 ms total) 2024-03-09T14:28:41.135 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 9 tests. 2024-03-09T14:28:41.136 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:28:41.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:28:41.179 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-03-09T14:28:41.180 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-03-09T14:28:41.180 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-03-09T14:28:41.270 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:41.270 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:41.270 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 1 test from 1 test suite. 2024-03-09T14:28:41.270 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:28:43.147 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from cls_rgw_stats 2024-03-09T14:28:43.147 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] cls_rgw_stats.simulate 2024-03-09T14:28:43.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.164+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~107JV7GJRNBZ.0 size=1048576 2024-03-09T14:28:43.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.166+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~107JV7GJRNBZ.1 size=1048576 2024-03-09T14:28:43.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.167+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~107JV7GJRNBZ.2 size=346993 2024-03-09T14:28:43.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.167+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=107JV7GJRNBZ tag=JF7UB1ZQ3PZP type=write size=3492721 2024-03-09T14:28:43.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.169+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~PP3DH4GWY7ZY.0 size=1048576 2024-03-09T14:28:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.170+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~PP3DH4GWY7ZY.1 size=1048576 2024-03-09T14:28:43.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.172+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~PP3DH4GWY7ZY.2 size=486440 2024-03-09T14:28:43.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.172+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=PP3DH4GWY7ZY tag=K1LTKFGG4CPC type=write size=3632168 2024-03-09T14:28:43.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.174+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~2JFIH6NWN1UI.0 size=1048576 2024-03-09T14:28:43.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.175+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~2JFIH6NWN1UI.1 size=553761 2024-03-09T14:28:43.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.175+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=2JFIH6NWN1UI tag=9RQUSZ8DSP6H type=write size=2650913 2024-03-09T14:28:43.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.177+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=HUZ5L3X4EHE8 type=write size=190546 2024-03-09T14:28:43.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.179+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~Q212246JN4JF.0 size=422271 2024-03-09T14:28:43.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.179+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=Q212246JN4JF tag=CHB707648JIK type=write size=1470847 2024-03-09T14:28:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.181+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=DJEYQC33AQAM type=del size=1499046 2024-03-09T14:28:43.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.182+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=IO00UR2IXYNM type=del size=2950231 2024-03-09T14:28:43.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.184+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=21TJ0PRZ54RG type=del size=729706 2024-03-09T14:28:43.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.186+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=5EQOFNKJE7C5 type=del size=3287481 2024-03-09T14:28:43.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.188+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~0IRP4W0ZU6MQ.0 size=1048576 2024-03-09T14:28:43.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.189+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~0IRP4W0ZU6MQ.1 size=718946 2024-03-09T14:28:43.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.189+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=0IRP4W0ZU6MQ tag=7XNZ8G917BZ5 type=write size=2816098 2024-03-09T14:28:43.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.191+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=A457A2OJ61T0 type=del size=2498496 2024-03-09T14:28:43.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.192+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=IMG1F58SRMGE type=del size=1108807 2024-03-09T14:28:43.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.194+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=HLJGQ2YCC9OV type=del size=724001 2024-03-09T14:28:43.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.196+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~3BKK21JYRAS8.0 size=1048576 2024-03-09T14:28:43.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.197+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~3BKK21JYRAS8.1 size=1048576 2024-03-09T14:28:43.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.198+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~3BKK21JYRAS8.2 size=581502 2024-03-09T14:28:43.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.198+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=3BKK21JYRAS8 tag=BWTKY7SND0UI type=write size=3727230 2024-03-09T14:28:43.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.200+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=EJYDN9KK243C type=del size=3163347 2024-03-09T14:28:43.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.201+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=0EGC0EHEUE5Y type=del size=1594244 2024-03-09T14:28:43.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.202+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~107JV7GJRNBZ.0 size=1048576 2024-03-09T14:28:43.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.203+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~107JV7GJRNBZ.1 size=1048576 2024-03-09T14:28:43.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.204+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~107JV7GJRNBZ.2 size=346993 2024-03-09T14:28:43.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.207+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=107JV7GJRNBZ tag=JF7UB1ZQ3PZP type=write size=3492721 2024-03-09T14:28:43.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.208+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=2GOIFYSKILN3 type=del size=3659263 2024-03-09T14:28:43.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.209+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~PP3DH4GWY7ZY.0 size=1048576 2024-03-09T14:28:43.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.209+0000 7f1c6444c780 1 < canceled part key=_multipart_HNK7POWS6FSU.2~PP3DH4GWY7ZY.1 size=1048576 2024-03-09T14:28:43.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.210+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~PP3DH4GWY7ZY.2 size=486440 2024-03-09T14:28:43.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.213+0000 7f1c6444c780 1 < canceled multipart upload key=HNK7POWS6FSU upload=PP3DH4GWY7ZY tag=K1LTKFGG4CPC type=write size=3632168 2024-03-09T14:28:43.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.214+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=96URK5G7V93Z type=del size=3144055 2024-03-09T14:28:43.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.215+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~2JFIH6NWN1UI.0 size=1048576 2024-03-09T14:28:43.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.216+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~2JFIH6NWN1UI.1 size=553761 2024-03-09T14:28:43.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.219+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=2JFIH6NWN1UI tag=9RQUSZ8DSP6H type=write size=2650913 2024-03-09T14:28:43.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.220+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=9IOR95BFL228 type=del size=502419 2024-03-09T14:28:43.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.221+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=HUZ5L3X4EHE8 type=write size=190546 2024-03-09T14:28:43.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.224+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~VC4XAULBA7RD.0 size=1048576 2024-03-09T14:28:43.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.225+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~VC4XAULBA7RD.1 size=453629 2024-03-09T14:28:43.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.225+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=VC4XAULBA7RD tag=M7TIQU8Y1DWL type=write size=2550781 2024-03-09T14:28:43.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.226+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~Q212246JN4JF.0 size=422271 2024-03-09T14:28:43.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.228+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=Q212246JN4JF tag=CHB707648JIK type=write size=1470847 2024-03-09T14:28:43.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.230+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=24TW72D5JDGD type=del size=982235 2024-03-09T14:28:43.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.233+0000 7f1c6444c780 1 < suggested remove operation key=PBM4ICXZ2497 tag=DJEYQC33AQAM type=del 2024-03-09T14:28:43.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.235+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~K7RDKS6SKR7P.0 size=1048576 2024-03-09T14:28:43.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.236+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~K7RDKS6SKR7P.1 size=1048576 2024-03-09T14:28:43.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.237+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~K7RDKS6SKR7P.2 size=406006 2024-03-09T14:28:43.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.237+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=K7RDKS6SKR7P tag=3M4VSPISQGOH type=write size=3551734 2024-03-09T14:28:43.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.238+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=IO00UR2IXYNM type=del 2024-03-09T14:28:43.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.240+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=HUM0CQN07R3D type=del size=1727435 2024-03-09T14:28:43.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.241+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=21TJ0PRZ54RG type=del 2024-03-09T14:28:43.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.242+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=8P52AX59DB1Y type=del size=4122690 2024-03-09T14:28:43.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.244+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=5EQOFNKJE7C5 type=del 2024-03-09T14:28:43.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.247+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~W06XCZP4PR5J.0 size=217719 2024-03-09T14:28:43.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.247+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=W06XCZP4PR5J tag=ZXAW61NUVIS4 type=write size=1266295 2024-03-09T14:28:43.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.248+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~0IRP4W0ZU6MQ.0 size=1048576 2024-03-09T14:28:43.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.249+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~0IRP4W0ZU6MQ.1 size=718946 2024-03-09T14:28:43.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.251+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=0IRP4W0ZU6MQ tag=7XNZ8G917BZ5 type=write size=2816098 2024-03-09T14:28:43.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.254+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~9LPKACP2T6LX.0 size=1048576 2024-03-09T14:28:43.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.254+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~9LPKACP2T6LX.1 size=1048576 2024-03-09T14:28:43.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.256+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~9LPKACP2T6LX.2 size=555233 2024-03-09T14:28:43.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.256+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=9LPKACP2T6LX tag=CN0IUKZ2HPB8 type=write size=3700961 2024-03-09T14:28:43.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.258+0000 7f1c6444c780 1 < suggested update operation key=HNK7POWS6FSU tag=A457A2OJ61T0 type=del size=2498496 2024-03-09T14:28:43.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.259+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=0J0NMFUIEBSA type=write size=706510 2024-03-09T14:28:43.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.260+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=IMG1F58SRMGE type=del 2024-03-09T14:28:43.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.262+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=HXAHVZWAFLU8 type=write size=863762 2024-03-09T14:28:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.263+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=HLJGQ2YCC9OV type=del 2024-03-09T14:28:43.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.265+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=UA2LWTV4LN87 type=del size=2411349 2024-03-09T14:28:43.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.266+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~3BKK21JYRAS8.0 size=1048576 2024-03-09T14:28:43.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.267+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~3BKK21JYRAS8.1 size=1048576 2024-03-09T14:28:43.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.268+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~3BKK21JYRAS8.2 size=581502 2024-03-09T14:28:43.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.270+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=3BKK21JYRAS8 tag=BWTKY7SND0UI type=write size=3727230 2024-03-09T14:28:43.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.271+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=Y56H1MC8I7CM type=del size=326856 2024-03-09T14:28:43.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.273+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=EJYDN9KK243C type=del size=3163347 2024-03-09T14:28:43.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.274+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=NUQBL6VAESF4 type=del size=2812007 2024-03-09T14:28:43.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.276+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=0EGC0EHEUE5Y type=del 2024-03-09T14:28:43.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.277+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=3E1BEFJ832YL type=del size=3828189 2024-03-09T14:28:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.278+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=2GOIFYSKILN3 type=del 2024-03-09T14:28:43.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.279+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=2JIMDB5W3AUO type=del size=3704936 2024-03-09T14:28:43.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.280+0000 7f1c6444c780 1 < canceled operation key=KMX7TNIOKWOA tag=96URK5G7V93Z type=del size=3144055 2024-03-09T14:28:43.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.282+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=DJSO866G23X2 type=del size=2121241 2024-03-09T14:28:43.283 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.283+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=9IOR95BFL228 type=del 2024-03-09T14:28:43.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.284+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=UEAVY28CQ8ES type=del size=2816715 2024-03-09T14:28:43.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.285+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~VC4XAULBA7RD.0 size=1048576 2024-03-09T14:28:43.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.286+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~VC4XAULBA7RD.1 size=453629 2024-03-09T14:28:43.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.288+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=VC4XAULBA7RD tag=M7TIQU8Y1DWL type=write size=2550781 2024-03-09T14:28:43.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.289+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=WXQO0256OK24 type=del size=2012818 2024-03-09T14:28:43.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.290+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=24TW72D5JDGD type=del 2024-03-09T14:28:43.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.291+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=1DGPUAUFL3BC type=write size=853951 2024-03-09T14:28:43.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.292+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~K7RDKS6SKR7P.0 size=1048576 2024-03-09T14:28:43.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.293+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~K7RDKS6SKR7P.1 size=1048576 2024-03-09T14:28:43.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.294+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~K7RDKS6SKR7P.2 size=406006 2024-03-09T14:28:43.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.297+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=K7RDKS6SKR7P tag=3M4VSPISQGOH type=write size=3551734 2024-03-09T14:28:43.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.299+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~ZP8M65KRB5OO.0 size=1048576 2024-03-09T14:28:43.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.300+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~ZP8M65KRB5OO.1 size=964700 2024-03-09T14:28:43.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.300+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=ZP8M65KRB5OO tag=VFH13LIUXMIL type=write size=3061852 2024-03-09T14:28:43.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.302+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=HUM0CQN07R3D type=del size=1727435 2024-03-09T14:28:43.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.303+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=30A9JQX1GNSN type=del size=2311882 2024-03-09T14:28:43.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.304+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=8P52AX59DB1Y type=del 2024-03-09T14:28:43.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.306+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~T9QGJJSETVSO.0 size=1048576 2024-03-09T14:28:43.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.307+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~T9QGJJSETVSO.1 size=851136 2024-03-09T14:28:43.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.307+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=T9QGJJSETVSO tag=1OMY64E8MT2S type=write size=2948288 2024-03-09T14:28:43.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.307+0000 7f1c6444c780 1 < canceled part key=_multipart_YECG84AJ5IK2.2~W06XCZP4PR5J.0 size=217719 2024-03-09T14:28:43.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.309+0000 7f1c6444c780 1 < canceled multipart upload key=YECG84AJ5IK2 upload=W06XCZP4PR5J tag=ZXAW61NUVIS4 type=write size=1266295 2024-03-09T14:28:43.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.310+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=UI1C1GAF6EG7 type=del size=3783923 2024-03-09T14:28:43.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.311+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~9LPKACP2T6LX.0 size=1048576 2024-03-09T14:28:43.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.312+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~9LPKACP2T6LX.1 size=1048576 2024-03-09T14:28:43.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.313+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~9LPKACP2T6LX.2 size=555233 2024-03-09T14:28:43.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.315+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=9LPKACP2T6LX tag=CN0IUKZ2HPB8 type=write size=3700961 2024-03-09T14:28:43.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.316+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=S3Z9RRQYYS25 type=del size=738421 2024-03-09T14:28:43.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.318+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=0J0NMFUIEBSA type=write size=706510 2024-03-09T14:28:43.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.319+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=X6SC61NAODG4 type=del size=3423523 2024-03-09T14:28:43.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.320+0000 7f1c6444c780 1 < completed write operation key=BYX1155MZ2LP tag=HXAHVZWAFLU8 type=write size=863762 2024-03-09T14:28:43.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.322+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~F8ZMSK5YU2ZC.0 size=719446 2024-03-09T14:28:43.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.322+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=F8ZMSK5YU2ZC tag=5OOH70JFJ6ME type=write size=1768022 2024-03-09T14:28:43.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.323+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=UA2LWTV4LN87 type=del 2024-03-09T14:28:43.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.325+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~0UXES152RONX.0 size=1048576 2024-03-09T14:28:43.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.326+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~0UXES152RONX.1 size=1048576 2024-03-09T14:28:43.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.327+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~0UXES152RONX.2 size=850552 2024-03-09T14:28:43.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.327+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=0UXES152RONX tag=FSHSJKKZU9ZK type=write size=3996280 2024-03-09T14:28:43.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.329+0000 7f1c6444c780 1 < suggested remove operation key=IBVEN2JEB49N tag=Y56H1MC8I7CM type=del 2024-03-09T14:28:43.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.331+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~WBP61CIUVZS7.0 size=836198 2024-03-09T14:28:43.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.331+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=WBP61CIUVZS7 tag=DCRIG0FHMYWM type=write size=1884774 2024-03-09T14:28:43.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.333+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=NUQBL6VAESF4 type=del 2024-03-09T14:28:43.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.334+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=GJN9SDK458X7 type=del size=3773766 2024-03-09T14:28:43.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.335+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=3E1BEFJ832YL type=del 2024-03-09T14:28:43.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.336+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=3RA1QNXZ6IK5 type=del size=2829933 2024-03-09T14:28:43.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.338+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=2JIMDB5W3AUO type=del 2024-03-09T14:28:43.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.339+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=CNQW3LBTDBRG type=del size=1672009 2024-03-09T14:28:43.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.340+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=DJSO866G23X2 type=del 2024-03-09T14:28:43.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.341+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=2WWK4GG0WAZZ type=del size=3302917 2024-03-09T14:28:43.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.343+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=UEAVY28CQ8ES type=del 2024-03-09T14:28:43.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.345+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=3R8UFRMQVHWX type=write size=926114 2024-03-09T14:28:43.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.346+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=WXQO0256OK24 type=del 2024-03-09T14:28:43.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.347+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=DXT7ZEYCE4PC type=write size=479982 2024-03-09T14:28:43.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.349+0000 7f1c6444c780 1 < completed write operation key=PBM4ICXZ2497 tag=1DGPUAUFL3BC type=write size=853951 2024-03-09T14:28:43.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.351+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~QY8QXLE24XV6.0 size=728641 2024-03-09T14:28:43.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.351+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=QY8QXLE24XV6 tag=4ZLDFTSEZE36 type=write size=1777217 2024-03-09T14:28:43.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.352+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~ZP8M65KRB5OO.0 size=1048576 2024-03-09T14:28:43.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.353+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~ZP8M65KRB5OO.1 size=964700 2024-03-09T14:28:43.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.355+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=ZP8M65KRB5OO tag=VFH13LIUXMIL type=write size=3061852 2024-03-09T14:28:43.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.356+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=4P0FJP09LM1B type=write size=316360 2024-03-09T14:28:43.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.359+0000 7f1c6444c780 1 < suggested remove operation key=KNOEGKSERB6Z tag=30A9JQX1GNSN type=del 2024-03-09T14:28:43.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.360+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=FQH6FGQ61CB6 type=del size=2156240 2024-03-09T14:28:43.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.361+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~T9QGJJSETVSO.0 size=1048576 2024-03-09T14:28:43.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.362+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~T9QGJJSETVSO.1 size=851136 2024-03-09T14:28:43.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.364+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=T9QGJJSETVSO tag=1OMY64E8MT2S type=write size=2948288 2024-03-09T14:28:43.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.366+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~NBUREZ1CSOTJ.0 size=1048576 2024-03-09T14:28:43.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.367+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~NBUREZ1CSOTJ.1 size=1048576 2024-03-09T14:28:43.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.368+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~NBUREZ1CSOTJ.2 size=107077 2024-03-09T14:28:43.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.368+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=NBUREZ1CSOTJ tag=FWENCAFPME4B type=write size=3252805 2024-03-09T14:28:43.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.369+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=UI1C1GAF6EG7 type=del 2024-03-09T14:28:43.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.370+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=JAA71GXGZQMJ type=del size=1196054 2024-03-09T14:28:43.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.371+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=S3Z9RRQYYS25 type=del 2024-03-09T14:28:43.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.372+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=3BAFQRZYBTV9 type=write size=69816 2024-03-09T14:28:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.374+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=X6SC61NAODG4 type=del 2024-03-09T14:28:43.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.376+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~XSE9H0B41BMH.0 size=1048576 2024-03-09T14:28:43.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.377+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~XSE9H0B41BMH.1 size=1048576 2024-03-09T14:28:43.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.378+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~XSE9H0B41BMH.2 size=709476 2024-03-09T14:28:43.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.378+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=XSE9H0B41BMH tag=BPWZ3BNZ7IE9 type=write size=3855204 2024-03-09T14:28:43.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.378+0000 7f1c6444c780 1 < canceled part key=_multipart_1NQRJ8ICZNM6.2~F8ZMSK5YU2ZC.0 size=719446 2024-03-09T14:28:43.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.380+0000 7f1c6444c780 1 < canceled multipart upload key=1NQRJ8ICZNM6 upload=F8ZMSK5YU2ZC tag=5OOH70JFJ6ME type=write size=1768022 2024-03-09T14:28:43.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.382+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~7OLKF32HZW0R.0 size=1048576 2024-03-09T14:28:43.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.383+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~7OLKF32HZW0R.1 size=1048576 2024-03-09T14:28:43.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.384+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~7OLKF32HZW0R.2 size=628879 2024-03-09T14:28:43.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.384+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=7OLKF32HZW0R tag=GUEPWU2GX9M6 type=write size=3774607 2024-03-09T14:28:43.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.385+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~0UXES152RONX.0 size=1048576 2024-03-09T14:28:43.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.386+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~0UXES152RONX.1 size=1048576 2024-03-09T14:28:43.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.386+0000 7f1c6444c780 1 < canceled part key=_multipart_VL5EUQ52WRAN.2~0UXES152RONX.2 size=850552 2024-03-09T14:28:43.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.388+0000 7f1c6444c780 1 < canceled multipart upload key=VL5EUQ52WRAN upload=0UXES152RONX tag=FSHSJKKZU9ZK type=write size=3996280 2024-03-09T14:28:43.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.389+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=7CYRO39VS2K7 type=write size=286161 2024-03-09T14:28:43.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.390+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~WBP61CIUVZS7.0 size=836198 2024-03-09T14:28:43.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.392+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=WBP61CIUVZS7 tag=DCRIG0FHMYWM type=write size=1884774 2024-03-09T14:28:43.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.395+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~K9F7IEK7FTSE.0 size=1048576 2024-03-09T14:28:43.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.395+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~K9F7IEK7FTSE.1 size=1048576 2024-03-09T14:28:43.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.396+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~K9F7IEK7FTSE.2 size=720897 2024-03-09T14:28:43.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.396+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=K9F7IEK7FTSE tag=RXPTV9FS6GAP type=write size=3866625 2024-03-09T14:28:43.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.398+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=GJN9SDK458X7 type=del 2024-03-09T14:28:43.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.400+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~VZ0P1ZT4YFMW.0 size=1048576 2024-03-09T14:28:43.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.401+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~VZ0P1ZT4YFMW.1 size=1048576 2024-03-09T14:28:43.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.403+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~VZ0P1ZT4YFMW.2 size=653710 2024-03-09T14:28:43.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.403+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=VZ0P1ZT4YFMW tag=CFYGUFZR9J15 type=write size=3799438 2024-03-09T14:28:43.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.404+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=3RA1QNXZ6IK5 type=del 2024-03-09T14:28:43.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.405+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=H2GJ02U54YR4 type=write size=314989 2024-03-09T14:28:43.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.406+0000 7f1c6444c780 -1 < failed to complete operation key=0IHHFQBKKJ0G tag=CNQW3LBTDBRG type=del size=1672009: (22) Invalid argument 2024-03-09T14:28:43.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.408+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~AF5ENYUBOVQ6.0 size=841493 2024-03-09T14:28:43.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.408+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=AF5ENYUBOVQ6 tag=22OOWOD5KVB5 type=write size=1890069 2024-03-09T14:28:43.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.409+0000 7f1c6444c780 -1 < failed to complete operation key=KNOEGKSERB6Z tag=2WWK4GG0WAZZ type=del size=3302917: (22) Invalid argument 2024-03-09T14:28:43.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.411+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=G25EROHOKBG2 type=write size=579471 2024-03-09T14:28:43.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.412+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=3R8UFRMQVHWX type=write size=926114 2024-03-09T14:28:43.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.414+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~S3BVIMMSCJY7.0 size=1048576 2024-03-09T14:28:43.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.415+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~S3BVIMMSCJY7.1 size=1048576 2024-03-09T14:28:43.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.416+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~S3BVIMMSCJY7.2 size=450365 2024-03-09T14:28:43.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.416+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=S3BVIMMSCJY7 tag=0MVRV9LLD7XZ type=write size=3596093 2024-03-09T14:28:43.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.417+0000 7f1c6444c780 1 < completed write operation key=MOVS6ZMK708G tag=DXT7ZEYCE4PC type=write size=479982 2024-03-09T14:28:43.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.418+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=7SSKCL47ODA1 type=del size=3526662 2024-03-09T14:28:43.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.418+0000 7f1c6444c780 1 < canceled part key=_multipart_1NQRJ8ICZNM6.2~QY8QXLE24XV6.0 size=728641 2024-03-09T14:28:43.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.420+0000 7f1c6444c780 1 < canceled multipart upload key=1NQRJ8ICZNM6 upload=QY8QXLE24XV6 tag=4ZLDFTSEZE36 type=write size=1777217 2024-03-09T14:28:43.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.422+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~AKXLDT8XBI51.0 size=140699 2024-03-09T14:28:43.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.422+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=AKXLDT8XBI51 tag=0I4FGOSHE3IF type=write size=1189275 2024-03-09T14:28:43.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.424+0000 7f1c6444c780 1 < suggested remove operation key=YECG84AJ5IK2 tag=4P0FJP09LM1B type=write 2024-03-09T14:28:43.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.425+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=6O41YYB40Y0W type=del size=2297089 2024-03-09T14:28:43.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.426+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=FQH6FGQ61CB6 type=del 2024-03-09T14:28:43.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.428+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~7ZRSPACQT12D.0 size=1048576 2024-03-09T14:28:43.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.429+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~7ZRSPACQT12D.1 size=490670 2024-03-09T14:28:43.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.429+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=7ZRSPACQT12D tag=401UFDHDD5L8 type=write size=2587822 2024-03-09T14:28:43.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.430+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~NBUREZ1CSOTJ.0 size=1048576 2024-03-09T14:28:43.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.431+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~NBUREZ1CSOTJ.1 size=1048576 2024-03-09T14:28:43.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.432+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~NBUREZ1CSOTJ.2 size=107077 2024-03-09T14:28:43.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.434+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=NBUREZ1CSOTJ tag=FWENCAFPME4B type=write size=3252805 2024-03-09T14:28:43.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.435+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=XMGNR913988Z type=del size=3030442 2024-03-09T14:28:43.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.436+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=JAA71GXGZQMJ type=del 2024-03-09T14:28:43.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.437+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=X9K0XGC0WPHZ type=del size=2739610 2024-03-09T14:28:43.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.438+0000 7f1c6444c780 1 < completed write operation key=SGHNHOCYPM38 tag=3BAFQRZYBTV9 type=write size=69816 2024-03-09T14:28:43.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.440+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=S1F0A68N58KG type=del size=1903553 2024-03-09T14:28:43.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.441+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~XSE9H0B41BMH.0 size=1048576 2024-03-09T14:28:43.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.442+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~XSE9H0B41BMH.1 size=1048576 2024-03-09T14:28:43.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.442+0000 7f1c6444c780 1 < canceled part key=_multipart_P33029QWKW23.2~XSE9H0B41BMH.2 size=709476 2024-03-09T14:28:43.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.444+0000 7f1c6444c780 1 < canceled multipart upload key=P33029QWKW23 upload=XSE9H0B41BMH tag=BPWZ3BNZ7IE9 type=write size=3855204 2024-03-09T14:28:43.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.445+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=IJK1FCT1XL3G type=del size=3551665 2024-03-09T14:28:43.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.445+0000 7f1c6444c780 1 < canceled part key=_multipart_QSMTZR754455.2~7OLKF32HZW0R.0 size=1048576 2024-03-09T14:28:43.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.446+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~7OLKF32HZW0R.1 size=1048576 2024-03-09T14:28:43.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.447+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~7OLKF32HZW0R.2 size=628879 2024-03-09T14:28:43.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.449+0000 7f1c6444c780 1 < canceled multipart upload key=QSMTZR754455 upload=7OLKF32HZW0R tag=GUEPWU2GX9M6 type=write size=3774607 2024-03-09T14:28:43.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.450+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=MZ3K04QKKKAA type=write size=679502 2024-03-09T14:28:43.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.451+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=7CYRO39VS2K7 type=write size=286161 2024-03-09T14:28:43.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.452+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=WKIKZWNR0MOX type=del size=1602211 2024-03-09T14:28:43.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.453+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~K9F7IEK7FTSE.0 size=1048576 2024-03-09T14:28:43.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.454+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~K9F7IEK7FTSE.1 size=1048576 2024-03-09T14:28:43.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.455+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~K9F7IEK7FTSE.2 size=720897 2024-03-09T14:28:43.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.457+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=K9F7IEK7FTSE tag=RXPTV9FS6GAP type=write size=3866625 2024-03-09T14:28:43.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.459+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~ISHDMIS526LU.0 size=1048576 2024-03-09T14:28:43.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.460+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~ISHDMIS526LU.1 size=51137 2024-03-09T14:28:43.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.460+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=ISHDMIS526LU tag=9W6ZLP0WIJIW type=write size=2148289 2024-03-09T14:28:43.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.462+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~VZ0P1ZT4YFMW.0 size=1048576 2024-03-09T14:28:43.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.462+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~VZ0P1ZT4YFMW.1 size=1048576 2024-03-09T14:28:43.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.463+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~VZ0P1ZT4YFMW.2 size=653710 2024-03-09T14:28:43.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.465+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=VZ0P1ZT4YFMW tag=CFYGUFZR9J15 type=write size=3799438 2024-03-09T14:28:43.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.466+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=MUSL651LXASA type=del size=2440177 2024-03-09T14:28:43.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.468+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=H2GJ02U54YR4 type=write size=314989 2024-03-09T14:28:43.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.470+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~5XX097LT6VKL.0 size=1048576 2024-03-09T14:28:43.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.470+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~5XX097LT6VKL.1 size=270821 2024-03-09T14:28:43.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.470+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=5XX097LT6VKL tag=54PCR05VTDS1 type=write size=2367973 2024-03-09T14:28:43.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.472+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~AF5ENYUBOVQ6.0 size=841493 2024-03-09T14:28:43.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.473+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=AF5ENYUBOVQ6 tag=22OOWOD5KVB5 type=write size=1890069 2024-03-09T14:28:43.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.474+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=FN3JJ07KEWJP type=del size=2538351 2024-03-09T14:28:43.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.476+0000 7f1c6444c780 1 < completed write operation key=BYX1155MZ2LP tag=G25EROHOKBG2 type=write size=579471 2024-03-09T14:28:43.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.477+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=G6VQCV3XRTIN type=del size=2947041 2024-03-09T14:28:43.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.477+0000 7f1c6444c780 1 < canceled part key=_multipart_1NQRJ8ICZNM6.2~S3BVIMMSCJY7.0 size=1048576 2024-03-09T14:28:43.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.478+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~S3BVIMMSCJY7.1 size=1048576 2024-03-09T14:28:43.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.479+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~S3BVIMMSCJY7.2 size=450365 2024-03-09T14:28:43.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.481+0000 7f1c6444c780 1 < canceled multipart upload key=1NQRJ8ICZNM6 upload=S3BVIMMSCJY7 tag=0MVRV9LLD7XZ type=write size=3596093 2024-03-09T14:28:43.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.483+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~8541TUECC3EO.0 size=1048576 2024-03-09T14:28:43.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.484+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~8541TUECC3EO.1 size=1048576 2024-03-09T14:28:43.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.485+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~8541TUECC3EO.2 size=547597 2024-03-09T14:28:43.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.485+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=8541TUECC3EO tag=H5O6ADUTTJ8C type=write size=3693325 2024-03-09T14:28:43.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.486+0000 7f1c6444c780 -1 < failed to complete operation key=YECG84AJ5IK2 tag=7SSKCL47ODA1 type=del size=3526662: (22) Invalid argument 2024-03-09T14:28:43.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.487+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=6Z0V07X8TSL0 type=del size=4137524 2024-03-09T14:28:43.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.488+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~AKXLDT8XBI51.0 size=140699 2024-03-09T14:28:43.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.489+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=AKXLDT8XBI51 tag=0I4FGOSHE3IF type=write size=1189275 2024-03-09T14:28:43.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.490+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=KENQYWV0EM3O type=del size=199477 2024-03-09T14:28:43.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.492+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=6O41YYB40Y0W type=del 2024-03-09T14:28:43.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.493+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=143GLU45Z6K1 type=del size=3006244 2024-03-09T14:28:43.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.494+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~7ZRSPACQT12D.0 size=1048576 2024-03-09T14:28:43.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.495+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~7ZRSPACQT12D.1 size=490670 2024-03-09T14:28:43.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.497+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=7ZRSPACQT12D tag=401UFDHDD5L8 type=write size=2587822 2024-03-09T14:28:43.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.499+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~MJ4M6PG5F660.0 size=1048576 2024-03-09T14:28:43.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.500+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~MJ4M6PG5F660.1 size=457285 2024-03-09T14:28:43.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.500+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=MJ4M6PG5F660 tag=VX4J209YHYJ6 type=write size=2554437 2024-03-09T14:28:43.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.501+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=XMGNR913988Z type=del 2024-03-09T14:28:43.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.502+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=XTIGE3658O3O type=del size=2133294 2024-03-09T14:28:43.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.503+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=X9K0XGC0WPHZ type=del 2024-03-09T14:28:43.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.505+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~RD6GUK4PKGIL.0 size=1048576 2024-03-09T14:28:43.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.506+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~RD6GUK4PKGIL.1 size=1048576 2024-03-09T14:28:43.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.508+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~RD6GUK4PKGIL.2 size=417870 2024-03-09T14:28:43.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.508+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=RD6GUK4PKGIL tag=LUUNOKQUEVUJ type=write size=3563598 2024-03-09T14:28:43.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.509+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=S1F0A68N58KG type=del 2024-03-09T14:28:43.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.511+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~YZ8KJT3GLU3W.0 size=1048576 2024-03-09T14:28:43.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.511+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~YZ8KJT3GLU3W.1 size=1048576 2024-03-09T14:28:43.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.512+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~YZ8KJT3GLU3W.2 size=586611 2024-03-09T14:28:43.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.512+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=YZ8KJT3GLU3W tag=7WW5VSNJXME5 type=write size=3732339 2024-03-09T14:28:43.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.513+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=IJK1FCT1XL3G type=del 2024-03-09T14:28:43.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.515+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~G2WY1U25I719.0 size=1048576 2024-03-09T14:28:43.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.516+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~G2WY1U25I719.1 size=1048576 2024-03-09T14:28:43.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.517+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~G2WY1U25I719.2 size=209045 2024-03-09T14:28:43.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.517+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=G2WY1U25I719 tag=0S321N7BAOV7 type=write size=3354773 2024-03-09T14:28:43.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.518+0000 7f1c6444c780 1 < completed write operation key=MX3X6ILR7J8N tag=MZ3K04QKKKAA type=write size=679502 2024-03-09T14:28:43.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.519+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=8C01QIBMDUB7 type=del size=647927 2024-03-09T14:28:43.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.521+0000 7f1c6444c780 1 < suggested remove operation key=MOVS6ZMK708G tag=WKIKZWNR0MOX type=del 2024-03-09T14:28:43.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.523+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~5FIWCUV7LH6Z.0 size=1048576 2024-03-09T14:28:43.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.524+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~5FIWCUV7LH6Z.1 size=997972 2024-03-09T14:28:43.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.524+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=5FIWCUV7LH6Z tag=W75WURYNKFNZ type=write size=3095124 2024-03-09T14:28:43.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.525+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~ISHDMIS526LU.0 size=1048576 2024-03-09T14:28:43.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.526+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~ISHDMIS526LU.1 size=51137 2024-03-09T14:28:43.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.528+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=ISHDMIS526LU tag=9W6ZLP0WIJIW type=write size=2148289 2024-03-09T14:28:43.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.529+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=F92872K5RP63 type=del size=4095941 2024-03-09T14:28:43.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.530+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=MUSL651LXASA type=del 2024-03-09T14:28:43.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.531+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=S2NEMVC1FB46 type=write size=230666 2024-03-09T14:28:43.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.532+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~5XX097LT6VKL.0 size=1048576 2024-03-09T14:28:43.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.533+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~5XX097LT6VKL.1 size=270821 2024-03-09T14:28:43.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.534+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=5XX097LT6VKL tag=54PCR05VTDS1 type=write size=2367973 2024-03-09T14:28:43.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.536+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=BTRQIOO6CJG8 type=del size=3807644 2024-03-09T14:28:43.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.537+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=FN3JJ07KEWJP type=del 2024-03-09T14:28:43.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.539+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~MSTPMB5B4I11.0 size=1048576 2024-03-09T14:28:43.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.540+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~MSTPMB5B4I11.1 size=575925 2024-03-09T14:28:43.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.540+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=MSTPMB5B4I11 tag=XP6EV755ILTE type=write size=2673077 2024-03-09T14:28:43.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.541+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=G6VQCV3XRTIN type=del 2024-03-09T14:28:43.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.544+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~R1EDNCCFVCJ9.0 size=1048576 2024-03-09T14:28:43.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.545+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~R1EDNCCFVCJ9.1 size=1048576 2024-03-09T14:28:43.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.546+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~R1EDNCCFVCJ9.2 size=977945 2024-03-09T14:28:43.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.546+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=R1EDNCCFVCJ9 tag=DZJ28ONX3KAI type=write size=4123673 2024-03-09T14:28:43.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.547+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~8541TUECC3EO.0 size=1048576 2024-03-09T14:28:43.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.548+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~8541TUECC3EO.1 size=1048576 2024-03-09T14:28:43.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.549+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~8541TUECC3EO.2 size=547597 2024-03-09T14:28:43.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.551+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=8541TUECC3EO tag=H5O6ADUTTJ8C type=write size=3693325 2024-03-09T14:28:43.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.552+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=IDYERYFZWY48 type=del size=3781368 2024-03-09T14:28:43.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.553+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=6Z0V07X8TSL0 type=del 2024-03-09T14:28:43.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.555+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~W0CAH3VBC83N.0 size=304069 2024-03-09T14:28:43.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.555+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=W0CAH3VBC83N tag=PIMTX5JBVMJ9 type=write size=1352645 2024-03-09T14:28:43.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.556+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=KENQYWV0EM3O type=del 2024-03-09T14:28:43.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.558+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=70C6LGH9X8PS type=del size=1813783 2024-03-09T14:28:43.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.559+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=143GLU45Z6K1 type=del 2024-03-09T14:28:43.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.561+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~WDI3CEBQVX5U.0 size=638854 2024-03-09T14:28:43.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.561+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=WDI3CEBQVX5U tag=QIO4CXCFB6E5 type=write size=1687430 2024-03-09T14:28:43.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.562+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~MJ4M6PG5F660.0 size=1048576 2024-03-09T14:28:43.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.563+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~MJ4M6PG5F660.1 size=457285 2024-03-09T14:28:43.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.565+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=MJ4M6PG5F660 tag=VX4J209YHYJ6 type=write size=2554437 2024-03-09T14:28:43.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.566+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=PASTLBZS6GUE type=del size=2204634 2024-03-09T14:28:43.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.567+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=XTIGE3658O3O type=del 2024-03-09T14:28:43.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.569+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~VW9JE1KL8YD7.0 size=187490 2024-03-09T14:28:43.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.569+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=VW9JE1KL8YD7 tag=PWZ8PVWDK2Y8 type=write size=1236066 2024-03-09T14:28:43.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.570+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~RD6GUK4PKGIL.0 size=1048576 2024-03-09T14:28:43.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.571+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~RD6GUK4PKGIL.1 size=1048576 2024-03-09T14:28:43.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.572+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~RD6GUK4PKGIL.2 size=417870 2024-03-09T14:28:43.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.574+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=RD6GUK4PKGIL tag=LUUNOKQUEVUJ type=write size=3563598 2024-03-09T14:28:43.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.576+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~91CFKIWU03T2.0 size=1048576 2024-03-09T14:28:43.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.577+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~91CFKIWU03T2.1 size=1048576 2024-03-09T14:28:43.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.577+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~91CFKIWU03T2.2 size=552748 2024-03-09T14:28:43.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.577+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=91CFKIWU03T2 tag=TSC0JJDXGK8P type=write size=3698476 2024-03-09T14:28:43.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.579+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~YZ8KJT3GLU3W.0 size=1048576 2024-03-09T14:28:43.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.579+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~YZ8KJT3GLU3W.1 size=1048576 2024-03-09T14:28:43.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.580+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~YZ8KJT3GLU3W.2 size=586611 2024-03-09T14:28:43.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.582+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=YZ8KJT3GLU3W tag=7WW5VSNJXME5 type=write size=3732339 2024-03-09T14:28:43.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.583+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=NIY5AYAUXTTF type=del size=3825930 2024-03-09T14:28:43.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.584+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~G2WY1U25I719.0 size=1048576 2024-03-09T14:28:43.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.585+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~G2WY1U25I719.1 size=1048576 2024-03-09T14:28:43.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.586+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~G2WY1U25I719.2 size=209045 2024-03-09T14:28:43.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.588+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=G2WY1U25I719 tag=0S321N7BAOV7 type=write size=3354773 2024-03-09T14:28:43.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.590+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~4QS0LCH7U85O.0 size=336705 2024-03-09T14:28:43.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.590+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=4QS0LCH7U85O tag=5SFYLXJYUAK6 type=write size=1385281 2024-03-09T14:28:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.592+0000 7f1c6444c780 1 < suggested update operation key=MX3X6ILR7J8N tag=8C01QIBMDUB7 type=del size=647927 2024-03-09T14:28:43.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.594+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~C0QQR6SUJ3JW.0 size=1048576 2024-03-09T14:28:43.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.595+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~C0QQR6SUJ3JW.1 size=1048576 2024-03-09T14:28:43.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.596+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~C0QQR6SUJ3JW.2 size=408248 2024-03-09T14:28:43.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.596+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=C0QQR6SUJ3JW tag=01B5HYA6OWQF type=write size=3553976 2024-03-09T14:28:43.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.597+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~5FIWCUV7LH6Z.0 size=1048576 2024-03-09T14:28:43.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.598+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~5FIWCUV7LH6Z.1 size=997972 2024-03-09T14:28:43.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.600+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=5FIWCUV7LH6Z tag=W75WURYNKFNZ type=write size=3095124 2024-03-09T14:28:43.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.601+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=KN64F7YK4PFT type=del size=3765970 2024-03-09T14:28:43.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.603+0000 7f1c6444c780 1 < suggested update operation key=YK7ENO4UAB2M tag=F92872K5RP63 type=del size=4095941 2024-03-09T14:28:43.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.605+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~MCXDTCTFIQU6.0 size=1048576 2024-03-09T14:28:43.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.606+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~MCXDTCTFIQU6.1 size=939922 2024-03-09T14:28:43.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.606+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=MCXDTCTFIQU6 tag=Q835JECIO551 type=write size=3037074 2024-03-09T14:28:43.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.607+0000 7f1c6444c780 1 < canceled operation key=Z34QOCZB3DFX tag=S2NEMVC1FB46 type=write size=230666 2024-03-09T14:28:43.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.609+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=2SJ0YLTV246D type=del size=416804 2024-03-09T14:28:43.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.610+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=BTRQIOO6CJG8 type=del 2024-03-09T14:28:43.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.612+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~ZTDC909HEORP.0 size=1048576 2024-03-09T14:28:43.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.613+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~ZTDC909HEORP.1 size=749871 2024-03-09T14:28:43.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.613+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=ZTDC909HEORP tag=OMZPSX89O3OL type=write size=2847023 2024-03-09T14:28:43.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.613+0000 7f1c6444c780 1 < canceled part key=_multipart_VL5EUQ52WRAN.2~MSTPMB5B4I11.0 size=1048576 2024-03-09T14:28:43.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.614+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~MSTPMB5B4I11.1 size=575925 2024-03-09T14:28:43.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.616+0000 7f1c6444c780 1 < canceled multipart upload key=VL5EUQ52WRAN upload=MSTPMB5B4I11 tag=XP6EV755ILTE type=write size=2673077 2024-03-09T14:28:43.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.617+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=PCKGGCZOJIWG type=write size=460316 2024-03-09T14:28:43.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.618+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~R1EDNCCFVCJ9.0 size=1048576 2024-03-09T14:28:43.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.619+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~R1EDNCCFVCJ9.1 size=1048576 2024-03-09T14:28:43.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.620+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~R1EDNCCFVCJ9.2 size=977945 2024-03-09T14:28:43.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.622+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=R1EDNCCFVCJ9 tag=DZJ28ONX3KAI type=write size=4123673 2024-03-09T14:28:43.623 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.623+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=EMVS3TRQAGSC type=write size=734391 2024-03-09T14:28:43.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.624+0000 7f1c6444c780 1 < canceled operation key=CVD0EGQUVJYR tag=IDYERYFZWY48 type=del size=3781368 2024-03-09T14:28:43.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.625+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=SNKNW0LSY5T2 type=write size=112091 2024-03-09T14:28:43.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.626+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~W0CAH3VBC83N.0 size=304069 2024-03-09T14:28:43.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.628+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=W0CAH3VBC83N tag=PIMTX5JBVMJ9 type=write size=1352645 2024-03-09T14:28:43.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.629+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=CVABWG3COU39 type=del size=445963 2024-03-09T14:28:43.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.631+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=70C6LGH9X8PS type=del 2024-03-09T14:28:43.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.632+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=9WJJ6CLAU12R type=del size=2327137 2024-03-09T14:28:43.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.633+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~WDI3CEBQVX5U.0 size=638854 2024-03-09T14:28:43.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.635+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=WDI3CEBQVX5U tag=QIO4CXCFB6E5 type=write size=1687430 2024-03-09T14:28:43.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.636+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=4JC0SCBV35E1 type=del size=4072065 2024-03-09T14:28:43.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.637+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=PASTLBZS6GUE type=del 2024-03-09T14:28:43.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.638+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=ARABLF6O4WP8 type=write size=917247 2024-03-09T14:28:43.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.640+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~VW9JE1KL8YD7.0 size=187490 2024-03-09T14:28:43.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.641+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=VW9JE1KL8YD7 tag=PWZ8PVWDK2Y8 type=write size=1236066 2024-03-09T14:28:43.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.643+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=F8WE216VE8UR type=del size=657208 2024-03-09T14:28:43.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.644+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~91CFKIWU03T2.0 size=1048576 2024-03-09T14:28:43.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.645+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~91CFKIWU03T2.1 size=1048576 2024-03-09T14:28:43.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.646+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~91CFKIWU03T2.2 size=552748 2024-03-09T14:28:43.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.648+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=91CFKIWU03T2 tag=TSC0JJDXGK8P type=write size=3698476 2024-03-09T14:28:43.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.650+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~RCZGF119HBZI.0 size=1048576 2024-03-09T14:28:43.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.651+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~RCZGF119HBZI.1 size=1048576 2024-03-09T14:28:43.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.651+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~RCZGF119HBZI.2 size=732675 2024-03-09T14:28:43.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.651+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=RCZGF119HBZI tag=Y9WDHQEOMWBS type=write size=3878403 2024-03-09T14:28:43.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.653+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=NIY5AYAUXTTF type=del 2024-03-09T14:28:43.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.654+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=9MHNYULU20D2 type=del size=1388969 2024-03-09T14:28:43.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.655+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~4QS0LCH7U85O.0 size=336705 2024-03-09T14:28:43.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.657+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=4QS0LCH7U85O tag=5SFYLXJYUAK6 type=write size=1385281 2024-03-09T14:28:43.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.659+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~435ARR7MV7RI.0 size=1048576 2024-03-09T14:28:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.660+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~435ARR7MV7RI.1 size=1048576 2024-03-09T14:28:43.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.661+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~435ARR7MV7RI.2 size=570562 2024-03-09T14:28:43.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.661+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=435ARR7MV7RI tag=PPT3TPSUZPOZ type=write size=3716290 2024-03-09T14:28:43.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.662+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~C0QQR6SUJ3JW.0 size=1048576 2024-03-09T14:28:43.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.662+0000 7f1c6444c780 1 < canceled part key=_multipart_35Y98D5U0M8O.2~C0QQR6SUJ3JW.1 size=1048576 2024-03-09T14:28:43.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.663+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~C0QQR6SUJ3JW.2 size=408248 2024-03-09T14:28:43.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.664+0000 7f1c6444c780 1 < canceled multipart upload key=35Y98D5U0M8O upload=C0QQR6SUJ3JW tag=01B5HYA6OWQF type=write size=3553976 2024-03-09T14:28:43.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.666+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=3VF6M1VZ33TH type=del size=1594573 2024-03-09T14:28:43.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.668+0000 7f1c6444c780 1 < suggested update operation key=KMX7TNIOKWOA tag=KN64F7YK4PFT type=del size=3765970 2024-03-09T14:28:43.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.670+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~I2DYD17Z67KA.0 size=1048576 2024-03-09T14:28:43.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.671+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~I2DYD17Z67KA.1 size=805576 2024-03-09T14:28:43.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.671+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=I2DYD17Z67KA tag=F577ZGHV2FGQ type=write size=2902728 2024-03-09T14:28:43.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.672+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~MCXDTCTFIQU6.0 size=1048576 2024-03-09T14:28:43.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.673+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~MCXDTCTFIQU6.1 size=939922 2024-03-09T14:28:43.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.675+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=MCXDTCTFIQU6 tag=Q835JECIO551 type=write size=3037074 2024-03-09T14:28:43.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.676+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=K8NAOPQV8HMD type=del size=2762048 2024-03-09T14:28:43.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.678+0000 7f1c6444c780 1 < suggested update operation key=JX05U3G6NLLO tag=2SJ0YLTV246D type=del size=416804 2024-03-09T14:28:43.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.679+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=P2ULH876ZVG0 type=del size=1582361 2024-03-09T14:28:43.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.680+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~ZTDC909HEORP.0 size=1048576 2024-03-09T14:28:43.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.681+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~ZTDC909HEORP.1 size=749871 2024-03-09T14:28:43.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.683+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=ZTDC909HEORP tag=OMZPSX89O3OL type=write size=2847023 2024-03-09T14:28:43.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.684+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=RSIOY043WMKH type=del size=1930332 2024-03-09T14:28:43.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.686+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=PCKGGCZOJIWG type=write size=460316 2024-03-09T14:28:43.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.687+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=OPA5P7Y2J1B4 type=del size=2522943 2024-03-09T14:28:43.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.688+0000 7f1c6444c780 1 < completed write operation key=IBVEN2JEB49N tag=EMVS3TRQAGSC type=write size=734391 2024-03-09T14:28:43.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.689+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=2AZM72U0MAWY type=write size=1047421 2024-03-09T14:28:43.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.690+0000 7f1c6444c780 1 < completed write operation key=EREG1M13901A tag=SNKNW0LSY5T2 type=write size=112091 2024-03-09T14:28:43.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.691+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=05EEBYV72UGT type=del size=1533782 2024-03-09T14:28:43.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.692+0000 7f1c6444c780 1 < canceled operation key=MOVS6ZMK708G tag=CVABWG3COU39 type=del size=445963 2024-03-09T14:28:43.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.694+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=81VAYLRRP0EE type=del size=4035923 2024-03-09T14:28:43.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.695+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=9WJJ6CLAU12R type=del 2024-03-09T14:28:43.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.696+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=7KT9AST5PPY6 type=del size=98645 2024-03-09T14:28:43.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.697+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=4JC0SCBV35E1 type=del 2024-03-09T14:28:43.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.699+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~XVTROUQNHFCR.0 size=1048576 2024-03-09T14:28:43.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.700+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~XVTROUQNHFCR.1 size=14986 2024-03-09T14:28:43.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.700+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=XVTROUQNHFCR tag=RCE5XGCDMLNJ type=write size=2112138 2024-03-09T14:28:43.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.701+0000 7f1c6444c780 1 < canceled operation key=71FSR1CHFBO0 tag=ARABLF6O4WP8 type=write size=917247 2024-03-09T14:28:43.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.703+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~IPQAH4BK25T5.0 size=1048576 2024-03-09T14:28:43.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.704+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~IPQAH4BK25T5.1 size=534829 2024-03-09T14:28:43.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.704+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=IPQAH4BK25T5 tag=0C68RMIT8NVN type=write size=2631981 2024-03-09T14:28:43.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.705+0000 7f1c6444c780 1 < canceled operation key=SGHNHOCYPM38 tag=F8WE216VE8UR type=del size=657208 2024-03-09T14:28:43.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.707+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~70J43RTBZ11D.0 size=882118 2024-03-09T14:28:43.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.707+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=70J43RTBZ11D tag=0UDZIFLZ7732 type=write size=1930694 2024-03-09T14:28:43.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.708+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~RCZGF119HBZI.0 size=1048576 2024-03-09T14:28:43.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.709+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~RCZGF119HBZI.1 size=1048576 2024-03-09T14:28:43.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.710+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~RCZGF119HBZI.2 size=732675 2024-03-09T14:28:43.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.712+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=RCZGF119HBZI tag=Y9WDHQEOMWBS type=write size=3878403 2024-03-09T14:28:43.715 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.715+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=EIPCBMM3HYT1 type=del size=3324304 2024-03-09T14:28:43.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.716+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=9MHNYULU20D2 type=del 2024-03-09T14:28:43.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.717+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=ZILN0F2JI00T type=del size=1645062 2024-03-09T14:28:43.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.717+0000 7f1c6444c780 1 < canceled part key=_multipart_YK7ENO4UAB2M.2~435ARR7MV7RI.0 size=1048576 2024-03-09T14:28:43.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.718+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~435ARR7MV7RI.1 size=1048576 2024-03-09T14:28:43.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.719+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~435ARR7MV7RI.2 size=570562 2024-03-09T14:28:43.721 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.721+0000 7f1c6444c780 1 < canceled multipart upload key=YK7ENO4UAB2M upload=435ARR7MV7RI tag=PPT3TPSUZPOZ type=write size=3716290 2024-03-09T14:28:43.723 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.723+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=6HNDVOK05US3 type=del size=4123237 2024-03-09T14:28:43.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.724+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=3VF6M1VZ33TH type=del 2024-03-09T14:28:43.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.725+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=ICO06W45D8IR type=del size=754459 2024-03-09T14:28:43.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.726+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~I2DYD17Z67KA.0 size=1048576 2024-03-09T14:28:43.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.727+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~I2DYD17Z67KA.1 size=805576 2024-03-09T14:28:43.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.729+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=I2DYD17Z67KA tag=F577ZGHV2FGQ type=write size=2902728 2024-03-09T14:28:43.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.730+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=IX2TMY4N9RVW type=del size=847832 2024-03-09T14:28:43.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.731+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=K8NAOPQV8HMD type=del 2024-03-09T14:28:43.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.733+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~LELYLU2EF7A2.0 size=1048576 2024-03-09T14:28:43.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.734+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~LELYLU2EF7A2.1 size=824750 2024-03-09T14:28:43.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.734+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=LELYLU2EF7A2 tag=WU6B0D6IQQOA type=write size=2921902 2024-03-09T14:28:43.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.735+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=P2ULH876ZVG0 type=del 2024-03-09T14:28:43.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.737+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~5F6YOJQYU1MY.0 size=210172 2024-03-09T14:28:43.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.737+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=5F6YOJQYU1MY tag=WWBL9L7SDHIK type=write size=1258748 2024-03-09T14:28:43.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.739+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=RSIOY043WMKH type=del size=1930332 2024-03-09T14:28:43.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.740+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=VLGLR3ANOTMN type=del size=1197606 2024-03-09T14:28:43.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.742+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=OPA5P7Y2J1B4 type=del 2024-03-09T14:28:43.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.744+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~9FJ9497Q4EBP.0 size=85711 2024-03-09T14:28:43.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.744+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=9FJ9497Q4EBP tag=80ELOTTU4F13 type=write size=1134287 2024-03-09T14:28:43.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.745+0000 7f1c6444c780 1 < completed write operation key=YECG84AJ5IK2 tag=2AZM72U0MAWY type=write size=1047421 2024-03-09T14:28:43.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.746+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=SYJIB23HKOR3 type=del size=2781010 2024-03-09T14:28:43.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.747+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=05EEBYV72UGT type=del size=1533782 2024-03-09T14:28:43.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.749+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~E3OBW1M20NGC.0 size=1048576 2024-03-09T14:28:43.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.750+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~E3OBW1M20NGC.1 size=1048576 2024-03-09T14:28:43.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.751+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~E3OBW1M20NGC.2 size=786884 2024-03-09T14:28:43.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.751+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=E3OBW1M20NGC tag=7ROTF4C73215 type=write size=3932612 2024-03-09T14:28:43.752 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.752+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=81VAYLRRP0EE type=del 2024-03-09T14:28:43.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.754+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~LZFR8ALZI013.0 size=828735 2024-03-09T14:28:43.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.754+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=LZFR8ALZI013 tag=JKGRSZN2CAQW type=write size=1877311 2024-03-09T14:28:43.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.755+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=7KT9AST5PPY6 type=del 2024-03-09T14:28:43.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.756+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=WXZDGZBNQBFB type=del size=1023188 2024-03-09T14:28:43.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.757+0000 7f1c6444c780 1 < canceled part key=_multipart_KNOEGKSERB6Z.2~XVTROUQNHFCR.0 size=1048576 2024-03-09T14:28:43.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.758+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~XVTROUQNHFCR.1 size=14986 2024-03-09T14:28:43.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.759+0000 7f1c6444c780 1 < canceled multipart upload key=KNOEGKSERB6Z upload=XVTROUQNHFCR tag=RCE5XGCDMLNJ type=write size=2112138 2024-03-09T14:28:43.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.761+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=CYF7CZIC1L9C type=del size=1889359 2024-03-09T14:28:43.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.761+0000 7f1c6444c780 1 < canceled part key=_multipart_0IHHFQBKKJ0G.2~IPQAH4BK25T5.0 size=1048576 2024-03-09T14:28:43.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.762+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~IPQAH4BK25T5.1 size=534829 2024-03-09T14:28:43.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.764+0000 7f1c6444c780 1 < canceled multipart upload key=0IHHFQBKKJ0G upload=IPQAH4BK25T5 tag=0C68RMIT8NVN type=write size=2631981 2024-03-09T14:28:43.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.766+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~TL170S1IU32R.0 size=1048576 2024-03-09T14:28:43.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.767+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~TL170S1IU32R.1 size=522992 2024-03-09T14:28:43.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.767+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=TL170S1IU32R tag=LSOADPKJOTHY type=write size=2620144 2024-03-09T14:28:43.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.768+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~70J43RTBZ11D.0 size=882118 2024-03-09T14:28:43.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.770+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=70J43RTBZ11D tag=0UDZIFLZ7732 type=write size=1930694 2024-03-09T14:28:43.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.771+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=2Y1LI0L1SCEW type=del size=503739 2024-03-09T14:28:43.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.772+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=EIPCBMM3HYT1 type=del 2024-03-09T14:28:43.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.773+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=MZ1WYR1Z82ZE type=write size=482228 2024-03-09T14:28:43.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.775+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=ZILN0F2JI00T type=del 2024-03-09T14:28:43.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.776+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=9PY71IPD1V77 type=write size=250143 2024-03-09T14:28:43.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.777+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=6HNDVOK05US3 type=del 2024-03-09T14:28:43.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.779+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~610Z6DT2FJ7J.0 size=1048576 2024-03-09T14:28:43.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.780+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~610Z6DT2FJ7J.1 size=1048576 2024-03-09T14:28:43.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.781+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~610Z6DT2FJ7J.2 size=927535 2024-03-09T14:28:43.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.781+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=610Z6DT2FJ7J tag=83DAZMYXX5YX type=write size=4073263 2024-03-09T14:28:43.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.782+0000 7f1c6444c780 1 < canceled operation key=BAWV7KY6NT8P tag=ICO06W45D8IR type=del size=754459 2024-03-09T14:28:43.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.783+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=IMZXHNLXF0R3 type=del size=3483988 2024-03-09T14:28:43.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.785+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=IX2TMY4N9RVW type=del 2024-03-09T14:28:43.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.786+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=AGHRP1A200G1 type=write size=571758 2024-03-09T14:28:43.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.787+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~LELYLU2EF7A2.0 size=1048576 2024-03-09T14:28:43.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.788+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~LELYLU2EF7A2.1 size=824750 2024-03-09T14:28:43.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.790+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=LELYLU2EF7A2 tag=WU6B0D6IQQOA type=write size=2921902 2024-03-09T14:28:43.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.791+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=W4OBKIZ0H4GQ type=del size=588850 2024-03-09T14:28:43.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.792+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~5F6YOJQYU1MY.0 size=210172 2024-03-09T14:28:43.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.794+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=5F6YOJQYU1MY tag=WWBL9L7SDHIK type=write size=1258748 2024-03-09T14:28:43.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.795+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=W0OU628162LX type=del size=1876881 2024-03-09T14:28:43.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.797+0000 7f1c6444c780 1 < suggested update operation key=3CC018VYSRHN tag=VLGLR3ANOTMN type=del size=1197606 2024-03-09T14:28:43.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.798+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=CC2121UGR6CY type=del size=555636 2024-03-09T14:28:43.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.800+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~9FJ9497Q4EBP.0 size=85711 2024-03-09T14:28:43.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.802+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=9FJ9497Q4EBP tag=80ELOTTU4F13 type=write size=1134287 2024-03-09T14:28:43.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.803+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=HKRHA7KK2DDW type=write size=668358 2024-03-09T14:28:43.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.804+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=SYJIB23HKOR3 type=del 2024-03-09T14:28:43.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.805+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=F20DN7JLT0S8 type=del size=3957535 2024-03-09T14:28:43.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.806+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~E3OBW1M20NGC.0 size=1048576 2024-03-09T14:28:43.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.807+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~E3OBW1M20NGC.1 size=1048576 2024-03-09T14:28:43.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.808+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~E3OBW1M20NGC.2 size=786884 2024-03-09T14:28:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.810+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=E3OBW1M20NGC tag=7ROTF4C73215 type=write size=3932612 2024-03-09T14:28:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.811+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=0X5R3R1RPSV1 type=del size=2345653 2024-03-09T14:28:43.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.812+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~LZFR8ALZI013.0 size=828735 2024-03-09T14:28:43.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.814+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=LZFR8ALZI013 tag=JKGRSZN2CAQW type=write size=1877311 2024-03-09T14:28:43.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.815+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=3YXOHJ51HD4C type=del size=3497938 2024-03-09T14:28:43.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.817+0000 7f1c6444c780 1 < suggested remove operation key=MX3X6ILR7J8N tag=WXZDGZBNQBFB type=del 2024-03-09T14:28:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.819+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=XOR8QW4WSXSG type=del size=3630290 2024-03-09T14:28:43.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.820+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=CYF7CZIC1L9C type=del 2024-03-09T14:28:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.821+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=ZASL7BPHC21U type=del size=2938385 2024-03-09T14:28:43.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.822+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~TL170S1IU32R.0 size=1048576 2024-03-09T14:28:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.824+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~TL170S1IU32R.1 size=522992 2024-03-09T14:28:43.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.826+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=TL170S1IU32R tag=LSOADPKJOTHY type=write size=2620144 2024-03-09T14:28:43.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.828+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~2S8UC1QE2IS0.0 size=1048576 2024-03-09T14:28:43.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.828+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~2S8UC1QE2IS0.1 size=1048576 2024-03-09T14:28:43.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.829+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~2S8UC1QE2IS0.2 size=132793 2024-03-09T14:28:43.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.829+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=2S8UC1QE2IS0 tag=178B1EGXOBWJ type=write size=3278521 2024-03-09T14:28:43.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.831+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=2Y1LI0L1SCEW type=del 2024-03-09T14:28:43.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.832+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=VFBSVA11JQX4 type=del size=752871 2024-03-09T14:28:43.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.833+0000 7f1c6444c780 1 < completed write operation key=MOVS6ZMK708G tag=MZ1WYR1Z82ZE type=write size=482228 2024-03-09T14:28:43.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.835+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~8OVT3YDKFNU5.0 size=679085 2024-03-09T14:28:43.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.835+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=8OVT3YDKFNU5 tag=30F7C2E7JX0D type=write size=1727661 2024-03-09T14:28:43.836 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.836+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=9PY71IPD1V77 type=write size=250143 2024-03-09T14:28:43.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.837+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=LZG0RD1XOOLH type=del size=333318 2024-03-09T14:28:43.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.838+0000 7f1c6444c780 1 < canceled part key=_multipart_KMX7TNIOKWOA.2~610Z6DT2FJ7J.0 size=1048576 2024-03-09T14:28:43.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.839+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~610Z6DT2FJ7J.1 size=1048576 2024-03-09T14:28:43.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.840+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~610Z6DT2FJ7J.2 size=927535 2024-03-09T14:28:43.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.841+0000 7f1c6444c780 1 < canceled multipart upload key=KMX7TNIOKWOA upload=610Z6DT2FJ7J tag=83DAZMYXX5YX type=write size=4073263 2024-03-09T14:28:43.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.843+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=0ASD0UABS2VP type=del size=2884749 2024-03-09T14:28:43.844 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.844+0000 7f1c6444c780 -1 < failed to complete operation key=3CC018VYSRHN tag=IMZXHNLXF0R3 type=del size=3483988: (22) Invalid argument 2024-03-09T14:28:43.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.845+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=5140XSCTB1PS type=del size=2791599 2024-03-09T14:28:43.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.846+0000 7f1c6444c780 1 < completed write operation key=IBVEN2JEB49N tag=AGHRP1A200G1 type=write size=571758 2024-03-09T14:28:43.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.848+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~EWMDX2CXJKIW.0 size=1048576 2024-03-09T14:28:43.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.849+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~EWMDX2CXJKIW.1 size=1048576 2024-03-09T14:28:43.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.850+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~EWMDX2CXJKIW.2 size=528290 2024-03-09T14:28:43.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.850+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=EWMDX2CXJKIW tag=TR4XRE89HXEY type=write size=3674018 2024-03-09T14:28:43.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.851+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=W4OBKIZ0H4GQ type=del 2024-03-09T14:28:43.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.853+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~7NIX1UBMZE3X.0 size=1011479 2024-03-09T14:28:43.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.853+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=7NIX1UBMZE3X tag=8RYGWGCZRBD9 type=write size=2060055 2024-03-09T14:28:43.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.854+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=W0OU628162LX type=del 2024-03-09T14:28:43.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.856+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=KWLGB22UF8V0 type=del size=2712835 2024-03-09T14:28:43.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.857+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=CC2121UGR6CY type=del 2024-03-09T14:28:43.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.859+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~CFP70F21V5TS.0 size=102147 2024-03-09T14:28:43.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.859+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=CFP70F21V5TS tag=ACMZGKL78EG1 type=write size=1150723 2024-03-09T14:28:43.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.860+0000 7f1c6444c780 1 < canceled operation key=YK7ENO4UAB2M tag=HKRHA7KK2DDW type=write size=668358 2024-03-09T14:28:43.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.861+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=WBJ5U6RU4H8R type=write size=595281 2024-03-09T14:28:43.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.862+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=F20DN7JLT0S8 type=del 2024-03-09T14:28:43.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.863+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=NXB21OCZUZQM type=del size=4173088 2024-03-09T14:28:43.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.864+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=0X5R3R1RPSV1 type=del 2024-03-09T14:28:43.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.866+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=LHME3DS1SJNU type=del size=3315506 2024-03-09T14:28:43.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.867+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=3YXOHJ51HD4C type=del 2024-03-09T14:28:43.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.868+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=2JL9NJN3PEXG type=del size=1703930 2024-03-09T14:28:43.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.869+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=XOR8QW4WSXSG type=del 2024-03-09T14:28:43.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.871+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~CGLBZHDECOE0.0 size=1048576 2024-03-09T14:28:43.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.872+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~CGLBZHDECOE0.1 size=993948 2024-03-09T14:28:43.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.872+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=CGLBZHDECOE0 tag=1GMDXXSGUYQ5 type=write size=3091100 2024-03-09T14:28:43.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.875+0000 7f1c6444c780 1 < suggested update operation key=CVD0EGQUVJYR tag=ZASL7BPHC21U type=del size=2938385 2024-03-09T14:28:43.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.876+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=MBGK8AV5L0S1 type=del size=155034 2024-03-09T14:28:43.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.876+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~2S8UC1QE2IS0.0 size=1048576 2024-03-09T14:28:43.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.877+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~2S8UC1QE2IS0.1 size=1048576 2024-03-09T14:28:43.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.878+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~2S8UC1QE2IS0.2 size=132793 2024-03-09T14:28:43.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.880+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=2S8UC1QE2IS0 tag=178B1EGXOBWJ type=write size=3278521 2024-03-09T14:28:43.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.881+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=M5NWN24PXAI1 type=del size=3747091 2024-03-09T14:28:43.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.882+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=VFBSVA11JQX4 type=del 2024-03-09T14:28:43.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.884+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~E3VH0SNP2XEV.0 size=452824 2024-03-09T14:28:43.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.884+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=E3VH0SNP2XEV tag=Q15ONTB2QU0S type=write size=1501400 2024-03-09T14:28:43.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.885+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~8OVT3YDKFNU5.0 size=679085 2024-03-09T14:28:43.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.887+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=8OVT3YDKFNU5 tag=30F7C2E7JX0D type=write size=1727661 2024-03-09T14:28:43.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.888+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=2BXLO9Y73X15 type=del size=4149535 2024-03-09T14:28:43.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.891+0000 7f1c6444c780 1 < suggested update operation key=Z34QOCZB3DFX tag=LZG0RD1XOOLH type=del size=333318 2024-03-09T14:28:43.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.892+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=BO6VM3Q7YWRY type=write size=875811 2024-03-09T14:28:43.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.893+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=0ASD0UABS2VP type=del 2024-03-09T14:28:43.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.895+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~WKBCL1DE7C70.0 size=879745 2024-03-09T14:28:43.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.895+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=WKBCL1DE7C70 tag=680AMXVANZET type=write size=1928321 2024-03-09T14:28:43.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.896+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=5140XSCTB1PS type=del 2024-03-09T14:28:43.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.898+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~97MH9ZJTPJAT.0 size=1048576 2024-03-09T14:28:43.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.899+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~97MH9ZJTPJAT.1 size=1048576 2024-03-09T14:28:43.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.900+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~97MH9ZJTPJAT.2 size=503322 2024-03-09T14:28:43.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.900+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=97MH9ZJTPJAT tag=Y7HBML3PXI5A type=write size=3649050 2024-03-09T14:28:43.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.901+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~EWMDX2CXJKIW.0 size=1048576 2024-03-09T14:28:43.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.902+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~EWMDX2CXJKIW.1 size=1048576 2024-03-09T14:28:43.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.902+0000 7f1c6444c780 1 < canceled part key=_multipart_Z34QOCZB3DFX.2~EWMDX2CXJKIW.2 size=528290 2024-03-09T14:28:43.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.904+0000 7f1c6444c780 1 < canceled multipart upload key=Z34QOCZB3DFX upload=EWMDX2CXJKIW tag=TR4XRE89HXEY type=write size=3674018 2024-03-09T14:28:43.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.906+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~0LINHGRZPA1J.0 size=1048576 2024-03-09T14:28:43.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.906+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~0LINHGRZPA1J.1 size=604369 2024-03-09T14:28:43.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.906+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=0LINHGRZPA1J tag=0H76X6X29E38 type=write size=2701521 2024-03-09T14:28:43.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.908+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~7NIX1UBMZE3X.0 size=1011479 2024-03-09T14:28:43.909 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.909+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=7NIX1UBMZE3X tag=8RYGWGCZRBD9 type=write size=2060055 2024-03-09T14:28:43.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.911+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=OAD492YGHQCD type=del size=830838 2024-03-09T14:28:43.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.912+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=KWLGB22UF8V0 type=del 2024-03-09T14:28:43.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.914+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~MB4NNEDUQBPW.0 size=1048576 2024-03-09T14:28:43.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.915+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~MB4NNEDUQBPW.1 size=1048576 2024-03-09T14:28:43.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.916+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~MB4NNEDUQBPW.2 size=717386 2024-03-09T14:28:43.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.916+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=MB4NNEDUQBPW tag=0LO7MPHRAB8A type=write size=3863114 2024-03-09T14:28:43.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.917+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~CFP70F21V5TS.0 size=102147 2024-03-09T14:28:43.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.919+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=CFP70F21V5TS tag=ACMZGKL78EG1 type=write size=1150723 2024-03-09T14:28:43.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.921+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~SFGMX9T2Z9I3.0 size=1048576 2024-03-09T14:28:43.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.922+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~SFGMX9T2Z9I3.1 size=1048576 2024-03-09T14:28:43.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.923+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~SFGMX9T2Z9I3.2 size=750949 2024-03-09T14:28:43.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.923+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=SFGMX9T2Z9I3 tag=Y7UCL7YO8KP7 type=write size=3896677 2024-03-09T14:28:43.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.924+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=WBJ5U6RU4H8R type=write size=595281 2024-03-09T14:28:43.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.925+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=DZ9I9ULTFR66 type=del size=2714671 2024-03-09T14:28:43.926 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.926+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=NXB21OCZUZQM type=del 2024-03-09T14:28:43.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.928+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~XYKZ2XF83IVB.0 size=1048576 2024-03-09T14:28:43.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.930+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~XYKZ2XF83IVB.1 size=1048576 2024-03-09T14:28:43.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.931+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~XYKZ2XF83IVB.2 size=803649 2024-03-09T14:28:43.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.931+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=XYKZ2XF83IVB tag=P2BWOHHHX20J type=write size=3949377 2024-03-09T14:28:43.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.932+0000 7f1c6444c780 1 < completed delete operation key=YK7ENO4UAB2M tag=LHME3DS1SJNU type=del 2024-03-09T14:28:43.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.933+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=6N4RYS2HTF3J type=del size=1068629 2024-03-09T14:28:43.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.934+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=2JL9NJN3PEXG type=del 2024-03-09T14:28:43.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.936+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=UZ9I9676BV70 type=write size=393593 2024-03-09T14:28:43.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.936+0000 7f1c6444c780 1 < canceled part key=_multipart_KWDIDE9AE3JP.2~CGLBZHDECOE0.0 size=1048576 2024-03-09T14:28:43.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.937+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~CGLBZHDECOE0.1 size=993948 2024-03-09T14:28:43.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.939+0000 7f1c6444c780 1 < canceled multipart upload key=KWDIDE9AE3JP upload=CGLBZHDECOE0 tag=1GMDXXSGUYQ5 type=write size=3091100 2024-03-09T14:28:43.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.941+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~AJK17WOY65XR.0 size=1048576 2024-03-09T14:28:43.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.942+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~AJK17WOY65XR.1 size=130264 2024-03-09T14:28:43.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.942+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=AJK17WOY65XR tag=3B8X50SY0MVE type=write size=2227416 2024-03-09T14:28:43.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.943+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=MBGK8AV5L0S1 type=del size=155034 2024-03-09T14:28:43.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.944+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=CH0SLCC15WUY type=write size=63019 2024-03-09T14:28:43.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.945+0000 7f1c6444c780 1 < canceled operation key=3CC018VYSRHN tag=M5NWN24PXAI1 type=del size=3747091 2024-03-09T14:28:43.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.948+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~BDLRHEECSVIF.0 size=601920 2024-03-09T14:28:43.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.948+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=BDLRHEECSVIF tag=J04YRCK2EMBJ type=write size=1650496 2024-03-09T14:28:43.949 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.949+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~E3VH0SNP2XEV.0 size=452824 2024-03-09T14:28:43.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.951+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=E3VH0SNP2XEV tag=Q15ONTB2QU0S type=write size=1501400 2024-03-09T14:28:43.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.952+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=VY2RKXDICQKZ type=write size=276704 2024-03-09T14:28:43.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.953+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=2BXLO9Y73X15 type=del 2024-03-09T14:28:43.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.954+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=PM7QXEJXUO10 type=del size=4071722 2024-03-09T14:28:43.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.955+0000 7f1c6444c780 1 < completed write operation key=71FSR1CHFBO0 tag=BO6VM3Q7YWRY type=write size=875811 2024-03-09T14:28:43.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.956+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=H0XMF1SM7FYS type=del size=2975433 2024-03-09T14:28:43.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.957+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~WKBCL1DE7C70.0 size=879745 2024-03-09T14:28:43.960 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.959+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=WKBCL1DE7C70 tag=680AMXVANZET type=write size=1928321 2024-03-09T14:28:43.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.961+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=EQ0GUY0BQO11 type=write size=227959 2024-03-09T14:28:43.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.962+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~97MH9ZJTPJAT.0 size=1048576 2024-03-09T14:28:43.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.963+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~97MH9ZJTPJAT.1 size=1048576 2024-03-09T14:28:43.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.963+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~97MH9ZJTPJAT.2 size=503322 2024-03-09T14:28:43.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.965+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=97MH9ZJTPJAT tag=Y7HBML3PXI5A type=write size=3649050 2024-03-09T14:28:43.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.966+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=IWKNVK8YF688 type=del size=2763037 2024-03-09T14:28:43.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.967+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~0LINHGRZPA1J.0 size=1048576 2024-03-09T14:28:43.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.968+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~0LINHGRZPA1J.1 size=604369 2024-03-09T14:28:43.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.970+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=0LINHGRZPA1J tag=0H76X6X29E38 type=write size=2701521 2024-03-09T14:28:43.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.971+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=ZQK1IJA7ZY5P type=write size=990799 2024-03-09T14:28:43.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.972+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=OAD492YGHQCD type=del 2024-03-09T14:28:43.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.974+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~YPTNME2P94IK.0 size=1048576 2024-03-09T14:28:43.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.975+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~YPTNME2P94IK.1 size=1048576 2024-03-09T14:28:43.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.976+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~YPTNME2P94IK.2 size=855752 2024-03-09T14:28:43.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.976+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=YPTNME2P94IK tag=TODFNUYEZQ6U type=write size=4001480 2024-03-09T14:28:43.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.976+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~MB4NNEDUQBPW.0 size=1048576 2024-03-09T14:28:43.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.977+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~MB4NNEDUQBPW.1 size=1048576 2024-03-09T14:28:43.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.978+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~MB4NNEDUQBPW.2 size=717386 2024-03-09T14:28:43.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.980+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=MB4NNEDUQBPW tag=0LO7MPHRAB8A type=write size=3863114 2024-03-09T14:28:43.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.982+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~41N24JQKJIAZ.0 size=599029 2024-03-09T14:28:43.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.982+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=41N24JQKJIAZ tag=22NEYY8MENIL type=write size=1647605 2024-03-09T14:28:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.983+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~SFGMX9T2Z9I3.0 size=1048576 2024-03-09T14:28:43.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.983+0000 7f1c6444c780 1 < canceled part key=_multipart_CVD0EGQUVJYR.2~SFGMX9T2Z9I3.1 size=1048576 2024-03-09T14:28:43.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.984+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~SFGMX9T2Z9I3.2 size=750949 2024-03-09T14:28:43.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.986+0000 7f1c6444c780 1 < canceled multipart upload key=CVD0EGQUVJYR upload=SFGMX9T2Z9I3 tag=Y7UCL7YO8KP7 type=write size=3896677 2024-03-09T14:28:43.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.989+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~XEDFP1ZLTGFR.0 size=1048576 2024-03-09T14:28:43.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.989+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~XEDFP1ZLTGFR.1 size=1048576 2024-03-09T14:28:43.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.990+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~XEDFP1ZLTGFR.2 size=700234 2024-03-09T14:28:43.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.990+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=XEDFP1ZLTGFR tag=R8V8JAK05R1S type=write size=3845962 2024-03-09T14:28:43.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.992+0000 7f1c6444c780 1 < canceled operation key=V05XJ56M53T8 tag=DZ9I9ULTFR66 type=del size=2714671 2024-03-09T14:28:43.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.993+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=FN90TPBAL9SV type=del size=75855 2024-03-09T14:28:43.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.994+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~XYKZ2XF83IVB.0 size=1048576 2024-03-09T14:28:43.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.994+0000 7f1c6444c780 1 < canceled part key=_multipart_V05XJ56M53T8.2~XYKZ2XF83IVB.1 size=1048576 2024-03-09T14:28:43.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.995+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~XYKZ2XF83IVB.2 size=803649 2024-03-09T14:28:43.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.997+0000 7f1c6444c780 1 < canceled multipart upload key=V05XJ56M53T8 upload=XYKZ2XF83IVB tag=P2BWOHHHX20J type=write size=3949377 2024-03-09T14:28:43.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:43.999+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~WPEDAS63Z0S0.0 size=1048576 2024-03-09T14:28:44.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.000+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~WPEDAS63Z0S0.1 size=1048576 2024-03-09T14:28:44.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.001+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~WPEDAS63Z0S0.2 size=738681 2024-03-09T14:28:44.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.001+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=WPEDAS63Z0S0 tag=TLZZZR00ADPT type=write size=3884409 2024-03-09T14:28:44.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.002+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=6N4RYS2HTF3J type=del 2024-03-09T14:28:44.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.004+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~F2FK638SOINU.0 size=1048576 2024-03-09T14:28:44.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.005+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~F2FK638SOINU.1 size=1048576 2024-03-09T14:28:44.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.006+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~F2FK638SOINU.2 size=233108 2024-03-09T14:28:44.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.006+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=F2FK638SOINU tag=WQUT5154X97C type=write size=3378836 2024-03-09T14:28:44.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.007+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=UZ9I9676BV70 type=write size=393593 2024-03-09T14:28:44.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.009+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=5NUY3BU3P7P0 type=del size=143660 2024-03-09T14:28:44.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.010+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~AJK17WOY65XR.0 size=1048576 2024-03-09T14:28:44.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.011+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~AJK17WOY65XR.1 size=130264 2024-03-09T14:28:44.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.013+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=AJK17WOY65XR tag=3B8X50SY0MVE type=write size=2227416 2024-03-09T14:28:44.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.015+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~M7CNCA3FXPIM.0 size=1048576 2024-03-09T14:28:44.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.016+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~M7CNCA3FXPIM.1 size=1048576 2024-03-09T14:28:44.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.017+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~M7CNCA3FXPIM.2 size=334368 2024-03-09T14:28:44.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.017+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=M7CNCA3FXPIM tag=EHA6KDPY50E2 type=write size=3480096 2024-03-09T14:28:44.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.018+0000 7f1c6444c780 1 < completed write operation key=NIN0FB6YTKWA tag=CH0SLCC15WUY type=write size=63019 2024-03-09T14:28:44.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.020+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~2QWWBKJPV91H.0 size=1048576 2024-03-09T14:28:44.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.021+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~2QWWBKJPV91H.1 size=181433 2024-03-09T14:28:44.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.021+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=2QWWBKJPV91H tag=SONHRHEKLXS8 type=write size=2278585 2024-03-09T14:28:44.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.022+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~BDLRHEECSVIF.0 size=601920 2024-03-09T14:28:44.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.024+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=BDLRHEECSVIF tag=J04YRCK2EMBJ type=write size=1650496 2024-03-09T14:28:44.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.026+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=2LSQ713N97AD type=del size=637616 2024-03-09T14:28:44.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.027+0000 7f1c6444c780 1 < canceled operation key=NIN0FB6YTKWA tag=VY2RKXDICQKZ type=write size=276704 2024-03-09T14:28:44.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.029+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~UR0ZH1M7ZJ5Q.0 size=1048576 2024-03-09T14:28:44.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.030+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~UR0ZH1M7ZJ5Q.1 size=858313 2024-03-09T14:28:44.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.030+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=UR0ZH1M7ZJ5Q tag=2AKUYCKVCA7L type=write size=2955465 2024-03-09T14:28:44.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.031+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=PM7QXEJXUO10 type=del 2024-03-09T14:28:44.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.032+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=PZMLJ62XQWE8 type=del size=1750571 2024-03-09T14:28:44.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.034+0000 7f1c6444c780 1 < canceled operation key=HPFPL79B0GLS tag=H0XMF1SM7FYS type=del size=2975433 2024-03-09T14:28:44.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.035+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=56DXYPDLNEXG type=write size=859926 2024-03-09T14:28:44.036 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.036+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=EQ0GUY0BQO11 type=write size=227959 2024-03-09T14:28:44.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.039+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~AK7WCLNGWYPY.0 size=877330 2024-03-09T14:28:44.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.039+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=AK7WCLNGWYPY tag=Y9M007ZYY8M4 type=write size=1925906 2024-03-09T14:28:44.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.041+0000 7f1c6444c780 1 < suggested remove operation key=QSMTZR754455 tag=IWKNVK8YF688 type=del 2024-03-09T14:28:44.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.042+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=7I5ZG3GSXU9F type=del size=3271703 2024-03-09T14:28:44.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.044+0000 7f1c6444c780 1 < completed write operation key=3CC018VYSRHN tag=ZQK1IJA7ZY5P type=write size=990799 2024-03-09T14:28:44.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.045+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=0M6L0V0IML3E type=del size=1542987 2024-03-09T14:28:44.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.046+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~YPTNME2P94IK.0 size=1048576 2024-03-09T14:28:44.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.047+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~YPTNME2P94IK.1 size=1048576 2024-03-09T14:28:44.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.048+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~YPTNME2P94IK.2 size=855752 2024-03-09T14:28:44.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.050+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=YPTNME2P94IK tag=TODFNUYEZQ6U type=write size=4001480 2024-03-09T14:28:44.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.052+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~UMOW3Q5MO6NQ.0 size=1048576 2024-03-09T14:28:44.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.053+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~UMOW3Q5MO6NQ.1 size=1048576 2024-03-09T14:28:44.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.054+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~UMOW3Q5MO6NQ.2 size=656502 2024-03-09T14:28:44.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.054+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=UMOW3Q5MO6NQ tag=5TC47B05FJX6 type=write size=3802230 2024-03-09T14:28:44.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.055+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~41N24JQKJIAZ.0 size=599029 2024-03-09T14:28:44.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.057+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=41N24JQKJIAZ tag=22NEYY8MENIL type=write size=1647605 2024-03-09T14:28:44.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.059+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~7YAK1DZT94ZQ.0 size=1048576 2024-03-09T14:28:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.060+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~7YAK1DZT94ZQ.1 size=52090 2024-03-09T14:28:44.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.060+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=7YAK1DZT94ZQ tag=Q72T1CX10K0V type=write size=2149242 2024-03-09T14:28:44.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.061+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~XEDFP1ZLTGFR.0 size=1048576 2024-03-09T14:28:44.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.062+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~XEDFP1ZLTGFR.1 size=1048576 2024-03-09T14:28:44.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.063+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~XEDFP1ZLTGFR.2 size=700234 2024-03-09T14:28:44.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.065+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=XEDFP1ZLTGFR tag=R8V8JAK05R1S type=write size=3845962 2024-03-09T14:28:44.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.067+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~S9U8BG3Z6Y54.0 size=1048576 2024-03-09T14:28:44.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.068+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~S9U8BG3Z6Y54.1 size=919314 2024-03-09T14:28:44.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.068+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=S9U8BG3Z6Y54 tag=U4LKDD4CF27U type=write size=3016466 2024-03-09T14:28:44.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.069+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=FN90TPBAL9SV type=del 2024-03-09T14:28:44.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.070+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=9XPN0YX8VDI5 type=del size=3463436 2024-03-09T14:28:44.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.072+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~WPEDAS63Z0S0.0 size=1048576 2024-03-09T14:28:44.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.073+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~WPEDAS63Z0S0.1 size=1048576 2024-03-09T14:28:44.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.073+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~WPEDAS63Z0S0.2 size=738681 2024-03-09T14:28:44.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.075+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=WPEDAS63Z0S0 tag=TLZZZR00ADPT type=write size=3884409 2024-03-09T14:28:44.076 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.077+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=9TO9LE0Y6ED4 type=del size=4175862 2024-03-09T14:28:44.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.078+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~F2FK638SOINU.0 size=1048576 2024-03-09T14:28:44.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.079+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~F2FK638SOINU.1 size=1048576 2024-03-09T14:28:44.080 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.080+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~F2FK638SOINU.2 size=233108 2024-03-09T14:28:44.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.082+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=F2FK638SOINU tag=WQUT5154X97C type=write size=3378836 2024-03-09T14:28:44.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.083+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=FN7BVVY9W42S type=del size=3986088 2024-03-09T14:28:44.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.084+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=5NUY3BU3P7P0 type=del 2024-03-09T14:28:44.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.085+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=5O2RJZ0G3352 type=write size=54400 2024-03-09T14:28:44.086 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.086+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~M7CNCA3FXPIM.0 size=1048576 2024-03-09T14:28:44.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.087+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~M7CNCA3FXPIM.1 size=1048576 2024-03-09T14:28:44.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.088+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~M7CNCA3FXPIM.2 size=334368 2024-03-09T14:28:44.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.090+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=M7CNCA3FXPIM tag=EHA6KDPY50E2 type=write size=3480096 2024-03-09T14:28:44.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.092+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~YODDIKRBR46Q.0 size=100675 2024-03-09T14:28:44.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.092+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=YODDIKRBR46Q tag=4L9OOAQYAVCP type=write size=1149251 2024-03-09T14:28:44.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.093+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~2QWWBKJPV91H.0 size=1048576 2024-03-09T14:28:44.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.094+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~2QWWBKJPV91H.1 size=181433 2024-03-09T14:28:44.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.097+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=2QWWBKJPV91H tag=SONHRHEKLXS8 type=write size=2278585 2024-03-09T14:28:44.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.098+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=BJP8Q7TDC4E5 type=del size=1120718 2024-03-09T14:28:44.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.099+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=2LSQ713N97AD type=del size=637616 2024-03-09T14:28:44.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.100+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=UZLYUFRQ9MDG type=del size=1494463 2024-03-09T14:28:44.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.101+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~UR0ZH1M7ZJ5Q.0 size=1048576 2024-03-09T14:28:44.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.102+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~UR0ZH1M7ZJ5Q.1 size=858313 2024-03-09T14:28:44.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.104+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=UR0ZH1M7ZJ5Q tag=2AKUYCKVCA7L type=write size=2955465 2024-03-09T14:28:44.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.105+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=R2FFJ1DJUVRC type=del size=1276905 2024-03-09T14:28:44.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.107+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=PZMLJ62XQWE8 type=del 2024-03-09T14:28:44.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.108+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=1S69FA4ABPUG type=write size=376741 2024-03-09T14:28:44.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.109+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=56DXYPDLNEXG type=write size=859926 2024-03-09T14:28:44.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.111+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~9NZ7WL5YWA32.0 size=1048576 2024-03-09T14:28:44.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.112+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~9NZ7WL5YWA32.1 size=1048576 2024-03-09T14:28:44.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.113+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~9NZ7WL5YWA32.2 size=527253 2024-03-09T14:28:44.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.113+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=9NZ7WL5YWA32 tag=4R90BVOC1KQ2 type=write size=3672981 2024-03-09T14:28:44.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.114+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~AK7WCLNGWYPY.0 size=877330 2024-03-09T14:28:44.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.116+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=AK7WCLNGWYPY tag=Y9M007ZYY8M4 type=write size=1925906 2024-03-09T14:28:44.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.117+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=A1NNYB64BS28 type=del size=3016548 2024-03-09T14:28:44.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.118+0000 7f1c6444c780 1 < canceled operation key=NIN0FB6YTKWA tag=7I5ZG3GSXU9F type=del size=3271703 2024-03-09T14:28:44.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.120+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=2AY5Q98Q8RSB type=write size=736677 2024-03-09T14:28:44.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.122+0000 7f1c6444c780 1 < suggested update operation key=MOVS6ZMK708G tag=0M6L0V0IML3E type=del size=1542987 2024-03-09T14:28:44.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.123+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=YHE16PXQB641 type=del size=2139405 2024-03-09T14:28:44.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.123+0000 7f1c6444c780 1 < canceled part key=_multipart_YECG84AJ5IK2.2~UMOW3Q5MO6NQ.0 size=1048576 2024-03-09T14:28:44.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.124+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~UMOW3Q5MO6NQ.1 size=1048576 2024-03-09T14:28:44.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.125+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~UMOW3Q5MO6NQ.2 size=656502 2024-03-09T14:28:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.127+0000 7f1c6444c780 1 < canceled multipart upload key=YECG84AJ5IK2 upload=UMOW3Q5MO6NQ tag=5TC47B05FJX6 type=write size=3802230 2024-03-09T14:28:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.129+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~GV1XA60SL5CC.0 size=1048576 2024-03-09T14:28:44.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.130+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~GV1XA60SL5CC.1 size=799338 2024-03-09T14:28:44.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.130+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=GV1XA60SL5CC tag=6XZBYKQKXUWI type=write size=2896490 2024-03-09T14:28:44.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.131+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~7YAK1DZT94ZQ.0 size=1048576 2024-03-09T14:28:44.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.132+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~7YAK1DZT94ZQ.1 size=52090 2024-03-09T14:28:44.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.133+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=7YAK1DZT94ZQ tag=Q72T1CX10K0V type=write size=2149242 2024-03-09T14:28:44.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.135+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~9YQVALOCOSG4.0 size=1048576 2024-03-09T14:28:44.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.136+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~9YQVALOCOSG4.1 size=919649 2024-03-09T14:28:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.136+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=9YQVALOCOSG4 tag=1TZTO55ZUS70 type=write size=3016801 2024-03-09T14:28:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.137+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~S9U8BG3Z6Y54.0 size=1048576 2024-03-09T14:28:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.137+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~S9U8BG3Z6Y54.1 size=919314 2024-03-09T14:28:44.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.138+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=S9U8BG3Z6Y54 tag=U4LKDD4CF27U type=write size=3016466 2024-03-09T14:28:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.141+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~0CCPSYQXYV3S.0 size=814318 2024-03-09T14:28:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.141+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=0CCPSYQXYV3S tag=RLSIRC5ICNA1 type=write size=1862894 2024-03-09T14:28:44.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.149+0000 7f1c6444c780 1 < suggested remove operation key=KNOEGKSERB6Z tag=9XPN0YX8VDI5 type=del 2024-03-09T14:28:44.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.150+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=5ITJ1YMULRCX type=del size=437939 2024-03-09T14:28:44.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.151+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=9TO9LE0Y6ED4 type=del 2024-03-09T14:28:44.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.152+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=0AE5TVQ1M1ST type=del size=555470 2024-03-09T14:28:44.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.153+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=FN7BVVY9W42S type=del 2024-03-09T14:28:44.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.155+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=ZZ86EED2GS37 type=del size=3651202 2024-03-09T14:28:44.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.157+0000 7f1c6444c780 1 < suggested update operation key=KWDIDE9AE3JP tag=5O2RJZ0G3352 type=write size=54400 2024-03-09T14:28:44.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.158+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=KF574CQSPFIG type=write size=574830 2024-03-09T14:28:44.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.159+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~YODDIKRBR46Q.0 size=100675 2024-03-09T14:28:44.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.161+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=YODDIKRBR46Q tag=4L9OOAQYAVCP type=write size=1149251 2024-03-09T14:28:44.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.162+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=KRTMQM4QK3DR type=del size=2176717 2024-03-09T14:28:44.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.164+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=BJP8Q7TDC4E5 type=del 2024-03-09T14:28:44.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.166+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=Q4CXV7A9JGNJ type=del size=4081577 2024-03-09T14:28:44.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.167+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=UZLYUFRQ9MDG type=del 2024-03-09T14:28:44.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.168+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=3D2LJSUVZLUZ type=write size=1030880 2024-03-09T14:28:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.169+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=R2FFJ1DJUVRC type=del 2024-03-09T14:28:44.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.170+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=EQYIPJ0OFXM4 type=del size=1911087 2024-03-09T14:28:44.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.171+0000 7f1c6444c780 1 < completed write operation key=71FSR1CHFBO0 tag=1S69FA4ABPUG type=write size=376741 2024-03-09T14:28:44.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.174+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~2K71KXWT46WF.0 size=1048576 2024-03-09T14:28:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.175+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~2K71KXWT46WF.1 size=1048576 2024-03-09T14:28:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.175+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~2K71KXWT46WF.2 size=771424 2024-03-09T14:28:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.175+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=2K71KXWT46WF tag=93JZYVA4MJ0Y type=write size=3917152 2024-03-09T14:28:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.177+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~9NZ7WL5YWA32.0 size=1048576 2024-03-09T14:28:44.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.178+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~9NZ7WL5YWA32.1 size=1048576 2024-03-09T14:28:44.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.179+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~9NZ7WL5YWA32.2 size=527253 2024-03-09T14:28:44.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.180+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=9NZ7WL5YWA32 tag=4R90BVOC1KQ2 type=write size=3672981 2024-03-09T14:28:44.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.182+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~60UQJLWDTZCV.0 size=1048576 2024-03-09T14:28:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.183+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~60UQJLWDTZCV.1 size=1048576 2024-03-09T14:28:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.184+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~60UQJLWDTZCV.2 size=395478 2024-03-09T14:28:44.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.184+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=60UQJLWDTZCV tag=PN3NPWKEY8D0 type=write size=3541206 2024-03-09T14:28:44.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.187+0000 7f1c6444c780 1 < suggested remove operation key=BYX1155MZ2LP tag=A1NNYB64BS28 type=del 2024-03-09T14:28:44.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.188+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=CF94ZCHJIW8Y type=del size=2156271 2024-03-09T14:28:44.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.190+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=2AY5Q98Q8RSB type=write size=736677 2024-03-09T14:28:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.192+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~MJNKPUL7TZVK.0 size=1048576 2024-03-09T14:28:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.193+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~MJNKPUL7TZVK.1 size=598565 2024-03-09T14:28:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.193+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=MJNKPUL7TZVK tag=1Y3I5AX5OD1R type=write size=2695717 2024-03-09T14:28:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.194+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=YHE16PXQB641 type=del 2024-03-09T14:28:44.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.195+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=QNJW22CIG0YR type=del size=3779234 2024-03-09T14:28:44.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.197+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~GV1XA60SL5CC.0 size=1048576 2024-03-09T14:28:44.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.198+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~GV1XA60SL5CC.1 size=799338 2024-03-09T14:28:44.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.199+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=GV1XA60SL5CC tag=6XZBYKQKXUWI type=write size=2896490 2024-03-09T14:28:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.201+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~4Q23Z6M8FNFP.0 size=1048576 2024-03-09T14:28:44.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.202+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~4Q23Z6M8FNFP.1 size=240120 2024-03-09T14:28:44.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.202+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=4Q23Z6M8FNFP tag=A0ST54WRZO6S type=write size=2337272 2024-03-09T14:28:44.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.204+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~9YQVALOCOSG4.0 size=1048576 2024-03-09T14:28:44.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.204+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~9YQVALOCOSG4.1 size=919649 2024-03-09T14:28:44.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.206+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=9YQVALOCOSG4 tag=1TZTO55ZUS70 type=write size=3016801 2024-03-09T14:28:44.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.208+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~UL4E0GHICLGB.0 size=1048576 2024-03-09T14:28:44.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.209+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~UL4E0GHICLGB.1 size=559158 2024-03-09T14:28:44.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.209+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=UL4E0GHICLGB tag=RHPI0SATTEDW type=write size=2656310 2024-03-09T14:28:44.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.210+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~0CCPSYQXYV3S.0 size=814318 2024-03-09T14:28:44.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.212+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=0CCPSYQXYV3S tag=RLSIRC5ICNA1 type=write size=1862894 2024-03-09T14:28:44.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.213+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=CCS1270GMMHP type=del size=3210855 2024-03-09T14:28:44.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.215+0000 7f1c6444c780 1 < canceled operation key=0ZZ0P8Y7KSAX tag=5ITJ1YMULRCX type=del size=437939 2024-03-09T14:28:44.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.216+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=0RZQRZUM1DOD type=del size=2373686 2024-03-09T14:28:44.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.217+0000 7f1c6444c780 1 < canceled operation key=EREG1M13901A tag=0AE5TVQ1M1ST type=del size=555470 2024-03-09T14:28:44.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.218+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=R3CC7IKMCPRG type=del size=1520898 2024-03-09T14:28:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.219+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=ZZ86EED2GS37 type=del 2024-03-09T14:28:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.221+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~1M8Z2NUA8DCI.0 size=1048576 2024-03-09T14:28:44.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.222+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~1M8Z2NUA8DCI.1 size=794409 2024-03-09T14:28:44.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.222+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=1M8Z2NUA8DCI tag=Q8H2F9BS39FT type=write size=2891561 2024-03-09T14:28:44.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.225+0000 7f1c6444c780 1 < suggested update operation key=1NQRJ8ICZNM6 tag=KF574CQSPFIG type=write size=574830 2024-03-09T14:28:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.226+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=CJIJJXCU5OTR type=del size=1984314 2024-03-09T14:28:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.227+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=KRTMQM4QK3DR type=del 2024-03-09T14:28:44.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.228+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=K4O1L2GI2J76 type=del size=4108282 2024-03-09T14:28:44.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.230+0000 7f1c6444c780 1 < suggested update operation key=YECG84AJ5IK2 tag=Q4CXV7A9JGNJ type=del size=4081577 2024-03-09T14:28:44.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.232+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=R4O862XD27SG type=del size=3092681 2024-03-09T14:28:44.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.233+0000 7f1c6444c780 1 < completed write operation key=35Y98D5U0M8O tag=3D2LJSUVZLUZ type=write size=1030880 2024-03-09T14:28:44.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.234+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=TTG48BQIGJVJ type=del size=870321 2024-03-09T14:28:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.235+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=EQYIPJ0OFXM4 type=del 2024-03-09T14:28:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.236+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=6B2JKIXE95S2 type=del size=1152234 2024-03-09T14:28:44.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.236+0000 7f1c6444c780 1 < canceled part key=_multipart_WMO6LTCMVXD2.2~2K71KXWT46WF.0 size=1048576 2024-03-09T14:28:44.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.237+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~2K71KXWT46WF.1 size=1048576 2024-03-09T14:28:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.238+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~2K71KXWT46WF.2 size=771424 2024-03-09T14:28:44.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.240+0000 7f1c6444c780 1 < canceled multipart upload key=WMO6LTCMVXD2 upload=2K71KXWT46WF tag=93JZYVA4MJ0Y type=write size=3917152 2024-03-09T14:28:44.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.241+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=0M1ZN8LVY2KD type=del size=1199850 2024-03-09T14:28:44.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.242+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~60UQJLWDTZCV.0 size=1048576 2024-03-09T14:28:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.243+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~60UQJLWDTZCV.1 size=1048576 2024-03-09T14:28:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.244+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~60UQJLWDTZCV.2 size=395478 2024-03-09T14:28:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.246+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=60UQJLWDTZCV tag=PN3NPWKEY8D0 type=write size=3541206 2024-03-09T14:28:44.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.248+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~78GIHP8QKP0I.0 size=1048576 2024-03-09T14:28:44.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.249+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~78GIHP8QKP0I.1 size=798366 2024-03-09T14:28:44.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.249+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=78GIHP8QKP0I tag=T0DMKPMOYEJH type=write size=2895518 2024-03-09T14:28:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.250+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=CF94ZCHJIW8Y type=del 2024-03-09T14:28:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.251+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=5945KT1RAJ82 type=del size=2406649 2024-03-09T14:28:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.253+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~MJNKPUL7TZVK.0 size=1048576 2024-03-09T14:28:44.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.254+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~MJNKPUL7TZVK.1 size=598565 2024-03-09T14:28:44.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.256+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=MJNKPUL7TZVK tag=1Y3I5AX5OD1R type=write size=2695717 2024-03-09T14:28:44.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.259+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~THV61LDOET07.0 size=1041107 2024-03-09T14:28:44.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.259+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=THV61LDOET07 tag=PL8HKU7N7H5G type=write size=2089683 2024-03-09T14:28:44.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.262+0000 7f1c6444c780 1 < suggested remove operation key=HPFPL79B0GLS tag=QNJW22CIG0YR type=del 2024-03-09T14:28:44.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.263+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=AF9P6FCHVG5I type=del size=2663730 2024-03-09T14:28:44.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.264+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~4Q23Z6M8FNFP.0 size=1048576 2024-03-09T14:28:44.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.264+0000 7f1c6444c780 1 < canceled part key=_multipart_KWDIDE9AE3JP.2~4Q23Z6M8FNFP.1 size=240120 2024-03-09T14:28:44.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.266+0000 7f1c6444c780 1 < canceled multipart upload key=KWDIDE9AE3JP upload=4Q23Z6M8FNFP tag=A0ST54WRZO6S type=write size=2337272 2024-03-09T14:28:44.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.267+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=V3WPI9K108O1 type=del size=1244174 2024-03-09T14:28:44.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.268+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~UL4E0GHICLGB.0 size=1048576 2024-03-09T14:28:44.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.269+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~UL4E0GHICLGB.1 size=559158 2024-03-09T14:28:44.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.271+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=UL4E0GHICLGB tag=RHPI0SATTEDW type=write size=2656310 2024-03-09T14:28:44.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.272+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=28O70NRTK31K type=del size=2952581 2024-03-09T14:28:44.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.274+0000 7f1c6444c780 1 < suggested update operation key=1NQRJ8ICZNM6 tag=CCS1270GMMHP type=del size=3210855 2024-03-09T14:28:44.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.275+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=XF4S2M4EUGJ8 type=write size=994371 2024-03-09T14:28:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.276+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=0RZQRZUM1DOD type=del 2024-03-09T14:28:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.278+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=L4YPE3G958T6 type=del size=1228241 2024-03-09T14:28:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.279+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=R3CC7IKMCPRG type=del size=1520898 2024-03-09T14:28:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.281+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~DPSWH8TVJNH5.0 size=1048576 2024-03-09T14:28:44.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.282+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~DPSWH8TVJNH5.1 size=1048576 2024-03-09T14:28:44.283 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.283+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~DPSWH8TVJNH5.2 size=208374 2024-03-09T14:28:44.283 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.283+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=DPSWH8TVJNH5 tag=JN1CJ3AEWVYW type=write size=3354102 2024-03-09T14:28:44.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.284+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~1M8Z2NUA8DCI.0 size=1048576 2024-03-09T14:28:44.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.285+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~1M8Z2NUA8DCI.1 size=794409 2024-03-09T14:28:44.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.287+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=1M8Z2NUA8DCI tag=Q8H2F9BS39FT type=write size=2891561 2024-03-09T14:28:44.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.288+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=LA1OBHIHRI8Y type=del size=513581 2024-03-09T14:28:44.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.289+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=CJIJJXCU5OTR type=del 2024-03-09T14:28:44.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.290+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=4ATUN3I9MRGL type=del size=1341720 2024-03-09T14:28:44.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.291+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=K4O1L2GI2J76 type=del 2024-03-09T14:28:44.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.292+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=UK2QC0KNRTXY type=del size=1898760 2024-03-09T14:28:44.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.293+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=R4O862XD27SG type=del 2024-03-09T14:28:44.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.295+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~BNA66F9WU4BN.0 size=182463 2024-03-09T14:28:44.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.295+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=BNA66F9WU4BN tag=2EWM95QKQ8NV type=write size=1231039 2024-03-09T14:28:44.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.296+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=HPFPL79B0GLS tag=TTG48BQIGJVJ type=del size=870321: (2) No such file or directory 2024-03-09T14:28:44.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.297+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=ATUIT5T0CQIR type=del size=2425151 2024-03-09T14:28:44.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.298+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=6B2JKIXE95S2 type=del 2024-03-09T14:28:44.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.300+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~26G5LQRI8TBT.0 size=278897 2024-03-09T14:28:44.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.300+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=26G5LQRI8TBT tag=R6B47GEEEY5W type=write size=1327473 2024-03-09T14:28:44.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.301+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=0M1ZN8LVY2KD type=del 2024-03-09T14:28:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.302+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=DTNH18XRK0QA type=del size=2948046 2024-03-09T14:28:44.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.303+0000 7f1c6444c780 1 < canceled part key=_multipart_35Y98D5U0M8O.2~78GIHP8QKP0I.0 size=1048576 2024-03-09T14:28:44.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.304+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~78GIHP8QKP0I.1 size=798366 2024-03-09T14:28:44.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.306+0000 7f1c6444c780 1 < canceled multipart upload key=35Y98D5U0M8O upload=78GIHP8QKP0I tag=T0DMKPMOYEJH type=write size=2895518 2024-03-09T14:28:44.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.307+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=G316N8P1P00B type=del size=3514697 2024-03-09T14:28:44.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.309+0000 7f1c6444c780 1 < suggested remove operation key=P33029QWKW23 tag=5945KT1RAJ82 type=del 2024-03-09T14:28:44.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.310+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=9BJ5PIXB7RD1 type=del size=1769659 2024-03-09T14:28:44.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.311+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~THV61LDOET07.0 size=1041107 2024-03-09T14:28:44.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.313+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=THV61LDOET07 tag=PL8HKU7N7H5G type=write size=2089683 2024-03-09T14:28:44.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.315+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~45T0VPHSIHKL.0 size=1048576 2024-03-09T14:28:44.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.316+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~45T0VPHSIHKL.1 size=1048576 2024-03-09T14:28:44.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.317+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~45T0VPHSIHKL.2 size=410314 2024-03-09T14:28:44.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.317+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=45T0VPHSIHKL tag=32O2PQTTMRBZ type=write size=3556042 2024-03-09T14:28:44.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.318+0000 7f1c6444c780 -1 < failed to complete operation key=1NQRJ8ICZNM6 tag=AF9P6FCHVG5I type=del size=2663730: (22) Invalid argument 2024-03-09T14:28:44.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.319+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=S1AKNYFYAGGA type=del size=2303644 2024-03-09T14:28:44.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.320+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=V3WPI9K108O1 type=del 2024-03-09T14:28:44.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.322+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=FP7HAJ02I3LW type=del size=1077532 2024-03-09T14:28:44.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.323+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=28O70NRTK31K type=del 2024-03-09T14:28:44.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.324+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=EHDUCELTDH9T type=del size=2888392 2024-03-09T14:28:44.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.325+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=XF4S2M4EUGJ8 type=write size=994371 2024-03-09T14:28:44.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.327+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~T298CMNERZ2Z.0 size=1048576 2024-03-09T14:28:44.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.328+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~T298CMNERZ2Z.1 size=1048576 2024-03-09T14:28:44.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.329+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~T298CMNERZ2Z.2 size=986258 2024-03-09T14:28:44.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.329+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=T298CMNERZ2Z tag=UK58VQ3F2FW8 type=write size=4131986 2024-03-09T14:28:44.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.330+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=L4YPE3G958T6 type=del 2024-03-09T14:28:44.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.332+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=BZ1M9XAESU62 type=write size=258362 2024-03-09T14:28:44.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.333+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~DPSWH8TVJNH5.0 size=1048576 2024-03-09T14:28:44.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.334+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~DPSWH8TVJNH5.1 size=1048576 2024-03-09T14:28:44.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.335+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~DPSWH8TVJNH5.2 size=208374 2024-03-09T14:28:44.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.337+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=DPSWH8TVJNH5 tag=JN1CJ3AEWVYW type=write size=3354102 2024-03-09T14:28:44.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.339+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~L87ZTQB39FXC.0 size=206177 2024-03-09T14:28:44.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.339+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=L87ZTQB39FXC tag=21MELQ9IAW68 type=write size=1254753 2024-03-09T14:28:44.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.341+0000 7f1c6444c780 1 < suggested update operation key=NIN0FB6YTKWA tag=LA1OBHIHRI8Y type=del size=513581 2024-03-09T14:28:44.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.342+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=16LCRLPA2ZJT type=write size=708137 2024-03-09T14:28:44.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.344+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=4ATUN3I9MRGL type=del size=1341720 2024-03-09T14:28:44.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.345+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=6B8CPCUWD2FC type=del size=253002 2024-03-09T14:28:44.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.346+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=UK2QC0KNRTXY type=del 2024-03-09T14:28:44.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.347+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=QW9283Y69K9M type=del size=3416306 2024-03-09T14:28:44.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.348+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~BNA66F9WU4BN.0 size=182463 2024-03-09T14:28:44.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.350+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=BNA66F9WU4BN tag=2EWM95QKQ8NV type=write size=1231039 2024-03-09T14:28:44.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.351+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=V9D4OLI09MGM type=del size=3187120 2024-03-09T14:28:44.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.354+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=ATUIT5T0CQIR type=del size=2425151 2024-03-09T14:28:44.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.355+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=04AEUJFXVCIW type=del size=2607229 2024-03-09T14:28:44.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.355+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~26G5LQRI8TBT.0 size=278897 2024-03-09T14:28:44.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.357+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=26G5LQRI8TBT tag=R6B47GEEEY5W type=write size=1327473 2024-03-09T14:28:44.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.359+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~LZ734EEDSM4O.0 size=1048576 2024-03-09T14:28:44.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.360+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~LZ734EEDSM4O.1 size=60469 2024-03-09T14:28:44.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.360+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=LZ734EEDSM4O tag=6TSR93S0EODP type=write size=2157621 2024-03-09T14:28:44.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.361+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=DTNH18XRK0QA type=del 2024-03-09T14:28:44.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.362+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=MMVN03609AS7 type=write size=309933 2024-03-09T14:28:44.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.364+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=G316N8P1P00B type=del 2024-03-09T14:28:44.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.366+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~6KNHI29W0L7X.0 size=1048576 2024-03-09T14:28:44.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.367+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~6KNHI29W0L7X.1 size=1048576 2024-03-09T14:28:44.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.368+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~6KNHI29W0L7X.2 size=990032 2024-03-09T14:28:44.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.368+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=6KNHI29W0L7X tag=UFE80Z23S3PS type=write size=4135760 2024-03-09T14:28:44.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.370+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=9BJ5PIXB7RD1 type=del size=1769659 2024-03-09T14:28:44.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.372+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~TW1S3GTT9GTJ.0 size=1048576 2024-03-09T14:28:44.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.373+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~TW1S3GTT9GTJ.1 size=1048576 2024-03-09T14:28:44.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.374+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~TW1S3GTT9GTJ.2 size=388132 2024-03-09T14:28:44.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.374+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=TW1S3GTT9GTJ tag=EZQEJ3GO3HHP type=write size=3533860 2024-03-09T14:28:44.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.375+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~45T0VPHSIHKL.0 size=1048576 2024-03-09T14:28:44.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.376+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~45T0VPHSIHKL.1 size=1048576 2024-03-09T14:28:44.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.377+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~45T0VPHSIHKL.2 size=410314 2024-03-09T14:28:44.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.379+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=45T0VPHSIHKL tag=32O2PQTTMRBZ type=write size=3556042 2024-03-09T14:28:44.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.380+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=75QWJPOGI1I1 type=del size=2304633 2024-03-09T14:28:44.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.381+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=S1AKNYFYAGGA type=del 2024-03-09T14:28:44.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.382+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=6MNYG2DWJU3M type=del size=2032568 2024-03-09T14:28:44.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.383+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=FP7HAJ02I3LW type=del 2024-03-09T14:28:44.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.384+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=TI4JN6P4I2NQ type=del size=51736 2024-03-09T14:28:44.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.385+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=EHDUCELTDH9T type=del 2024-03-09T14:28:44.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.386+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=WJT2AT3ZHK63 type=del size=4155054 2024-03-09T14:28:44.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.387+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~T298CMNERZ2Z.0 size=1048576 2024-03-09T14:28:44.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.388+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~T298CMNERZ2Z.1 size=1048576 2024-03-09T14:28:44.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.390+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~T298CMNERZ2Z.2 size=986258 2024-03-09T14:28:44.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.391+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=T298CMNERZ2Z tag=UK58VQ3F2FW8 type=write size=4131986 2024-03-09T14:28:44.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.394+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~JQF3IHDQ89RC.0 size=1048576 2024-03-09T14:28:44.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.395+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~JQF3IHDQ89RC.1 size=390950 2024-03-09T14:28:44.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.395+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=JQF3IHDQ89RC tag=DEBJ2301PXX9 type=write size=2488102 2024-03-09T14:28:44.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.396+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=BZ1M9XAESU62 type=write size=258362 2024-03-09T14:28:44.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.397+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=VZ6C0SQKKPBR type=del size=381824 2024-03-09T14:28:44.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.397+0000 7f1c6444c780 1 < canceled part key=_multipart_HPFPL79B0GLS.2~L87ZTQB39FXC.0 size=206177 2024-03-09T14:28:44.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.399+0000 7f1c6444c780 1 < canceled multipart upload key=HPFPL79B0GLS upload=L87ZTQB39FXC tag=21MELQ9IAW68 type=write size=1254753 2024-03-09T14:28:44.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.400+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=OPXXMNC7GYL8 type=del size=3243524 2024-03-09T14:28:44.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.401+0000 7f1c6444c780 1 < completed write operation key=HNK7POWS6FSU tag=16LCRLPA2ZJT type=write size=708137 2024-03-09T14:28:44.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.403+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~42BXQ8V4YN88.0 size=636220 2024-03-09T14:28:44.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.403+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=42BXQ8V4YN88 tag=0MRBQ94RS1HF type=write size=1684796 2024-03-09T14:28:44.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.404+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=6B8CPCUWD2FC type=del 2024-03-09T14:28:44.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.406+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=DI7OGAD3ZKI0 type=del size=4091918 2024-03-09T14:28:44.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.407+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=QW9283Y69K9M type=del 2024-03-09T14:28:44.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.409+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~54G3ZK1PYW2W.0 size=1048576 2024-03-09T14:28:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.410+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~54G3ZK1PYW2W.1 size=499784 2024-03-09T14:28:44.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.410+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=54G3ZK1PYW2W tag=G2XXX3J1SVZE type=write size=2596936 2024-03-09T14:28:44.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.411+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=V9D4OLI09MGM type=del 2024-03-09T14:28:44.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.412+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=KJ5XAHBIX5YD type=del size=1080910 2024-03-09T14:28:44.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.414+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=04AEUJFXVCIW type=del 2024-03-09T14:28:44.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.416+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~5IMB0WRBHCOS.0 size=1048576 2024-03-09T14:28:44.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.416+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~5IMB0WRBHCOS.1 size=506963 2024-03-09T14:28:44.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.416+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=5IMB0WRBHCOS tag=GRJMLHX4GQAJ type=write size=2604115 2024-03-09T14:28:44.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.418+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~LZ734EEDSM4O.0 size=1048576 2024-03-09T14:28:44.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.418+0000 7f1c6444c780 1 < canceled part key=_multipart_0ZZ0P8Y7KSAX.2~LZ734EEDSM4O.1 size=60469 2024-03-09T14:28:44.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.420+0000 7f1c6444c780 1 < canceled multipart upload key=0ZZ0P8Y7KSAX upload=LZ734EEDSM4O tag=6TSR93S0EODP type=write size=2157621 2024-03-09T14:28:44.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.422+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~APGVR6R1YT1T.0 size=607695 2024-03-09T14:28:44.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.422+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=APGVR6R1YT1T tag=WTD8011GFS2D type=write size=1656271 2024-03-09T14:28:44.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.423+0000 7f1c6444c780 1 < completed write operation key=KNOEGKSERB6Z tag=MMVN03609AS7 type=write size=309933 2024-03-09T14:28:44.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.425+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~81N0P9TYT0IE.0 size=1048576 2024-03-09T14:28:44.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.426+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~81N0P9TYT0IE.1 size=66493 2024-03-09T14:28:44.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.426+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=81N0P9TYT0IE tag=RSQ60JARW77M type=write size=2163645 2024-03-09T14:28:44.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.426+0000 7f1c6444c780 1 < canceled part key=_multipart_EREG1M13901A.2~6KNHI29W0L7X.0 size=1048576 2024-03-09T14:28:44.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.427+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~6KNHI29W0L7X.1 size=1048576 2024-03-09T14:28:44.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.428+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~6KNHI29W0L7X.2 size=990032 2024-03-09T14:28:44.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.430+0000 7f1c6444c780 1 < canceled multipart upload key=EREG1M13901A upload=6KNHI29W0L7X tag=UFE80Z23S3PS type=write size=4135760 2024-03-09T14:28:44.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.431+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=5EKFGLDO9VPJ type=del size=984883 2024-03-09T14:28:44.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.432+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~TW1S3GTT9GTJ.0 size=1048576 2024-03-09T14:28:44.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.433+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~TW1S3GTT9GTJ.1 size=1048576 2024-03-09T14:28:44.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.433+0000 7f1c6444c780 1 < canceled part key=_multipart_VL5EUQ52WRAN.2~TW1S3GTT9GTJ.2 size=388132 2024-03-09T14:28:44.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.435+0000 7f1c6444c780 1 < canceled multipart upload key=VL5EUQ52WRAN upload=TW1S3GTT9GTJ tag=EZQEJ3GO3HHP type=write size=3533860 2024-03-09T14:28:44.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.437+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=XRMCTXGO1UR0 type=del size=2821446 2024-03-09T14:28:44.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.438+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=75QWJPOGI1I1 type=del 2024-03-09T14:28:44.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.440+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~U6NTJKOHGIB8.0 size=1048576 2024-03-09T14:28:44.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.441+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~U6NTJKOHGIB8.1 size=1048576 2024-03-09T14:28:44.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.442+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~U6NTJKOHGIB8.2 size=82240 2024-03-09T14:28:44.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.442+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=U6NTJKOHGIB8 tag=5WTYDCZ7KYCB type=write size=3227968 2024-03-09T14:28:44.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.443+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=6MNYG2DWJU3M type=del 2024-03-09T14:28:44.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.444+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=302TKAQQ1F1U type=write size=908279 2024-03-09T14:28:44.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.446+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=TI4JN6P4I2NQ type=del 2024-03-09T14:28:44.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.447+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=YCQQBO94411J type=del size=3987006 2024-03-09T14:28:44.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.449+0000 7f1c6444c780 1 < suggested update operation key=MX3X6ILR7J8N tag=WJT2AT3ZHK63 type=del size=4155054 2024-03-09T14:28:44.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.450+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=403DRCZAOQ34 type=del size=2785904 2024-03-09T14:28:44.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.451+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~JQF3IHDQ89RC.0 size=1048576 2024-03-09T14:28:44.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.452+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~JQF3IHDQ89RC.1 size=390950 2024-03-09T14:28:44.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.454+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=JQF3IHDQ89RC tag=DEBJ2301PXX9 type=write size=2488102 2024-03-09T14:28:44.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.457+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~S3EDTC56TO3W.0 size=1048576 2024-03-09T14:28:44.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.457+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~S3EDTC56TO3W.1 size=1048576 2024-03-09T14:28:44.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.458+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~S3EDTC56TO3W.2 size=585431 2024-03-09T14:28:44.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.458+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=S3EDTC56TO3W tag=HP3O6QVEEDUS type=write size=3731159 2024-03-09T14:28:44.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.460+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=VZ6C0SQKKPBR type=del 2024-03-09T14:28:44.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.462+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~TTA3VBI9L8OA.0 size=1048576 2024-03-09T14:28:44.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.463+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~TTA3VBI9L8OA.1 size=1048576 2024-03-09T14:28:44.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.464+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~TTA3VBI9L8OA.2 size=901870 2024-03-09T14:28:44.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.464+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=TTA3VBI9L8OA tag=4DKWYBPXVKSY type=write size=4047598 2024-03-09T14:28:44.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.465+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=OPXXMNC7GYL8 type=del 2024-03-09T14:28:44.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.466+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=6ZGLIFNMT35P type=del size=1338233 2024-03-09T14:28:44.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.467+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~42BXQ8V4YN88.0 size=636220 2024-03-09T14:28:44.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.469+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=42BXQ8V4YN88 tag=0MRBQ94RS1HF type=write size=1684796 2024-03-09T14:28:44.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.471+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=2EUK62H15A8P type=del size=854415 2024-03-09T14:28:44.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.472+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=DI7OGAD3ZKI0 type=del size=4091918 2024-03-09T14:28:44.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.473+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=TL5VD1ZFMKLO type=write size=197750 2024-03-09T14:28:44.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.475+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~54G3ZK1PYW2W.0 size=1048576 2024-03-09T14:28:44.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.476+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~54G3ZK1PYW2W.1 size=499784 2024-03-09T14:28:44.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.479+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=54G3ZK1PYW2W tag=G2XXX3J1SVZE type=write size=2596936 2024-03-09T14:28:44.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.480+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=2WGDEDZY6I24 type=del size=3547321 2024-03-09T14:28:44.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.481+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=KJ5XAHBIX5YD type=del 2024-03-09T14:28:44.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.483+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~AKYUNZI6O0V0.0 size=1046576 2024-03-09T14:28:44.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.483+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=AKYUNZI6O0V0 tag=GX7RBZOBIJA4 type=write size=2095152 2024-03-09T14:28:44.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.483+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~5IMB0WRBHCOS.0 size=1048576 2024-03-09T14:28:44.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.484+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~5IMB0WRBHCOS.1 size=506963 2024-03-09T14:28:44.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.486+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=5IMB0WRBHCOS tag=GRJMLHX4GQAJ type=write size=2604115 2024-03-09T14:28:44.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.488+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~FWPA15YYBM7C.0 size=809371 2024-03-09T14:28:44.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.488+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=FWPA15YYBM7C tag=EFQGQIQWF2FH type=write size=1857947 2024-03-09T14:28:44.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.489+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~APGVR6R1YT1T.0 size=607695 2024-03-09T14:28:44.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.491+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=APGVR6R1YT1T tag=WTD8011GFS2D type=write size=1656271 2024-03-09T14:28:44.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.493+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~MX1CSJCBMYHX.0 size=245245 2024-03-09T14:28:44.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.493+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=MX1CSJCBMYHX tag=8UIOU97RHX4T type=write size=1293821 2024-03-09T14:28:44.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.494+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~81N0P9TYT0IE.0 size=1048576 2024-03-09T14:28:44.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.495+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~81N0P9TYT0IE.1 size=66493 2024-03-09T14:28:44.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.497+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=81N0P9TYT0IE tag=RSQ60JARW77M type=write size=2163645 2024-03-09T14:28:44.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.498+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=VMONHDVK1Z50 type=del size=4109876 2024-03-09T14:28:44.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.499+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=5EKFGLDO9VPJ type=del 2024-03-09T14:28:44.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.500+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=D5D150C83ERN type=del size=1603159 2024-03-09T14:28:44.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.501+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=XRMCTXGO1UR0 type=del 2024-03-09T14:28:44.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.503+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~AE6146FBIG0N.0 size=347785 2024-03-09T14:28:44.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.503+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=AE6146FBIG0N tag=OEGS3VZJ15XK type=write size=1396361 2024-03-09T14:28:44.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.504+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~U6NTJKOHGIB8.0 size=1048576 2024-03-09T14:28:44.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.505+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~U6NTJKOHGIB8.1 size=1048576 2024-03-09T14:28:44.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.506+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~U6NTJKOHGIB8.2 size=82240 2024-03-09T14:28:44.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.508+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=U6NTJKOHGIB8 tag=5WTYDCZ7KYCB type=write size=3227968 2024-03-09T14:28:44.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.510+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~VIGAVUJK1YA9.0 size=1048576 2024-03-09T14:28:44.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.511+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~VIGAVUJK1YA9.1 size=55284 2024-03-09T14:28:44.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.511+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=VIGAVUJK1YA9 tag=JHVMEHP28W8T type=write size=2152436 2024-03-09T14:28:44.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.513+0000 7f1c6444c780 1 < suggested update operation key=35Y98D5U0M8O tag=302TKAQQ1F1U type=write size=908279 2024-03-09T14:28:44.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.514+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=XH5FJ3JSTQ1M type=del size=764043 2024-03-09T14:28:44.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.515+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=YCQQBO94411J type=del 2024-03-09T14:28:44.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.517+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~51VPU8JY2QZV.0 size=1048576 2024-03-09T14:28:44.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.518+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~51VPU8JY2QZV.1 size=1048576 2024-03-09T14:28:44.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.519+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~51VPU8JY2QZV.2 size=10137 2024-03-09T14:28:44.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.519+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=51VPU8JY2QZV tag=VFS7NQY1695G type=write size=3155865 2024-03-09T14:28:44.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.521+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=403DRCZAOQ34 type=del size=2785904 2024-03-09T14:28:44.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.522+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=QT0YE8NNK5G9 type=write size=990099 2024-03-09T14:28:44.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.524+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~S3EDTC56TO3W.0 size=1048576 2024-03-09T14:28:44.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.524+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~S3EDTC56TO3W.1 size=1048576 2024-03-09T14:28:44.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.524+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~S3EDTC56TO3W.2 size=585431 2024-03-09T14:28:44.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.526+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=S3EDTC56TO3W tag=HP3O6QVEEDUS type=write size=3731159 2024-03-09T14:28:44.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.528+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=FON8QAIIR42E type=del size=1737348 2024-03-09T14:28:44.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.529+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~TTA3VBI9L8OA.0 size=1048576 2024-03-09T14:28:44.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.530+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~TTA3VBI9L8OA.1 size=1048576 2024-03-09T14:28:44.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.530+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~TTA3VBI9L8OA.2 size=901870 2024-03-09T14:28:44.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.532+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=TTA3VBI9L8OA tag=4DKWYBPXVKSY type=write size=4047598 2024-03-09T14:28:44.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.534+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~MXWBRRE6VQCR.0 size=754548 2024-03-09T14:28:44.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.534+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=MXWBRRE6VQCR tag=O8QK1TSR34CH type=write size=1803124 2024-03-09T14:28:44.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.537+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=6ZGLIFNMT35P type=del size=1338233 2024-03-09T14:28:44.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.539+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~98THXZY66ZEI.0 size=1048576 2024-03-09T14:28:44.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.540+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~98THXZY66ZEI.1 size=1048576 2024-03-09T14:28:44.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.540+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~98THXZY66ZEI.2 size=484836 2024-03-09T14:28:44.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.540+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=98THXZY66ZEI tag=K9NRGESRHSBV type=write size=3630564 2024-03-09T14:28:44.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.542+0000 7f1c6444c780 -1 < failed to complete operation key=0ZZ0P8Y7KSAX tag=2EUK62H15A8P type=del size=854415: (22) Invalid argument 2024-03-09T14:28:44.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.543+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=B1U509V02ZI8 type=write size=73902 2024-03-09T14:28:44.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.544+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=TL5VD1ZFMKLO type=write size=197750 2024-03-09T14:28:44.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.548+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=WDS43AAH733D type=del size=895734 2024-03-09T14:28:44.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.551+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=2WGDEDZY6I24 type=del 2024-03-09T14:28:44.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.552+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=13EEXZTFFN79 type=del size=567201 2024-03-09T14:28:44.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.553+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~AKYUNZI6O0V0.0 size=1046576 2024-03-09T14:28:44.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.555+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=AKYUNZI6O0V0 tag=GX7RBZOBIJA4 type=write size=2095152 2024-03-09T14:28:44.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.556+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=AZFZJLP1DW9G type=del size=2942350 2024-03-09T14:28:44.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.558+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~FWPA15YYBM7C.0 size=809371 2024-03-09T14:28:44.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.560+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=FWPA15YYBM7C tag=EFQGQIQWF2FH type=write size=1857947 2024-03-09T14:28:44.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.562+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~9X6CG258WJZL.0 size=1048576 2024-03-09T14:28:44.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.563+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~9X6CG258WJZL.1 size=1048576 2024-03-09T14:28:44.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.564+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~9X6CG258WJZL.2 size=109906 2024-03-09T14:28:44.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.564+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=9X6CG258WJZL tag=7IH7HTKQ3H96 type=write size=3255634 2024-03-09T14:28:44.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.565+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~MX1CSJCBMYHX.0 size=245245 2024-03-09T14:28:44.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.567+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=MX1CSJCBMYHX tag=8UIOU97RHX4T type=write size=1293821 2024-03-09T14:28:44.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.568+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=VUT1EDJ469US type=del size=3241484 2024-03-09T14:28:44.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.569+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=VMONHDVK1Z50 type=del 2024-03-09T14:28:44.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.570+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=USZK2K13M9W0 type=del size=2429112 2024-03-09T14:28:44.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.572+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=D5D150C83ERN type=del 2024-03-09T14:28:44.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.573+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=40BVC1JCF96P type=del size=1905126 2024-03-09T14:28:44.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.574+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~AE6146FBIG0N.0 size=347785 2024-03-09T14:28:44.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.576+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=AE6146FBIG0N tag=OEGS3VZJ15XK type=write size=1396361 2024-03-09T14:28:44.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.577+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=M6SM3N05K4ST type=del size=1699923 2024-03-09T14:28:44.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.579+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~VIGAVUJK1YA9.0 size=1048576 2024-03-09T14:28:44.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.580+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~VIGAVUJK1YA9.1 size=55284 2024-03-09T14:28:44.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.582+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=VIGAVUJK1YA9 tag=JHVMEHP28W8T type=write size=2152436 2024-03-09T14:28:44.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.583+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=0D1ZT8BAUMXK type=del size=93236 2024-03-09T14:28:44.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.584+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=XH5FJ3JSTQ1M type=del 2024-03-09T14:28:44.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.587+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=QK5R2B0I65Q5 type=del size=3393357 2024-03-09T14:28:44.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.588+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~51VPU8JY2QZV.0 size=1048576 2024-03-09T14:28:44.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.589+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~51VPU8JY2QZV.1 size=1048576 2024-03-09T14:28:44.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.590+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~51VPU8JY2QZV.2 size=10137 2024-03-09T14:28:44.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.592+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=51VPU8JY2QZV tag=VFS7NQY1695G type=write size=3155865 2024-03-09T14:28:44.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.593+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=SN21V5H1WKT6 type=del size=3157302 2024-03-09T14:28:44.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.595+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=QT0YE8NNK5G9 type=write size=990099 2024-03-09T14:28:44.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.597+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~ZW61T24TOXNV.0 size=1048576 2024-03-09T14:28:44.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.598+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~ZW61T24TOXNV.1 size=1048576 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.599+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~ZW61T24TOXNV.2 size=822709 2024-03-09T14:28:44.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.599+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=ZW61T24TOXNV tag=EMRL8UYVBSK9 type=write size=3968437 2024-03-09T14:28:44.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.600+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=FON8QAIIR42E type=del 2024-03-09T14:28:44.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.603+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~ZGOHS0IEXJ3Q.0 size=804077 2024-03-09T14:28:44.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.603+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=ZGOHS0IEXJ3Q tag=RWXA07YD6AW1 type=write size=1852653 2024-03-09T14:28:44.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.604+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~MXWBRRE6VQCR.0 size=754548 2024-03-09T14:28:44.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.606+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=MXWBRRE6VQCR tag=O8QK1TSR34CH type=write size=1803124 2024-03-09T14:28:44.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.609+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~JYU5FGZ7KV8K.0 size=1048576 2024-03-09T14:28:44.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.610+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~JYU5FGZ7KV8K.1 size=1048576 2024-03-09T14:28:44.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.610+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~JYU5FGZ7KV8K.2 size=717094 2024-03-09T14:28:44.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.610+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=JYU5FGZ7KV8K tag=54AV2L619XSK type=write size=3862822 2024-03-09T14:28:44.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.612+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~98THXZY66ZEI.0 size=1048576 2024-03-09T14:28:44.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.612+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~98THXZY66ZEI.1 size=1048576 2024-03-09T14:28:44.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.612+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~98THXZY66ZEI.2 size=484836 2024-03-09T14:28:44.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.614+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=98THXZY66ZEI tag=K9NRGESRHSBV type=write size=3630564 2024-03-09T14:28:44.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.615+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=OYCG12A25D2S type=write size=900715 2024-03-09T14:28:44.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.617+0000 7f1c6444c780 1 < suggested remove operation key=EREG1M13901A tag=B1U509V02ZI8 type=write 2024-03-09T14:28:44.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.618+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=DOHLLMP5YN6J type=del size=4143206 2024-03-09T14:28:44.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.619+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=WDS43AAH733D type=del 2024-03-09T14:28:44.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.620+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=PWMWU7UX5QXQ type=write size=306439 2024-03-09T14:28:44.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.622+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=13EEXZTFFN79 type=del 2024-03-09T14:28:44.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.624+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~Z134YJDNWEUT.0 size=1048576 2024-03-09T14:28:44.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.625+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~Z134YJDNWEUT.1 size=368033 2024-03-09T14:28:44.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.625+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=Z134YJDNWEUT tag=74WUX44WTEJW type=write size=2465185 2024-03-09T14:28:44.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.626+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=AZFZJLP1DW9G type=del 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.628+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~X7OQM14I2IGH.0 size=1048576 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.629+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~X7OQM14I2IGH.1 size=1048576 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.630+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~X7OQM14I2IGH.2 size=263642 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.630+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=X7OQM14I2IGH tag=I9QF2Y12B462 type=write size=3409370 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.630+0000 7f1c6444c780 1 < canceled part key=_multipart_49YOZGJ8XC4K.2~9X6CG258WJZL.0 size=1048576 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.630+0000 7f1c6444c780 1 < canceled part key=_multipart_49YOZGJ8XC4K.2~9X6CG258WJZL.1 size=1048576 2024-03-09T14:28:44.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.631+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~9X6CG258WJZL.2 size=109906 2024-03-09T14:28:44.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.633+0000 7f1c6444c780 1 < canceled multipart upload key=49YOZGJ8XC4K upload=9X6CG258WJZL tag=7IH7HTKQ3H96 type=write size=3255634 2024-03-09T14:28:44.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.635+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=6RZ7XWNRX77C type=write size=425443 2024-03-09T14:28:44.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.636+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=VUT1EDJ469US type=del 2024-03-09T14:28:44.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.637+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=WMCUW7IFCR83 type=del size=1140288 2024-03-09T14:28:44.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.639+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=USZK2K13M9W0 type=del 2024-03-09T14:28:44.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.640+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=M3IOXZL52PRB type=del size=529068 2024-03-09T14:28:44.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.641+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=40BVC1JCF96P type=del 2024-03-09T14:28:44.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.643+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=MPT5YLED0F0N type=del size=1283918 2024-03-09T14:28:44.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.644+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=M6SM3N05K4ST type=del 2024-03-09T14:28:44.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.647+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~XXGK4V2FHT8G.0 size=1048576 2024-03-09T14:28:44.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.647+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~XXGK4V2FHT8G.1 size=1048576 2024-03-09T14:28:44.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.648+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~XXGK4V2FHT8G.2 size=339514 2024-03-09T14:28:44.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.648+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=XXGK4V2FHT8G tag=9ZOOEVZUN2AO type=write size=3485242 2024-03-09T14:28:44.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.649+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=0D1ZT8BAUMXK type=del 2024-03-09T14:28:44.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.651+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=CPU2JAMJ35H1 type=write size=21574 2024-03-09T14:28:44.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.653+0000 7f1c6444c780 1 < suggested remove operation key=35Y98D5U0M8O tag=QK5R2B0I65Q5 type=del 2024-03-09T14:28:44.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.655+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~VP6C7USZE121.0 size=1048576 2024-03-09T14:28:44.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.656+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~VP6C7USZE121.1 size=1007376 2024-03-09T14:28:44.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.656+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=VP6C7USZE121 tag=TW84HTTMZS2Y type=write size=3104528 2024-03-09T14:28:44.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.657+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=SN21V5H1WKT6 type=del 2024-03-09T14:28:44.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.659+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~M0TLH52Z1ZI5.0 size=1048576 2024-03-09T14:28:44.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.660+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~M0TLH52Z1ZI5.1 size=656252 2024-03-09T14:28:44.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.660+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=M0TLH52Z1ZI5 tag=Q4GUWX7L8OM6 type=write size=2753404 2024-03-09T14:28:44.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.661+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~ZW61T24TOXNV.0 size=1048576 2024-03-09T14:28:44.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.662+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~ZW61T24TOXNV.1 size=1048576 2024-03-09T14:28:44.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.663+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~ZW61T24TOXNV.2 size=822709 2024-03-09T14:28:44.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.665+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=ZW61T24TOXNV tag=EMRL8UYVBSK9 type=write size=3968437 2024-03-09T14:28:44.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.666+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=LKTDCUV8CX80 type=del size=3708688 2024-03-09T14:28:44.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.667+0000 7f1c6444c780 1 < canceled part key=_multipart_KNOEGKSERB6Z.2~ZGOHS0IEXJ3Q.0 size=804077 2024-03-09T14:28:44.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.669+0000 7f1c6444c780 1 < canceled multipart upload key=KNOEGKSERB6Z upload=ZGOHS0IEXJ3Q tag=RWXA07YD6AW1 type=write size=1852653 2024-03-09T14:28:44.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.670+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=30ZB52D8DA9T type=write size=991332 2024-03-09T14:28:44.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.671+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~JYU5FGZ7KV8K.0 size=1048576 2024-03-09T14:28:44.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.672+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~JYU5FGZ7KV8K.1 size=1048576 2024-03-09T14:28:44.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.673+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~JYU5FGZ7KV8K.2 size=717094 2024-03-09T14:28:44.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.675+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=JYU5FGZ7KV8K tag=54AV2L619XSK type=write size=3862822 2024-03-09T14:28:44.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.676+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=ZFU3WWT01XU1 type=write size=93814 2024-03-09T14:28:44.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.678+0000 7f1c6444c780 1 < suggested update operation key=Z34QOCZB3DFX tag=OYCG12A25D2S type=write size=900715 2024-03-09T14:28:44.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.680+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~BVWJKUH3XRX3.0 size=43424 2024-03-09T14:28:44.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.680+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=BVWJKUH3XRX3 tag=V5UZFHZW2ZGM type=write size=1092000 2024-03-09T14:28:44.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.683+0000 7f1c6444c780 1 < suggested remove operation key=HNK7POWS6FSU tag=DOHLLMP5YN6J type=del 2024-03-09T14:28:44.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.684+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=MOOEJS8QAMZK type=del size=3667040 2024-03-09T14:28:44.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.685+0000 7f1c6444c780 1 < completed write operation key=CVD0EGQUVJYR tag=PWMWU7UX5QXQ type=write size=306439 2024-03-09T14:28:44.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.686+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=LA0ISUH044IQ type=del size=2059124 2024-03-09T14:28:44.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.686+0000 7f1c6444c780 1 < canceled part key=_multipart_VL5EUQ52WRAN.2~Z134YJDNWEUT.0 size=1048576 2024-03-09T14:28:44.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.687+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~Z134YJDNWEUT.1 size=368033 2024-03-09T14:28:44.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.689+0000 7f1c6444c780 1 < canceled multipart upload key=VL5EUQ52WRAN upload=Z134YJDNWEUT tag=74WUX44WTEJW type=write size=2465185 2024-03-09T14:28:44.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.691+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=NQCENTMKQQCN type=del size=2139233 2024-03-09T14:28:44.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.692+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~X7OQM14I2IGH.0 size=1048576 2024-03-09T14:28:44.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.693+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~X7OQM14I2IGH.1 size=1048576 2024-03-09T14:28:44.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.694+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~X7OQM14I2IGH.2 size=263642 2024-03-09T14:28:44.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.696+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=X7OQM14I2IGH tag=I9QF2Y12B462 type=write size=3409370 2024-03-09T14:28:44.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.699+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~HR3W8RSXIGOC.0 size=1048576 2024-03-09T14:28:44.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.700+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~HR3W8RSXIGOC.1 size=20465 2024-03-09T14:28:44.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.700+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=HR3W8RSXIGOC tag=TQDRDK5ACW88 type=write size=2117617 2024-03-09T14:28:44.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.701+0000 7f1c6444c780 1 < completed write operation key=NIN0FB6YTKWA tag=6RZ7XWNRX77C type=write size=425443 2024-03-09T14:28:44.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.703+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=S9LXLZAW4YEI type=del size=1491954 2024-03-09T14:28:44.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.704+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=WMCUW7IFCR83 type=del 2024-03-09T14:28:44.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.706+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~VYKBTJS13EVE.0 size=5041 2024-03-09T14:28:44.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.706+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=VYKBTJS13EVE tag=I6DIO9AXGCVG type=write size=1053617 2024-03-09T14:28:44.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.707+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=M3IOXZL52PRB type=del 2024-03-09T14:28:44.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.708+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=06OUI0KKZHP6 type=write size=118407 2024-03-09T14:28:44.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.709+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=MPT5YLED0F0N type=del 2024-03-09T14:28:44.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.711+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=EI8B03R29J3D type=del size=2183399 2024-03-09T14:28:44.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.711+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~XXGK4V2FHT8G.0 size=1048576 2024-03-09T14:28:44.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.712+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~XXGK4V2FHT8G.1 size=1048576 2024-03-09T14:28:44.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.713+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~XXGK4V2FHT8G.2 size=339514 2024-03-09T14:28:44.715 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.715+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=XXGK4V2FHT8G tag=9ZOOEVZUN2AO type=write size=3485242 2024-03-09T14:28:44.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.716+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=LB6ZEC28DGDH type=del size=699111 2024-03-09T14:28:44.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.717+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=CPU2JAMJ35H1 type=write size=21574 2024-03-09T14:28:44.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.718+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=489OF1A0FKW6 type=del size=1189130 2024-03-09T14:28:44.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.719+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~VP6C7USZE121.0 size=1048576 2024-03-09T14:28:44.720 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.720+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~VP6C7USZE121.1 size=1007376 2024-03-09T14:28:44.722 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.722+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=VP6C7USZE121 tag=TW84HTTMZS2Y type=write size=3104528 2024-03-09T14:28:44.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.724+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=8EGC6U1UUJ7Q type=del size=2694457 2024-03-09T14:28:44.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.725+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~M0TLH52Z1ZI5.0 size=1048576 2024-03-09T14:28:44.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.725+0000 7f1c6444c780 1 < canceled part key=_multipart_PBM4ICXZ2497.2~M0TLH52Z1ZI5.1 size=656252 2024-03-09T14:28:44.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.727+0000 7f1c6444c780 1 < canceled multipart upload key=PBM4ICXZ2497 upload=M0TLH52Z1ZI5 tag=Q4GUWX7L8OM6 type=write size=2753404 2024-03-09T14:28:44.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.728+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=EB65ZX9DXBUO type=del size=1796275 2024-03-09T14:28:44.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.729+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=LKTDCUV8CX80 type=del 2024-03-09T14:28:44.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.730+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=2E523D2AR9EK type=del size=1152833 2024-03-09T14:28:44.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.732+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=30ZB52D8DA9T type=write size=991332 2024-03-09T14:28:44.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.733+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=RJSMA4H2DMU3 type=del size=1675809 2024-03-09T14:28:44.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.734+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=ZFU3WWT01XU1 type=write size=93814 2024-03-09T14:28:44.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.735+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=AL3GICNGGYAH type=write size=992454 2024-03-09T14:28:44.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.735+0000 7f1c6444c780 1 < canceled part key=_multipart_HNK7POWS6FSU.2~BVWJKUH3XRX3.0 size=43424 2024-03-09T14:28:44.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.737+0000 7f1c6444c780 1 < canceled multipart upload key=HNK7POWS6FSU upload=BVWJKUH3XRX3 tag=V5UZFHZW2ZGM type=write size=1092000 2024-03-09T14:28:44.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.739+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~CKSARX539UGA.0 size=1048576 2024-03-09T14:28:44.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.740+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~CKSARX539UGA.1 size=806751 2024-03-09T14:28:44.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.740+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=CKSARX539UGA tag=8EIQ6Q2ZFFPO type=write size=2903903 2024-03-09T14:28:44.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.741+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=MOOEJS8QAMZK type=del 2024-03-09T14:28:44.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.744+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~HES8WGAKGPXF.0 size=74527 2024-03-09T14:28:44.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.744+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=HES8WGAKGPXF tag=2WW8MJCSVHN4 type=write size=1123103 2024-03-09T14:28:44.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.745+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=LA0ISUH044IQ type=del 2024-03-09T14:28:44.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.746+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=8T4V0ZZ80KDK type=del size=2812370 2024-03-09T14:28:44.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.747+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=NQCENTMKQQCN type=del 2024-03-09T14:28:44.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.748+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=38A651I6F8TT type=del size=2176917 2024-03-09T14:28:44.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.748+0000 7f1c6444c780 1 < canceled part key=_multipart_MOVS6ZMK708G.2~HR3W8RSXIGOC.0 size=1048576 2024-03-09T14:28:44.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.749+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~HR3W8RSXIGOC.1 size=20465 2024-03-09T14:28:44.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.751+0000 7f1c6444c780 1 < canceled multipart upload key=MOVS6ZMK708G upload=HR3W8RSXIGOC tag=TQDRDK5ACW88 type=write size=2117617 2024-03-09T14:28:44.752 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.752+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=F6MHFK0ITA42 type=del size=3540921 2024-03-09T14:28:44.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.755+0000 7f1c6444c780 1 < suggested update operation key=YK7ENO4UAB2M tag=S9LXLZAW4YEI type=del size=1491954 2024-03-09T14:28:44.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.756+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=Z2IQGYKG33XL type=del size=1844227 2024-03-09T14:28:44.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.757+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~VYKBTJS13EVE.0 size=5041 2024-03-09T14:28:44.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.759+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=VYKBTJS13EVE tag=I6DIO9AXGCVG type=write size=1053617 2024-03-09T14:28:44.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.760+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=XJZTNAN1F4FY type=del size=567537 2024-03-09T14:28:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.761+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=06OUI0KKZHP6 type=write size=118407 2024-03-09T14:28:44.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.762+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=Q7IO9EJ5HB9K type=write size=617270 2024-03-09T14:28:44.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.763+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=EI8B03R29J3D type=del 2024-03-09T14:28:44.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.765+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=RFSC52GYY7PO type=del size=1972637 2024-03-09T14:28:44.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.767+0000 7f1c6444c780 1 < suggested update operation key=YK7ENO4UAB2M tag=LB6ZEC28DGDH type=del size=699111 2024-03-09T14:28:44.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.768+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=H60XANUTE65T type=del size=3484164 2024-03-09T14:28:44.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.771+0000 7f1c6444c780 1 < suggested update operation key=HPFPL79B0GLS tag=489OF1A0FKW6 type=del size=1189130 2024-03-09T14:28:44.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.773+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~05SLDDYM0Y8F.0 size=725587 2024-03-09T14:28:44.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.773+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=05SLDDYM0Y8F tag=5X6EQ5S5YNV7 type=write size=1774163 2024-03-09T14:28:44.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.774+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=8EGC6U1UUJ7Q type=del 2024-03-09T14:28:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.775+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=GWLYGAWHMPIN type=write size=494454 2024-03-09T14:28:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.777+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=EB65ZX9DXBUO type=del 2024-03-09T14:28:44.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.779+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~G6MR4HPC62FM.0 size=1048576 2024-03-09T14:28:44.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.780+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~G6MR4HPC62FM.1 size=803781 2024-03-09T14:28:44.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.780+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=G6MR4HPC62FM tag=663QT7F2F7ZD type=write size=2900933 2024-03-09T14:28:44.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.781+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=2E523D2AR9EK type=del 2024-03-09T14:28:44.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.782+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=M4MNU8KFYQO2 type=del size=2744664 2024-03-09T14:28:44.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.783+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=RJSMA4H2DMU3 type=del 2024-03-09T14:28:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.785+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~UTYXP8SXVQ9Y.0 size=714728 2024-03-09T14:28:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.785+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=UTYXP8SXVQ9Y tag=REQPA7UUT18V type=write size=1763304 2024-03-09T14:28:44.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.786+0000 7f1c6444c780 1 < completed write operation key=EREG1M13901A tag=AL3GICNGGYAH type=write size=992454 2024-03-09T14:28:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.789+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~YBVVJCDO3VJG.0 size=1048576 2024-03-09T14:28:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.789+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~YBVVJCDO3VJG.1 size=754971 2024-03-09T14:28:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.789+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=YBVVJCDO3VJG tag=6Y56RMTFE7BM type=write size=2852123 2024-03-09T14:28:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.791+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~CKSARX539UGA.0 size=1048576 2024-03-09T14:28:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.792+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~CKSARX539UGA.1 size=806751 2024-03-09T14:28:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.793+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=CKSARX539UGA tag=8EIQ6Q2ZFFPO type=write size=2903903 2024-03-09T14:28:44.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.795+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~1D7X4YHNQN8F.0 size=1048576 2024-03-09T14:28:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.796+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~1D7X4YHNQN8F.1 size=376334 2024-03-09T14:28:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.796+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=1D7X4YHNQN8F tag=M17F256599O9 type=write size=2473486 2024-03-09T14:28:44.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.797+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~HES8WGAKGPXF.0 size=74527 2024-03-09T14:28:44.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.799+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=HES8WGAKGPXF tag=2WW8MJCSVHN4 type=write size=1123103 2024-03-09T14:28:44.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.800+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=8OG0L33V8R46 type=del size=1357467 2024-03-09T14:28:44.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.801+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=8T4V0ZZ80KDK type=del 2024-03-09T14:28:44.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.804+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~33ERCXRKPWRM.0 size=36851 2024-03-09T14:28:44.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.804+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=33ERCXRKPWRM tag=F2ZR8VNFXZ4A type=write size=1085427 2024-03-09T14:28:44.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.805+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=38A651I6F8TT type=del 2024-03-09T14:28:44.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.806+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=FV2IRE10YNWJ type=del size=2299228 2024-03-09T14:28:44.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.808+0000 7f1c6444c780 1 < suggested remove operation key=Z34QOCZB3DFX tag=F6MHFK0ITA42 type=del 2024-03-09T14:28:44.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.810+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=6CQA45XV0P3M type=del size=3129417 2024-03-09T14:28:44.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.811+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=Z2IQGYKG33XL type=del 2024-03-09T14:28:44.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.812+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=XBR36J8UW76U type=del size=2537521 2024-03-09T14:28:44.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.815+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=XJZTNAN1F4FY type=del 2024-03-09T14:28:44.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.816+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=4KT3190C8C2S type=del size=2337684 2024-03-09T14:28:44.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.817+0000 7f1c6444c780 -1 < failed to complete operation key=YK7ENO4UAB2M tag=Q7IO9EJ5HB9K type=write size=617270: (22) Invalid argument 2024-03-09T14:28:44.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.819+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=P02I0E7527S7 type=del size=816541 2024-03-09T14:28:44.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.820+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=RFSC52GYY7PO type=del 2024-03-09T14:28:44.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.821+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=OZCFX8LRULFI type=del size=208754 2024-03-09T14:28:44.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.822+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=H60XANUTE65T type=del 2024-03-09T14:28:44.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.823+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=CO5A1G47U2YL type=write size=710484 2024-03-09T14:28:44.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.824+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~05SLDDYM0Y8F.0 size=725587 2024-03-09T14:28:44.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.826+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=05SLDDYM0Y8F tag=5X6EQ5S5YNV7 type=write size=1774163 2024-03-09T14:28:44.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.828+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~9N13IOYZHVLJ.0 size=1032308 2024-03-09T14:28:44.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.828+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=9N13IOYZHVLJ tag=ZCEAB9YMX4VF type=write size=2080884 2024-03-09T14:28:44.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.829+0000 7f1c6444c780 1 < canceled operation key=YECG84AJ5IK2 tag=GWLYGAWHMPIN type=write size=494454 2024-03-09T14:28:44.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.831+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=J4X0MKC49297 type=del size=1743863 2024-03-09T14:28:44.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.832+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~G6MR4HPC62FM.0 size=1048576 2024-03-09T14:28:44.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.833+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~G6MR4HPC62FM.1 size=803781 2024-03-09T14:28:44.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.835+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=G6MR4HPC62FM tag=663QT7F2F7ZD type=write size=2900933 2024-03-09T14:28:44.836 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.836+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=9ARGU1V6B6TL type=del size=1236006 2024-03-09T14:28:44.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.838+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=M4MNU8KFYQO2 type=del size=2744664 2024-03-09T14:28:44.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.839+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=24QJ803WZ6OV type=del size=2665382 2024-03-09T14:28:44.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.840+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~UTYXP8SXVQ9Y.0 size=714728 2024-03-09T14:28:44.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.842+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=UTYXP8SXVQ9Y tag=REQPA7UUT18V type=write size=1763304 2024-03-09T14:28:44.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.843+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=TTFL4GNFV4CB type=del size=2338867 2024-03-09T14:28:44.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.845+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~YBVVJCDO3VJG.0 size=1048576 2024-03-09T14:28:44.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.845+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~YBVVJCDO3VJG.1 size=754971 2024-03-09T14:28:44.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.847+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=YBVVJCDO3VJG tag=6Y56RMTFE7BM type=write size=2852123 2024-03-09T14:28:44.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.849+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=EW73IL6PJFHZ type=del size=1701982 2024-03-09T14:28:44.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.850+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~1D7X4YHNQN8F.0 size=1048576 2024-03-09T14:28:44.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.851+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~1D7X4YHNQN8F.1 size=376334 2024-03-09T14:28:44.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.853+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=1D7X4YHNQN8F tag=M17F256599O9 type=write size=2473486 2024-03-09T14:28:44.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.855+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~0A6EJ02MMAZ8.0 size=1048576 2024-03-09T14:28:44.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.856+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~0A6EJ02MMAZ8.1 size=1048576 2024-03-09T14:28:44.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.856+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~0A6EJ02MMAZ8.2 size=69755 2024-03-09T14:28:44.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.856+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=0A6EJ02MMAZ8 tag=AKAIAGI9UBYK type=write size=3215483 2024-03-09T14:28:44.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.858+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=8OG0L33V8R46 type=del 2024-03-09T14:28:44.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.860+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~A3HLUDW5I25L.0 size=1048576 2024-03-09T14:28:44.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.861+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~A3HLUDW5I25L.1 size=427216 2024-03-09T14:28:44.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.861+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=A3HLUDW5I25L tag=AHMGW95NHU35 type=write size=2524368 2024-03-09T14:28:44.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.862+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~33ERCXRKPWRM.0 size=36851 2024-03-09T14:28:44.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.863+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=33ERCXRKPWRM tag=F2ZR8VNFXZ4A type=write size=1085427 2024-03-09T14:28:44.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.865+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=Q042Q1MILMH6 type=del size=2864713 2024-03-09T14:28:44.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.866+0000 7f1c6444c780 -1 < failed to complete operation key=V05XJ56M53T8 tag=FV2IRE10YNWJ type=del size=2299228: (22) Invalid argument 2024-03-09T14:28:44.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.867+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=70CCYHVG557N type=del size=3611632 2024-03-09T14:28:44.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.868+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=6CQA45XV0P3M type=del 2024-03-09T14:28:44.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.869+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=W6CBRFXI2N7O type=del size=1616792 2024-03-09T14:28:44.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.870+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=XBR36J8UW76U type=del 2024-03-09T14:28:44.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.871+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=JMRZ4YFEYVGC type=del size=607594 2024-03-09T14:28:44.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.873+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=4KT3190C8C2S type=del 2024-03-09T14:28:44.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.874+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=N3N498OJD2YV type=del size=2678395 2024-03-09T14:28:44.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.875+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=P02I0E7527S7 type=del 2024-03-09T14:28:44.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.877+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~BZUSU7ECRGKF.0 size=1048576 2024-03-09T14:28:44.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.878+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~BZUSU7ECRGKF.1 size=403180 2024-03-09T14:28:44.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.878+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=BZUSU7ECRGKF tag=HMMVUG9Q3ARW type=write size=2500332 2024-03-09T14:28:44.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.879+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=OZCFX8LRULFI type=del 2024-03-09T14:28:44.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.881+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~CHMDBC3Y4LW4.0 size=1048576 2024-03-09T14:28:44.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.882+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~CHMDBC3Y4LW4.1 size=1048576 2024-03-09T14:28:44.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.883+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~CHMDBC3Y4LW4.2 size=996846 2024-03-09T14:28:44.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.883+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=CHMDBC3Y4LW4 tag=91NDQ65M1N8K type=write size=4142574 2024-03-09T14:28:44.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.886+0000 7f1c6444c780 1 < suggested remove operation key=HPFPL79B0GLS tag=CO5A1G47U2YL type=write 2024-03-09T14:28:44.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.888+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~TTY7FX15SE6U.0 size=1048576 2024-03-09T14:28:44.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.889+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~TTY7FX15SE6U.1 size=1048576 2024-03-09T14:28:44.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.890+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~TTY7FX15SE6U.2 size=541384 2024-03-09T14:28:44.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.890+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=TTY7FX15SE6U tag=V52LUU27JXX5 type=write size=3687112 2024-03-09T14:28:44.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.892+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~9N13IOYZHVLJ.0 size=1032308 2024-03-09T14:28:44.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.894+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=9N13IOYZHVLJ tag=ZCEAB9YMX4VF type=write size=2080884 2024-03-09T14:28:44.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.895+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=QCZ6XBIMINGK type=del size=3461818 2024-03-09T14:28:44.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.896+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=J4X0MKC49297 type=del 2024-03-09T14:28:44.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.898+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=GTMB0B9F7R1B type=del size=643698 2024-03-09T14:28:44.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.899+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=9ARGU1V6B6TL type=del 2024-03-09T14:28:44.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.900+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=WT5YC7Z4OD7Y type=del size=1186786 2024-03-09T14:28:44.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.902+0000 7f1c6444c780 1 < suggested remove operation key=0ZZ0P8Y7KSAX tag=24QJ803WZ6OV type=del 2024-03-09T14:28:44.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.904+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=DALZ2W364F2G type=del size=2086800 2024-03-09T14:28:44.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.905+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=TTFL4GNFV4CB type=del 2024-03-09T14:28:44.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.906+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=6BP07D9UNCOK type=del size=1440033 2024-03-09T14:28:44.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.907+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=EW73IL6PJFHZ type=del size=1701982 2024-03-09T14:28:44.909 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.909+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=OFDTCXDNP3DZ type=del size=1503728 2024-03-09T14:28:44.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.910+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~0A6EJ02MMAZ8.0 size=1048576 2024-03-09T14:28:44.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.911+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~0A6EJ02MMAZ8.1 size=1048576 2024-03-09T14:28:44.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.912+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~0A6EJ02MMAZ8.2 size=69755 2024-03-09T14:28:44.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.915+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=0A6EJ02MMAZ8 tag=AKAIAGI9UBYK type=write size=3215483 2024-03-09T14:28:44.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.917+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~L0SEF52HOJHR.0 size=1048576 2024-03-09T14:28:44.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.918+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~L0SEF52HOJHR.1 size=417180 2024-03-09T14:28:44.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.918+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=L0SEF52HOJHR tag=KPUKIM4VGCK6 type=write size=2514332 2024-03-09T14:28:44.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.919+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~A3HLUDW5I25L.0 size=1048576 2024-03-09T14:28:44.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.921+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~A3HLUDW5I25L.1 size=427216 2024-03-09T14:28:44.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.923+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=A3HLUDW5I25L tag=AHMGW95NHU35 type=write size=2524368 2024-03-09T14:28:44.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.925+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=0O8A53DOGMRV type=write size=211980 2024-03-09T14:28:44.926 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.926+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=Q042Q1MILMH6 type=del 2024-03-09T14:28:44.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.928+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=MMJPKOQF1S3B type=del size=3513189 2024-03-09T14:28:44.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.930+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=70CCYHVG557N type=del 2024-03-09T14:28:44.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.932+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~D47N4KA8GI40.0 size=390302 2024-03-09T14:28:44.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.932+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=D47N4KA8GI40 tag=YJP8J5CYU9LO type=write size=1438878 2024-03-09T14:28:44.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.934+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=W6CBRFXI2N7O type=del 2024-03-09T14:28:44.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.935+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=F8PWHTOSTVZD type=del size=3054215 2024-03-09T14:28:44.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.936+0000 7f1c6444c780 1 < completed delete operation key=YK7ENO4UAB2M tag=JMRZ4YFEYVGC type=del 2024-03-09T14:28:44.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.938+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~0MCNBZLI4XE5.0 size=1048576 2024-03-09T14:28:44.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.939+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~0MCNBZLI4XE5.1 size=1048576 2024-03-09T14:28:44.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.940+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~0MCNBZLI4XE5.2 size=693779 2024-03-09T14:28:44.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.940+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=0MCNBZLI4XE5 tag=2KLBFZN88ZVS type=write size=3839507 2024-03-09T14:28:44.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.942+0000 7f1c6444c780 1 < suggested remove operation key=BAWV7KY6NT8P tag=N3N498OJD2YV type=del 2024-03-09T14:28:44.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.943+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=PU092P2Z0UID type=del size=5650 2024-03-09T14:28:44.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.944+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~BZUSU7ECRGKF.0 size=1048576 2024-03-09T14:28:44.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.945+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~BZUSU7ECRGKF.1 size=403180 2024-03-09T14:28:44.947 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.947+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=BZUSU7ECRGKF tag=HMMVUG9Q3ARW type=write size=2500332 2024-03-09T14:28:44.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.948+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=UW45BS35OXDS type=del size=570223 2024-03-09T14:28:44.949 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.949+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~CHMDBC3Y4LW4.0 size=1048576 2024-03-09T14:28:44.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.950+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~CHMDBC3Y4LW4.1 size=1048576 2024-03-09T14:28:44.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.950+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~CHMDBC3Y4LW4.2 size=996846 2024-03-09T14:28:44.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.951+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=CHMDBC3Y4LW4 tag=91NDQ65M1N8K type=write size=4142574 2024-03-09T14:28:44.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.953+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=TU5ALGOD1PU1 type=write size=735539 2024-03-09T14:28:44.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.954+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~TTY7FX15SE6U.0 size=1048576 2024-03-09T14:28:44.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.954+0000 7f1c6444c780 1 < canceled part key=_multipart_0ZZ0P8Y7KSAX.2~TTY7FX15SE6U.1 size=1048576 2024-03-09T14:28:44.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.955+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~TTY7FX15SE6U.2 size=541384 2024-03-09T14:28:44.957 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.957+0000 7f1c6444c780 1 < canceled multipart upload key=0ZZ0P8Y7KSAX upload=TTY7FX15SE6U tag=V52LUU27JXX5 type=write size=3687112 2024-03-09T14:28:44.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.958+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=7EGGCK9DGB1A type=del size=1892121 2024-03-09T14:28:44.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.961+0000 7f1c6444c780 1 < suggested update operation key=71FSR1CHFBO0 tag=QCZ6XBIMINGK type=del size=3461818 2024-03-09T14:28:44.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.962+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~6EEYOLP5N477.0 size=644685 2024-03-09T14:28:44.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.962+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=6EEYOLP5N477 tag=IFQC11JBVWYV type=write size=1693261 2024-03-09T14:28:44.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.964+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=GTMB0B9F7R1B type=del 2024-03-09T14:28:44.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.965+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~4MR8NBL778FQ.0 size=1048576 2024-03-09T14:28:44.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.966+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~4MR8NBL778FQ.1 size=1048576 2024-03-09T14:28:44.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.967+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~4MR8NBL778FQ.2 size=575557 2024-03-09T14:28:44.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.967+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=4MR8NBL778FQ tag=QM1Z8C2947Z2 type=write size=3721285 2024-03-09T14:28:44.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.968+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=WT5YC7Z4OD7Y type=del 2024-03-09T14:28:44.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.969+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=1KXV9O4YM7MG type=del size=132137 2024-03-09T14:28:44.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.971+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=DALZ2W364F2G type=del 2024-03-09T14:28:44.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.972+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=KV3ZYK4N3EQF type=del size=2766575 2024-03-09T14:28:44.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.974+0000 7f1c6444c780 1 < suggested remove operation key=HNK7POWS6FSU tag=6BP07D9UNCOK type=del 2024-03-09T14:28:44.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.977+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~8TK8UR67MKU3.0 size=1048576 2024-03-09T14:28:44.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.977+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~8TK8UR67MKU3.1 size=43973 2024-03-09T14:28:44.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.977+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=8TK8UR67MKU3 tag=JXPS4KZVOQFA type=write size=2141125 2024-03-09T14:28:44.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.979+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=OFDTCXDNP3DZ type=del 2024-03-09T14:28:44.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.980+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=91MNILFEFG5O type=write size=1033055 2024-03-09T14:28:44.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.981+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~L0SEF52HOJHR.0 size=1048576 2024-03-09T14:28:44.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.982+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~L0SEF52HOJHR.1 size=417180 2024-03-09T14:28:44.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.984+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=L0SEF52HOJHR tag=KPUKIM4VGCK6 type=write size=2514332 2024-03-09T14:28:44.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.985+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=BRJFLBQ20QKG type=del size=51942 2024-03-09T14:28:44.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.986+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=0O8A53DOGMRV type=write size=211980 2024-03-09T14:28:44.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.989+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~BTTBVFLYXDTV.0 size=1048576 2024-03-09T14:28:44.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.990+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~BTTBVFLYXDTV.1 size=1048576 2024-03-09T14:28:44.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.990+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~BTTBVFLYXDTV.2 size=382399 2024-03-09T14:28:44.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.990+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=BTTBVFLYXDTV tag=JQ6AQV6CRZY2 type=write size=3528127 2024-03-09T14:28:44.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.992+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=MMJPKOQF1S3B type=del 2024-03-09T14:28:44.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.993+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=8F0OEFPETIS9 type=del size=3273274 2024-03-09T14:28:44.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.994+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~D47N4KA8GI40.0 size=390302 2024-03-09T14:28:44.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.996+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=D47N4KA8GI40 tag=YJP8J5CYU9LO type=write size=1438878 2024-03-09T14:28:44.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.999+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~MWOEHDYX8BEP.0 size=1048576 2024-03-09T14:28:44.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.999+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~MWOEHDYX8BEP.1 size=749598 2024-03-09T14:28:45.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:44.999+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=MWOEHDYX8BEP tag=D65ZZ7JVGN22 type=write size=2846750 2024-03-09T14:28:45.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.001+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=F8PWHTOSTVZD type=del 2024-03-09T14:28:45.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.002+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=C9VIEEHXRWBV type=write size=401446 2024-03-09T14:28:45.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.003+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~0MCNBZLI4XE5.0 size=1048576 2024-03-09T14:28:45.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.004+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~0MCNBZLI4XE5.1 size=1048576 2024-03-09T14:28:45.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.005+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~0MCNBZLI4XE5.2 size=693779 2024-03-09T14:28:45.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.007+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=0MCNBZLI4XE5 tag=2KLBFZN88ZVS type=write size=3839507 2024-03-09T14:28:45.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.008+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=GMIVPI2HMEU7 type=del size=3127501 2024-03-09T14:28:45.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.009+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=PU092P2Z0UID type=del 2024-03-09T14:28:45.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.011+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~GGPAXOBTMLH1.0 size=1048576 2024-03-09T14:28:45.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.012+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~GGPAXOBTMLH1.1 size=1048576 2024-03-09T14:28:45.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.013+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~GGPAXOBTMLH1.2 size=410209 2024-03-09T14:28:45.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.013+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=GGPAXOBTMLH1 tag=XPU9SAK2VH11 type=write size=3555937 2024-03-09T14:28:45.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.015+0000 7f1c6444c780 1 < suggested update operation key=BYX1155MZ2LP tag=UW45BS35OXDS type=del size=570223 2024-03-09T14:28:45.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.016+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=5774L7DEBZLP type=del size=3784867 2024-03-09T14:28:45.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.018+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=TU5ALGOD1PU1 type=write size=735539 2024-03-09T14:28:45.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.019+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=V04E9BI5T6WP type=del size=3440052 2024-03-09T14:28:45.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.020+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=7EGGCK9DGB1A type=del 2024-03-09T14:28:45.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.021+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=M7YTN4VIHP6Y type=del size=3729230 2024-03-09T14:28:45.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.022+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~6EEYOLP5N477.0 size=644685 2024-03-09T14:28:45.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.024+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=6EEYOLP5N477 tag=IFQC11JBVWYV type=write size=1693261 2024-03-09T14:28:45.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.025+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=XUOHD38KWNDQ type=del size=2532979 2024-03-09T14:28:45.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.026+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~4MR8NBL778FQ.0 size=1048576 2024-03-09T14:28:45.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.027+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~4MR8NBL778FQ.1 size=1048576 2024-03-09T14:28:45.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.028+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~4MR8NBL778FQ.2 size=575557 2024-03-09T14:28:45.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.030+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=4MR8NBL778FQ tag=QM1Z8C2947Z2 type=write size=3721285 2024-03-09T14:28:45.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.033+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~2XOSYM14MNPK.0 size=1048576 2024-03-09T14:28:45.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.034+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~2XOSYM14MNPK.1 size=1048576 2024-03-09T14:28:45.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.035+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~2XOSYM14MNPK.2 size=96526 2024-03-09T14:28:45.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.035+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=2XOSYM14MNPK tag=LDU7T2XKJT4Y type=write size=3242254 2024-03-09T14:28:45.036 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.036+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=1KXV9O4YM7MG type=del 2024-03-09T14:28:45.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.038+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~K8DBDKAF9VB8.0 size=1048576 2024-03-09T14:28:45.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.039+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~K8DBDKAF9VB8.1 size=1048576 2024-03-09T14:28:45.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.040+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~K8DBDKAF9VB8.2 size=361546 2024-03-09T14:28:45.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.040+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=K8DBDKAF9VB8 tag=FS4IZFPXZCAK type=write size=3507274 2024-03-09T14:28:45.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.042+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=KV3ZYK4N3EQF type=del 2024-03-09T14:28:45.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.043+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=BGV5SGEHZYXI type=write size=396263 2024-03-09T14:28:45.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.044+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~8TK8UR67MKU3.0 size=1048576 2024-03-09T14:28:45.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.045+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~8TK8UR67MKU3.1 size=43973 2024-03-09T14:28:45.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.047+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=8TK8UR67MKU3 tag=JXPS4KZVOQFA type=write size=2141125 2024-03-09T14:28:45.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.048+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=6J2ZYM0EOT62 type=del size=3930017 2024-03-09T14:28:45.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.050+0000 7f1c6444c780 1 < suggested remove operation key=IBVEN2JEB49N tag=91MNILFEFG5O type=write 2024-03-09T14:28:45.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.051+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=KX0R5BRWEIAZ type=del size=1404618 2024-03-09T14:28:45.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.053+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=BRJFLBQ20QKG type=del 2024-03-09T14:28:45.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.055+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~YKYGPD3O0HLJ.0 size=859972 2024-03-09T14:28:45.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.055+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=YKYGPD3O0HLJ tag=WQGPU2FK1XGP type=write size=1908548 2024-03-09T14:28:45.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.056+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~BTTBVFLYXDTV.0 size=1048576 2024-03-09T14:28:45.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.057+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~BTTBVFLYXDTV.1 size=1048576 2024-03-09T14:28:45.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.058+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~BTTBVFLYXDTV.2 size=382399 2024-03-09T14:28:45.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.059+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=BTTBVFLYXDTV tag=JQ6AQV6CRZY2 type=write size=3528127 2024-03-09T14:28:45.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.061+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~PPVUFIWWEIFV.0 size=1048576 2024-03-09T14:28:45.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.062+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~PPVUFIWWEIFV.1 size=1048576 2024-03-09T14:28:45.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.063+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~PPVUFIWWEIFV.2 size=607658 2024-03-09T14:28:45.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.063+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=PPVUFIWWEIFV tag=5TEBTTOQL1IT type=write size=3753386 2024-03-09T14:28:45.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.064+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=8F0OEFPETIS9 type=del 2024-03-09T14:28:45.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.066+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~BFSKZB1FT2J4.0 size=1048576 2024-03-09T14:28:45.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.067+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~BFSKZB1FT2J4.1 size=1048576 2024-03-09T14:28:45.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.068+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~BFSKZB1FT2J4.2 size=756856 2024-03-09T14:28:45.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.068+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=BFSKZB1FT2J4 tag=CBJHYWQC4NP9 type=write size=3902584 2024-03-09T14:28:45.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.069+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~MWOEHDYX8BEP.0 size=1048576 2024-03-09T14:28:45.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.070+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~MWOEHDYX8BEP.1 size=749598 2024-03-09T14:28:45.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.072+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=MWOEHDYX8BEP tag=D65ZZ7JVGN22 type=write size=2846750 2024-03-09T14:28:45.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.073+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=6EAYFMOD0IQN type=write size=919807 2024-03-09T14:28:45.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.074+0000 7f1c6444c780 1 < completed write operation key=SGHNHOCYPM38 tag=C9VIEEHXRWBV type=write size=401446 2024-03-09T14:28:45.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.077+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~O4NXAS987QJO.0 size=263402 2024-03-09T14:28:45.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.077+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=O4NXAS987QJO tag=QE9YOILEAK69 type=write size=1311978 2024-03-09T14:28:45.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.078+0000 7f1c6444c780 -1 < failed to complete operation key=BYX1155MZ2LP tag=GMIVPI2HMEU7 type=del size=3127501: (22) Invalid argument 2024-03-09T14:28:45.080 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.080+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~4LLYVRHFS8FJ.0 size=1048576 2024-03-09T14:28:45.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.081+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~4LLYVRHFS8FJ.1 size=1048576 2024-03-09T14:28:45.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.082+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~4LLYVRHFS8FJ.2 size=214591 2024-03-09T14:28:45.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.082+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=4LLYVRHFS8FJ tag=XLX7TUEZ6W0G type=write size=3360319 2024-03-09T14:28:45.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.083+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~GGPAXOBTMLH1.0 size=1048576 2024-03-09T14:28:45.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.084+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~GGPAXOBTMLH1.1 size=1048576 2024-03-09T14:28:45.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.085+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~GGPAXOBTMLH1.2 size=410209 2024-03-09T14:28:45.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.087+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=GGPAXOBTMLH1 tag=XPU9SAK2VH11 type=write size=3555937 2024-03-09T14:28:45.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.089+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~DFM462NZA3Y0.0 size=521549 2024-03-09T14:28:45.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.089+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=DFM462NZA3Y0 tag=PCXMYARTJVC6 type=write size=1570125 2024-03-09T14:28:45.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.090+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=5774L7DEBZLP type=del 2024-03-09T14:28:45.091 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.091+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=4F928ARHJFLN type=del size=3970528 2024-03-09T14:28:45.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.093+0000 7f1c6444c780 1 < suggested remove operation key=35Y98D5U0M8O tag=V04E9BI5T6WP type=del 2024-03-09T14:28:45.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.095+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~3Z328AKQO4M1.0 size=1048576 2024-03-09T14:28:45.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.096+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~3Z328AKQO4M1.1 size=373070 2024-03-09T14:28:45.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.096+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=3Z328AKQO4M1 tag=J34DPD1LWGJB type=write size=2470222 2024-03-09T14:28:45.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.098+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=M7YTN4VIHP6Y type=del size=3729230 2024-03-09T14:28:45.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.099+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=WOPATBIOMPSJ type=del size=576839 2024-03-09T14:28:45.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.100+0000 7f1c6444c780 -1 < failed to complete operation key=35Y98D5U0M8O tag=XUOHD38KWNDQ type=del size=2532979: (22) Invalid argument 2024-03-09T14:28:45.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.101+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=XSG0C04L6YLJ type=write size=499559 2024-03-09T14:28:45.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.102+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~2XOSYM14MNPK.0 size=1048576 2024-03-09T14:28:45.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.103+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~2XOSYM14MNPK.1 size=1048576 2024-03-09T14:28:45.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.104+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~2XOSYM14MNPK.2 size=96526 2024-03-09T14:28:45.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.106+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=2XOSYM14MNPK tag=LDU7T2XKJT4Y type=write size=3242254 2024-03-09T14:28:45.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.107+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=6RJPMX3F0T7V type=del size=151136 2024-03-09T14:28:45.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.108+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~K8DBDKAF9VB8.0 size=1048576 2024-03-09T14:28:45.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.109+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~K8DBDKAF9VB8.1 size=1048576 2024-03-09T14:28:45.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.110+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~K8DBDKAF9VB8.2 size=361546 2024-03-09T14:28:45.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.112+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=K8DBDKAF9VB8 tag=FS4IZFPXZCAK type=write size=3507274 2024-03-09T14:28:45.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.113+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=OV80QQDRO214 type=del size=3413286 2024-03-09T14:28:45.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.114+0000 7f1c6444c780 1 < completed write operation key=HNK7POWS6FSU tag=BGV5SGEHZYXI type=write size=396263 2024-03-09T14:28:45.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.115+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=FN3L2DIOOA10 type=del size=2032517 2024-03-09T14:28:45.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.117+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=6J2ZYM0EOT62 type=del 2024-03-09T14:28:45.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.119+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~L8AG0CJRQRC3.0 size=1048576 2024-03-09T14:28:45.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.120+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~L8AG0CJRQRC3.1 size=1048576 2024-03-09T14:28:45.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.121+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~L8AG0CJRQRC3.2 size=919050 2024-03-09T14:28:45.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.121+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=L8AG0CJRQRC3 tag=HMQOA6KVOFLQ type=write size=4064778 2024-03-09T14:28:45.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.123+0000 7f1c6444c780 1 < suggested update operation key=MOVS6ZMK708G tag=KX0R5BRWEIAZ type=del size=1404618 2024-03-09T14:28:45.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.125+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~GU4BI74YH9IW.0 size=1048576 2024-03-09T14:28:45.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.126+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~GU4BI74YH9IW.1 size=751319 2024-03-09T14:28:45.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.126+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=GU4BI74YH9IW tag=GS8PFI2G9J32 type=write size=2848471 2024-03-09T14:28:45.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.127+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~YKYGPD3O0HLJ.0 size=859972 2024-03-09T14:28:45.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.129+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=YKYGPD3O0HLJ tag=WQGPU2FK1XGP type=write size=1908548 2024-03-09T14:28:45.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.130+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=4DG7OLPN5TDD type=del size=3028687 2024-03-09T14:28:45.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.131+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~PPVUFIWWEIFV.0 size=1048576 2024-03-09T14:28:45.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.132+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~PPVUFIWWEIFV.1 size=1048576 2024-03-09T14:28:45.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.133+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~PPVUFIWWEIFV.2 size=607658 2024-03-09T14:28:45.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.135+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=PPVUFIWWEIFV tag=5TEBTTOQL1IT type=write size=3753386 2024-03-09T14:28:45.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.138+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~KK2IROUFBWOR.0 size=1048576 2024-03-09T14:28:45.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.138+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~KK2IROUFBWOR.1 size=301618 2024-03-09T14:28:45.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.138+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=KK2IROUFBWOR tag=O9HKH4NATWVF type=write size=2398770 2024-03-09T14:28:45.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.140+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~BFSKZB1FT2J4.0 size=1048576 2024-03-09T14:28:45.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.141+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~BFSKZB1FT2J4.1 size=1048576 2024-03-09T14:28:45.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.142+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~BFSKZB1FT2J4.2 size=756856 2024-03-09T14:28:45.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.144+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=BFSKZB1FT2J4 tag=CBJHYWQC4NP9 type=write size=3902584 2024-03-09T14:28:45.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.145+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=LRGQHIZV4ETU type=del size=2337963 2024-03-09T14:28:45.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.146+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=35Y98D5U0M8O tag=6EAYFMOD0IQN type=write size=919807: (2) No such file or directory 2024-03-09T14:28:45.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.148+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~JDHHMUJ5IEMX.0 size=1048576 2024-03-09T14:28:45.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.148+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~JDHHMUJ5IEMX.1 size=1048576 2024-03-09T14:28:45.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.149+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~JDHHMUJ5IEMX.2 size=881731 2024-03-09T14:28:45.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.149+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=JDHHMUJ5IEMX tag=DWYR835Q3CUC type=write size=4027459 2024-03-09T14:28:45.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.150+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~O4NXAS987QJO.0 size=263402 2024-03-09T14:28:45.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.152+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=O4NXAS987QJO tag=QE9YOILEAK69 type=write size=1311978 2024-03-09T14:28:45.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.154+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=A8K2GVKBEOJD type=del size=373421 2024-03-09T14:28:45.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.155+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~4LLYVRHFS8FJ.0 size=1048576 2024-03-09T14:28:45.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.156+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~4LLYVRHFS8FJ.1 size=1048576 2024-03-09T14:28:45.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.157+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~4LLYVRHFS8FJ.2 size=214591 2024-03-09T14:28:45.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.159+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=4LLYVRHFS8FJ tag=XLX7TUEZ6W0G type=write size=3360319 2024-03-09T14:28:45.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.160+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=JST06TAY8JY0 type=del size=1163915 2024-03-09T14:28:45.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.161+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~DFM462NZA3Y0.0 size=521549 2024-03-09T14:28:45.163 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.163+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=DFM462NZA3Y0 tag=PCXMYARTJVC6 type=write size=1570125 2024-03-09T14:28:45.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.164+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=87G4SU4M13DR type=del size=1447400 2024-03-09T14:28:45.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.165+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=4F928ARHJFLN type=del 2024-03-09T14:28:45.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.166+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=7X3MSVSAK3JP type=del size=1443990 2024-03-09T14:28:45.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.168+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~3Z328AKQO4M1.0 size=1048576 2024-03-09T14:28:45.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.168+0000 7f1c6444c780 1 < canceled part key=_multipart_PBM4ICXZ2497.2~3Z328AKQO4M1.1 size=373070 2024-03-09T14:28:45.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.169+0000 7f1c6444c780 1 < canceled multipart upload key=PBM4ICXZ2497 upload=3Z328AKQO4M1 tag=J34DPD1LWGJB type=write size=2470222 2024-03-09T14:28:45.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.171+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=RE3PPK5UWZZP type=del size=3327696 2024-03-09T14:28:45.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.172+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=WOPATBIOMPSJ type=del 2024-03-09T14:28:45.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.173+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=2PCVYC711HP1 type=del size=3330465 2024-03-09T14:28:45.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.174+0000 7f1c6444c780 1 < completed write operation key=PBM4ICXZ2497 tag=XSG0C04L6YLJ type=write size=499559 2024-03-09T14:28:45.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.175+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=V988Q70GG652 type=del size=2241424 2024-03-09T14:28:45.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.176+0000 7f1c6444c780 1 < canceled operation key=VL5EUQ52WRAN tag=6RJPMX3F0T7V type=del size=151136 2024-03-09T14:28:45.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.177+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=1VRTWMJ93NV6 type=del size=2740744 2024-03-09T14:28:45.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.178+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=OV80QQDRO214 type=del 2024-03-09T14:28:45.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.179+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=8BT137ORIC4X type=del size=135901 2024-03-09T14:28:45.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.181+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=FN3L2DIOOA10 type=del 2024-03-09T14:28:45.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.182+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=Z965ASQU6TYA type=write size=308840 2024-03-09T14:28:45.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.183+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~L8AG0CJRQRC3.0 size=1048576 2024-03-09T14:28:45.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.184+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~L8AG0CJRQRC3.1 size=1048576 2024-03-09T14:28:45.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.185+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~L8AG0CJRQRC3.2 size=919050 2024-03-09T14:28:45.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.187+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=L8AG0CJRQRC3 tag=HMQOA6KVOFLQ type=write size=4064778 2024-03-09T14:28:45.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.189+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~4CIH27JVDWRX.0 size=1048576 2024-03-09T14:28:45.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.190+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~4CIH27JVDWRX.1 size=78403 2024-03-09T14:28:45.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.190+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=4CIH27JVDWRX tag=T1T8H27CQ0G0 type=write size=2175555 2024-03-09T14:28:45.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.191+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~GU4BI74YH9IW.0 size=1048576 2024-03-09T14:28:45.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.192+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~GU4BI74YH9IW.1 size=751319 2024-03-09T14:28:45.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.194+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=GU4BI74YH9IW tag=GS8PFI2G9J32 type=write size=2848471 2024-03-09T14:28:45.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.196+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~MWBQAM1L2S77.0 size=1048576 2024-03-09T14:28:45.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.196+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~MWBQAM1L2S77.1 size=6955 2024-03-09T14:28:45.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.196+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=MWBQAM1L2S77 tag=PXX2K2AH88G4 type=write size=2104107 2024-03-09T14:28:45.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.198+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=4DG7OLPN5TDD type=del 2024-03-09T14:28:45.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.200+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~PBJ82WHDNBBG.0 size=1048576 2024-03-09T14:28:45.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.201+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~PBJ82WHDNBBG.1 size=955153 2024-03-09T14:28:45.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.201+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=PBJ82WHDNBBG tag=MPKGYTF5VL1W type=write size=3052305 2024-03-09T14:28:45.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.201+0000 7f1c6444c780 1 < canceled part key=_multipart_CVD0EGQUVJYR.2~KK2IROUFBWOR.0 size=1048576 2024-03-09T14:28:45.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.202+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~KK2IROUFBWOR.1 size=301618 2024-03-09T14:28:45.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.204+0000 7f1c6444c780 1 < canceled multipart upload key=CVD0EGQUVJYR upload=KK2IROUFBWOR tag=O9HKH4NATWVF type=write size=2398770 2024-03-09T14:28:45.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.205+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=IPR6XHX9WNZT type=del size=997860 2024-03-09T14:28:45.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.206+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=LRGQHIZV4ETU type=del 2024-03-09T14:28:45.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.207+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=HPS4RV2RCSAX type=del size=3552647 2024-03-09T14:28:45.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.208+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~JDHHMUJ5IEMX.0 size=1048576 2024-03-09T14:28:45.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.208+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~JDHHMUJ5IEMX.1 size=1048576 2024-03-09T14:28:45.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.209+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~JDHHMUJ5IEMX.2 size=881731 2024-03-09T14:28:45.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.211+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=JDHHMUJ5IEMX tag=DWYR835Q3CUC type=write size=4027459 2024-03-09T14:28:45.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.212+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=EYG0WI9AQ8RW type=del size=2974439 2024-03-09T14:28:45.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.214+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=A8K2GVKBEOJD type=del 2024-03-09T14:28:45.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.216+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~9RK02VPFAOBX.0 size=1048576 2024-03-09T14:28:45.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.217+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~9RK02VPFAOBX.1 size=831677 2024-03-09T14:28:45.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.217+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=9RK02VPFAOBX tag=2N3O55V6YP2Y type=write size=2928829 2024-03-09T14:28:45.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.219+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=JST06TAY8JY0 type=del size=1163915 2024-03-09T14:28:45.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.221+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~3ZGT9UDY9V0P.0 size=1048576 2024-03-09T14:28:45.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.222+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~3ZGT9UDY9V0P.1 size=359315 2024-03-09T14:28:45.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.222+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=3ZGT9UDY9V0P tag=C693N5I8TW15 type=write size=2456467 2024-03-09T14:28:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.223+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=87G4SU4M13DR type=del size=1447400 2024-03-09T14:28:45.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.225+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=U6UQ3W280ONE type=del size=2713217 2024-03-09T14:28:45.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.226+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=7X3MSVSAK3JP type=del 2024-03-09T14:28:45.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.227+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=4NIDNTZ226K0 type=del size=527729 2024-03-09T14:28:45.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.228+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=RE3PPK5UWZZP type=del 2024-03-09T14:28:45.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.230+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~QHS8PCEZW2E9.0 size=1048576 2024-03-09T14:28:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.231+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~QHS8PCEZW2E9.1 size=798254 2024-03-09T14:28:45.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.231+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=QHS8PCEZW2E9 tag=II3NI382LIM6 type=write size=2895406 2024-03-09T14:28:45.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.232+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=2PCVYC711HP1 type=del 2024-03-09T14:28:45.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.233+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=DHNWK421J0OW type=del size=3553144 2024-03-09T14:28:45.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.235+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=V988Q70GG652 type=del 2024-03-09T14:28:45.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.236+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=ZPR15OQRZQB5 type=del size=1910802 2024-03-09T14:28:45.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.237+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=1VRTWMJ93NV6 type=del 2024-03-09T14:28:45.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.238+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=69SJQ0K99C3Y type=del size=2874132 2024-03-09T14:28:45.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.239+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=8BT137ORIC4X type=del 2024-03-09T14:28:45.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.240+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=IS7FBKJ7LYRA type=write size=658815 2024-03-09T14:28:45.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.241+0000 7f1c6444c780 1 < completed write operation key=KNOEGKSERB6Z tag=Z965ASQU6TYA type=write size=308840 2024-03-09T14:28:45.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.243+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=HAKNLXQFPK2B type=write size=735818 2024-03-09T14:28:45.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.245+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~4CIH27JVDWRX.0 size=1048576 2024-03-09T14:28:45.246 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.246+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~4CIH27JVDWRX.1 size=78403 2024-03-09T14:28:45.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.248+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=4CIH27JVDWRX tag=T1T8H27CQ0G0 type=write size=2175555 2024-03-09T14:28:45.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.249+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=Q8K7RQ92ZBXM type=write size=145493 2024-03-09T14:28:45.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.250+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~MWBQAM1L2S77.0 size=1048576 2024-03-09T14:28:45.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.251+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~MWBQAM1L2S77.1 size=6955 2024-03-09T14:28:45.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.253+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=MWBQAM1L2S77 tag=PXX2K2AH88G4 type=write size=2104107 2024-03-09T14:28:45.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.255+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~753I0M55WX05.0 size=1048576 2024-03-09T14:28:45.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.256+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~753I0M55WX05.1 size=1048576 2024-03-09T14:28:45.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.257+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~753I0M55WX05.2 size=806902 2024-03-09T14:28:45.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.257+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=753I0M55WX05 tag=0SMWFRZDHWSY type=write size=3952630 2024-03-09T14:28:45.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.258+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~PBJ82WHDNBBG.0 size=1048576 2024-03-09T14:28:45.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.259+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~PBJ82WHDNBBG.1 size=955153 2024-03-09T14:28:45.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.261+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=PBJ82WHDNBBG tag=MPKGYTF5VL1W type=write size=3052305 2024-03-09T14:28:45.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.263+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~85RCYWCDZH9F.0 size=393521 2024-03-09T14:28:45.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.263+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=85RCYWCDZH9F tag=B89AZ7ZQA1PJ type=write size=1442097 2024-03-09T14:28:45.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.264+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=IPR6XHX9WNZT type=del 2024-03-09T14:28:45.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.266+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~2F1FROLZT2YJ.0 size=1048576 2024-03-09T14:28:45.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.267+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~2F1FROLZT2YJ.1 size=1048576 2024-03-09T14:28:45.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.268+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~2F1FROLZT2YJ.2 size=924337 2024-03-09T14:28:45.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.268+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=2F1FROLZT2YJ tag=GRDZGKGZ7E17 type=write size=4070065 2024-03-09T14:28:45.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.270+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=HPS4RV2RCSAX type=del 2024-03-09T14:28:45.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.272+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~GI1W11MID91N.0 size=314375 2024-03-09T14:28:45.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.272+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=GI1W11MID91N tag=RD0EMB9RQT16 type=write size=1362951 2024-03-09T14:28:45.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.273+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=EYG0WI9AQ8RW type=del 2024-03-09T14:28:45.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.274+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=IJSTQEO32JS2 type=del size=1882192 2024-03-09T14:28:45.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.275+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~9RK02VPFAOBX.0 size=1048576 2024-03-09T14:28:45.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.276+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~9RK02VPFAOBX.1 size=831677 2024-03-09T14:28:45.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.279+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=9RK02VPFAOBX tag=2N3O55V6YP2Y type=write size=2928829 2024-03-09T14:28:45.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.280+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=FTIBL1WUQOYU type=del size=933568 2024-03-09T14:28:45.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.281+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~3ZGT9UDY9V0P.0 size=1048576 2024-03-09T14:28:45.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.282+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~3ZGT9UDY9V0P.1 size=359315 2024-03-09T14:28:45.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.284+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=3ZGT9UDY9V0P tag=C693N5I8TW15 type=write size=2456467 2024-03-09T14:28:45.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.286+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~7K80JMY0OZ3B.0 size=1048576 2024-03-09T14:28:45.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.287+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~7K80JMY0OZ3B.1 size=1048576 2024-03-09T14:28:45.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.288+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~7K80JMY0OZ3B.2 size=17269 2024-03-09T14:28:45.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.288+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=7K80JMY0OZ3B tag=60L1YONJQF8B type=write size=3162997 2024-03-09T14:28:45.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.289+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=U6UQ3W280ONE type=del 2024-03-09T14:28:45.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.290+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=T8Y5ZPG9Q3J2 type=del size=608213 2024-03-09T14:28:45.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.291+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=4NIDNTZ226K0 type=del 2024-03-09T14:28:45.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.292+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=SFNC8NTUIEN0 type=del size=1380616 2024-03-09T14:28:45.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.293+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~QHS8PCEZW2E9.0 size=1048576 2024-03-09T14:28:45.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.294+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~QHS8PCEZW2E9.1 size=798254 2024-03-09T14:28:45.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.296+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=QHS8PCEZW2E9 tag=II3NI382LIM6 type=write size=2895406 2024-03-09T14:28:45.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.297+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=R17BTGPOXTYL type=del size=597649 2024-03-09T14:28:45.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.300+0000 7f1c6444c780 1 < suggested update operation key=JX05U3G6NLLO tag=DHNWK421J0OW type=del size=3553144 2024-03-09T14:28:45.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.301+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=GKVQVTPYRZ0R type=del size=3813330 2024-03-09T14:28:45.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.302+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=ZPR15OQRZQB5 type=del 2024-03-09T14:28:45.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.304+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~2HLW4SJGDCY3.0 size=1048576 2024-03-09T14:28:45.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.305+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~2HLW4SJGDCY3.1 size=1003861 2024-03-09T14:28:45.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.305+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=2HLW4SJGDCY3 tag=NHK2V035ARY3 type=write size=3101013 2024-03-09T14:28:45.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.306+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=69SJQ0K99C3Y type=del 2024-03-09T14:28:45.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.308+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~XFAL78IXRO50.0 size=634097 2024-03-09T14:28:45.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.308+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=XFAL78IXRO50 tag=B4VQC33V5VSS type=write size=1682673 2024-03-09T14:28:45.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.310+0000 7f1c6444c780 1 < completed write operation key=KMX7TNIOKWOA tag=IS7FBKJ7LYRA type=write size=658815 2024-03-09T14:28:45.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.311+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=QDZA0W71LWIT type=del size=2537577 2024-03-09T14:28:45.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.312+0000 7f1c6444c780 1 < completed write operation key=WMO6LTCMVXD2 tag=HAKNLXQFPK2B type=write size=735818 2024-03-09T14:28:45.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.313+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=ACIQCI7OFX8H type=del size=2384561 2024-03-09T14:28:45.314 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.314+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=Q8K7RQ92ZBXM type=write size=145493 2024-03-09T14:28:45.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.315+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=UDE40THCNNM8 type=del size=4092693 2024-03-09T14:28:45.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.317+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~753I0M55WX05.0 size=1048576 2024-03-09T14:28:45.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.317+0000 7f1c6444c780 1 < canceled part key=_multipart_0ZZ0P8Y7KSAX.2~753I0M55WX05.1 size=1048576 2024-03-09T14:28:45.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.318+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~753I0M55WX05.2 size=806902 2024-03-09T14:28:45.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.319+0000 7f1c6444c780 1 < canceled multipart upload key=0ZZ0P8Y7KSAX upload=753I0M55WX05 tag=0SMWFRZDHWSY type=write size=3952630 2024-03-09T14:28:45.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.321+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=7DZ5EP5M80AP type=write size=341551 2024-03-09T14:28:45.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.322+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~85RCYWCDZH9F.0 size=393521 2024-03-09T14:28:45.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.324+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=85RCYWCDZH9F tag=B89AZ7ZQA1PJ type=write size=1442097 2024-03-09T14:28:45.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.325+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=XTMR3RUAN8SW type=del size=1167377 2024-03-09T14:28:45.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.326+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~2F1FROLZT2YJ.0 size=1048576 2024-03-09T14:28:45.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.327+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~2F1FROLZT2YJ.1 size=1048576 2024-03-09T14:28:45.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.328+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~2F1FROLZT2YJ.2 size=924337 2024-03-09T14:28:45.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.330+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=2F1FROLZT2YJ tag=GRDZGKGZ7E17 type=write size=4070065 2024-03-09T14:28:45.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.332+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~92U1FVGZUMDX.0 size=98830 2024-03-09T14:28:45.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.332+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=92U1FVGZUMDX tag=JTPYS0HBLJ01 type=write size=1147406 2024-03-09T14:28:45.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.333+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~GI1W11MID91N.0 size=314375 2024-03-09T14:28:45.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.335+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=GI1W11MID91N tag=RD0EMB9RQT16 type=write size=1362951 2024-03-09T14:28:45.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.336+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=1BRTU2IP11U2 type=del size=805972 2024-03-09T14:28:45.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.338+0000 7f1c6444c780 1 < suggested remove operation key=MX3X6ILR7J8N tag=IJSTQEO32JS2 type=del 2024-03-09T14:28:45.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.339+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=YMY4A4F0EUC5 type=del size=3169454 2024-03-09T14:28:45.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.340+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=FTIBL1WUQOYU type=del 2024-03-09T14:28:45.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.342+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=LTB409PBE2PY type=del size=2525764 2024-03-09T14:28:45.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.343+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~7K80JMY0OZ3B.0 size=1048576 2024-03-09T14:28:45.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.344+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~7K80JMY0OZ3B.1 size=1048576 2024-03-09T14:28:45.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.344+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~7K80JMY0OZ3B.2 size=17269 2024-03-09T14:28:45.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.346+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=7K80JMY0OZ3B tag=60L1YONJQF8B type=write size=3162997 2024-03-09T14:28:45.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.348+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=CC2FCIZ832ML type=write size=725755 2024-03-09T14:28:45.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.349+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=T8Y5ZPG9Q3J2 type=del 2024-03-09T14:28:45.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.350+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=9ZK2MQC9G2ST type=del size=929539 2024-03-09T14:28:45.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.352+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=SFNC8NTUIEN0 type=del 2024-03-09T14:28:45.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.354+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=CQJ39P19MPUW type=write size=109906 2024-03-09T14:28:45.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.355+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=R17BTGPOXTYL type=del 2024-03-09T14:28:45.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.357+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~T935LXY6WCGY.0 size=1048576 2024-03-09T14:28:45.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.358+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~T935LXY6WCGY.1 size=1048576 2024-03-09T14:28:45.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.359+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~T935LXY6WCGY.2 size=369541 2024-03-09T14:28:45.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.359+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=T935LXY6WCGY tag=Z53BX3WKX4Z2 type=write size=3515269 2024-03-09T14:28:45.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.360+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=GKVQVTPYRZ0R type=del 2024-03-09T14:28:45.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.362+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=4YZ2YNY0S1UT type=del size=208166 2024-03-09T14:28:45.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.363+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~2HLW4SJGDCY3.0 size=1048576 2024-03-09T14:28:45.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.364+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~2HLW4SJGDCY3.1 size=1003861 2024-03-09T14:28:45.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.366+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=2HLW4SJGDCY3 tag=NHK2V035ARY3 type=write size=3101013 2024-03-09T14:28:45.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.367+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=0T1ANA214DYP type=del size=3062202 2024-03-09T14:28:45.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.368+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~XFAL78IXRO50.0 size=634097 2024-03-09T14:28:45.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.370+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=XFAL78IXRO50 tag=B4VQC33V5VSS type=write size=1682673 2024-03-09T14:28:45.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.372+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=OG66UTDF1WUL type=del size=2042516 2024-03-09T14:28:45.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.373+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=QDZA0W71LWIT type=del 2024-03-09T14:28:45.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.375+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IF61NWOBEEZ8.0 size=1048576 2024-03-09T14:28:45.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.376+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IF61NWOBEEZ8.1 size=126980 2024-03-09T14:28:45.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.376+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=IF61NWOBEEZ8 tag=F8ET1JK5ATSH type=write size=2224132 2024-03-09T14:28:45.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.377+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=ACIQCI7OFX8H type=del 2024-03-09T14:28:45.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.379+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~GO8C3H7ZLLNK.0 size=1048576 2024-03-09T14:28:45.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.380+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~GO8C3H7ZLLNK.1 size=1048576 2024-03-09T14:28:45.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.381+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~GO8C3H7ZLLNK.2 size=972936 2024-03-09T14:28:45.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.381+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=GO8C3H7ZLLNK tag=MNI3LENYFRBN type=write size=4118664 2024-03-09T14:28:45.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.382+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=UDE40THCNNM8 type=del 2024-03-09T14:28:45.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.383+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=00G4DLHVOJC0 type=del size=1242030 2024-03-09T14:28:45.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.384+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=MX3X6ILR7J8N tag=7DZ5EP5M80AP type=write size=341551: (2) No such file or directory 2024-03-09T14:28:45.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.385+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=8A7C5SCZY9AX type=del size=2042404 2024-03-09T14:28:45.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.387+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=XTMR3RUAN8SW type=del size=1167377 2024-03-09T14:28:45.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.388+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=SXH1OP671PLQ type=del size=3372591 2024-03-09T14:28:45.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.389+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~92U1FVGZUMDX.0 size=98830 2024-03-09T14:28:45.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.391+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=92U1FVGZUMDX tag=JTPYS0HBLJ01 type=write size=1147406 2024-03-09T14:28:45.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.393+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~7JXXQXFG2PKX.0 size=45207 2024-03-09T14:28:45.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.393+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=7JXXQXFG2PKX tag=2E8FOD0S2C6M type=write size=1093783 2024-03-09T14:28:45.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.394+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=1BRTU2IP11U2 type=del 2024-03-09T14:28:45.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.395+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=8O7EDJDSD5BN type=del size=1710447 2024-03-09T14:28:45.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.396+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=YMY4A4F0EUC5 type=del 2024-03-09T14:28:45.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.398+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~HS8XMODYF8JP.0 size=369244 2024-03-09T14:28:45.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.398+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=HS8XMODYF8JP tag=72POE8VV6PN4 type=write size=1417820 2024-03-09T14:28:45.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.400+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=LTB409PBE2PY type=del 2024-03-09T14:28:45.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.402+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~SG8QDQXYS164.0 size=45092 2024-03-09T14:28:45.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.402+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=SG8QDQXYS164 tag=2LGHU640RTB2 type=write size=1093668 2024-03-09T14:28:45.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.403+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=CC2FCIZ832ML type=write size=725755 2024-03-09T14:28:45.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.405+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=21T9AEU509VI type=del size=3935978 2024-03-09T14:28:45.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.406+0000 7f1c6444c780 1 < canceled operation key=V05XJ56M53T8 tag=9ZK2MQC9G2ST type=del size=929539 2024-03-09T14:28:45.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.408+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~AAEQVIZ5VFN6.0 size=1048576 2024-03-09T14:28:45.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.409+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~AAEQVIZ5VFN6.1 size=1048576 2024-03-09T14:28:45.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.410+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~AAEQVIZ5VFN6.2 size=194442 2024-03-09T14:28:45.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.410+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=AAEQVIZ5VFN6 tag=AIE7DM36O6MX type=write size=3340170 2024-03-09T14:28:45.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.412+0000 7f1c6444c780 1 < suggested remove operation key=BAWV7KY6NT8P tag=CQJ39P19MPUW type=write 2024-03-09T14:28:45.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.414+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~ZI8AV1P8HT3I.0 size=1048576 2024-03-09T14:28:45.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.415+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~ZI8AV1P8HT3I.1 size=1048576 2024-03-09T14:28:45.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.416+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~ZI8AV1P8HT3I.2 size=853080 2024-03-09T14:28:45.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.416+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=ZI8AV1P8HT3I tag=3RC74IJ4ZLJM type=write size=3998808 2024-03-09T14:28:45.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.417+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~T935LXY6WCGY.0 size=1048576 2024-03-09T14:28:45.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.418+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~T935LXY6WCGY.1 size=1048576 2024-03-09T14:28:45.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.419+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~T935LXY6WCGY.2 size=369541 2024-03-09T14:28:45.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.420+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=T935LXY6WCGY tag=Z53BX3WKX4Z2 type=write size=3515269 2024-03-09T14:28:45.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.422+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~66J02ZZRXHG7.0 size=1048576 2024-03-09T14:28:45.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.423+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~66J02ZZRXHG7.1 size=1048576 2024-03-09T14:28:45.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.424+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~66J02ZZRXHG7.2 size=90030 2024-03-09T14:28:45.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.424+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=66J02ZZRXHG7 tag=YNV5ZM08C13K type=write size=3235758 2024-03-09T14:28:45.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.425+0000 7f1c6444c780 -1 < failed to complete operation key=BAWV7KY6NT8P tag=4YZ2YNY0S1UT type=del size=208166: (22) Invalid argument 2024-03-09T14:28:45.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.427+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=2BZ1NT0Y7Y8S type=del size=1832290 2024-03-09T14:28:45.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.428+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=0T1ANA214DYP type=del 2024-03-09T14:28:45.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.430+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~T72IUP5XR6O4.0 size=1048576 2024-03-09T14:28:45.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.431+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~T72IUP5XR6O4.1 size=277591 2024-03-09T14:28:45.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.431+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=T72IUP5XR6O4 tag=XBQOVWFTB93K type=write size=2374743 2024-03-09T14:28:45.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.433+0000 7f1c6444c780 1 < suggested remove operation key=BYX1155MZ2LP tag=OG66UTDF1WUL type=del 2024-03-09T14:28:45.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.434+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=K9DIT238YRDL type=del size=3661729 2024-03-09T14:28:45.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.435+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IF61NWOBEEZ8.0 size=1048576 2024-03-09T14:28:45.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.436+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IF61NWOBEEZ8.1 size=126980 2024-03-09T14:28:45.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.438+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=IF61NWOBEEZ8 tag=F8ET1JK5ATSH type=write size=2224132 2024-03-09T14:28:45.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.439+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=V0YEV3Y9N8YM type=del size=2965405 2024-03-09T14:28:45.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.440+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~GO8C3H7ZLLNK.0 size=1048576 2024-03-09T14:28:45.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.441+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~GO8C3H7ZLLNK.1 size=1048576 2024-03-09T14:28:45.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.442+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~GO8C3H7ZLLNK.2 size=972936 2024-03-09T14:28:45.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.444+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=GO8C3H7ZLLNK tag=MNI3LENYFRBN type=write size=4118664 2024-03-09T14:28:45.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.445+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=JNKVLCNM9LCQ type=del size=81446 2024-03-09T14:28:45.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.447+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=00G4DLHVOJC0 type=del 2024-03-09T14:28:45.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.448+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=IXJJZY8D2GH8 type=write size=779954 2024-03-09T14:28:45.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.450+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=8A7C5SCZY9AX type=del 2024-03-09T14:28:45.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.451+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=62BM2RLGZFBA type=write size=957823 2024-03-09T14:28:45.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.452+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=SXH1OP671PLQ type=del 2024-03-09T14:28:45.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.454+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~2MKC2WWYS7PT.0 size=1048576 2024-03-09T14:28:45.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.455+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~2MKC2WWYS7PT.1 size=428542 2024-03-09T14:28:45.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.455+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=2MKC2WWYS7PT tag=4PQRR3OQZM5P type=write size=2525694 2024-03-09T14:28:45.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.456+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~7JXXQXFG2PKX.0 size=45207 2024-03-09T14:28:45.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.459+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=7JXXQXFG2PKX tag=2E8FOD0S2C6M type=write size=1093783 2024-03-09T14:28:45.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.460+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=IUTYEP4JWE37 type=del size=2665118 2024-03-09T14:28:45.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.461+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=8O7EDJDSD5BN type=del 2024-03-09T14:28:45.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.463+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~BLCH3KCM985V.0 size=1048576 2024-03-09T14:28:45.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.464+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~BLCH3KCM985V.1 size=1048576 2024-03-09T14:28:45.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.465+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~BLCH3KCM985V.2 size=959872 2024-03-09T14:28:45.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.465+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=BLCH3KCM985V tag=AV0C0JOBXZ1F type=write size=4105600 2024-03-09T14:28:45.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.466+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~HS8XMODYF8JP.0 size=369244 2024-03-09T14:28:45.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.468+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=HS8XMODYF8JP tag=72POE8VV6PN4 type=write size=1417820 2024-03-09T14:28:45.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.469+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=LRTRYHJLJH1J type=del size=821295 2024-03-09T14:28:45.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.471+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~SG8QDQXYS164.0 size=45092 2024-03-09T14:28:45.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.473+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=SG8QDQXYS164 tag=2LGHU640RTB2 type=write size=1093668 2024-03-09T14:28:45.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.475+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~6NDPLDH534FD.0 size=1048576 2024-03-09T14:28:45.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.476+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~6NDPLDH534FD.1 size=30288 2024-03-09T14:28:45.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.476+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=6NDPLDH534FD tag=723VN2PSLBZW type=write size=2127440 2024-03-09T14:28:45.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.478+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=21T9AEU509VI type=del 2024-03-09T14:28:45.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.479+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=4AKUUF6NP219 type=del size=4021437 2024-03-09T14:28:45.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.481+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~AAEQVIZ5VFN6.0 size=1048576 2024-03-09T14:28:45.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.481+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~AAEQVIZ5VFN6.1 size=1048576 2024-03-09T14:28:45.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.482+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~AAEQVIZ5VFN6.2 size=194442 2024-03-09T14:28:45.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.484+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=AAEQVIZ5VFN6 tag=AIE7DM36O6MX type=write size=3340170 2024-03-09T14:28:45.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.486+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=E28VMFMCR6T6 type=del size=277544 2024-03-09T14:28:45.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.487+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~ZI8AV1P8HT3I.0 size=1048576 2024-03-09T14:28:45.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.488+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~ZI8AV1P8HT3I.1 size=1048576 2024-03-09T14:28:45.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.489+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~ZI8AV1P8HT3I.2 size=853080 2024-03-09T14:28:45.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.491+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=ZI8AV1P8HT3I tag=3RC74IJ4ZLJM type=write size=3998808 2024-03-09T14:28:45.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.492+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=G5UAT6BG2Y00 type=del size=999262 2024-03-09T14:28:45.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.493+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~66J02ZZRXHG7.0 size=1048576 2024-03-09T14:28:45.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.494+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~66J02ZZRXHG7.1 size=1048576 2024-03-09T14:28:45.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.495+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~66J02ZZRXHG7.2 size=90030 2024-03-09T14:28:45.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.497+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=66J02ZZRXHG7 tag=YNV5ZM08C13K type=write size=3235758 2024-03-09T14:28:45.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.499+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~BJ5ZSD33WR23.0 size=1048576 2024-03-09T14:28:45.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.500+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~BJ5ZSD33WR23.1 size=688337 2024-03-09T14:28:45.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.500+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=BJ5ZSD33WR23 tag=LGTB6Y0NLNRI type=write size=2785489 2024-03-09T14:28:45.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.501+0000 7f1c6444c780 -1 < failed to complete operation key=BYX1155MZ2LP tag=2BZ1NT0Y7Y8S type=del size=1832290: (22) Invalid argument 2024-03-09T14:28:45.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.503+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~M7YD5L3QLNJ1.0 size=1048576 2024-03-09T14:28:45.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.504+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~M7YD5L3QLNJ1.1 size=666595 2024-03-09T14:28:45.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.504+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=M7YD5L3QLNJ1 tag=GM8PR67466ZI type=write size=2763747 2024-03-09T14:28:45.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.505+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~T72IUP5XR6O4.0 size=1048576 2024-03-09T14:28:45.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.506+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~T72IUP5XR6O4.1 size=277591 2024-03-09T14:28:45.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.508+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=T72IUP5XR6O4 tag=XBQOVWFTB93K type=write size=2374743 2024-03-09T14:28:45.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.511+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~OFTKZ4C9HA6H.0 size=1048576 2024-03-09T14:28:45.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.511+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~OFTKZ4C9HA6H.1 size=9496 2024-03-09T14:28:45.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.511+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=OFTKZ4C9HA6H tag=NTYIRBLUOIK3 type=write size=2106648 2024-03-09T14:28:45.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.513+0000 7f1c6444c780 1 < canceled operation key=3CC018VYSRHN tag=K9DIT238YRDL type=del size=3661729 2024-03-09T14:28:45.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.515+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~S4W5YCD7K8PB.0 size=1048576 2024-03-09T14:28:45.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.516+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~S4W5YCD7K8PB.1 size=226239 2024-03-09T14:28:45.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.516+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=S4W5YCD7K8PB tag=EGG953PCSYOM type=write size=2323391 2024-03-09T14:28:45.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.517+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=V0YEV3Y9N8YM type=del 2024-03-09T14:28:45.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.518+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=IHQQY04GATUT type=write size=409536 2024-03-09T14:28:45.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.519+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=JNKVLCNM9LCQ type=del 2024-03-09T14:28:45.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.521+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~PXKHGXDR89A7.0 size=709304 2024-03-09T14:28:45.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.521+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=PXKHGXDR89A7 tag=S9P1R3KBWO80 type=write size=1757880 2024-03-09T14:28:45.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.523+0000 7f1c6444c780 1 < suggested remove operation key=MX3X6ILR7J8N tag=IXJJZY8D2GH8 type=write 2024-03-09T14:28:45.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.524+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=RI5U5DLVWHZX type=del size=232249 2024-03-09T14:28:45.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.526+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=62BM2RLGZFBA type=write size=957823 2024-03-09T14:28:45.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.527+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=ENAF029D01EN type=del size=4100235 2024-03-09T14:28:45.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.528+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~2MKC2WWYS7PT.0 size=1048576 2024-03-09T14:28:45.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.529+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~2MKC2WWYS7PT.1 size=428542 2024-03-09T14:28:45.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.531+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=2MKC2WWYS7PT tag=4PQRR3OQZM5P type=write size=2525694 2024-03-09T14:28:45.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.533+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~AT80WUA8Y2V4.0 size=1048576 2024-03-09T14:28:45.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.534+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~AT80WUA8Y2V4.1 size=379836 2024-03-09T14:28:45.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.534+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=AT80WUA8Y2V4 tag=DMH79ON24G5G type=write size=2476988 2024-03-09T14:28:45.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.536+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=IUTYEP4JWE37 type=del size=2665118 2024-03-09T14:28:45.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.537+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=Q2RCH96EZ1ZT type=del size=84913 2024-03-09T14:28:45.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.538+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~BLCH3KCM985V.0 size=1048576 2024-03-09T14:28:45.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.539+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~BLCH3KCM985V.1 size=1048576 2024-03-09T14:28:45.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.540+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~BLCH3KCM985V.2 size=959872 2024-03-09T14:28:45.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.542+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=BLCH3KCM985V tag=AV0C0JOBXZ1F type=write size=4105600 2024-03-09T14:28:45.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.543+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=35BO3BXU0OMS type=write size=898313 2024-03-09T14:28:45.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.545+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=LRTRYHJLJH1J type=del 2024-03-09T14:28:45.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.546+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=MQM4BN72UIHL type=write size=512515 2024-03-09T14:28:45.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.547+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~6NDPLDH534FD.0 size=1048576 2024-03-09T14:28:45.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.548+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~6NDPLDH534FD.1 size=30288 2024-03-09T14:28:45.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.549+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=6NDPLDH534FD tag=723VN2PSLBZW type=write size=2127440 2024-03-09T14:28:45.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.551+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~2LF0RC3VUO05.0 size=1048576 2024-03-09T14:28:45.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.552+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~2LF0RC3VUO05.1 size=1048576 2024-03-09T14:28:45.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.553+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~2LF0RC3VUO05.2 size=128968 2024-03-09T14:28:45.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.553+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=2LF0RC3VUO05 tag=K9NHT1J413I1 type=write size=3274696 2024-03-09T14:28:45.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.554+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=4AKUUF6NP219 type=del 2024-03-09T14:28:45.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.556+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~2GH4SAVE466L.0 size=1048576 2024-03-09T14:28:45.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.557+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~2GH4SAVE466L.1 size=459996 2024-03-09T14:28:45.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.557+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=2GH4SAVE466L tag=XOMJLR54QPM3 type=write size=2557148 2024-03-09T14:28:45.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.558+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=E28VMFMCR6T6 type=del 2024-03-09T14:28:45.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.560+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~PAO7ZPGQSYFN.0 size=1048576 2024-03-09T14:28:45.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.561+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~PAO7ZPGQSYFN.1 size=244704 2024-03-09T14:28:45.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.561+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=PAO7ZPGQSYFN tag=3Y9U3KXABI8H type=write size=2341856 2024-03-09T14:28:45.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.562+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=G5UAT6BG2Y00 type=del 2024-03-09T14:28:45.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.564+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=RMJXPJ8BXYW9 type=del size=1851169 2024-03-09T14:28:45.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.565+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~BJ5ZSD33WR23.0 size=1048576 2024-03-09T14:28:45.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.566+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~BJ5ZSD33WR23.1 size=688337 2024-03-09T14:28:45.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.568+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=BJ5ZSD33WR23 tag=LGTB6Y0NLNRI type=write size=2785489 2024-03-09T14:28:45.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.569+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=UDW9MHPLZBZC type=del size=3090625 2024-03-09T14:28:45.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.570+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~M7YD5L3QLNJ1.0 size=1048576 2024-03-09T14:28:45.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.570+0000 7f1c6444c780 1 < canceled part key=_multipart_HNK7POWS6FSU.2~M7YD5L3QLNJ1.1 size=666595 2024-03-09T14:28:45.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.572+0000 7f1c6444c780 1 < canceled multipart upload key=HNK7POWS6FSU upload=M7YD5L3QLNJ1 tag=GM8PR67466ZI type=write size=2763747 2024-03-09T14:28:45.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.573+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=N5TI399PFSI0 type=del size=1147513 2024-03-09T14:28:45.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.574+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~OFTKZ4C9HA6H.0 size=1048576 2024-03-09T14:28:45.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.575+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~OFTKZ4C9HA6H.1 size=9496 2024-03-09T14:28:45.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.577+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=OFTKZ4C9HA6H tag=NTYIRBLUOIK3 type=write size=2106648 2024-03-09T14:28:45.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.578+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=F0DDO5ITQRF7 type=del size=871636 2024-03-09T14:28:45.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.579+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~S4W5YCD7K8PB.0 size=1048576 2024-03-09T14:28:45.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.579+0000 7f1c6444c780 1 < canceled part key=_multipart_1NQRJ8ICZNM6.2~S4W5YCD7K8PB.1 size=226239 2024-03-09T14:28:45.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.581+0000 7f1c6444c780 1 < canceled multipart upload key=1NQRJ8ICZNM6 upload=S4W5YCD7K8PB tag=EGG953PCSYOM type=write size=2323391 2024-03-09T14:28:45.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.583+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~M1EZDNMFAC9F.0 size=1048576 2024-03-09T14:28:45.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.584+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~M1EZDNMFAC9F.1 size=1048576 2024-03-09T14:28:45.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.585+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~M1EZDNMFAC9F.2 size=887799 2024-03-09T14:28:45.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.585+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=M1EZDNMFAC9F tag=Y7PFNVOPD7Y7 type=write size=4033527 2024-03-09T14:28:45.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.587+0000 7f1c6444c780 1 < suggested update operation key=KNOEGKSERB6Z tag=IHQQY04GATUT type=write size=409536 2024-03-09T14:28:45.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.588+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=2BJHN3P2KMEQ type=del size=1536597 2024-03-09T14:28:45.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.589+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~PXKHGXDR89A7.0 size=709304 2024-03-09T14:28:45.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.591+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=PXKHGXDR89A7 tag=S9P1R3KBWO80 type=write size=1757880 2024-03-09T14:28:45.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.593+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~GLNZ8VVIQQDZ.0 size=857866 2024-03-09T14:28:45.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.593+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=GLNZ8VVIQQDZ tag=24BULV13U3NY type=write size=1906442 2024-03-09T14:28:45.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.595+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=RI5U5DLVWHZX type=del 2024-03-09T14:28:45.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.596+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=I5IP09XB7GRC type=del size=69394 2024-03-09T14:28:45.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.597+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=ENAF029D01EN type=del 2024-03-09T14:28:45.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.598+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=BZ6FO9K5D041 type=del size=2947149 2024-03-09T14:28:45.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.599+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~AT80WUA8Y2V4.0 size=1048576 2024-03-09T14:28:45.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.600+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~AT80WUA8Y2V4.1 size=379836 2024-03-09T14:28:45.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.602+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=AT80WUA8Y2V4 tag=DMH79ON24G5G type=write size=2476988 2024-03-09T14:28:45.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.604+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~II0D7JY47SBD.0 size=1048576 2024-03-09T14:28:45.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.605+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~II0D7JY47SBD.1 size=1048576 2024-03-09T14:28:45.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.606+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~II0D7JY47SBD.2 size=244563 2024-03-09T14:28:45.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.606+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=II0D7JY47SBD tag=QCA9NG9ZGWH2 type=write size=3390291 2024-03-09T14:28:45.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.607+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=Q2RCH96EZ1ZT type=del 2024-03-09T14:28:45.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.609+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~KTI9QFH2PHF0.0 size=1048576 2024-03-09T14:28:45.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.610+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~KTI9QFH2PHF0.1 size=92527 2024-03-09T14:28:45.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.610+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=KTI9QFH2PHF0 tag=U7OPIY36J5N7 type=write size=2189679 2024-03-09T14:28:45.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.613+0000 7f1c6444c780 1 < suggested update operation key=HPFPL79B0GLS tag=35BO3BXU0OMS type=write size=898313 2024-03-09T14:28:45.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.615+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~MFMY7V38MULI.0 size=1048576 2024-03-09T14:28:45.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.616+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~MFMY7V38MULI.1 size=1033732 2024-03-09T14:28:45.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.616+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=MFMY7V38MULI tag=E3MCZOV3ZAOU type=write size=3130884 2024-03-09T14:28:45.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.618+0000 7f1c6444c780 1 < suggested remove operation key=HNK7POWS6FSU tag=MQM4BN72UIHL type=write 2024-03-09T14:28:45.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.619+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=TAJYMUJYZ6CY type=write size=1003975 2024-03-09T14:28:45.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.621+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~2LF0RC3VUO05.0 size=1048576 2024-03-09T14:28:45.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.621+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~2LF0RC3VUO05.1 size=1048576 2024-03-09T14:28:45.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.622+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~2LF0RC3VUO05.2 size=128968 2024-03-09T14:28:45.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.624+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=2LF0RC3VUO05 tag=K9NHT1J413I1 type=write size=3274696 2024-03-09T14:28:45.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.626+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~Y4QKAMWFMMR6.0 size=1048576 2024-03-09T14:28:45.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.627+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~Y4QKAMWFMMR6.1 size=1048576 2024-03-09T14:28:45.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.628+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~Y4QKAMWFMMR6.2 size=548556 2024-03-09T14:28:45.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.628+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=Y4QKAMWFMMR6 tag=TP74B23UJBU3 type=write size=3694284 2024-03-09T14:28:45.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.629+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~2GH4SAVE466L.0 size=1048576 2024-03-09T14:28:45.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.630+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~2GH4SAVE466L.1 size=459996 2024-03-09T14:28:45.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.632+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=2GH4SAVE466L tag=XOMJLR54QPM3 type=write size=2557148 2024-03-09T14:28:45.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.634+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~NBMPSTCOU6Y0.0 size=1048576 2024-03-09T14:28:45.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.635+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~NBMPSTCOU6Y0.1 size=1003650 2024-03-09T14:28:45.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.635+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=NBMPSTCOU6Y0 tag=59O1HWYRWTYX type=write size=3100802 2024-03-09T14:28:45.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.637+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~PAO7ZPGQSYFN.0 size=1048576 2024-03-09T14:28:45.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.638+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~PAO7ZPGQSYFN.1 size=244704 2024-03-09T14:28:45.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.639+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=PAO7ZPGQSYFN tag=3Y9U3KXABI8H type=write size=2341856 2024-03-09T14:28:45.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.641+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=W7385FXUWP1W type=del size=1295209 2024-03-09T14:28:45.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.642+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=RMJXPJ8BXYW9 type=del 2024-03-09T14:28:45.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.644+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~XW8ZDN1K7PB4.0 size=1048576 2024-03-09T14:28:45.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.645+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~XW8ZDN1K7PB4.1 size=114893 2024-03-09T14:28:45.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.645+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=XW8ZDN1K7PB4 tag=RRG731QXVXRT type=write size=2212045 2024-03-09T14:28:45.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.646+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=UDW9MHPLZBZC type=del 2024-03-09T14:28:45.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.647+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=F1A1UITKO52Y type=write size=933247 2024-03-09T14:28:45.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.648+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=N5TI399PFSI0 type=del 2024-03-09T14:28:45.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.650+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~47J2UD5NV2QN.0 size=325651 2024-03-09T14:28:45.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.650+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=47J2UD5NV2QN tag=OUU6K70WNON4 type=write size=1374227 2024-03-09T14:28:45.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.652+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=F0DDO5ITQRF7 type=del 2024-03-09T14:28:45.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.653+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=5UF7HE9XWYOZ type=write size=680852 2024-03-09T14:28:45.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.654+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~M1EZDNMFAC9F.0 size=1048576 2024-03-09T14:28:45.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.655+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~M1EZDNMFAC9F.1 size=1048576 2024-03-09T14:28:45.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.656+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~M1EZDNMFAC9F.2 size=887799 2024-03-09T14:28:45.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.658+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=M1EZDNMFAC9F tag=Y7PFNVOPD7Y7 type=write size=4033527 2024-03-09T14:28:45.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.659+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=CWDJISZ4RZ9H type=del size=2823880 2024-03-09T14:28:45.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.660+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=2BJHN3P2KMEQ type=del 2024-03-09T14:28:45.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.662+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~AZXZ8SCJT142.0 size=1048576 2024-03-09T14:28:45.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.663+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~AZXZ8SCJT142.1 size=1048576 2024-03-09T14:28:45.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.664+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~AZXZ8SCJT142.2 size=513060 2024-03-09T14:28:45.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.664+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=AZXZ8SCJT142 tag=CIBRBJRHDOPL type=write size=3658788 2024-03-09T14:28:45.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.665+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~GLNZ8VVIQQDZ.0 size=857866 2024-03-09T14:28:45.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.667+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=GLNZ8VVIQQDZ tag=24BULV13U3NY type=write size=1906442 2024-03-09T14:28:45.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.669+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=8QP6PA34U2XG type=del size=3302112 2024-03-09T14:28:45.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.670+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=I5IP09XB7GRC type=del size=69394 2024-03-09T14:28:45.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.672+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=3DNBNRQ3CGS4 type=write size=950752 2024-03-09T14:28:45.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.673+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=BZ6FO9K5D041 type=del 2024-03-09T14:28:45.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.674+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=R31I7RU9UN5N type=del size=750678 2024-03-09T14:28:45.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.675+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~II0D7JY47SBD.0 size=1048576 2024-03-09T14:28:45.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.675+0000 7f1c6444c780 1 < canceled part key=_multipart_V05XJ56M53T8.2~II0D7JY47SBD.1 size=1048576 2024-03-09T14:28:45.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.676+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~II0D7JY47SBD.2 size=244563 2024-03-09T14:28:45.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.678+0000 7f1c6444c780 1 < canceled multipart upload key=V05XJ56M53T8 upload=II0D7JY47SBD tag=QCA9NG9ZGWH2 type=write size=3390291 2024-03-09T14:28:45.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.679+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=3H4FV1MIEPZS type=write size=712609 2024-03-09T14:28:45.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.680+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~KTI9QFH2PHF0.0 size=1048576 2024-03-09T14:28:45.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.681+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~KTI9QFH2PHF0.1 size=92527 2024-03-09T14:28:45.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.683+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=KTI9QFH2PHF0 tag=U7OPIY36J5N7 type=write size=2189679 2024-03-09T14:28:45.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.685+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~YCRZ7AFYHSDB.0 size=1048576 2024-03-09T14:28:45.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.686+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~YCRZ7AFYHSDB.1 size=654898 2024-03-09T14:28:45.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.686+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=YCRZ7AFYHSDB tag=QDB81AOUXM3F type=write size=2752050 2024-03-09T14:28:45.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.687+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~MFMY7V38MULI.0 size=1048576 2024-03-09T14:28:45.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.688+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~MFMY7V38MULI.1 size=1033732 2024-03-09T14:28:45.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.690+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=MFMY7V38MULI tag=E3MCZOV3ZAOU type=write size=3130884 2024-03-09T14:28:45.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.691+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=YA6NQU4PUXXZ type=del size=816130 2024-03-09T14:28:45.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.692+0000 7f1c6444c780 1 < completed write operation key=3CC018VYSRHN tag=TAJYMUJYZ6CY type=write size=1003975 2024-03-09T14:28:45.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.694+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=23I2M6CJ96Y8 type=del size=3424008 2024-03-09T14:28:45.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.695+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~Y4QKAMWFMMR6.0 size=1048576 2024-03-09T14:28:45.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.696+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~Y4QKAMWFMMR6.1 size=1048576 2024-03-09T14:28:45.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.697+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~Y4QKAMWFMMR6.2 size=548556 2024-03-09T14:28:45.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.699+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=Y4QKAMWFMMR6 tag=TP74B23UJBU3 type=write size=3694284 2024-03-09T14:28:45.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.700+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=1L09LBPUG8I3 type=write size=508295 2024-03-09T14:28:45.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.701+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~NBMPSTCOU6Y0.0 size=1048576 2024-03-09T14:28:45.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.702+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~NBMPSTCOU6Y0.1 size=1003650 2024-03-09T14:28:45.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.704+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=NBMPSTCOU6Y0 tag=59O1HWYRWTYX type=write size=3100802 2024-03-09T14:28:45.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.705+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=FDCECE8UEGFA type=del size=3284239 2024-03-09T14:28:45.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.706+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=W7385FXUWP1W type=del 2024-03-09T14:28:45.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.708+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=WA2TGK3PK4I8 type=del size=881260 2024-03-09T14:28:45.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.709+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~XW8ZDN1K7PB4.0 size=1048576 2024-03-09T14:28:45.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.710+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~XW8ZDN1K7PB4.1 size=114893 2024-03-09T14:28:45.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.712+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=XW8ZDN1K7PB4 tag=RRG731QXVXRT type=write size=2212045 2024-03-09T14:28:45.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.713+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=75C1J8L71K06 type=del size=4056055 2024-03-09T14:28:45.715 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.715+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=F1A1UITKO52Y type=write 2024-03-09T14:28:45.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.717+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~XQ3CYOTU1AEB.0 size=1048576 2024-03-09T14:28:45.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.718+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~XQ3CYOTU1AEB.1 size=1048576 2024-03-09T14:28:45.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.719+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~XQ3CYOTU1AEB.2 size=932623 2024-03-09T14:28:45.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.719+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=XQ3CYOTU1AEB tag=Z9SERXKEIB4O type=write size=4078351 2024-03-09T14:28:45.720 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.720+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~47J2UD5NV2QN.0 size=325651 2024-03-09T14:28:45.722 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.722+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=47J2UD5NV2QN tag=OUU6K70WNON4 type=write size=1374227 2024-03-09T14:28:45.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.724+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~0QP8S61VR4IK.0 size=904790 2024-03-09T14:28:45.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.724+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=0QP8S61VR4IK tag=D1G72UAPOZEN type=write size=1953366 2024-03-09T14:28:45.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.725+0000 7f1c6444c780 -1 < failed to complete operation key=YK7ENO4UAB2M tag=5UF7HE9XWYOZ type=write size=680852: (22) Invalid argument 2024-03-09T14:28:45.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.727+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~CFF86DB8H7J5.0 size=1048576 2024-03-09T14:28:45.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.728+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~CFF86DB8H7J5.1 size=26063 2024-03-09T14:28:45.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.728+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=CFF86DB8H7J5 tag=2MIA8UQ6J3LF type=write size=2123215 2024-03-09T14:28:45.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.729+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=CWDJISZ4RZ9H type=del 2024-03-09T14:28:45.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.731+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~95PQGHEHJWZI.0 size=1048576 2024-03-09T14:28:45.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.732+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~95PQGHEHJWZI.1 size=898311 2024-03-09T14:28:45.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.732+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=95PQGHEHJWZI tag=35MKF6TB46H2 type=write size=2995463 2024-03-09T14:28:45.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.734+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~AZXZ8SCJT142.0 size=1048576 2024-03-09T14:28:45.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.734+0000 7f1c6444c780 1 < canceled part key=_multipart_SGHNHOCYPM38.2~AZXZ8SCJT142.1 size=1048576 2024-03-09T14:28:45.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.734+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~AZXZ8SCJT142.2 size=513060 2024-03-09T14:28:45.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.736+0000 7f1c6444c780 1 < canceled multipart upload key=SGHNHOCYPM38 upload=AZXZ8SCJT142 tag=CIBRBJRHDOPL type=write size=3658788 2024-03-09T14:28:45.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.737+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=VD1DRK7X7T96 type=del size=1928486 2024-03-09T14:28:45.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.739+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=8QP6PA34U2XG type=del 2024-03-09T14:28:45.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.741+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~5SCFWKQQOXSC.0 size=145102 2024-03-09T14:28:45.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.741+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=5SCFWKQQOXSC tag=DOX3B3K9OLUM type=write size=1193678 2024-03-09T14:28:45.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.742+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=3DNBNRQ3CGS4 type=write size=950752 2024-03-09T14:28:45.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.743+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=JYTE7M6NN15V type=del size=1345433 2024-03-09T14:28:45.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.744+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=R31I7RU9UN5N type=del 2024-03-09T14:28:45.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.746+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=CBLF2R26TMUK type=write size=258313 2024-03-09T14:28:45.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.747+0000 7f1c6444c780 1 < canceled operation key=26VE2HJPD0FX tag=3H4FV1MIEPZS type=write size=712609 2024-03-09T14:28:45.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.748+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=UJ9IIQPEOYIF type=del size=918977 2024-03-09T14:28:45.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.749+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~YCRZ7AFYHSDB.0 size=1048576 2024-03-09T14:28:45.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.750+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~YCRZ7AFYHSDB.1 size=654898 2024-03-09T14:28:45.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.752+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=YCRZ7AFYHSDB tag=QDB81AOUXM3F type=write size=2752050 2024-03-09T14:28:45.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.753+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=B6J6B5TDTWQ3 type=write size=764637 2024-03-09T14:28:45.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.755+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=YA6NQU4PUXXZ type=del 2024-03-09T14:28:45.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.756+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=SRSLZXXOHNVK type=del size=1703376 2024-03-09T14:28:45.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.758+0000 7f1c6444c780 1 < suggested remove operation key=CVD0EGQUVJYR tag=23I2M6CJ96Y8 type=del 2024-03-09T14:28:45.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.760+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=KB1FAM735M7X type=del size=491764 2024-03-09T14:28:45.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.761+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=1L09LBPUG8I3 type=write size=508295 2024-03-09T14:28:45.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.763+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~JUI20S1W99FI.0 size=442750 2024-03-09T14:28:45.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.763+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=JUI20S1W99FI tag=8JU1QRU46W1V type=write size=1491326 2024-03-09T14:28:45.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.764+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=YK7ENO4UAB2M tag=FDCECE8UEGFA type=del size=3284239: (2) No such file or directory 2024-03-09T14:28:45.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.765+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=BNGGKH5HAZX9 type=del size=3802587 2024-03-09T14:28:45.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.766+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=WA2TGK3PK4I8 type=del 2024-03-09T14:28:45.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.767+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=U9TXO2JOOL1V type=del size=3772412 2024-03-09T14:28:45.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.769+0000 7f1c6444c780 -1 < failed to complete operation key=YK7ENO4UAB2M tag=75C1J8L71K06 type=del size=4056055: (22) Invalid argument 2024-03-09T14:28:45.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.770+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=HO5EI4BPFJJ7 type=del size=3039024 2024-03-09T14:28:45.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.771+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~XQ3CYOTU1AEB.0 size=1048576 2024-03-09T14:28:45.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.772+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~XQ3CYOTU1AEB.1 size=1048576 2024-03-09T14:28:45.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.773+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~XQ3CYOTU1AEB.2 size=932623 2024-03-09T14:28:45.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.775+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=XQ3CYOTU1AEB tag=Z9SERXKEIB4O type=write size=4078351 2024-03-09T14:28:45.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.776+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=RLX85NR5L550 type=del size=1598501 2024-03-09T14:28:45.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.777+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~0QP8S61VR4IK.0 size=904790 2024-03-09T14:28:45.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.780+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=0QP8S61VR4IK tag=D1G72UAPOZEN type=write size=1953366 2024-03-09T14:28:45.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.781+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=3M860H47BS6G type=del size=226803 2024-03-09T14:28:45.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.781+0000 7f1c6444c780 1 < canceled part key=_multipart_QSMTZR754455.2~CFF86DB8H7J5.0 size=1048576 2024-03-09T14:28:45.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.782+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~CFF86DB8H7J5.1 size=26063 2024-03-09T14:28:45.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.784+0000 7f1c6444c780 1 < canceled multipart upload key=QSMTZR754455 upload=CFF86DB8H7J5 tag=2MIA8UQ6J3LF type=write size=2123215 2024-03-09T14:28:45.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.785+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=LHYLV6PYT90Y type=del size=3450879 2024-03-09T14:28:45.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.786+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~95PQGHEHJWZI.0 size=1048576 2024-03-09T14:28:45.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.786+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~95PQGHEHJWZI.1 size=898311 2024-03-09T14:28:45.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.788+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=95PQGHEHJWZI tag=35MKF6TB46H2 type=write size=2995463 2024-03-09T14:28:45.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.790+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~PPLUPDZBWHDT.0 size=1048576 2024-03-09T14:28:45.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.791+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~PPLUPDZBWHDT.1 size=915842 2024-03-09T14:28:45.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.791+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=PPLUPDZBWHDT tag=F0Z1VRLP0YW9 type=write size=3012994 2024-03-09T14:28:45.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.793+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=VD1DRK7X7T96 type=del 2024-03-09T14:28:45.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.794+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=CK8D2IQK9ZXZ type=del size=3665655 2024-03-09T14:28:45.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.795+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~5SCFWKQQOXSC.0 size=145102 2024-03-09T14:28:45.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.797+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=5SCFWKQQOXSC tag=DOX3B3K9OLUM type=write size=1193678 2024-03-09T14:28:45.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.799+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~8WH3R65K1L5E.0 size=1048576 2024-03-09T14:28:45.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.800+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~8WH3R65K1L5E.1 size=1048576 2024-03-09T14:28:45.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.801+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~8WH3R65K1L5E.2 size=590519 2024-03-09T14:28:45.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.801+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=8WH3R65K1L5E tag=O10OET0FUW2B type=write size=3736247 2024-03-09T14:28:45.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.803+0000 7f1c6444c780 1 < suggested remove operation key=KNOEGKSERB6Z tag=JYTE7M6NN15V type=del 2024-03-09T14:28:45.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.805+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~4T9MIGQ8K9EC.0 size=395772 2024-03-09T14:28:45.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.805+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=4T9MIGQ8K9EC tag=N93RGEXOYMQH type=write size=1444348 2024-03-09T14:28:45.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.806+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=CBLF2R26TMUK type=write size=258313 2024-03-09T14:28:45.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.807+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=ZFUKDH0OMG0F type=del size=3181523 2024-03-09T14:28:45.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.808+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=UJ9IIQPEOYIF type=del 2024-03-09T14:28:45.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.810+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=BU9L72Y1ULRS type=write size=76798 2024-03-09T14:28:45.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.813+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=B6J6B5TDTWQ3 type=write size=764637 2024-03-09T14:28:45.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.814+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=P0VUFQOCE54Y type=del size=2788888 2024-03-09T14:28:45.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.815+0000 7f1c6444c780 -1 < failed to complete operation key=KNOEGKSERB6Z tag=SRSLZXXOHNVK type=del size=1703376: (22) Invalid argument 2024-03-09T14:28:45.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.817+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~999HBYNUA5FL.0 size=1048576 2024-03-09T14:28:45.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.818+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~999HBYNUA5FL.1 size=1048576 2024-03-09T14:28:45.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.819+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~999HBYNUA5FL.2 size=411655 2024-03-09T14:28:45.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.819+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=999HBYNUA5FL tag=KYV76TTOYF6V type=write size=3557383 2024-03-09T14:28:45.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.820+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=KB1FAM735M7X type=del 2024-03-09T14:28:45.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.821+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=JU4DY68MQHZ3 type=write size=831755 2024-03-09T14:28:45.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.822+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~JUI20S1W99FI.0 size=442750 2024-03-09T14:28:45.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.824+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=JUI20S1W99FI tag=8JU1QRU46W1V type=write size=1491326 2024-03-09T14:28:45.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.825+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=IO4YX2JZJ3IR type=write size=610631 2024-03-09T14:28:45.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.826+0000 7f1c6444c780 1 < canceled operation key=QSMTZR754455 tag=BNGGKH5HAZX9 type=del size=3802587 2024-03-09T14:28:45.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.828+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=ZOWX2QMIWW5V type=del size=2504658 2024-03-09T14:28:45.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.829+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=U9TXO2JOOL1V type=del 2024-03-09T14:28:45.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.830+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=PYMMVY8EV2XP type=del size=2479543 2024-03-09T14:28:45.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.831+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=HO5EI4BPFJJ7 type=del 2024-03-09T14:28:45.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.833+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~57HWUOIJBZPG.0 size=282998 2024-03-09T14:28:45.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.833+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=57HWUOIJBZPG tag=1FJ09XREBTBO type=write size=1331574 2024-03-09T14:28:45.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.835+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=RLX85NR5L550 type=del 2024-03-09T14:28:45.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.837+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~ZB9IJO4TCPPV.0 size=1048576 2024-03-09T14:28:45.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.838+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~ZB9IJO4TCPPV.1 size=1048576 2024-03-09T14:28:45.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.839+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~ZB9IJO4TCPPV.2 size=428347 2024-03-09T14:28:45.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.839+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=ZB9IJO4TCPPV tag=2583REIEGTNY type=write size=3574075 2024-03-09T14:28:45.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.840+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=3M860H47BS6G type=del 2024-03-09T14:28:45.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.842+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~DWFSSCTOCLGK.0 size=889113 2024-03-09T14:28:45.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.842+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=DWFSSCTOCLGK tag=DJFE3OQY6ADZ type=write size=1937689 2024-03-09T14:28:45.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.843+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=LHYLV6PYT90Y type=del 2024-03-09T14:28:45.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.845+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~KW0XJ9EQ269X.0 size=1048576 2024-03-09T14:28:45.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.846+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~KW0XJ9EQ269X.1 size=1048576 2024-03-09T14:28:45.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.847+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~KW0XJ9EQ269X.2 size=477167 2024-03-09T14:28:45.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.847+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=KW0XJ9EQ269X tag=NE7QOQT0COYT type=write size=3622895 2024-03-09T14:28:45.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.848+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~PPLUPDZBWHDT.0 size=1048576 2024-03-09T14:28:45.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.849+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~PPLUPDZBWHDT.1 size=915842 2024-03-09T14:28:45.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.851+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=PPLUPDZBWHDT tag=F0Z1VRLP0YW9 type=write size=3012994 2024-03-09T14:28:45.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.852+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=1RON67YAVIGI type=write size=222364 2024-03-09T14:28:45.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.855+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=CK8D2IQK9ZXZ type=del 2024-03-09T14:28:45.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.856+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=0ARPTFHSM7JL type=del size=128308 2024-03-09T14:28:45.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.857+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~8WH3R65K1L5E.0 size=1048576 2024-03-09T14:28:45.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.857+0000 7f1c6444c780 1 < canceled part key=_multipart_V05XJ56M53T8.2~8WH3R65K1L5E.1 size=1048576 2024-03-09T14:28:45.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.858+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~8WH3R65K1L5E.2 size=590519 2024-03-09T14:28:45.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.860+0000 7f1c6444c780 1 < canceled multipart upload key=V05XJ56M53T8 upload=8WH3R65K1L5E tag=O10OET0FUW2B type=write size=3736247 2024-03-09T14:28:45.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.861+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=N3SWXRYDTWUP type=del size=1238669 2024-03-09T14:28:45.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.862+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~4T9MIGQ8K9EC.0 size=395772 2024-03-09T14:28:45.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.864+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=4T9MIGQ8K9EC tag=N93RGEXOYMQH type=write size=1444348 2024-03-09T14:28:45.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.866+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=P6FC229MTUJD type=del size=1473698 2024-03-09T14:28:45.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.867+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=ZFUKDH0OMG0F type=del 2024-03-09T14:28:45.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.868+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=ARFEM3XGXOSX type=del size=2617806 2024-03-09T14:28:45.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.869+0000 7f1c6444c780 1 < completed write operation key=0IHHFQBKKJ0G tag=BU9L72Y1ULRS type=write size=76798 2024-03-09T14:28:45.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.870+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=61BARWAU0IIB type=del size=2633511 2024-03-09T14:28:45.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.871+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=SGHNHOCYPM38 tag=P0VUFQOCE54Y type=del size=2788888: (2) No such file or directory 2024-03-09T14:28:45.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.872+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=V7QREKQBH4FR type=del size=2384747 2024-03-09T14:28:45.873 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.873+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~999HBYNUA5FL.0 size=1048576 2024-03-09T14:28:45.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.874+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~999HBYNUA5FL.1 size=1048576 2024-03-09T14:28:45.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.875+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~999HBYNUA5FL.2 size=411655 2024-03-09T14:28:45.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.877+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=999HBYNUA5FL tag=KYV76TTOYF6V type=write size=3557383 2024-03-09T14:28:45.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.878+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=JFD5Z0BAO99L type=del size=2965160 2024-03-09T14:28:45.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.879+0000 7f1c6444c780 1 < completed write operation key=35Y98D5U0M8O tag=JU4DY68MQHZ3 type=write size=831755 2024-03-09T14:28:45.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.881+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=0GCRRUQSEB4V type=write size=910501 2024-03-09T14:28:45.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.882+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=IO4YX2JZJ3IR type=write size=610631 2024-03-09T14:28:45.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.883+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=X9O3WQUA9CVB type=del size=1456261 2024-03-09T14:28:45.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.884+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=ZOWX2QMIWW5V type=del 2024-03-09T14:28:45.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.886+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=4HM2I9DVAUFO type=del size=530408 2024-03-09T14:28:45.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.888+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=PYMMVY8EV2XP type=del 2024-03-09T14:28:45.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.891+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~3YDT7VAVARII.0 size=1048576 2024-03-09T14:28:45.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.892+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~3YDT7VAVARII.1 size=900807 2024-03-09T14:28:45.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.892+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=3YDT7VAVARII tag=4FMIRCNIITNB type=write size=2997959 2024-03-09T14:28:45.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.893+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~57HWUOIJBZPG.0 size=282998 2024-03-09T14:28:45.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.895+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=57HWUOIJBZPG tag=1FJ09XREBTBO type=write size=1331574 2024-03-09T14:28:45.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.896+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=IOS5IO9MPC2R type=write size=912544 2024-03-09T14:28:45.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.897+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~ZB9IJO4TCPPV.0 size=1048576 2024-03-09T14:28:45.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.898+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~ZB9IJO4TCPPV.1 size=1048576 2024-03-09T14:28:45.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.899+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~ZB9IJO4TCPPV.2 size=428347 2024-03-09T14:28:45.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.901+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=ZB9IJO4TCPPV tag=2583REIEGTNY type=write size=3574075 2024-03-09T14:28:45.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.902+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=EERNVGS5MJEV type=del size=461067 2024-03-09T14:28:45.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.903+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~DWFSSCTOCLGK.0 size=889113 2024-03-09T14:28:45.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.905+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=DWFSSCTOCLGK tag=DJFE3OQY6ADZ type=write size=1937689 2024-03-09T14:28:45.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.906+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=569V21RLRC8V type=del size=859165 2024-03-09T14:28:45.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.906+0000 7f1c6444c780 1 < canceled part key=_multipart_YECG84AJ5IK2.2~KW0XJ9EQ269X.0 size=1048576 2024-03-09T14:28:45.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.907+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~KW0XJ9EQ269X.1 size=1048576 2024-03-09T14:28:45.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.908+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~KW0XJ9EQ269X.2 size=477167 2024-03-09T14:28:45.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.910+0000 7f1c6444c780 1 < canceled multipart upload key=YECG84AJ5IK2 upload=KW0XJ9EQ269X tag=NE7QOQT0COYT type=write size=3622895 2024-03-09T14:28:45.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.911+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=C7PUJYIS8HIN type=del size=2731876 2024-03-09T14:28:45.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.913+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=1RON67YAVIGI type=write size=222364 2024-03-09T14:28:45.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.915+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~PI24XSBQY4N8.0 size=581008 2024-03-09T14:28:45.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.915+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=PI24XSBQY4N8 tag=F8REY00GTKLL type=write size=1629584 2024-03-09T14:28:45.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.917+0000 7f1c6444c780 1 < suggested update operation key=MX3X6ILR7J8N tag=0ARPTFHSM7JL type=del size=128308 2024-03-09T14:28:45.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.918+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=7M945YYHE81D type=del size=491074 2024-03-09T14:28:45.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.919+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=N3SWXRYDTWUP type=del 2024-03-09T14:28:45.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.920+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=R11L33D34CZF type=del size=233286 2024-03-09T14:28:45.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.921+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=P6FC229MTUJD type=del 2024-03-09T14:28:45.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.923+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~1YVNBW1E36AN.0 size=1048576 2024-03-09T14:28:45.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.924+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~1YVNBW1E36AN.1 size=1048576 2024-03-09T14:28:45.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.925+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~1YVNBW1E36AN.2 size=982644 2024-03-09T14:28:45.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.925+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=1YVNBW1E36AN tag=8JNGCZ1Z1XK9 type=write size=4128372 2024-03-09T14:28:45.926 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.926+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=ARFEM3XGXOSX type=del 2024-03-09T14:28:45.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.928+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~V6EJ993JSVJH.0 size=1048576 2024-03-09T14:28:45.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.929+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~V6EJ993JSVJH.1 size=1048576 2024-03-09T14:28:45.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.930+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~V6EJ993JSVJH.2 size=854035 2024-03-09T14:28:45.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.930+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=V6EJ993JSVJH tag=GCT23SVW2K1B type=write size=3999763 2024-03-09T14:28:45.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.932+0000 7f1c6444c780 1 < suggested update operation key=KNOEGKSERB6Z tag=61BARWAU0IIB type=del size=2633511 2024-03-09T14:28:45.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.934+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~Y4JQ4EGPGOKE.0 size=1048576 2024-03-09T14:28:45.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.935+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~Y4JQ4EGPGOKE.1 size=582757 2024-03-09T14:28:45.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.935+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=Y4JQ4EGPGOKE tag=PV7SGEZV83CG type=write size=2679909 2024-03-09T14:28:45.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.936+0000 7f1c6444c780 -1 < failed to complete operation key=KNOEGKSERB6Z tag=V7QREKQBH4FR type=del size=2384747: (22) Invalid argument 2024-03-09T14:28:45.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.938+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~CWXMIADH34UO.0 size=369709 2024-03-09T14:28:45.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.938+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=CWXMIADH34UO tag=AJZ78CZS14DW type=write size=1418285 2024-03-09T14:28:45.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.940+0000 7f1c6444c780 1 < suggested update operation key=NIN0FB6YTKWA tag=JFD5Z0BAO99L type=del size=2965160 2024-03-09T14:28:45.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.942+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=HAB4W4BU9YEX type=write size=82849 2024-03-09T14:28:45.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.943+0000 7f1c6444c780 1 < completed write operation key=35Y98D5U0M8O tag=0GCRRUQSEB4V type=write size=910501 2024-03-09T14:28:45.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.944+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=J7CPZOJLHXNT type=del size=1954875 2024-03-09T14:28:45.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.945+0000 7f1c6444c780 -1 < failed to complete operation key=NIN0FB6YTKWA tag=X9O3WQUA9CVB type=del size=1456261: (22) Invalid argument 2024-03-09T14:28:45.946 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.946+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=SGHDPU4NKGA7 type=del size=1443309 2024-03-09T14:28:45.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.948+0000 7f1c6444c780 1 < suggested update operation key=BYX1155MZ2LP tag=4HM2I9DVAUFO type=del size=530408 2024-03-09T14:28:45.949 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.949+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=O08U0DGY4ZCP type=del size=832651 2024-03-09T14:28:45.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.951+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~3YDT7VAVARII.0 size=1048576 2024-03-09T14:28:45.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.952+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~3YDT7VAVARII.1 size=900807 2024-03-09T14:28:45.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.953+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=3YDT7VAVARII tag=4FMIRCNIITNB type=write size=2997959 2024-03-09T14:28:45.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.954+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=RVL8WXWUP1C2 type=del size=2225630 2024-03-09T14:28:45.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.956+0000 7f1c6444c780 1 < completed write operation key=VL5EUQ52WRAN tag=IOS5IO9MPC2R type=write size=912544 2024-03-09T14:28:45.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.957+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=IIS95XVE5JNK type=write size=480003 2024-03-09T14:28:45.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.958+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=EERNVGS5MJEV type=del 2024-03-09T14:28:45.960 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.960+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~3EE5EU1JBWT0.0 size=1048576 2024-03-09T14:28:45.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.961+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~3EE5EU1JBWT0.1 size=534313 2024-03-09T14:28:45.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.961+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=3EE5EU1JBWT0 tag=R92HC331BSE4 type=write size=2631465 2024-03-09T14:28:45.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.962+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=569V21RLRC8V type=del 2024-03-09T14:28:45.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.963+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=26CAZ47DN7EE type=write size=654974 2024-03-09T14:28:45.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.964+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=C7PUJYIS8HIN type=del 2024-03-09T14:28:45.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.965+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=J251GD421W6U type=del size=1597335 2024-03-09T14:28:45.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.967+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~PI24XSBQY4N8.0 size=581008 2024-03-09T14:28:45.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.969+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=PI24XSBQY4N8 tag=F8REY00GTKLL type=write size=1629584 2024-03-09T14:28:45.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.970+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=9UWPXH1M0QPA type=write size=714066 2024-03-09T14:28:45.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.971+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=7M945YYHE81D type=del 2024-03-09T14:28:45.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.972+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=23ES5QYNRFR9 type=del size=3051455 2024-03-09T14:28:45.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.973+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=R11L33D34CZF type=del 2024-03-09T14:28:45.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.975+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~J3ZX6EBK5S86.0 size=1048576 2024-03-09T14:28:45.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.976+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~J3ZX6EBK5S86.1 size=1048576 2024-03-09T14:28:45.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.977+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~J3ZX6EBK5S86.2 size=996735 2024-03-09T14:28:45.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.977+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=J3ZX6EBK5S86 tag=PTBN4ZUI50UT type=write size=4142463 2024-03-09T14:28:45.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.978+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~1YVNBW1E36AN.0 size=1048576 2024-03-09T14:28:45.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.979+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~1YVNBW1E36AN.1 size=1048576 2024-03-09T14:28:45.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.980+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~1YVNBW1E36AN.2 size=982644 2024-03-09T14:28:45.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.982+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=1YVNBW1E36AN tag=8JNGCZ1Z1XK9 type=write size=4128372 2024-03-09T14:28:45.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.983+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=FHP84LLAN4GG type=del size=163346 2024-03-09T14:28:45.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.984+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~V6EJ993JSVJH.0 size=1048576 2024-03-09T14:28:45.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.985+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~V6EJ993JSVJH.1 size=1048576 2024-03-09T14:28:45.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.986+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~V6EJ993JSVJH.2 size=854035 2024-03-09T14:28:45.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.988+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=V6EJ993JSVJH tag=GCT23SVW2K1B type=write size=3999763 2024-03-09T14:28:45.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.989+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=M3F0G46GGV88 type=del size=1355474 2024-03-09T14:28:45.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.991+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~Y4JQ4EGPGOKE.0 size=1048576 2024-03-09T14:28:45.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.991+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~Y4JQ4EGPGOKE.1 size=582757 2024-03-09T14:28:45.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.993+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=Y4JQ4EGPGOKE tag=PV7SGEZV83CG type=write size=2679909 2024-03-09T14:28:45.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.997+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~DFJJYMG022UW.0 size=1048576 2024-03-09T14:28:45.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.998+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~DFJJYMG022UW.1 size=1048576 2024-03-09T14:28:45.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.999+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~DFJJYMG022UW.2 size=205446 2024-03-09T14:28:45.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:45.999+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=DFJJYMG022UW tag=HFZ98MZ3B613 type=write size=3351174 2024-03-09T14:28:46.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.000+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~CWXMIADH34UO.0 size=369709 2024-03-09T14:28:46.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.002+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=CWXMIADH34UO tag=AJZ78CZS14DW type=write size=1418285 2024-03-09T14:28:46.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.003+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=ZWJ4B0S40RN5 type=del size=3778209 2024-03-09T14:28:46.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.004+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=HAB4W4BU9YEX type=write size=82849 2024-03-09T14:28:46.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.006+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~0C7HO8949TNJ.0 size=1048576 2024-03-09T14:28:46.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.007+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~0C7HO8949TNJ.1 size=1048576 2024-03-09T14:28:46.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.008+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~0C7HO8949TNJ.2 size=241470 2024-03-09T14:28:46.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.008+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=0C7HO8949TNJ tag=EOWFZ7UEJPN3 type=write size=3387198 2024-03-09T14:28:46.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.009+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=J7CPZOJLHXNT type=del 2024-03-09T14:28:46.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.010+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=B61FVM7WLSKJ type=del size=1341734 2024-03-09T14:28:46.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.012+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=SGHDPU4NKGA7 type=del 2024-03-09T14:28:46.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.013+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=2SPUMSFTN6CH type=del size=870296 2024-03-09T14:28:46.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.014+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=O08U0DGY4ZCP type=del 2024-03-09T14:28:46.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.016+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~NKFQFZ0PCZ32.0 size=1048576 2024-03-09T14:28:46.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.017+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~NKFQFZ0PCZ32.1 size=728068 2024-03-09T14:28:46.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.017+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=NKFQFZ0PCZ32 tag=T9EKMG0A835F type=write size=2825220 2024-03-09T14:28:46.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.018+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=RVL8WXWUP1C2 type=del 2024-03-09T14:28:46.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.019+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=PMIY56I1CF1I type=del size=3818950 2024-03-09T14:28:46.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.021+0000 7f1c6444c780 1 < canceled operation key=KWDIDE9AE3JP tag=IIS95XVE5JNK type=write size=480003 2024-03-09T14:28:46.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.022+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=YRWEPKNXBPF4 type=del size=2364767 2024-03-09T14:28:46.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.023+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~3EE5EU1JBWT0.0 size=1048576 2024-03-09T14:28:46.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.024+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~3EE5EU1JBWT0.1 size=534313 2024-03-09T14:28:46.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.026+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=3EE5EU1JBWT0 tag=R92HC331BSE4 type=write size=2631465 2024-03-09T14:28:46.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.028+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~7CR50IQ4AREF.0 size=1048576 2024-03-09T14:28:46.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.029+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~7CR50IQ4AREF.1 size=1048576 2024-03-09T14:28:46.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.030+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~7CR50IQ4AREF.2 size=749614 2024-03-09T14:28:46.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.030+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=7CR50IQ4AREF tag=JIC46HXAZXF8 type=write size=3895342 2024-03-09T14:28:46.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.031+0000 7f1c6444c780 1 < completed write operation key=CVD0EGQUVJYR tag=26CAZ47DN7EE type=write size=654974 2024-03-09T14:28:46.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.032+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=2DB76ZCXN8K7 type=write size=1009940 2024-03-09T14:28:46.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.033+0000 7f1c6444c780 1 < canceled operation key=IBVEN2JEB49N tag=J251GD421W6U type=del size=1597335 2024-03-09T14:28:46.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.035+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~5CHIMGGX6MWC.0 size=331309 2024-03-09T14:28:46.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.035+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=5CHIMGGX6MWC tag=ARYLGKEC70IO type=write size=1379885 2024-03-09T14:28:46.036 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.036+0000 7f1c6444c780 1 < completed write operation key=BYX1155MZ2LP tag=9UWPXH1M0QPA type=write size=714066 2024-03-09T14:28:46.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.038+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=DKV61IMSFFAV type=del size=1152202 2024-03-09T14:28:46.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.039+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=23ES5QYNRFR9 type=del 2024-03-09T14:28:46.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.040+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=ZJ5LY9UM12KB type=del size=2883205 2024-03-09T14:28:46.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.042+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~J3ZX6EBK5S86.0 size=1048576 2024-03-09T14:28:46.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.042+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~J3ZX6EBK5S86.1 size=1048576 2024-03-09T14:28:46.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.043+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~J3ZX6EBK5S86.2 size=996735 2024-03-09T14:28:46.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.045+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=J3ZX6EBK5S86 tag=PTBN4ZUI50UT type=write size=4142463 2024-03-09T14:28:46.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.046+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=N2PFP441NRIE type=del size=3154016 2024-03-09T14:28:46.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.047+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=FHP84LLAN4GG type=del 2024-03-09T14:28:46.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.048+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=HZZAECO2DL3Z type=write size=965503 2024-03-09T14:28:46.049 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.049+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=M3F0G46GGV88 type=del 2024-03-09T14:28:46.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.050+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=I8SDQCFTE02T type=del size=3723146 2024-03-09T14:28:46.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.051+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~DFJJYMG022UW.0 size=1048576 2024-03-09T14:28:46.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.052+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~DFJJYMG022UW.1 size=1048576 2024-03-09T14:28:46.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.053+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~DFJJYMG022UW.2 size=205446 2024-03-09T14:28:46.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.055+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=DFJJYMG022UW tag=HFZ98MZ3B613 type=write size=3351174 2024-03-09T14:28:46.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.057+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~VP0ZAEVE0G8K.0 size=1048576 2024-03-09T14:28:46.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.058+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~VP0ZAEVE0G8K.1 size=61479 2024-03-09T14:28:46.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.058+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=VP0ZAEVE0G8K tag=L0EACW3J9HOK type=write size=2158631 2024-03-09T14:28:46.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.059+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=ZWJ4B0S40RN5 type=del 2024-03-09T14:28:46.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.061+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~RDDGUEGG1N6D.0 size=1048576 2024-03-09T14:28:46.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.062+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~RDDGUEGG1N6D.1 size=91864 2024-03-09T14:28:46.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.062+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=RDDGUEGG1N6D tag=IGBZGA3TE4K6 type=write size=2189016 2024-03-09T14:28:46.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.064+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~0C7HO8949TNJ.0 size=1048576 2024-03-09T14:28:46.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.065+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~0C7HO8949TNJ.1 size=1048576 2024-03-09T14:28:46.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.066+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~0C7HO8949TNJ.2 size=241470 2024-03-09T14:28:46.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.068+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=0C7HO8949TNJ tag=EOWFZ7UEJPN3 type=write size=3387198 2024-03-09T14:28:46.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.070+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~R29028T308O8.0 size=1048576 2024-03-09T14:28:46.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.071+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~R29028T308O8.1 size=1008315 2024-03-09T14:28:46.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.071+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=R29028T308O8 tag=E5PL2REMCK0A type=write size=3105467 2024-03-09T14:28:46.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.072+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=B61FVM7WLSKJ type=del 2024-03-09T14:28:46.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.074+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=05XFSM2V559C type=write size=137396 2024-03-09T14:28:46.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.075+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=2SPUMSFTN6CH type=del 2024-03-09T14:28:46.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.077+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~IBZ2ULNWQT6T.0 size=437620 2024-03-09T14:28:46.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.077+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=IBZ2ULNWQT6T tag=QQTF7QEC39J0 type=write size=1486196 2024-03-09T14:28:46.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.079+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~NKFQFZ0PCZ32.0 size=1048576 2024-03-09T14:28:46.080 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.080+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~NKFQFZ0PCZ32.1 size=728068 2024-03-09T14:28:46.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.082+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=NKFQFZ0PCZ32 tag=T9EKMG0A835F type=write size=2825220 2024-03-09T14:28:46.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.084+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~SMO2LWYK80YR.0 size=1048576 2024-03-09T14:28:46.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.085+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~SMO2LWYK80YR.1 size=724140 2024-03-09T14:28:46.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.085+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=SMO2LWYK80YR tag=LOILJN283NEO type=write size=2821292 2024-03-09T14:28:46.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.087+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=PMIY56I1CF1I type=del size=3818950 2024-03-09T14:28:46.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.088+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=M73SUW05MQVM type=del size=390938 2024-03-09T14:28:46.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.089+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=YRWEPKNXBPF4 type=del 2024-03-09T14:28:46.091 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.091+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=P8K2UBKLD0IY type=del size=2092573 2024-03-09T14:28:46.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.092+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~7CR50IQ4AREF.0 size=1048576 2024-03-09T14:28:46.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.093+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~7CR50IQ4AREF.1 size=1048576 2024-03-09T14:28:46.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.094+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~7CR50IQ4AREF.2 size=749614 2024-03-09T14:28:46.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.096+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=7CR50IQ4AREF tag=JIC46HXAZXF8 type=write size=3895342 2024-03-09T14:28:46.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.097+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=44335EAZSNWH type=write size=490950 2024-03-09T14:28:46.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.098+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=2DB76ZCXN8K7 type=write size=1009940 2024-03-09T14:28:46.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.099+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=HFI5OPEF1D62 type=del size=3021236 2024-03-09T14:28:46.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.100+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~5CHIMGGX6MWC.0 size=331309 2024-03-09T14:28:46.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.102+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=5CHIMGGX6MWC tag=ARYLGKEC70IO type=write size=1379885 2024-03-09T14:28:46.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.104+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=X2G6K0O5AZO3 type=del size=99030 2024-03-09T14:28:46.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.106+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=DKV61IMSFFAV type=del size=1152202 2024-03-09T14:28:46.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.108+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~3WY10XUAAJJ5.0 size=1048576 2024-03-09T14:28:46.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.109+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~3WY10XUAAJJ5.1 size=1048576 2024-03-09T14:28:46.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.110+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~3WY10XUAAJJ5.2 size=6906 2024-03-09T14:28:46.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.110+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=3WY10XUAAJJ5 tag=ZKPR9NQ0NAR3 type=write size=3152634 2024-03-09T14:28:46.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.112+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=ZJ5LY9UM12KB type=del 2024-03-09T14:28:46.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.114+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~G3TY954APTLG.0 size=1048576 2024-03-09T14:28:46.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.115+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~G3TY954APTLG.1 size=784859 2024-03-09T14:28:46.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.115+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=G3TY954APTLG tag=62BCQH19TB7G type=write size=2882011 2024-03-09T14:28:46.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.116+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=N2PFP441NRIE type=del 2024-03-09T14:28:46.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.117+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=D82Q0A16D0J5 type=del size=2630380 2024-03-09T14:28:46.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.118+0000 7f1c6444c780 -1 < failed to complete operation key=P33029QWKW23 tag=HZZAECO2DL3Z type=write size=965503: (22) Invalid argument 2024-03-09T14:28:46.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.120+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~KIX1JJMZ5YLA.0 size=1048576 2024-03-09T14:28:46.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.121+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~KIX1JJMZ5YLA.1 size=1048576 2024-03-09T14:28:46.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.122+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~KIX1JJMZ5YLA.2 size=1010421 2024-03-09T14:28:46.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.122+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=KIX1JJMZ5YLA tag=CB8QECCCBH1W type=write size=4156149 2024-03-09T14:28:46.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.123+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=I8SDQCFTE02T type=del 2024-03-09T14:28:46.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.125+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~44RNG6WO3XJB.0 size=1048576 2024-03-09T14:28:46.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.126+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~44RNG6WO3XJB.1 size=1048576 2024-03-09T14:28:46.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.127+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~44RNG6WO3XJB.2 size=17405 2024-03-09T14:28:46.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.127+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=44RNG6WO3XJB tag=68K7SXF42HMQ type=write size=3163133 2024-03-09T14:28:46.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.128+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~VP0ZAEVE0G8K.0 size=1048576 2024-03-09T14:28:46.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.129+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~VP0ZAEVE0G8K.1 size=61479 2024-03-09T14:28:46.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.132+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=VP0ZAEVE0G8K tag=L0EACW3J9HOK type=write size=2158631 2024-03-09T14:28:46.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.133+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=S4PAF3PLALU1 type=del size=1385442 2024-03-09T14:28:46.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.134+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~RDDGUEGG1N6D.0 size=1048576 2024-03-09T14:28:46.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.134+0000 7f1c6444c780 1 < canceled part key=_multipart_KNOEGKSERB6Z.2~RDDGUEGG1N6D.1 size=91864 2024-03-09T14:28:46.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.136+0000 7f1c6444c780 1 < canceled multipart upload key=KNOEGKSERB6Z upload=RDDGUEGG1N6D tag=IGBZGA3TE4K6 type=write size=2189016 2024-03-09T14:28:46.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.139+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~2K3BVE779VUC.0 size=876020 2024-03-09T14:28:46.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.139+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=2K3BVE779VUC tag=H5SYW309MRT8 type=write size=1924596 2024-03-09T14:28:46.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.140+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~R29028T308O8.0 size=1048576 2024-03-09T14:28:46.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.141+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~R29028T308O8.1 size=1008315 2024-03-09T14:28:46.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.143+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=R29028T308O8 tag=E5PL2REMCK0A type=write size=3105467 2024-03-09T14:28:46.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.144+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=KYV6SLVX51GV type=del size=2750379 2024-03-09T14:28:46.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.146+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=05XFSM2V559C type=write size=137396 2024-03-09T14:28:46.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.147+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=J091D09BV21Y type=del size=951319 2024-03-09T14:28:46.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.148+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~IBZ2ULNWQT6T.0 size=437620 2024-03-09T14:28:46.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.150+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=IBZ2ULNWQT6T tag=QQTF7QEC39J0 type=write size=1486196 2024-03-09T14:28:46.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.151+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=0FHRDS0K2HXL type=del size=1870286 2024-03-09T14:28:46.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.152+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~SMO2LWYK80YR.0 size=1048576 2024-03-09T14:28:46.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.153+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~SMO2LWYK80YR.1 size=724140 2024-03-09T14:28:46.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.155+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=SMO2LWYK80YR tag=LOILJN283NEO type=write size=2821292 2024-03-09T14:28:46.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.157+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~PGAAA81T0A7P.0 size=1048576 2024-03-09T14:28:46.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.158+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~PGAAA81T0A7P.1 size=218966 2024-03-09T14:28:46.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.158+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=PGAAA81T0A7P tag=Q7ZW2IAF69R8 type=write size=2316118 2024-03-09T14:28:46.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.159+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=M73SUW05MQVM type=del 2024-03-09T14:28:46.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.160+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=FUVVRV02TSBD type=write size=771070 2024-03-09T14:28:46.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.162+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=P8K2UBKLD0IY type=del 2024-03-09T14:28:46.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.164+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~NYWEUAKQDPPI.0 size=1048576 2024-03-09T14:28:46.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.165+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~NYWEUAKQDPPI.1 size=735911 2024-03-09T14:28:46.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.165+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=NYWEUAKQDPPI tag=GZHH8Z1B1T13 type=write size=2833063 2024-03-09T14:28:46.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.167+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=44335EAZSNWH type=write size=490950 2024-03-09T14:28:46.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.169+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~BK5CBSX1OOEQ.0 size=18551 2024-03-09T14:28:46.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.169+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=BK5CBSX1OOEQ tag=PWRBUMSBOFIK type=write size=1067127 2024-03-09T14:28:46.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.171+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=HFI5OPEF1D62 type=del 2024-03-09T14:28:46.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.172+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=MM8EBR13N2NW type=write size=78016 2024-03-09T14:28:46.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.173+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=X2G6K0O5AZO3 type=del size=99030 2024-03-09T14:28:46.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.175+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~K0X7XHI4VM7L.0 size=1048576 2024-03-09T14:28:46.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.176+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~K0X7XHI4VM7L.1 size=1048576 2024-03-09T14:28:46.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.177+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~K0X7XHI4VM7L.2 size=745378 2024-03-09T14:28:46.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.177+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=K0X7XHI4VM7L tag=2774QPNR5X6C type=write size=3891106 2024-03-09T14:28:46.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.178+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~3WY10XUAAJJ5.0 size=1048576 2024-03-09T14:28:46.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.179+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~3WY10XUAAJJ5.1 size=1048576 2024-03-09T14:28:46.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.180+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~3WY10XUAAJJ5.2 size=6906 2024-03-09T14:28:46.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.182+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=3WY10XUAAJJ5 tag=ZKPR9NQ0NAR3 type=write size=3152634 2024-03-09T14:28:46.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.183+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=PPEJ2WY5UH73 type=del size=625495 2024-03-09T14:28:46.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.184+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~G3TY954APTLG.0 size=1048576 2024-03-09T14:28:46.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.184+0000 7f1c6444c780 1 < canceled part key=_multipart_KMX7TNIOKWOA.2~G3TY954APTLG.1 size=784859 2024-03-09T14:28:46.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.186+0000 7f1c6444c780 1 < canceled multipart upload key=KMX7TNIOKWOA upload=G3TY954APTLG tag=62BCQH19TB7G type=write size=2882011 2024-03-09T14:28:46.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.188+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~P00P0LGFJ6M8.0 size=292933 2024-03-09T14:28:46.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.188+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=P00P0LGFJ6M8 tag=GFLD8MT8MKXC type=write size=1341509 2024-03-09T14:28:46.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.189+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=D82Q0A16D0J5 type=del size=2630380 2024-03-09T14:28:46.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.190+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=C8HHZ51DCFHN type=write size=181373 2024-03-09T14:28:46.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.191+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~KIX1JJMZ5YLA.0 size=1048576 2024-03-09T14:28:46.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.192+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~KIX1JJMZ5YLA.1 size=1048576 2024-03-09T14:28:46.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.193+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~KIX1JJMZ5YLA.2 size=1010421 2024-03-09T14:28:46.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.195+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=KIX1JJMZ5YLA tag=CB8QECCCBH1W type=write size=4156149 2024-03-09T14:28:46.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.196+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=SO1A0UAMHOSG type=del size=1722318 2024-03-09T14:28:46.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.196+0000 7f1c6444c780 1 < canceled part key=_multipart_WMO6LTCMVXD2.2~44RNG6WO3XJB.0 size=1048576 2024-03-09T14:28:46.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.196+0000 7f1c6444c780 1 < canceled part key=_multipart_WMO6LTCMVXD2.2~44RNG6WO3XJB.1 size=1048576 2024-03-09T14:28:46.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.197+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~44RNG6WO3XJB.2 size=17405 2024-03-09T14:28:46.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.199+0000 7f1c6444c780 1 < canceled multipart upload key=WMO6LTCMVXD2 upload=44RNG6WO3XJB tag=68K7SXF42HMQ type=write size=3163133 2024-03-09T14:28:46.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.200+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=8CO3J0IGUJUD type=del size=1315198 2024-03-09T14:28:46.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.201+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=S4PAF3PLALU1 type=del 2024-03-09T14:28:46.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.202+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=ROVA2NZ0R2QI type=del size=1094381 2024-03-09T14:28:46.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.203+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~2K3BVE779VUC.0 size=876020 2024-03-09T14:28:46.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.205+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=2K3BVE779VUC tag=H5SYW309MRT8 type=write size=1924596 2024-03-09T14:28:46.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.206+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=Q4FP15HS53JP type=del size=503238 2024-03-09T14:28:46.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.208+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=KYV6SLVX51GV type=del 2024-03-09T14:28:46.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.209+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~FKTURSHDEC97.0 size=830566 2024-03-09T14:28:46.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.209+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=FKTURSHDEC97 tag=40BV96X0A3AF type=write size=1879142 2024-03-09T14:28:46.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.213+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=J091D09BV21Y type=del 2024-03-09T14:28:46.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.214+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=7RDL28GD62AT type=del size=3247213 2024-03-09T14:28:46.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.215+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=0FHRDS0K2HXL type=del 2024-03-09T14:28:46.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.216+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=JQTBS16OWBKV type=del size=1099901 2024-03-09T14:28:46.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.217+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~PGAAA81T0A7P.0 size=1048576 2024-03-09T14:28:46.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.218+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~PGAAA81T0A7P.1 size=218966 2024-03-09T14:28:46.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.220+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=PGAAA81T0A7P tag=Q7ZW2IAF69R8 type=write size=2316118 2024-03-09T14:28:46.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.222+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~IEO2EUMMZQ2V.0 size=1048576 2024-03-09T14:28:46.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.223+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~IEO2EUMMZQ2V.1 size=1048576 2024-03-09T14:28:46.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.224+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~IEO2EUMMZQ2V.2 size=626846 2024-03-09T14:28:46.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.224+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=IEO2EUMMZQ2V tag=DE6Q2NYCDU2S type=write size=3772574 2024-03-09T14:28:46.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.225+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=FUVVRV02TSBD type=write size=771070 2024-03-09T14:28:46.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.228+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~C89QJM146KCR.0 size=1048576 2024-03-09T14:28:46.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.228+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~C89QJM146KCR.1 size=833808 2024-03-09T14:28:46.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.228+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=C89QJM146KCR tag=4FICD13H6A1B type=write size=2930960 2024-03-09T14:28:46.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.230+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~NYWEUAKQDPPI.0 size=1048576 2024-03-09T14:28:46.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.231+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~NYWEUAKQDPPI.1 size=735911 2024-03-09T14:28:46.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.232+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=NYWEUAKQDPPI tag=GZHH8Z1B1T13 type=write size=2833063 2024-03-09T14:28:46.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.234+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~2VHYVI6MDKEK.0 size=1023175 2024-03-09T14:28:46.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.234+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=2VHYVI6MDKEK tag=70ZPZ5TPJ5HL type=write size=2071751 2024-03-09T14:28:46.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.236+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~BK5CBSX1OOEQ.0 size=18551 2024-03-09T14:28:46.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.237+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=BK5CBSX1OOEQ tag=PWRBUMSBOFIK type=write size=1067127 2024-03-09T14:28:46.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.239+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~EJ8Z3ZA9MUAC.0 size=1048576 2024-03-09T14:28:46.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.240+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~EJ8Z3ZA9MUAC.1 size=909845 2024-03-09T14:28:46.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.240+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=EJ8Z3ZA9MUAC tag=A923LWSMU22Z type=write size=3006997 2024-03-09T14:28:46.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.241+0000 7f1c6444c780 1 < completed write operation key=YECG84AJ5IK2 tag=MM8EBR13N2NW type=write size=78016 2024-03-09T14:28:46.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.242+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=SSXLUOSIJO8M type=del size=675861 2024-03-09T14:28:46.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.244+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~K0X7XHI4VM7L.0 size=1048576 2024-03-09T14:28:46.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.245+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~K0X7XHI4VM7L.1 size=1048576 2024-03-09T14:28:46.246 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.246+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~K0X7XHI4VM7L.2 size=745378 2024-03-09T14:28:46.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.248+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=K0X7XHI4VM7L tag=2774QPNR5X6C type=write size=3891106 2024-03-09T14:28:46.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.250+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~U88XCVQYHFTM.0 size=702396 2024-03-09T14:28:46.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.250+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=U88XCVQYHFTM tag=CHAR39L3RRCX type=write size=1750972 2024-03-09T14:28:46.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.251+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=PPEJ2WY5UH73 type=del 2024-03-09T14:28:46.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.253+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~UGZ2H80WQJTX.0 size=1048576 2024-03-09T14:28:46.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.254+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~UGZ2H80WQJTX.1 size=110911 2024-03-09T14:28:46.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.254+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=UGZ2H80WQJTX tag=D935OKSGMNLS type=write size=2208063 2024-03-09T14:28:46.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.255+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~P00P0LGFJ6M8.0 size=292933 2024-03-09T14:28:46.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.257+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=P00P0LGFJ6M8 tag=GFLD8MT8MKXC type=write size=1341509 2024-03-09T14:28:46.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.259+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~N077M02VYHEL.0 size=320278 2024-03-09T14:28:46.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.259+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=N077M02VYHEL tag=PPVV2VC5QFUI type=write size=1368854 2024-03-09T14:28:46.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.260+0000 7f1c6444c780 1 < completed write operation key=PBM4ICXZ2497 tag=C8HHZ51DCFHN type=write size=181373 2024-03-09T14:28:46.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.261+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=CLL8P37C8S7T type=del size=2526688 2024-03-09T14:28:46.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.262+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=SO1A0UAMHOSG type=del 2024-03-09T14:28:46.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.263+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=AQL8K3Z0700W type=del size=1610053 2024-03-09T14:28:46.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.265+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=8CO3J0IGUJUD type=del size=1315198 2024-03-09T14:28:46.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.266+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=RR1EZMCC0GGT type=del size=417058 2024-03-09T14:28:46.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.267+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=ROVA2NZ0R2QI type=del 2024-03-09T14:28:46.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.268+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=E5YE7Y7UVJXA type=del size=2993082 2024-03-09T14:28:46.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.270+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=Q4FP15HS53JP type=del size=503238 2024-03-09T14:28:46.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.271+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=GH0M6DW4QUDD type=del size=1356087 2024-03-09T14:28:46.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.273+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~FKTURSHDEC97.0 size=830566 2024-03-09T14:28:46.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.274+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=FKTURSHDEC97 tag=40BV96X0A3AF type=write size=1879142 2024-03-09T14:28:46.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.276+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~Z6ZDCODACO2P.0 size=1048576 2024-03-09T14:28:46.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.277+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~Z6ZDCODACO2P.1 size=353219 2024-03-09T14:28:46.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.277+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=Z6ZDCODACO2P tag=YV587MNKFDM1 type=write size=2450371 2024-03-09T14:28:46.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.278+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=7RDL28GD62AT type=del 2024-03-09T14:28:46.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.281+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~GSC3REO4K383.0 size=992212 2024-03-09T14:28:46.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.281+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=GSC3REO4K383 tag=9ZBKE82QLPD1 type=write size=2040788 2024-03-09T14:28:46.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.282+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=JQTBS16OWBKV type=del 2024-03-09T14:28:46.283 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.283+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=0S8HRB3HOKVV type=write size=464564 2024-03-09T14:28:46.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.284+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~IEO2EUMMZQ2V.0 size=1048576 2024-03-09T14:28:46.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.285+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~IEO2EUMMZQ2V.1 size=1048576 2024-03-09T14:28:46.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.286+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~IEO2EUMMZQ2V.2 size=626846 2024-03-09T14:28:46.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.288+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=IEO2EUMMZQ2V tag=DE6Q2NYCDU2S type=write size=3772574 2024-03-09T14:28:46.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.289+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=PMGSS5VVG0GZ type=del size=361769 2024-03-09T14:28:46.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.290+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~C89QJM146KCR.0 size=1048576 2024-03-09T14:28:46.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.291+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~C89QJM146KCR.1 size=833808 2024-03-09T14:28:46.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.293+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=C89QJM146KCR tag=4FICD13H6A1B type=write size=2930960 2024-03-09T14:28:46.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.294+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=N5R6U383QH0K type=write size=328476 2024-03-09T14:28:46.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.295+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~2VHYVI6MDKEK.0 size=1023175 2024-03-09T14:28:46.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.297+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=2VHYVI6MDKEK tag=70ZPZ5TPJ5HL type=write size=2071751 2024-03-09T14:28:46.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.298+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=GKELBNT3SPG1 type=del size=1393128 2024-03-09T14:28:46.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.299+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~EJ8Z3ZA9MUAC.0 size=1048576 2024-03-09T14:28:46.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.300+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~EJ8Z3ZA9MUAC.1 size=909845 2024-03-09T14:28:46.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.302+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=EJ8Z3ZA9MUAC tag=A923LWSMU22Z type=write size=3006997 2024-03-09T14:28:46.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.304+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~KTD4SCGZDDEY.0 size=1048576 2024-03-09T14:28:46.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.305+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~KTD4SCGZDDEY.1 size=137114 2024-03-09T14:28:46.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.305+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=KTD4SCGZDDEY tag=APA14GUT5QXN type=write size=2234266 2024-03-09T14:28:46.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.306+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=SSXLUOSIJO8M type=del 2024-03-09T14:28:46.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.307+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=N56DXWWVEFHK type=del size=109889 2024-03-09T14:28:46.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.308+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~U88XCVQYHFTM.0 size=702396 2024-03-09T14:28:46.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.310+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=U88XCVQYHFTM tag=CHAR39L3RRCX type=write size=1750972 2024-03-09T14:28:46.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.311+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=5O6F15Q73YQ0 type=del size=3381658 2024-03-09T14:28:46.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.312+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~UGZ2H80WQJTX.0 size=1048576 2024-03-09T14:28:46.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.313+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~UGZ2H80WQJTX.1 size=110911 2024-03-09T14:28:46.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.315+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=UGZ2H80WQJTX tag=D935OKSGMNLS type=write size=2208063 2024-03-09T14:28:46.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.318+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~4RO80CG1ZKA7.0 size=1048576 2024-03-09T14:28:46.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.319+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~4RO80CG1ZKA7.1 size=1048576 2024-03-09T14:28:46.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.320+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~4RO80CG1ZKA7.2 size=868290 2024-03-09T14:28:46.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.320+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=4RO80CG1ZKA7 tag=TDLO05FL58VQ type=write size=4014018 2024-03-09T14:28:46.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.321+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~N077M02VYHEL.0 size=320278 2024-03-09T14:28:46.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.323+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=N077M02VYHEL tag=PPVV2VC5QFUI type=write size=1368854 2024-03-09T14:28:46.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.325+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~7PAKO8794NLX.0 size=960517 2024-03-09T14:28:46.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.325+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=7PAKO8794NLX tag=PK242BS4PD7P type=write size=2009093 2024-03-09T14:28:46.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.326+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=CLL8P37C8S7T type=del 2024-03-09T14:28:46.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.327+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=IAGLZZYOC29C type=del size=2567705 2024-03-09T14:28:46.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.328+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=AQL8K3Z0700W type=del 2024-03-09T14:28:46.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.330+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=QUSWF3627OJ7 type=del size=3303534 2024-03-09T14:28:46.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.331+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=RR1EZMCC0GGT type=del 2024-03-09T14:28:46.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.332+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=GA36T63FNH67 type=write size=1036719 2024-03-09T14:28:46.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.334+0000 7f1c6444c780 1 < suggested update operation key=35Y98D5U0M8O tag=E5YE7Y7UVJXA type=del size=2993082 2024-03-09T14:28:46.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.336+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=IMM02I92GWNK type=del size=4191423 2024-03-09T14:28:46.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.337+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=GH0M6DW4QUDD type=del 2024-03-09T14:28:46.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.339+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~9IA1NSAAHQ7A.0 size=1048576 2024-03-09T14:28:46.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.340+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~9IA1NSAAHQ7A.1 size=1048576 2024-03-09T14:28:46.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.341+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~9IA1NSAAHQ7A.2 size=473145 2024-03-09T14:28:46.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.341+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=9IA1NSAAHQ7A tag=PGW0JLGQI624 type=write size=3618873 2024-03-09T14:28:46.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.342+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~Z6ZDCODACO2P.0 size=1048576 2024-03-09T14:28:46.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.343+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~Z6ZDCODACO2P.1 size=353219 2024-03-09T14:28:46.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.345+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=Z6ZDCODACO2P tag=YV587MNKFDM1 type=write size=2450371 2024-03-09T14:28:46.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.347+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~8EH24XCGP1DN.0 size=1048576 2024-03-09T14:28:46.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.348+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~8EH24XCGP1DN.1 size=1048576 2024-03-09T14:28:46.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.349+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~8EH24XCGP1DN.2 size=807443 2024-03-09T14:28:46.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.349+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=8EH24XCGP1DN tag=WUFQ4TDERZLA type=write size=3953171 2024-03-09T14:28:46.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.350+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~GSC3REO4K383.0 size=992212 2024-03-09T14:28:46.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.352+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=GSC3REO4K383 tag=9ZBKE82QLPD1 type=write size=2040788 2024-03-09T14:28:46.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.353+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=TBAVK9N5UCR8 type=write size=644387 2024-03-09T14:28:46.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.355+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=0S8HRB3HOKVV type=write size=464564 2024-03-09T14:28:46.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.356+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=KUU8QEBWC30G type=write size=731186 2024-03-09T14:28:46.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.358+0000 7f1c6444c780 1 < suggested remove operation key=26VE2HJPD0FX tag=PMGSS5VVG0GZ type=del 2024-03-09T14:28:46.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.359+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=PNG22FGTRXV6 type=del size=1447386 2024-03-09T14:28:46.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.360+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=N5R6U383QH0K type=write size=328476 2024-03-09T14:28:46.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.361+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=3H3DAY5JWJXV type=del size=2602229 2024-03-09T14:28:46.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.363+0000 7f1c6444c780 1 < canceled operation key=HPFPL79B0GLS tag=GKELBNT3SPG1 type=del size=1393128 2024-03-09T14:28:46.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.364+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=IGB5Z0TML0O1 type=del size=2742444 2024-03-09T14:28:46.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.365+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~KTD4SCGZDDEY.0 size=1048576 2024-03-09T14:28:46.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.366+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~KTD4SCGZDDEY.1 size=137114 2024-03-09T14:28:46.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.368+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=KTD4SCGZDDEY tag=APA14GUT5QXN type=write size=2234266 2024-03-09T14:28:46.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.370+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~WSG7CMEOB5I3.0 size=1048576 2024-03-09T14:28:46.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.371+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~WSG7CMEOB5I3.1 size=1048576 2024-03-09T14:28:46.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.372+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~WSG7CMEOB5I3.2 size=625493 2024-03-09T14:28:46.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.372+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=WSG7CMEOB5I3 tag=TM26I3UEBAP9 type=write size=3771221 2024-03-09T14:28:46.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.374+0000 7f1c6444c780 1 < suggested update operation key=VL5EUQ52WRAN tag=N56DXWWVEFHK type=del size=109889 2024-03-09T14:28:46.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.375+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=2F94B50JI8AY type=del size=3369612 2024-03-09T14:28:46.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.376+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=5O6F15Q73YQ0 type=del size=3381658 2024-03-09T14:28:46.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.378+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~C2MOA58FLZ95.0 size=527336 2024-03-09T14:28:46.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.378+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=C2MOA58FLZ95 tag=VXQL9S1NTD2I type=write size=1575912 2024-03-09T14:28:46.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.380+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~4RO80CG1ZKA7.0 size=1048576 2024-03-09T14:28:46.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.381+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~4RO80CG1ZKA7.1 size=1048576 2024-03-09T14:28:46.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.381+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~4RO80CG1ZKA7.2 size=868290 2024-03-09T14:28:46.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.383+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=4RO80CG1ZKA7 tag=TDLO05FL58VQ type=write size=4014018 2024-03-09T14:28:46.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.386+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~261GXAV8BCO6.0 size=55255 2024-03-09T14:28:46.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.386+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=261GXAV8BCO6 tag=JZDDYF6FXVKO type=write size=1103831 2024-03-09T14:28:46.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.387+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~7PAKO8794NLX.0 size=960517 2024-03-09T14:28:46.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.389+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=7PAKO8794NLX tag=PK242BS4PD7P type=write size=2009093 2024-03-09T14:28:46.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.390+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=Q7MT87SHGBWP type=del size=3311070 2024-03-09T14:28:46.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.391+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=IAGLZZYOC29C type=del 2024-03-09T14:28:46.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.392+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=SCUXCZ0T4JXB type=del size=1361443 2024-03-09T14:28:46.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.393+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=QUSWF3627OJ7 type=del 2024-03-09T14:28:46.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.395+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~PIN1YNE01GKX.0 size=506765 2024-03-09T14:28:46.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.395+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=PIN1YNE01GKX tag=4Q2SDSD0S218 type=write size=1555341 2024-03-09T14:28:46.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.398+0000 7f1c6444c780 1 < suggested remove operation key=MX3X6ILR7J8N tag=GA36T63FNH67 type=write 2024-03-09T14:28:46.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.400+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~YEFU9TH92FQC.0 size=11610 2024-03-09T14:28:46.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.400+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=YEFU9TH92FQC tag=NMB77A4E4A0U type=write size=1060186 2024-03-09T14:28:46.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.401+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=IMM02I92GWNK type=del 2024-03-09T14:28:46.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.403+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~9651RZF4OIWO.0 size=124528 2024-03-09T14:28:46.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.403+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=9651RZF4OIWO tag=SER73AY2HBH0 type=write size=1173104 2024-03-09T14:28:46.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.404+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~9IA1NSAAHQ7A.0 size=1048576 2024-03-09T14:28:46.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.405+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~9IA1NSAAHQ7A.1 size=1048576 2024-03-09T14:28:46.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.405+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~9IA1NSAAHQ7A.2 size=473145 2024-03-09T14:28:46.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.407+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=9IA1NSAAHQ7A tag=PGW0JLGQI624 type=write size=3618873 2024-03-09T14:28:46.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.408+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=6W0LNUZ9D4DY type=write size=188435 2024-03-09T14:28:46.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.410+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~8EH24XCGP1DN.0 size=1048576 2024-03-09T14:28:46.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.410+0000 7f1c6444c780 1 < canceled part key=_multipart_HNK7POWS6FSU.2~8EH24XCGP1DN.1 size=1048576 2024-03-09T14:28:46.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.411+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~8EH24XCGP1DN.2 size=807443 2024-03-09T14:28:46.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.412+0000 7f1c6444c780 1 < canceled multipart upload key=HNK7POWS6FSU upload=8EH24XCGP1DN tag=WUFQ4TDERZLA type=write size=3953171 2024-03-09T14:28:46.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.414+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=K2BDARY6JMGZ type=del size=597704 2024-03-09T14:28:46.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.415+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=TBAVK9N5UCR8 type=write size=644387 2024-03-09T14:28:46.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.416+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=71Q0XXYR2GN1 type=del size=2775791 2024-03-09T14:28:46.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.418+0000 7f1c6444c780 1 < suggested update operation key=CVD0EGQUVJYR tag=KUU8QEBWC30G type=write size=731186 2024-03-09T14:28:46.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.420+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=RYIKHU7Y2FXA type=del size=3584168 2024-03-09T14:28:46.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.421+0000 7f1c6444c780 1 < canceled operation key=EREG1M13901A tag=PNG22FGTRXV6 type=del size=1447386 2024-03-09T14:28:46.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.422+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=WAJO5VFL926X type=write size=368850 2024-03-09T14:28:46.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.424+0000 7f1c6444c780 1 < suggested update operation key=0IHHFQBKKJ0G tag=3H3DAY5JWJXV type=del size=2602229 2024-03-09T14:28:46.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.427+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~WQIKKCESPGPY.0 size=1048576 2024-03-09T14:28:46.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.428+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~WQIKKCESPGPY.1 size=1048576 2024-03-09T14:28:46.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.429+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~WQIKKCESPGPY.2 size=394752 2024-03-09T14:28:46.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.429+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=WQIKKCESPGPY tag=WENYN8QV01M8 type=write size=3540480 2024-03-09T14:28:46.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.430+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=IGB5Z0TML0O1 type=del 2024-03-09T14:28:46.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.432+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~ZJ07MPGRR5PI.0 size=1048576 2024-03-09T14:28:46.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.433+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~ZJ07MPGRR5PI.1 size=329601 2024-03-09T14:28:46.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.433+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=ZJ07MPGRR5PI tag=5E1S7XTB3WW2 type=write size=2426753 2024-03-09T14:28:46.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.434+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~WSG7CMEOB5I3.0 size=1048576 2024-03-09T14:28:46.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.435+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~WSG7CMEOB5I3.1 size=1048576 2024-03-09T14:28:46.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.437+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~WSG7CMEOB5I3.2 size=625493 2024-03-09T14:28:46.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.439+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=WSG7CMEOB5I3 tag=TM26I3UEBAP9 type=write size=3771221 2024-03-09T14:28:46.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.440+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=T77RIYA42CL2 type=write size=1012113 2024-03-09T14:28:46.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.442+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=2F94B50JI8AY type=del 2024-03-09T14:28:46.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.443+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=JXVZ14YKRWAP type=del size=3377350 2024-03-09T14:28:46.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.444+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~C2MOA58FLZ95.0 size=527336 2024-03-09T14:28:46.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.446+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=C2MOA58FLZ95 tag=VXQL9S1NTD2I type=write size=1575912 2024-03-09T14:28:46.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.448+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~BRGF3RA84ZQ9.0 size=1048576 2024-03-09T14:28:46.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.449+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~BRGF3RA84ZQ9.1 size=796818 2024-03-09T14:28:46.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.449+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=BRGF3RA84ZQ9 tag=CRX0DPX0E2HH type=write size=2893970 2024-03-09T14:28:46.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.450+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~261GXAV8BCO6.0 size=55255 2024-03-09T14:28:46.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.452+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=261GXAV8BCO6 tag=JZDDYF6FXVKO type=write size=1103831 2024-03-09T14:28:46.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.454+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~P3WYMGHNYZMD.0 size=1048576 2024-03-09T14:28:46.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.455+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~P3WYMGHNYZMD.1 size=1048576 2024-03-09T14:28:46.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.456+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~P3WYMGHNYZMD.2 size=217311 2024-03-09T14:28:46.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.456+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=P3WYMGHNYZMD tag=NKWR9RX5TX1Q type=write size=3363039 2024-03-09T14:28:46.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.457+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=Q7MT87SHGBWP type=del 2024-03-09T14:28:46.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.459+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~LR5MWDT9TZXE.0 size=290161 2024-03-09T14:28:46.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.459+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=LR5MWDT9TZXE tag=32KY6XT104NF type=write size=1338737 2024-03-09T14:28:46.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.461+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=SCUXCZ0T4JXB type=del 2024-03-09T14:28:46.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.463+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~15N9ZE6C6LYE.0 size=230212 2024-03-09T14:28:46.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.463+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=15N9ZE6C6LYE tag=UYYMAKS1Z9PL type=write size=1278788 2024-03-09T14:28:46.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.464+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~PIN1YNE01GKX.0 size=506765 2024-03-09T14:28:46.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.466+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=PIN1YNE01GKX tag=4Q2SDSD0S218 type=write size=1555341 2024-03-09T14:28:46.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.467+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=W06X165YJ62H type=del size=87522 2024-03-09T14:28:46.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.467+0000 7f1c6444c780 1 < canceled part key=_multipart_35Y98D5U0M8O.2~YEFU9TH92FQC.0 size=11610 2024-03-09T14:28:46.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.469+0000 7f1c6444c780 1 < canceled multipart upload key=35Y98D5U0M8O upload=YEFU9TH92FQC tag=NMB77A4E4A0U type=write size=1060186 2024-03-09T14:28:46.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.470+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=PX386JN5P3MZ type=del size=701852 2024-03-09T14:28:46.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.472+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~9651RZF4OIWO.0 size=124528 2024-03-09T14:28:46.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.473+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=9651RZF4OIWO tag=SER73AY2HBH0 type=write size=1173104 2024-03-09T14:28:46.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.475+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=GC0FH1JQITNF type=del size=2450484 2024-03-09T14:28:46.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.477+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=6W0LNUZ9D4DY type=write size=188435 2024-03-09T14:28:46.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.478+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=U2KPW2K0VWXS type=del size=2386232 2024-03-09T14:28:46.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.480+0000 7f1c6444c780 1 < suggested update operation key=KWDIDE9AE3JP tag=K2BDARY6JMGZ type=del size=597704 2024-03-09T14:28:46.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.482+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~CHMSQNNYRZ1M.0 size=774032 2024-03-09T14:28:46.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.482+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=CHMSQNNYRZ1M tag=51D1MDS2OVX7 type=write size=1822608 2024-03-09T14:28:46.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.485+0000 7f1c6444c780 1 < suggested update operation key=MOVS6ZMK708G tag=71Q0XXYR2GN1 type=del size=2775791 2024-03-09T14:28:46.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.486+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=CQXPYVZMSNGE type=del size=1325599 2024-03-09T14:28:46.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.487+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=RYIKHU7Y2FXA type=del 2024-03-09T14:28:46.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.489+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~SRV529TPHH74.0 size=1025070 2024-03-09T14:28:46.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.489+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=SRV529TPHH74 tag=0UTCA3N2MSFG type=write size=2073646 2024-03-09T14:28:46.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.490+0000 7f1c6444c780 1 < canceled operation key=V05XJ56M53T8 tag=WAJO5VFL926X type=write size=368850 2024-03-09T14:28:46.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.491+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=0Z1B9FYT2GF2 type=write size=189516 2024-03-09T14:28:46.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.492+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~WQIKKCESPGPY.0 size=1048576 2024-03-09T14:28:46.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.493+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~WQIKKCESPGPY.1 size=1048576 2024-03-09T14:28:46.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.494+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~WQIKKCESPGPY.2 size=394752 2024-03-09T14:28:46.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.496+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=WQIKKCESPGPY tag=WENYN8QV01M8 type=write size=3540480 2024-03-09T14:28:46.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.499+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~0Y7B1I60R7W9.0 size=1048576 2024-03-09T14:28:46.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.500+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~0Y7B1I60R7W9.1 size=957552 2024-03-09T14:28:46.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.500+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=0Y7B1I60R7W9 tag=5BDBLKJ1RP9C type=write size=3054704 2024-03-09T14:28:46.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.501+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~ZJ07MPGRR5PI.0 size=1048576 2024-03-09T14:28:46.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.502+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~ZJ07MPGRR5PI.1 size=329601 2024-03-09T14:28:46.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.504+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=ZJ07MPGRR5PI tag=5E1S7XTB3WW2 type=write size=2426753 2024-03-09T14:28:46.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.505+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=UMHBJOPJQ35I type=del size=3862371 2024-03-09T14:28:46.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.506+0000 7f1c6444c780 1 < completed write operation key=HNK7POWS6FSU tag=T77RIYA42CL2 type=write size=1012113 2024-03-09T14:28:46.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.508+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~4L38XWGF7KJJ.0 size=1048576 2024-03-09T14:28:46.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.509+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~4L38XWGF7KJJ.1 size=1048576 2024-03-09T14:28:46.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.510+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~4L38XWGF7KJJ.2 size=957619 2024-03-09T14:28:46.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.510+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=4L38XWGF7KJJ tag=MFDG0VJ0V51F type=write size=4103347 2024-03-09T14:28:46.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.511+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=JXVZ14YKRWAP type=del 2024-03-09T14:28:46.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.512+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=4Z8O50I0W2J8 type=del size=623455 2024-03-09T14:28:46.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.513+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~BRGF3RA84ZQ9.0 size=1048576 2024-03-09T14:28:46.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.514+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~BRGF3RA84ZQ9.1 size=796818 2024-03-09T14:28:46.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.516+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=BRGF3RA84ZQ9 tag=CRX0DPX0E2HH type=write size=2893970 2024-03-09T14:28:46.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.517+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=7ROG22H3CF7X type=del size=2472337 2024-03-09T14:28:46.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.519+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~P3WYMGHNYZMD.0 size=1048576 2024-03-09T14:28:46.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.520+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~P3WYMGHNYZMD.1 size=1048576 2024-03-09T14:28:46.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.520+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~P3WYMGHNYZMD.2 size=217311 2024-03-09T14:28:46.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.523+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=P3WYMGHNYZMD tag=NKWR9RX5TX1Q type=write size=3363039 2024-03-09T14:28:46.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.524+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=7XF86ARY1ONJ type=del size=3312400 2024-03-09T14:28:46.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.525+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~LR5MWDT9TZXE.0 size=290161 2024-03-09T14:28:46.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.527+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=LR5MWDT9TZXE tag=32KY6XT104NF type=write size=1338737 2024-03-09T14:28:46.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.529+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~WVK38YONF5DY.0 size=1048576 2024-03-09T14:28:46.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.530+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~WVK38YONF5DY.1 size=332453 2024-03-09T14:28:46.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.530+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=WVK38YONF5DY tag=CRLJT2W36VYH type=write size=2429605 2024-03-09T14:28:46.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.531+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~15N9ZE6C6LYE.0 size=230212 2024-03-09T14:28:46.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.534+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=15N9ZE6C6LYE tag=UYYMAKS1Z9PL type=write size=1278788 2024-03-09T14:28:46.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.535+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=G9B8B0YN1Z2N type=del size=353409 2024-03-09T14:28:46.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.537+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=W06X165YJ62H type=del 2024-03-09T14:28:46.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.538+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=K3KU0QFTTYG3 type=write size=600371 2024-03-09T14:28:46.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.539+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=PX386JN5P3MZ type=del size=701852 2024-03-09T14:28:46.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.540+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=SMWS7MB423NI type=del size=1645532 2024-03-09T14:28:46.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.541+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=GC0FH1JQITNF type=del 2024-03-09T14:28:46.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.543+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~3HXTDKQVITCB.0 size=1048576 2024-03-09T14:28:46.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.544+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~3HXTDKQVITCB.1 size=202047 2024-03-09T14:28:46.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.544+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=3HXTDKQVITCB tag=N77WUAKWXQYO type=write size=2299199 2024-03-09T14:28:46.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.546+0000 7f1c6444c780 1 < suggested update operation key=KWDIDE9AE3JP tag=U2KPW2K0VWXS type=del size=2386232 2024-03-09T14:28:46.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.547+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=F7POLW4ZNKJ8 type=del size=2717637 2024-03-09T14:28:46.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.549+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~CHMSQNNYRZ1M.0 size=774032 2024-03-09T14:28:46.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.550+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=CHMSQNNYRZ1M tag=51D1MDS2OVX7 type=write size=1822608 2024-03-09T14:28:46.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.552+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~TDLSWF3PJO7J.0 size=962195 2024-03-09T14:28:46.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.552+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=TDLSWF3PJO7J tag=XUGEJ00YOCBR type=write size=2010771 2024-03-09T14:28:46.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.554+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=CQXPYVZMSNGE type=del 2024-03-09T14:28:46.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.555+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=2ZX321D6HMBG type=del size=2244238 2024-03-09T14:28:46.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.556+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~SRV529TPHH74.0 size=1025070 2024-03-09T14:28:46.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.558+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=SRV529TPHH74 tag=0UTCA3N2MSFG type=write size=2073646 2024-03-09T14:28:46.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.559+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=II6OZUOE71L5 type=del size=2115505 2024-03-09T14:28:46.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.560+0000 7f1c6444c780 1 < completed write operation key=NIN0FB6YTKWA tag=0Z1B9FYT2GF2 type=write size=189516 2024-03-09T14:28:46.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.561+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=P3I9B4D1CDU6 type=del size=3120034 2024-03-09T14:28:46.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.562+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~0Y7B1I60R7W9.0 size=1048576 2024-03-09T14:28:46.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.563+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~0Y7B1I60R7W9.1 size=957552 2024-03-09T14:28:46.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.565+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=0Y7B1I60R7W9 tag=5BDBLKJ1RP9C type=write size=3054704 2024-03-09T14:28:46.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.566+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=8CMG9ZL2K75P type=write size=291369 2024-03-09T14:28:46.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.568+0000 7f1c6444c780 1 < suggested remove operation key=BAWV7KY6NT8P tag=UMHBJOPJQ35I type=del 2024-03-09T14:28:46.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.570+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=Z7B0C54WEWS6 type=del size=1657942 2024-03-09T14:28:46.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.571+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~4L38XWGF7KJJ.0 size=1048576 2024-03-09T14:28:46.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.572+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~4L38XWGF7KJJ.1 size=1048576 2024-03-09T14:28:46.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.573+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~4L38XWGF7KJJ.2 size=957619 2024-03-09T14:28:46.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.575+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=4L38XWGF7KJJ tag=MFDG0VJ0V51F type=write size=4103347 2024-03-09T14:28:46.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.576+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=Z5AEVLT7Q7AA type=del size=3790733 2024-03-09T14:28:46.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.578+0000 7f1c6444c780 1 < suggested update operation key=BYX1155MZ2LP tag=4Z8O50I0W2J8 type=del size=623455 2024-03-09T14:28:46.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.579+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=NKSJ55PXW8MU type=del size=4085249 2024-03-09T14:28:46.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.580+0000 7f1c6444c780 -1 < failed to complete operation key=KWDIDE9AE3JP tag=7ROG22H3CF7X type=del size=2472337: (22) Invalid argument 2024-03-09T14:28:46.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.582+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~MZMSLARTBHHX.0 size=1048576 2024-03-09T14:28:46.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.583+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~MZMSLARTBHHX.1 size=1048576 2024-03-09T14:28:46.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.584+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~MZMSLARTBHHX.2 size=706017 2024-03-09T14:28:46.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.584+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=MZMSLARTBHHX tag=C3FLEX7Q3TE9 type=write size=3851745 2024-03-09T14:28:46.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.586+0000 7f1c6444c780 1 < suggested update operation key=CVD0EGQUVJYR tag=7XF86ARY1ONJ type=del size=3312400 2024-03-09T14:28:46.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.587+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=14RROLS2VDLZ type=del size=503747 2024-03-09T14:28:46.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.589+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~WVK38YONF5DY.0 size=1048576 2024-03-09T14:28:46.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.590+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~WVK38YONF5DY.1 size=332453 2024-03-09T14:28:46.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.592+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=WVK38YONF5DY tag=CRLJT2W36VYH type=write size=2429605 2024-03-09T14:28:46.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.593+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=4YYW9VL9COZK type=del size=2609541 2024-03-09T14:28:46.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.595+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=G9B8B0YN1Z2N type=del 2024-03-09T14:28:46.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.597+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~ZFNHXL626Z1D.0 size=332735 2024-03-09T14:28:46.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.597+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=ZFNHXL626Z1D tag=NU5QNXV4SK9Z type=write size=1381311 2024-03-09T14:28:46.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.599+0000 7f1c6444c780 1 < suggested remove operation key=CVD0EGQUVJYR tag=K3KU0QFTTYG3 type=write 2024-03-09T14:28:46.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.601+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~ESNZX091YXEZ.0 size=1048576 2024-03-09T14:28:46.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.602+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~ESNZX091YXEZ.1 size=1048576 2024-03-09T14:28:46.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.603+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~ESNZX091YXEZ.2 size=19409 2024-03-09T14:28:46.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.603+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=ESNZX091YXEZ tag=9PND1MTG811K type=write size=3165137 2024-03-09T14:28:46.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.605+0000 7f1c6444c780 1 < suggested remove operation key=YECG84AJ5IK2 tag=SMWS7MB423NI type=del 2024-03-09T14:28:46.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.606+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=1RSLNIBPJT08 type=del size=2164426 2024-03-09T14:28:46.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.607+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~3HXTDKQVITCB.0 size=1048576 2024-03-09T14:28:46.608 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.608+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~3HXTDKQVITCB.1 size=202047 2024-03-09T14:28:46.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.610+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=3HXTDKQVITCB tag=N77WUAKWXQYO type=write size=2299199 2024-03-09T14:28:46.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.612+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~NQ59GT0YU2LF.0 size=871462 2024-03-09T14:28:46.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.612+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=NQ59GT0YU2LF tag=69ACJ2U0IGPO type=write size=1920038 2024-03-09T14:28:46.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.614+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=F7POLW4ZNKJ8 type=del 2024-03-09T14:28:46.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.616+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~YB79B3ESYE3K.0 size=1048576 2024-03-09T14:28:46.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.617+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~YB79B3ESYE3K.1 size=575575 2024-03-09T14:28:46.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.617+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=YB79B3ESYE3K tag=RGX523NWLCAL type=write size=2672727 2024-03-09T14:28:46.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.618+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~TDLSWF3PJO7J.0 size=962195 2024-03-09T14:28:46.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.620+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=TDLSWF3PJO7J tag=XUGEJ00YOCBR type=write size=2010771 2024-03-09T14:28:46.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.621+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=3ZIY6YWSNYA2 type=del size=1355082 2024-03-09T14:28:46.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.622+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=2ZX321D6HMBG type=del 2024-03-09T14:28:46.623 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.623+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=NFPKBB6GNU1D type=del size=205029 2024-03-09T14:28:46.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.625+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=II6OZUOE71L5 type=del 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.627+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~F6EWC01SF4G8.0 size=772497 2024-03-09T14:28:46.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.627+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=F6EWC01SF4G8 tag=393XHZNO8XE3 type=write size=1821073 2024-03-09T14:28:46.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.628+0000 7f1c6444c780 -1 < failed to complete operation key=CVD0EGQUVJYR tag=P3I9B4D1CDU6 type=del size=3120034: (22) Invalid argument 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.630+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~4W3NLIZ8BZPR.0 size=348991 2024-03-09T14:28:46.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.630+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=4W3NLIZ8BZPR tag=E1B828QTL4WO type=write size=1397567 2024-03-09T14:28:46.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.632+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=8CMG9ZL2K75P type=write 2024-03-09T14:28:46.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.633+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=R139BW1N4MK4 type=del size=3696388 2024-03-09T14:28:46.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.634+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=Z7B0C54WEWS6 type=del 2024-03-09T14:28:46.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.636+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~3EB52HZK14AU.0 size=1048576 2024-03-09T14:28:46.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.637+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~3EB52HZK14AU.1 size=832697 2024-03-09T14:28:46.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.637+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=3EB52HZK14AU tag=YZRWPKYY4ZF2 type=write size=2929849 2024-03-09T14:28:46.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.640+0000 7f1c6444c780 1 < suggested remove operation key=Z34QOCZB3DFX tag=Z5AEVLT7Q7AA type=del 2024-03-09T14:28:46.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.642+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=OD8JFVLPJDYE type=del size=3521442 2024-03-09T14:28:46.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.645+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=NKSJ55PXW8MU type=del 2024-03-09T14:28:46.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.647+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~01B893AKJ8TK.0 size=1048576 2024-03-09T14:28:46.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.647+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~01B893AKJ8TK.1 size=1048576 2024-03-09T14:28:46.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.648+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~01B893AKJ8TK.2 size=88118 2024-03-09T14:28:46.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.648+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=01B893AKJ8TK tag=0SUDDCNHOXF6 type=write size=3233846 2024-03-09T14:28:46.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.649+0000 7f1c6444c780 1 < canceled part key=_multipart_0ZZ0P8Y7KSAX.2~MZMSLARTBHHX.0 size=1048576 2024-03-09T14:28:46.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.650+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~MZMSLARTBHHX.1 size=1048576 2024-03-09T14:28:46.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.650+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~MZMSLARTBHHX.2 size=706017 2024-03-09T14:28:46.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.652+0000 7f1c6444c780 1 < canceled multipart upload key=0ZZ0P8Y7KSAX upload=MZMSLARTBHHX tag=C3FLEX7Q3TE9 type=write size=3851745 2024-03-09T14:28:46.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.653+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=MFTNGYDWT4NR type=del size=3012487 2024-03-09T14:28:46.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.655+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=14RROLS2VDLZ type=del 2024-03-09T14:28:46.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.657+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~LNIOUTPA7WSX.0 size=1048576 2024-03-09T14:28:46.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.658+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~LNIOUTPA7WSX.1 size=527210 2024-03-09T14:28:46.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.658+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=LNIOUTPA7WSX tag=UXA3QJ05F2B6 type=write size=2624362 2024-03-09T14:28:46.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.659+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=4YYW9VL9COZK type=del 2024-03-09T14:28:46.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.660+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=SVU9TSP04L0L type=del size=3815596 2024-03-09T14:28:46.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.661+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~ZFNHXL626Z1D.0 size=332735 2024-03-09T14:28:46.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.663+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=ZFNHXL626Z1D tag=NU5QNXV4SK9Z type=write size=1381311 2024-03-09T14:28:46.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.664+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=CPUWYO02IKRF type=del size=3399061 2024-03-09T14:28:46.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.665+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~ESNZX091YXEZ.0 size=1048576 2024-03-09T14:28:46.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.665+0000 7f1c6444c780 1 < canceled part key=_multipart_1NQRJ8ICZNM6.2~ESNZX091YXEZ.1 size=1048576 2024-03-09T14:28:46.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.666+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~ESNZX091YXEZ.2 size=19409 2024-03-09T14:28:46.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.668+0000 7f1c6444c780 1 < canceled multipart upload key=1NQRJ8ICZNM6 upload=ESNZX091YXEZ tag=9PND1MTG811K type=write size=3165137 2024-03-09T14:28:46.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.669+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=P7PQLWPUVUPT type=del size=105780 2024-03-09T14:28:46.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.670+0000 7f1c6444c780 1 < canceled operation key=EREG1M13901A tag=1RSLNIBPJT08 type=del size=2164426 2024-03-09T14:28:46.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.673+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~T7PZJK78HLLF.0 size=259886 2024-03-09T14:28:46.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.673+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=T7PZJK78HLLF tag=9H0ZFGPO6EOM type=write size=1308462 2024-03-09T14:28:46.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.674+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~NQ59GT0YU2LF.0 size=871462 2024-03-09T14:28:46.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.676+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=NQ59GT0YU2LF tag=69ACJ2U0IGPO type=write size=1920038 2024-03-09T14:28:46.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.678+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~HL4QA5NK10DL.0 size=1048576 2024-03-09T14:28:46.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.679+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~HL4QA5NK10DL.1 size=436265 2024-03-09T14:28:46.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.679+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=HL4QA5NK10DL tag=RYMUQE4GP354 type=write size=2533417 2024-03-09T14:28:46.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.680+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~YB79B3ESYE3K.0 size=1048576 2024-03-09T14:28:46.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.681+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~YB79B3ESYE3K.1 size=575575 2024-03-09T14:28:46.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.683+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=YB79B3ESYE3K tag=RGX523NWLCAL type=write size=2672727 2024-03-09T14:28:46.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.685+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~Q1C0UJHUZLRK.0 size=1048576 2024-03-09T14:28:46.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.686+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~Q1C0UJHUZLRK.1 size=276730 2024-03-09T14:28:46.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.686+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=Q1C0UJHUZLRK tag=9NZSJ91SFYKJ type=write size=2373882 2024-03-09T14:28:46.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.687+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=3ZIY6YWSNYA2 type=del 2024-03-09T14:28:46.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.688+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=7V5G45H988XC type=del size=631521 2024-03-09T14:28:46.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.689+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=NFPKBB6GNU1D type=del 2024-03-09T14:28:46.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.690+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=8ZGLVWMZGNP5 type=del size=1681835 2024-03-09T14:28:46.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.691+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~F6EWC01SF4G8.0 size=772497 2024-03-09T14:28:46.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.693+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=F6EWC01SF4G8 tag=393XHZNO8XE3 type=write size=1821073 2024-03-09T14:28:46.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.694+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=3YARMID8EMVW type=del size=2967959 2024-03-09T14:28:46.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.696+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~4W3NLIZ8BZPR.0 size=348991 2024-03-09T14:28:46.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.698+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=4W3NLIZ8BZPR tag=E1B828QTL4WO type=write size=1397567 2024-03-09T14:28:46.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.700+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~P927GNS3168R.0 size=1048576 2024-03-09T14:28:46.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.701+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~P927GNS3168R.1 size=1048576 2024-03-09T14:28:46.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.702+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~P927GNS3168R.2 size=63529 2024-03-09T14:28:46.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.702+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=P927GNS3168R tag=OHS5DU3AULUK type=write size=3209257 2024-03-09T14:28:46.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.703+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=R139BW1N4MK4 type=del 2024-03-09T14:28:46.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.704+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=8C9H41GF59A8 type=write size=266340 2024-03-09T14:28:46.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.705+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~3EB52HZK14AU.0 size=1048576 2024-03-09T14:28:46.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.706+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~3EB52HZK14AU.1 size=832697 2024-03-09T14:28:46.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.708+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=3EB52HZK14AU tag=YZRWPKYY4ZF2 type=write size=2929849 2024-03-09T14:28:46.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.710+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~I102T8135CV5.0 size=1048576 2024-03-09T14:28:46.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.711+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~I102T8135CV5.1 size=1048576 2024-03-09T14:28:46.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.712+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~I102T8135CV5.2 size=560148 2024-03-09T14:28:46.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.712+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=I102T8135CV5 tag=N7ZT5MVHDM2D type=write size=3705876 2024-03-09T14:28:46.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.713+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=OD8JFVLPJDYE type=del 2024-03-09T14:28:46.715 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.715+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~8UCJD60XZCAM.0 size=1048576 2024-03-09T14:28:46.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.715+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~8UCJD60XZCAM.1 size=1048576 2024-03-09T14:28:46.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.716+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~8UCJD60XZCAM.2 size=258212 2024-03-09T14:28:46.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.716+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=8UCJD60XZCAM tag=284X3YOCEGRQ type=write size=3403940 2024-03-09T14:28:46.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.717+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~01B893AKJ8TK.0 size=1048576 2024-03-09T14:28:46.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.718+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~01B893AKJ8TK.1 size=1048576 2024-03-09T14:28:46.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.719+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~01B893AKJ8TK.2 size=88118 2024-03-09T14:28:46.721 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.721+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=01B893AKJ8TK tag=0SUDDCNHOXF6 type=write size=3233846 2024-03-09T14:28:46.722 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.722+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=RCL6F5ES2U0U type=del size=119184 2024-03-09T14:28:46.723 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.723+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=MFTNGYDWT4NR type=del 2024-03-09T14:28:46.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.724+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=OEWZPO5PFXG4 type=write size=750047 2024-03-09T14:28:46.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.726+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~LNIOUTPA7WSX.0 size=1048576 2024-03-09T14:28:46.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.726+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~LNIOUTPA7WSX.1 size=527210 2024-03-09T14:28:46.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.728+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=LNIOUTPA7WSX tag=UXA3QJ05F2B6 type=write size=2624362 2024-03-09T14:28:46.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.729+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=OY6447DROFD1 type=write size=480132 2024-03-09T14:28:46.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.732+0000 7f1c6444c780 1 < suggested update operation key=EREG1M13901A tag=SVU9TSP04L0L type=del size=3815596 2024-03-09T14:28:46.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.733+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=PI3X6O47QZ0O type=del size=3570157 2024-03-09T14:28:46.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.734+0000 7f1c6444c780 1 < canceled operation key=SGHNHOCYPM38 tag=CPUWYO02IKRF type=del size=3399061 2024-03-09T14:28:46.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.735+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=C30I5P4U71YE type=del size=2659045 2024-03-09T14:28:46.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.737+0000 7f1c6444c780 1 < suggested remove operation key=QSMTZR754455 tag=P7PQLWPUVUPT type=del 2024-03-09T14:28:46.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.739+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~JRUGTB6OD24X.0 size=1048576 2024-03-09T14:28:46.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.740+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~JRUGTB6OD24X.1 size=460392 2024-03-09T14:28:46.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.740+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=JRUGTB6OD24X tag=G8D75YZKWAD4 type=write size=2557544 2024-03-09T14:28:46.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.741+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~T7PZJK78HLLF.0 size=259886 2024-03-09T14:28:46.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.743+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=T7PZJK78HLLF tag=9H0ZFGPO6EOM type=write size=1308462 2024-03-09T14:28:46.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.746+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~2X0NYO0X3MUX.0 size=1048576 2024-03-09T14:28:46.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.747+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~2X0NYO0X3MUX.1 size=1048576 2024-03-09T14:28:46.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.748+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~2X0NYO0X3MUX.2 size=297020 2024-03-09T14:28:46.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.748+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=2X0NYO0X3MUX tag=EHLXXSO07VJF type=write size=3442748 2024-03-09T14:28:46.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.749+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~HL4QA5NK10DL.0 size=1048576 2024-03-09T14:28:46.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.750+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~HL4QA5NK10DL.1 size=436265 2024-03-09T14:28:46.752 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.752+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=HL4QA5NK10DL tag=RYMUQE4GP354 type=write size=2533417 2024-03-09T14:28:46.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.753+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=VXRGTE507T5V type=del size=1048940 2024-03-09T14:28:46.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.754+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~Q1C0UJHUZLRK.0 size=1048576 2024-03-09T14:28:46.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.755+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~Q1C0UJHUZLRK.1 size=276730 2024-03-09T14:28:46.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.757+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=Q1C0UJHUZLRK tag=9NZSJ91SFYKJ type=write size=2373882 2024-03-09T14:28:46.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.758+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=05RYMGXWVYXS type=write size=592021 2024-03-09T14:28:46.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.759+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=7V5G45H988XC type=del 2024-03-09T14:28:46.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.762+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~KGFFR4B4ILIG.0 size=1048576 2024-03-09T14:28:46.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.763+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~KGFFR4B4ILIG.1 size=1048576 2024-03-09T14:28:46.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.764+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~KGFFR4B4ILIG.2 size=362237 2024-03-09T14:28:46.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.764+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=KGFFR4B4ILIG tag=HZ0ZK5J0VW9O type=write size=3507965 2024-03-09T14:28:46.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.765+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=8ZGLVWMZGNP5 type=del 2024-03-09T14:28:46.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.766+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=2MI33Y708T5E type=del size=1756054 2024-03-09T14:28:46.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.767+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=3YARMID8EMVW type=del 2024-03-09T14:28:46.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.770+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~M5WS2U992S97.0 size=284661 2024-03-09T14:28:46.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.770+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=M5WS2U992S97 tag=RV24RQS22B83 type=write size=1333237 2024-03-09T14:28:46.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.771+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~P927GNS3168R.0 size=1048576 2024-03-09T14:28:46.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.772+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~P927GNS3168R.1 size=1048576 2024-03-09T14:28:46.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.773+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~P927GNS3168R.2 size=63529 2024-03-09T14:28:46.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.775+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=P927GNS3168R tag=OHS5DU3AULUK type=write size=3209257 2024-03-09T14:28:46.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.777+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~UWVNSBI255IO.0 size=1048576 2024-03-09T14:28:46.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.778+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~UWVNSBI255IO.1 size=901726 2024-03-09T14:28:46.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.778+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=UWVNSBI255IO tag=XT7FXUB7IFVC type=write size=2998878 2024-03-09T14:28:46.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.780+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=8C9H41GF59A8 type=write size=266340 2024-03-09T14:28:46.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.781+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=ZS092J3DZ1OK type=del size=462047 2024-03-09T14:28:46.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.782+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~I102T8135CV5.0 size=1048576 2024-03-09T14:28:46.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.783+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~I102T8135CV5.1 size=1048576 2024-03-09T14:28:46.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.784+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~I102T8135CV5.2 size=560148 2024-03-09T14:28:46.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.786+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=I102T8135CV5 tag=N7ZT5MVHDM2D type=write size=3705876 2024-03-09T14:28:46.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.787+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=VO7NUEZVY5XW type=del size=1232434 2024-03-09T14:28:46.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.788+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~8UCJD60XZCAM.0 size=1048576 2024-03-09T14:28:46.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.789+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~8UCJD60XZCAM.1 size=1048576 2024-03-09T14:28:46.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.791+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~8UCJD60XZCAM.2 size=258212 2024-03-09T14:28:46.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.793+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=8UCJD60XZCAM tag=284X3YOCEGRQ type=write size=3403940 2024-03-09T14:28:46.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.794+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=LD90DH6W70CN type=del size=416195 2024-03-09T14:28:46.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.795+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=RCL6F5ES2U0U type=del 2024-03-09T14:28:46.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.797+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~T03O26LM23P8.0 size=1048576 2024-03-09T14:28:46.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.798+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~T03O26LM23P8.1 size=1048576 2024-03-09T14:28:46.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.799+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~T03O26LM23P8.2 size=917907 2024-03-09T14:28:46.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.799+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=T03O26LM23P8 tag=1OZ11PL1RHSZ type=write size=4063635 2024-03-09T14:28:46.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.800+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=OEWZPO5PFXG4 type=write size=750047 2024-03-09T14:28:46.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.802+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=TV8SCVOL5S1X type=del size=406780 2024-03-09T14:28:46.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.803+0000 7f1c6444c780 1 < completed write operation key=0IHHFQBKKJ0G tag=OY6447DROFD1 type=write size=480132 2024-03-09T14:28:46.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.804+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=3RWZGC9TCYTD type=del size=3352686 2024-03-09T14:28:46.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.805+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=PI3X6O47QZ0O type=del 2024-03-09T14:28:46.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.806+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=PABE1L7XQG7X type=write size=153724 2024-03-09T14:28:46.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.808+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=C30I5P4U71YE type=del 2024-03-09T14:28:46.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.809+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=7U16639L6H23 type=del size=1860727 2024-03-09T14:28:46.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.810+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~JRUGTB6OD24X.0 size=1048576 2024-03-09T14:28:46.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.810+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~JRUGTB6OD24X.1 size=460392 2024-03-09T14:28:46.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.812+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=JRUGTB6OD24X tag=G8D75YZKWAD4 type=write size=2557544 2024-03-09T14:28:46.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.814+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~25NXFS9LSKBD.0 size=830872 2024-03-09T14:28:46.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.814+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=25NXFS9LSKBD tag=S91HCAAUS236 type=write size=1879448 2024-03-09T14:28:46.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.816+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~2X0NYO0X3MUX.0 size=1048576 2024-03-09T14:28:46.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.817+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~2X0NYO0X3MUX.1 size=1048576 2024-03-09T14:28:46.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.817+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~2X0NYO0X3MUX.2 size=297020 2024-03-09T14:28:46.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.819+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=2X0NYO0X3MUX tag=EHLXXSO07VJF type=write size=3442748 2024-03-09T14:28:46.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.821+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~6YZ407UXQVQK.0 size=1047457 2024-03-09T14:28:46.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.821+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=6YZ407UXQVQK tag=HUQGCVCHJJCV type=write size=2096033 2024-03-09T14:28:46.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.823+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=VXRGTE507T5V type=del 2024-03-09T14:28:46.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.824+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=5ABNVVD4WFRB type=del size=2892807 2024-03-09T14:28:46.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.826+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=05RYMGXWVYXS type=write size=592021 2024-03-09T14:28:46.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.827+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=CLC64ECEUEWX type=del size=1089577 2024-03-09T14:28:46.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.828+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~KGFFR4B4ILIG.0 size=1048576 2024-03-09T14:28:46.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.829+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~KGFFR4B4ILIG.1 size=1048576 2024-03-09T14:28:46.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.829+0000 7f1c6444c780 1 < canceled part key=_multipart_PBM4ICXZ2497.2~KGFFR4B4ILIG.2 size=362237 2024-03-09T14:28:46.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.831+0000 7f1c6444c780 1 < canceled multipart upload key=PBM4ICXZ2497 upload=KGFFR4B4ILIG tag=HZ0ZK5J0VW9O type=write size=3507965 2024-03-09T14:28:46.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.833+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~4DSM17Q20AAF.0 size=1048576 2024-03-09T14:28:46.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.834+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~4DSM17Q20AAF.1 size=1048576 2024-03-09T14:28:46.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.835+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~4DSM17Q20AAF.2 size=649325 2024-03-09T14:28:46.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.835+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=4DSM17Q20AAF tag=2SD93ZEYTGLW type=write size=3795053 2024-03-09T14:28:46.836 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.836+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=2MI33Y708T5E type=del 2024-03-09T14:28:46.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.838+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~2X0AD5ELYN6A.0 size=1048576 2024-03-09T14:28:46.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.839+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~2X0AD5ELYN6A.1 size=1048576 2024-03-09T14:28:46.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.841+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~2X0AD5ELYN6A.2 size=627379 2024-03-09T14:28:46.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.841+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=2X0AD5ELYN6A tag=I8PU5BZ2T2GU type=write size=3773107 2024-03-09T14:28:46.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.842+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~M5WS2U992S97.0 size=284661 2024-03-09T14:28:46.844 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.844+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=M5WS2U992S97 tag=RV24RQS22B83 type=write size=1333237 2024-03-09T14:28:46.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.845+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=NG9CQ259LLDX type=write size=609205 2024-03-09T14:28:46.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.846+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~UWVNSBI255IO.0 size=1048576 2024-03-09T14:28:46.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.847+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~UWVNSBI255IO.1 size=901726 2024-03-09T14:28:46.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.849+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=UWVNSBI255IO tag=XT7FXUB7IFVC type=write size=2998878 2024-03-09T14:28:46.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.851+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~GRV02IIT1EQ4.0 size=1048576 2024-03-09T14:28:46.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.852+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~GRV02IIT1EQ4.1 size=213313 2024-03-09T14:28:46.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.852+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=GRV02IIT1EQ4 tag=J03ZDCAB26KY type=write size=2310465 2024-03-09T14:28:46.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.855+0000 7f1c6444c780 1 < suggested update operation key=YK7ENO4UAB2M tag=ZS092J3DZ1OK type=del size=462047 2024-03-09T14:28:46.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.856+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=WBT8WA3SFY71 type=del size=87328 2024-03-09T14:28:46.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.858+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=VO7NUEZVY5XW type=del 2024-03-09T14:28:46.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.859+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=398QMTNWDDWR type=del size=596261 2024-03-09T14:28:46.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.861+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=LD90DH6W70CN type=del 2024-03-09T14:28:46.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.862+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=L2LDM1P2GPNL type=del size=2307003 2024-03-09T14:28:46.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.863+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~T03O26LM23P8.0 size=1048576 2024-03-09T14:28:46.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.863+0000 7f1c6444c780 1 < canceled part key=_multipart_Z34QOCZB3DFX.2~T03O26LM23P8.1 size=1048576 2024-03-09T14:28:46.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.864+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~T03O26LM23P8.2 size=917907 2024-03-09T14:28:46.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.866+0000 7f1c6444c780 1 < canceled multipart upload key=Z34QOCZB3DFX upload=T03O26LM23P8 tag=1OZ11PL1RHSZ type=write size=4063635 2024-03-09T14:28:46.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.868+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~YHT25G5JMMHR.0 size=1048576 2024-03-09T14:28:46.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.869+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~YHT25G5JMMHR.1 size=733133 2024-03-09T14:28:46.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.869+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=YHT25G5JMMHR tag=4YX8D25D0LRU type=write size=2830285 2024-03-09T14:28:46.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.870+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=TV8SCVOL5S1X type=del size=406780 2024-03-09T14:28:46.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.871+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=HL9EZ4HOC5IS type=del size=2526871 2024-03-09T14:28:46.873 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.873+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=3RWZGC9TCYTD type=del 2024-03-09T14:28:46.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.875+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~22OETVBNHNSX.0 size=1048576 2024-03-09T14:28:46.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.876+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~22OETVBNHNSX.1 size=958107 2024-03-09T14:28:46.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.876+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=22OETVBNHNSX tag=PNI5MBCS94HN type=write size=3055259 2024-03-09T14:28:46.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.877+0000 7f1c6444c780 1 < completed write operation key=CVD0EGQUVJYR tag=PABE1L7XQG7X type=write size=153724 2024-03-09T14:28:46.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.878+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=Y4U57MJEOHND type=del size=3601171 2024-03-09T14:28:46.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.879+0000 7f1c6444c780 1 < canceled operation key=CVD0EGQUVJYR tag=7U16639L6H23 type=del size=1860727 2024-03-09T14:28:46.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.881+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~ID7EXMT3G8PL.0 size=1048576 2024-03-09T14:28:46.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.882+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~ID7EXMT3G8PL.1 size=237640 2024-03-09T14:28:46.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.882+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=ID7EXMT3G8PL tag=1BZJHC5QJKE4 type=write size=2334792 2024-03-09T14:28:46.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.883+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~25NXFS9LSKBD.0 size=830872 2024-03-09T14:28:46.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.885+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=25NXFS9LSKBD tag=S91HCAAUS236 type=write size=1879448 2024-03-09T14:28:46.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.886+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=AMKABVVKETZ9 type=del size=784486 2024-03-09T14:28:46.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.887+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~6YZ407UXQVQK.0 size=1047457 2024-03-09T14:28:46.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.889+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=6YZ407UXQVQK tag=HUQGCVCHJJCV type=write size=2096033 2024-03-09T14:28:46.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.891+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~G0W4VE95XWYI.0 size=942852 2024-03-09T14:28:46.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.891+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=G0W4VE95XWYI tag=A2H3D6R4SJIJ type=write size=1991428 2024-03-09T14:28:46.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.893+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=5ABNVVD4WFRB type=del 2024-03-09T14:28:46.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.894+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=AI2XWGCPUKOC type=write size=119283 2024-03-09T14:28:46.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.896+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=CLC64ECEUEWX type=del size=1089577 2024-03-09T14:28:46.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.898+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~JM3JUI74US82.0 size=76481 2024-03-09T14:28:46.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.898+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=JM3JUI74US82 tag=VWS9XYV4NDAD type=write size=1125057 2024-03-09T14:28:46.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.899+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~4DSM17Q20AAF.0 size=1048576 2024-03-09T14:28:46.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.900+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~4DSM17Q20AAF.1 size=1048576 2024-03-09T14:28:46.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.901+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~4DSM17Q20AAF.2 size=649325 2024-03-09T14:28:46.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.902+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=4DSM17Q20AAF tag=2SD93ZEYTGLW type=write size=3795053 2024-03-09T14:28:46.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.903+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=0RZI68UKV53A type=write size=1046207 2024-03-09T14:28:46.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.904+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~2X0AD5ELYN6A.0 size=1048576 2024-03-09T14:28:46.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.905+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~2X0AD5ELYN6A.1 size=1048576 2024-03-09T14:28:46.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.905+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~2X0AD5ELYN6A.2 size=627379 2024-03-09T14:28:46.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.907+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=2X0AD5ELYN6A tag=I8PU5BZ2T2GU type=write size=3773107 2024-03-09T14:28:46.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.908+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=YJPAABU3ZJ7R type=del size=6204 2024-03-09T14:28:46.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.910+0000 7f1c6444c780 1 < completed write operation key=71FSR1CHFBO0 tag=NG9CQ259LLDX type=write size=609205 2024-03-09T14:28:46.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.912+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~6FBPQ7ZZS8FK.0 size=1048576 2024-03-09T14:28:46.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.912+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~6FBPQ7ZZS8FK.1 size=748931 2024-03-09T14:28:46.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.912+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=6FBPQ7ZZS8FK tag=V0GZ75VLN3NK type=write size=2846083 2024-03-09T14:28:46.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.914+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~GRV02IIT1EQ4.0 size=1048576 2024-03-09T14:28:46.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.914+0000 7f1c6444c780 1 < canceled part key=_multipart_IBVEN2JEB49N.2~GRV02IIT1EQ4.1 size=213313 2024-03-09T14:28:46.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.915+0000 7f1c6444c780 1 < canceled multipart upload key=IBVEN2JEB49N upload=GRV02IIT1EQ4 tag=J03ZDCAB26KY type=write size=2310465 2024-03-09T14:28:46.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.917+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~3KOEVT4POKIF.0 size=1048576 2024-03-09T14:28:46.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.918+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~3KOEVT4POKIF.1 size=588137 2024-03-09T14:28:46.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.918+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=3KOEVT4POKIF tag=HRU7Y0ED6PDH type=write size=2685289 2024-03-09T14:28:46.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.921+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=WBT8WA3SFY71 type=del 2024-03-09T14:28:46.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.923+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~4WIN1BOK9S3Q.0 size=1048576 2024-03-09T14:28:46.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.924+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~4WIN1BOK9S3Q.1 size=246781 2024-03-09T14:28:46.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.924+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=4WIN1BOK9S3Q tag=ASJMZ2U3HDVY type=write size=2343933 2024-03-09T14:28:46.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.925+0000 7f1c6444c780 1 < canceled operation key=KWDIDE9AE3JP tag=398QMTNWDDWR type=del size=596261 2024-03-09T14:28:46.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.927+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~P81QQAHHRB6I.0 size=712858 2024-03-09T14:28:46.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.927+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=P81QQAHHRB6I tag=9H4UDBPOPS6D type=write size=1761434 2024-03-09T14:28:46.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.928+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=L2LDM1P2GPNL type=del 2024-03-09T14:28:46.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.930+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~LOMRT1I9F2L9.0 size=1048576 2024-03-09T14:28:46.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.931+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~LOMRT1I9F2L9.1 size=163699 2024-03-09T14:28:46.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.931+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=LOMRT1I9F2L9 tag=W2ZDJTG4TACH type=write size=2260851 2024-03-09T14:28:46.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.932+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~YHT25G5JMMHR.0 size=1048576 2024-03-09T14:28:46.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.933+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~YHT25G5JMMHR.1 size=733133 2024-03-09T14:28:46.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.935+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=YHT25G5JMMHR tag=4YX8D25D0LRU type=write size=2830285 2024-03-09T14:28:46.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.936+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=EVYQSLVHFQ3V type=del size=3997783 2024-03-09T14:28:46.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.939+0000 7f1c6444c780 1 < suggested remove operation key=71FSR1CHFBO0 tag=HL9EZ4HOC5IS type=del 2024-03-09T14:28:46.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.941+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~TUK8RTQNJ839.0 size=1048576 2024-03-09T14:28:46.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.942+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~TUK8RTQNJ839.1 size=1048576 2024-03-09T14:28:46.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.943+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~TUK8RTQNJ839.2 size=896073 2024-03-09T14:28:46.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.943+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=TUK8RTQNJ839 tag=3Q6OXSMU3AFL type=write size=4041801 2024-03-09T14:28:46.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.944+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~22OETVBNHNSX.0 size=1048576 2024-03-09T14:28:46.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.945+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~22OETVBNHNSX.1 size=958107 2024-03-09T14:28:46.947 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.947+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=22OETVBNHNSX tag=PNI5MBCS94HN type=write size=3055259 2024-03-09T14:28:46.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.948+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=E5MOV8YETLBV type=del size=3184250 2024-03-09T14:28:46.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.950+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=Y4U57MJEOHND type=del 2024-03-09T14:28:46.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.952+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~34TE44KKYNTJ.0 size=780745 2024-03-09T14:28:46.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.952+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=34TE44KKYNTJ tag=JFU7HSO2TUVX type=write size=1829321 2024-03-09T14:28:46.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.953+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~ID7EXMT3G8PL.0 size=1048576 2024-03-09T14:28:46.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.954+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~ID7EXMT3G8PL.1 size=237640 2024-03-09T14:28:46.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.956+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=ID7EXMT3G8PL tag=1BZJHC5QJKE4 type=write size=2334792 2024-03-09T14:28:46.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.958+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~62C5OSSF30Z3.0 size=637674 2024-03-09T14:28:46.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.958+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=62C5OSSF30Z3 tag=PGLE2628ZJA0 type=write size=1686250 2024-03-09T14:28:46.959 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.959+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=AMKABVVKETZ9 type=del 2024-03-09T14:28:46.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.961+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=P61W0KAZSLJ1 type=del size=1986737 2024-03-09T14:28:46.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.963+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~G0W4VE95XWYI.0 size=942852 2024-03-09T14:28:46.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.965+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=G0W4VE95XWYI tag=A2H3D6R4SJIJ type=write size=1991428 2024-03-09T14:28:46.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.967+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~WJJ20IKAZ8DN.0 size=1005163 2024-03-09T14:28:46.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.967+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=WJJ20IKAZ8DN tag=PBDZP2P0CLU0 type=write size=2053739 2024-03-09T14:28:46.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.968+0000 7f1c6444c780 1 < completed write operation key=WMO6LTCMVXD2 tag=AI2XWGCPUKOC type=write size=119283 2024-03-09T14:28:46.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.969+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=QD9NGTQ7A6NS type=del size=2837013 2024-03-09T14:28:46.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.971+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~JM3JUI74US82.0 size=76481 2024-03-09T14:28:46.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.973+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=JM3JUI74US82 tag=VWS9XYV4NDAD type=write size=1125057 2024-03-09T14:28:46.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.975+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~EISS8AXMTG3R.0 size=1048576 2024-03-09T14:28:46.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.976+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~EISS8AXMTG3R.1 size=761398 2024-03-09T14:28:46.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.976+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=EISS8AXMTG3R tag=4KCAHF8XFVFX type=write size=2858550 2024-03-09T14:28:46.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.978+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=0RZI68UKV53A type=write size=1046207 2024-03-09T14:28:46.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.980+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~M97XA23ZFA01.0 size=1048576 2024-03-09T14:28:46.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.980+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~M97XA23ZFA01.1 size=269245 2024-03-09T14:28:46.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.980+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=M97XA23ZFA01 tag=GSQ54SGXM2TP type=write size=2366397 2024-03-09T14:28:46.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.982+0000 7f1c6444c780 -1 < failed to complete operation key=YK7ENO4UAB2M tag=YJPAABU3ZJ7R type=del size=6204: (22) Invalid argument 2024-03-09T14:28:46.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.983+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=0GOIHR8OUG8U type=del size=3913723 2024-03-09T14:28:46.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.983+0000 7f1c6444c780 1 < canceled part key=_multipart_VL5EUQ52WRAN.2~6FBPQ7ZZS8FK.0 size=1048576 2024-03-09T14:28:46.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.984+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~6FBPQ7ZZS8FK.1 size=748931 2024-03-09T14:28:46.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.986+0000 7f1c6444c780 1 < canceled multipart upload key=VL5EUQ52WRAN upload=6FBPQ7ZZS8FK tag=V0GZ75VLN3NK type=write size=2846083 2024-03-09T14:28:46.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.988+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~3TD351TY2NY4.0 size=1048576 2024-03-09T14:28:46.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.989+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~3TD351TY2NY4.1 size=1048576 2024-03-09T14:28:46.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.990+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~3TD351TY2NY4.2 size=79649 2024-03-09T14:28:46.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.990+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=3TD351TY2NY4 tag=3E5BPZ8Q8NV0 type=write size=3225377 2024-03-09T14:28:46.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.991+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~3KOEVT4POKIF.0 size=1048576 2024-03-09T14:28:46.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.992+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~3KOEVT4POKIF.1 size=588137 2024-03-09T14:28:46.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.994+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=3KOEVT4POKIF tag=HRU7Y0ED6PDH type=write size=2685289 2024-03-09T14:28:46.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.995+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=K6WZBOWO5AV4 type=del size=292997 2024-03-09T14:28:46.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.996+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~4WIN1BOK9S3Q.0 size=1048576 2024-03-09T14:28:46.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.996+0000 7f1c6444c780 1 < canceled part key=_multipart_KNOEGKSERB6Z.2~4WIN1BOK9S3Q.1 size=246781 2024-03-09T14:28:46.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:46.998+0000 7f1c6444c780 1 < canceled multipart upload key=KNOEGKSERB6Z upload=4WIN1BOK9S3Q tag=ASJMZ2U3HDVY type=write size=2343933 2024-03-09T14:28:47.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.000+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~QWNRNJAMI1IM.0 size=1048576 2024-03-09T14:28:47.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.001+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~QWNRNJAMI1IM.1 size=1048576 2024-03-09T14:28:47.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.002+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~QWNRNJAMI1IM.2 size=967117 2024-03-09T14:28:47.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.002+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=QWNRNJAMI1IM tag=H0Y8VP1CRE4P type=write size=4112845 2024-03-09T14:28:47.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.003+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~P81QQAHHRB6I.0 size=712858 2024-03-09T14:28:47.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.005+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=P81QQAHHRB6I tag=9H4UDBPOPS6D type=write size=1761434 2024-03-09T14:28:47.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.007+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=EV4J4KH2C232 type=del size=3695000 2024-03-09T14:28:47.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.008+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~LOMRT1I9F2L9.0 size=1048576 2024-03-09T14:28:47.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.009+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~LOMRT1I9F2L9.1 size=163699 2024-03-09T14:28:47.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.011+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=LOMRT1I9F2L9 tag=W2ZDJTG4TACH type=write size=2260851 2024-03-09T14:28:47.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.012+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=OG5YN19JKL2F type=del size=2746044 2024-03-09T14:28:47.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.015+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=EVYQSLVHFQ3V type=del size=3997783 2024-03-09T14:28:47.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.017+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~YQQT5M0ZFGFO.0 size=672136 2024-03-09T14:28:47.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.017+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=YQQT5M0ZFGFO tag=HFZV2X9S4DJD type=write size=1720712 2024-03-09T14:28:47.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.019+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~TUK8RTQNJ839.0 size=1048576 2024-03-09T14:28:47.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.019+0000 7f1c6444c780 1 < canceled part key=_multipart_EREG1M13901A.2~TUK8RTQNJ839.1 size=1048576 2024-03-09T14:28:47.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.019+0000 7f1c6444c780 1 < canceled part key=_multipart_EREG1M13901A.2~TUK8RTQNJ839.2 size=896073 2024-03-09T14:28:47.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.021+0000 7f1c6444c780 1 < canceled multipart upload key=EREG1M13901A upload=TUK8RTQNJ839 tag=3Q6OXSMU3AFL type=write size=4041801 2024-03-09T14:28:47.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.023+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~DRDVN5XYVWHT.0 size=1048576 2024-03-09T14:28:47.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.024+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~DRDVN5XYVWHT.1 size=1048576 2024-03-09T14:28:47.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.025+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~DRDVN5XYVWHT.2 size=479589 2024-03-09T14:28:47.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.025+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=DRDVN5XYVWHT tag=TUNZAFTQ2Z6B type=write size=3625317 2024-03-09T14:28:47.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.026+0000 7f1c6444c780 1 < completed delete operation key=YK7ENO4UAB2M tag=E5MOV8YETLBV type=del 2024-03-09T14:28:47.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.028+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~3MPHOZDQLSXE.0 size=1048576 2024-03-09T14:28:47.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.029+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~3MPHOZDQLSXE.1 size=1048576 2024-03-09T14:28:47.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.030+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~3MPHOZDQLSXE.2 size=510062 2024-03-09T14:28:47.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.030+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=3MPHOZDQLSXE tag=ZLN5GRMPZI0I type=write size=3655790 2024-03-09T14:28:47.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.031+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~34TE44KKYNTJ.0 size=780745 2024-03-09T14:28:47.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.033+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=34TE44KKYNTJ tag=JFU7HSO2TUVX type=write size=1829321 2024-03-09T14:28:47.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.034+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=J8OP3YZJIWQH type=del size=2664035 2024-03-09T14:28:47.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.035+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~62C5OSSF30Z3.0 size=637674 2024-03-09T14:28:47.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.037+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=62C5OSSF30Z3 tag=PGLE2628ZJA0 type=write size=1686250 2024-03-09T14:28:47.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.038+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=YWPFHQ3JGCE6 type=del size=294027 2024-03-09T14:28:47.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.039+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=P61W0KAZSLJ1 type=del 2024-03-09T14:28:47.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.040+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=GUCUTWDOHLVV type=del size=1633292 2024-03-09T14:28:47.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.041+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~WJJ20IKAZ8DN.0 size=1005163 2024-03-09T14:28:47.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.043+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=WJJ20IKAZ8DN tag=PBDZP2P0CLU0 type=write size=2053739 2024-03-09T14:28:47.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.045+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=11S1CJ004PCH type=del size=612968 2024-03-09T14:28:47.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.046+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=QD9NGTQ7A6NS type=del 2024-03-09T14:28:47.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.048+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~JRQPFLHL0XXA.0 size=1048576 2024-03-09T14:28:47.049 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.049+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~JRQPFLHL0XXA.1 size=1048576 2024-03-09T14:28:47.049 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.050+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~JRQPFLHL0XXA.2 size=1048242 2024-03-09T14:28:47.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.050+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=JRQPFLHL0XXA tag=TEMRE8D7YQYO type=write size=4193970 2024-03-09T14:28:47.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.051+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~EISS8AXMTG3R.0 size=1048576 2024-03-09T14:28:47.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.052+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~EISS8AXMTG3R.1 size=761398 2024-03-09T14:28:47.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.053+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=EISS8AXMTG3R tag=4KCAHF8XFVFX type=write size=2858550 2024-03-09T14:28:47.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.055+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=YH3IY7VO04YS type=del size=163748 2024-03-09T14:28:47.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.056+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~M97XA23ZFA01.0 size=1048576 2024-03-09T14:28:47.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.057+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~M97XA23ZFA01.1 size=269245 2024-03-09T14:28:47.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.058+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=M97XA23ZFA01 tag=GSQ54SGXM2TP type=write size=2366397 2024-03-09T14:28:47.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.060+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=ZTHUXPUQP3HQ type=del size=1609442 2024-03-09T14:28:47.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.061+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=0GOIHR8OUG8U type=del 2024-03-09T14:28:47.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.063+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~72E8FGQA81VU.0 size=1048576 2024-03-09T14:28:47.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.064+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~72E8FGQA81VU.1 size=1038795 2024-03-09T14:28:47.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.064+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=72E8FGQA81VU tag=5I3HI34J4WSH type=write size=3135947 2024-03-09T14:28:47.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.065+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~3TD351TY2NY4.0 size=1048576 2024-03-09T14:28:47.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.066+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~3TD351TY2NY4.1 size=1048576 2024-03-09T14:28:47.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.068+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~3TD351TY2NY4.2 size=79649 2024-03-09T14:28:47.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.070+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=3TD351TY2NY4 tag=3E5BPZ8Q8NV0 type=write size=3225377 2024-03-09T14:28:47.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.071+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=C7WVE9T1G1AQ type=del size=1327258 2024-03-09T14:28:47.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.072+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=K6WZBOWO5AV4 type=del size=292997 2024-03-09T14:28:47.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.074+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=I3CTZVO8G3LV type=del size=3380359 2024-03-09T14:28:47.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.075+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~QWNRNJAMI1IM.0 size=1048576 2024-03-09T14:28:47.076 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.076+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~QWNRNJAMI1IM.1 size=1048576 2024-03-09T14:28:47.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.077+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~QWNRNJAMI1IM.2 size=967117 2024-03-09T14:28:47.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.078+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=QWNRNJAMI1IM tag=H0Y8VP1CRE4P type=write size=4112845 2024-03-09T14:28:47.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.079+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=A4201XQ6VF5L type=del size=1727937 2024-03-09T14:28:47.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.081+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=EV4J4KH2C232 type=del 2024-03-09T14:28:47.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.082+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=1M231JT9BR7C type=del size=2859481 2024-03-09T14:28:47.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.083+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=OG5YN19JKL2F type=del 2024-03-09T14:28:47.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.084+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=JLHKXWG48WAN type=del size=2631578 2024-03-09T14:28:47.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.085+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~YQQT5M0ZFGFO.0 size=672136 2024-03-09T14:28:47.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.087+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=YQQT5M0ZFGFO tag=HFZV2X9S4DJD type=write size=1720712 2024-03-09T14:28:47.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.088+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=7VI4BDIDEZ8I type=del size=183409 2024-03-09T14:28:47.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.089+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~DRDVN5XYVWHT.0 size=1048576 2024-03-09T14:28:47.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.089+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~DRDVN5XYVWHT.1 size=1048576 2024-03-09T14:28:47.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.090+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~DRDVN5XYVWHT.2 size=479589 2024-03-09T14:28:47.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.092+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=DRDVN5XYVWHT tag=TUNZAFTQ2Z6B type=write size=3625317 2024-03-09T14:28:47.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.093+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=3D4EZ8OKRYRO type=del size=2956082 2024-03-09T14:28:47.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.094+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~3MPHOZDQLSXE.0 size=1048576 2024-03-09T14:28:47.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.094+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~3MPHOZDQLSXE.1 size=1048576 2024-03-09T14:28:47.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.095+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~3MPHOZDQLSXE.2 size=510062 2024-03-09T14:28:47.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.097+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=3MPHOZDQLSXE tag=ZLN5GRMPZI0I type=write size=3655790 2024-03-09T14:28:47.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.099+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=VF729H9PYK0X type=del size=815283 2024-03-09T14:28:47.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.100+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=J8OP3YZJIWQH type=del 2024-03-09T14:28:47.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.102+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~VWAZHLBGKMNH.0 size=1048576 2024-03-09T14:28:47.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.103+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~VWAZHLBGKMNH.1 size=1048576 2024-03-09T14:28:47.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.104+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~VWAZHLBGKMNH.2 size=579917 2024-03-09T14:28:47.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.104+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=VWAZHLBGKMNH tag=AF9XKQC05SLI type=write size=3725645 2024-03-09T14:28:47.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.105+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=YWPFHQ3JGCE6 type=del 2024-03-09T14:28:47.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.106+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=ET7TOPIB2PAS type=del size=3182670 2024-03-09T14:28:47.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.107+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=GUCUTWDOHLVV type=del 2024-03-09T14:28:47.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.108+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=EBUYHCLPOM3S type=write size=45336 2024-03-09T14:28:47.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.109+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=11S1CJ004PCH type=del 2024-03-09T14:28:47.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.111+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~KIAV1IX76HIR.0 size=1048576 2024-03-09T14:28:47.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.112+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~KIAV1IX76HIR.1 size=1048576 2024-03-09T14:28:47.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.113+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~KIAV1IX76HIR.2 size=944221 2024-03-09T14:28:47.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.113+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=KIAV1IX76HIR tag=GWAGOZPYUNP9 type=write size=4089949 2024-03-09T14:28:47.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.114+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~JRQPFLHL0XXA.0 size=1048576 2024-03-09T14:28:47.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.115+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~JRQPFLHL0XXA.1 size=1048576 2024-03-09T14:28:47.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.116+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~JRQPFLHL0XXA.2 size=1048242 2024-03-09T14:28:47.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.118+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=JRQPFLHL0XXA tag=TEMRE8D7YQYO type=write size=4193970 2024-03-09T14:28:47.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.119+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=8NFU6JYU6YSA type=del size=3148711 2024-03-09T14:28:47.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.120+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=YH3IY7VO04YS type=del 2024-03-09T14:28:47.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.123+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~XK91GFJEEII9.0 size=1048576 2024-03-09T14:28:47.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.124+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~XK91GFJEEII9.1 size=274340 2024-03-09T14:28:47.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.124+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=XK91GFJEEII9 tag=0Z7Q4TO3M59K type=write size=2371492 2024-03-09T14:28:47.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.126+0000 7f1c6444c780 1 < suggested remove operation key=PBM4ICXZ2497 tag=ZTHUXPUQP3HQ type=del 2024-03-09T14:28:47.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.127+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=1G01HR1YR4P6 type=del size=2717830 2024-03-09T14:28:47.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.128+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~72E8FGQA81VU.0 size=1048576 2024-03-09T14:28:47.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.128+0000 7f1c6444c780 1 < canceled part key=_multipart_WMO6LTCMVXD2.2~72E8FGQA81VU.1 size=1038795 2024-03-09T14:28:47.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.130+0000 7f1c6444c780 1 < canceled multipart upload key=WMO6LTCMVXD2 upload=72E8FGQA81VU tag=5I3HI34J4WSH type=write size=3135947 2024-03-09T14:28:47.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.131+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=LI4LLCT20JQ1 type=del size=2163765 2024-03-09T14:28:47.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.133+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=C7WVE9T1G1AQ type=del 2024-03-09T14:28:47.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.134+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=R481K51CXSGZ type=del size=4007572 2024-03-09T14:28:47.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.135+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=I3CTZVO8G3LV type=del 2024-03-09T14:28:47.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.137+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~XG2IP0AJIGCL.0 size=1048576 2024-03-09T14:28:47.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.138+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~XG2IP0AJIGCL.1 size=1048576 2024-03-09T14:28:47.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.139+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~XG2IP0AJIGCL.2 size=477748 2024-03-09T14:28:47.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.139+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=XG2IP0AJIGCL tag=AB3DAMNMTLIU type=write size=3623476 2024-03-09T14:28:47.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.141+0000 7f1c6444c780 1 < suggested remove operation key=V05XJ56M53T8 tag=A4201XQ6VF5L type=del 2024-03-09T14:28:47.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.143+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=79DKIU1AY1IS type=del size=1926348 2024-03-09T14:28:47.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.144+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=1M231JT9BR7C type=del 2024-03-09T14:28:47.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.145+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=183C8C8EH7D1 type=del size=2279690 2024-03-09T14:28:47.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.146+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=V05XJ56M53T8 tag=JLHKXWG48WAN type=del size=2631578: (2) No such file or directory 2024-03-09T14:28:47.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.147+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=A0LA7DRSUDTX type=del size=922964 2024-03-09T14:28:47.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.149+0000 7f1c6444c780 1 < suggested update operation key=SGHNHOCYPM38 tag=7VI4BDIDEZ8I type=del size=183409 2024-03-09T14:28:47.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.151+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~RQBUFOM3U967.0 size=929599 2024-03-09T14:28:47.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.151+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=RQBUFOM3U967 tag=I6EOF19TITSB type=write size=1978175 2024-03-09T14:28:47.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.153+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=3D4EZ8OKRYRO type=del 2024-03-09T14:28:47.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.155+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=UX0GNO3LL9F1 type=del size=640977 2024-03-09T14:28:47.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.156+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=VF729H9PYK0X type=del 2024-03-09T14:28:47.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.157+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=20VXPV01VATN type=del size=1592758 2024-03-09T14:28:47.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.158+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~VWAZHLBGKMNH.0 size=1048576 2024-03-09T14:28:47.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.159+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~VWAZHLBGKMNH.1 size=1048576 2024-03-09T14:28:47.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.160+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~VWAZHLBGKMNH.2 size=579917 2024-03-09T14:28:47.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.162+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=VWAZHLBGKMNH tag=AF9XKQC05SLI type=write size=3725645 2024-03-09T14:28:47.163 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.163+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=DULNDD35KZ7I type=write size=12272 2024-03-09T14:28:47.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.164+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=ET7TOPIB2PAS type=del size=3182670 2024-03-09T14:28:47.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.166+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~AM2V6I9I7PVW.0 size=593727 2024-03-09T14:28:47.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.166+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=AM2V6I9I7PVW tag=R5YSRBDGEWCB type=write size=1642303 2024-03-09T14:28:47.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.168+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=EBUYHCLPOM3S type=write size=45336 2024-03-09T14:28:47.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.170+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~D25110RHARUX.0 size=1048576 2024-03-09T14:28:47.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.171+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~D25110RHARUX.1 size=1048576 2024-03-09T14:28:47.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.172+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~D25110RHARUX.2 size=429913 2024-03-09T14:28:47.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.172+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=D25110RHARUX tag=WCW6NX8CY07D type=write size=3575641 2024-03-09T14:28:47.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.173+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~KIAV1IX76HIR.0 size=1048576 2024-03-09T14:28:47.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.174+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~KIAV1IX76HIR.1 size=1048576 2024-03-09T14:28:47.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.175+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~KIAV1IX76HIR.2 size=944221 2024-03-09T14:28:47.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.178+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=KIAV1IX76HIR tag=GWAGOZPYUNP9 type=write size=4089949 2024-03-09T14:28:47.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.180+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~YHV8SVTKB8TK.0 size=461793 2024-03-09T14:28:47.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.180+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=YHV8SVTKB8TK tag=52O3022MJZIA type=write size=1510369 2024-03-09T14:28:47.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.181+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=8NFU6JYU6YSA type=del 2024-03-09T14:28:47.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.182+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=VEBJWMD5I2XZ type=write size=1045368 2024-03-09T14:28:47.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.183+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~XK91GFJEEII9.0 size=1048576 2024-03-09T14:28:47.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.183+0000 7f1c6444c780 1 < canceled part key=_multipart_IBVEN2JEB49N.2~XK91GFJEEII9.1 size=274340 2024-03-09T14:28:47.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.185+0000 7f1c6444c780 1 < canceled multipart upload key=IBVEN2JEB49N upload=XK91GFJEEII9 tag=0Z7Q4TO3M59K type=write size=2371492 2024-03-09T14:28:47.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.186+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=QNUIUXJR5SJK type=del size=2679475 2024-03-09T14:28:47.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.188+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=1G01HR1YR4P6 type=del 2024-03-09T14:28:47.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.190+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~REFQ8ET3NRXP.0 size=1048576 2024-03-09T14:28:47.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.191+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~REFQ8ET3NRXP.1 size=1048576 2024-03-09T14:28:47.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.192+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~REFQ8ET3NRXP.2 size=679785 2024-03-09T14:28:47.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.192+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=REFQ8ET3NRXP tag=SMIAWDD82ZSJ type=write size=3825513 2024-03-09T14:28:47.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.194+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=LI4LLCT20JQ1 type=del 2024-03-09T14:28:47.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.196+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~P4WCATSPREUC.0 size=1048576 2024-03-09T14:28:47.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.197+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~P4WCATSPREUC.1 size=1048576 2024-03-09T14:28:47.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.197+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~P4WCATSPREUC.2 size=320472 2024-03-09T14:28:47.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.197+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=P4WCATSPREUC tag=H7XL1I06KVOT type=write size=3466200 2024-03-09T14:28:47.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.200+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=R481K51CXSGZ type=del 2024-03-09T14:28:47.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.201+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=5P7T15Y1G4IH type=write size=577493 2024-03-09T14:28:47.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.202+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~XG2IP0AJIGCL.0 size=1048576 2024-03-09T14:28:47.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.203+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~XG2IP0AJIGCL.1 size=1048576 2024-03-09T14:28:47.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.204+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~XG2IP0AJIGCL.2 size=477748 2024-03-09T14:28:47.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.206+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=XG2IP0AJIGCL tag=AB3DAMNMTLIU type=write size=3623476 2024-03-09T14:28:47.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.208+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~KMIXXA7OX5DU.0 size=553470 2024-03-09T14:28:47.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.208+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=KMIXXA7OX5DU tag=X9A5A252OBOM type=write size=1602046 2024-03-09T14:28:47.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.210+0000 7f1c6444c780 1 < canceled operation key=NIN0FB6YTKWA tag=79DKIU1AY1IS type=del size=1926348 2024-03-09T14:28:47.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.211+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=J7EGC6OG7FL9 type=del size=1962968 2024-03-09T14:28:47.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.212+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=183C8C8EH7D1 type=del 2024-03-09T14:28:47.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.213+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=UV97M6KAUXV9 type=del size=1994002 2024-03-09T14:28:47.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.215+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=A0LA7DRSUDTX type=del 2024-03-09T14:28:47.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.216+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=D5QT2WGF3N3M type=write size=402835 2024-03-09T14:28:47.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.216+0000 7f1c6444c780 1 < canceled part key=_multipart_PBM4ICXZ2497.2~RQBUFOM3U967.0 size=929599 2024-03-09T14:28:47.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.218+0000 7f1c6444c780 1 < canceled multipart upload key=PBM4ICXZ2497 upload=RQBUFOM3U967 tag=I6EOF19TITSB type=write size=1978175 2024-03-09T14:28:47.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.219+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=7VTA1WLE7194 type=del size=2705140 2024-03-09T14:28:47.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.221+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=UX0GNO3LL9F1 type=del 2024-03-09T14:28:47.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.223+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~6YLNTNI5QN0D.0 size=1033809 2024-03-09T14:28:47.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.223+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=6YLNTNI5QN0D tag=22QC0VRH7UM3 type=write size=2082385 2024-03-09T14:28:47.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.224+0000 7f1c6444c780 1 < canceled operation key=49YOZGJ8XC4K tag=20VXPV01VATN type=del size=1592758 2024-03-09T14:28:47.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.226+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~BA23B174SLBL.0 size=1048576 2024-03-09T14:28:47.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.227+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~BA23B174SLBL.1 size=1048576 2024-03-09T14:28:47.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.228+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~BA23B174SLBL.2 size=292109 2024-03-09T14:28:47.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.228+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=BA23B174SLBL tag=H0MC09KJ3NNM type=write size=3437837 2024-03-09T14:28:47.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.229+0000 7f1c6444c780 1 < completed write operation key=PBM4ICXZ2497 tag=DULNDD35KZ7I type=write size=12272 2024-03-09T14:28:47.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.230+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=HN56XOZV2PN4 type=write size=562531 2024-03-09T14:28:47.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.231+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~AM2V6I9I7PVW.0 size=593727 2024-03-09T14:28:47.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.233+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=AM2V6I9I7PVW tag=R5YSRBDGEWCB type=write size=1642303 2024-03-09T14:28:47.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.235+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=DKLXLGER3E6E type=del size=835412 2024-03-09T14:28:47.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.235+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~D25110RHARUX.0 size=1048576 2024-03-09T14:28:47.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.236+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~D25110RHARUX.1 size=1048576 2024-03-09T14:28:47.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.237+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~D25110RHARUX.2 size=429913 2024-03-09T14:28:47.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.239+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=D25110RHARUX tag=WCW6NX8CY07D type=write size=3575641 2024-03-09T14:28:47.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.241+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~EJZIU2U1EUDE.0 size=308923 2024-03-09T14:28:47.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.241+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=EJZIU2U1EUDE tag=VH1PXLNEZWEU type=write size=1357499 2024-03-09T14:28:47.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.241+0000 7f1c6444c780 1 < canceled part key=_multipart_Z34QOCZB3DFX.2~YHV8SVTKB8TK.0 size=461793 2024-03-09T14:28:47.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.243+0000 7f1c6444c780 1 < canceled multipart upload key=Z34QOCZB3DFX upload=YHV8SVTKB8TK tag=52O3022MJZIA type=write size=1510369 2024-03-09T14:28:47.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.244+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=7KE4AV08BUR5 type=write size=823727 2024-03-09T14:28:47.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.245+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=VEBJWMD5I2XZ type=write size=1045368 2024-03-09T14:28:47.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.247+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~V9DKWFBMSO2O.0 size=1048576 2024-03-09T14:28:47.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.248+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~V9DKWFBMSO2O.1 size=285628 2024-03-09T14:28:47.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.248+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=V9DKWFBMSO2O tag=J5614HJAS5BG type=write size=2382780 2024-03-09T14:28:47.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.249+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=QNUIUXJR5SJK type=del 2024-03-09T14:28:47.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.251+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~EX8BOVTYVGQR.0 size=1048576 2024-03-09T14:28:47.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.252+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~EX8BOVTYVGQR.1 size=1048576 2024-03-09T14:28:47.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.252+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~EX8BOVTYVGQR.2 size=9129 2024-03-09T14:28:47.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.252+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=EX8BOVTYVGQR tag=AEW9F9F01WSO type=write size=3154857 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.254+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~REFQ8ET3NRXP.0 size=1048576 2024-03-09T14:28:47.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.254+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~REFQ8ET3NRXP.1 size=1048576 2024-03-09T14:28:47.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.255+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~REFQ8ET3NRXP.2 size=679785 2024-03-09T14:28:47.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.257+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=REFQ8ET3NRXP tag=SMIAWDD82ZSJ type=write size=3825513 2024-03-09T14:28:47.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.258+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=IDEUYTKH4WRE type=del size=1644500 2024-03-09T14:28:47.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.260+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~P4WCATSPREUC.0 size=1048576 2024-03-09T14:28:47.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.260+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~P4WCATSPREUC.1 size=1048576 2024-03-09T14:28:47.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.261+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~P4WCATSPREUC.2 size=320472 2024-03-09T14:28:47.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.263+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=P4WCATSPREUC tag=H7XL1I06KVOT type=write size=3466200 2024-03-09T14:28:47.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.265+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~VZKRS0HXRRDA.0 size=1048576 2024-03-09T14:28:47.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.266+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~VZKRS0HXRRDA.1 size=1048576 2024-03-09T14:28:47.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.267+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~VZKRS0HXRRDA.2 size=676528 2024-03-09T14:28:47.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.267+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=VZKRS0HXRRDA tag=POK8CA05F7R0 type=write size=3822256 2024-03-09T14:28:47.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.269+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=5P7T15Y1G4IH type=write 2024-03-09T14:28:47.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.270+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=CK7Z6QO529RP type=del size=1218662 2024-03-09T14:28:47.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.271+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~KMIXXA7OX5DU.0 size=553470 2024-03-09T14:28:47.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.273+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=KMIXXA7OX5DU tag=X9A5A252OBOM type=write size=1602046 2024-03-09T14:28:47.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.275+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=9MRPFPND80VJ type=del size=3244772 2024-03-09T14:28:47.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.276+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=J7EGC6OG7FL9 type=del 2024-03-09T14:28:47.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.277+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=P38NWRKMQALR type=del size=2763249 2024-03-09T14:28:47.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.278+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=UV97M6KAUXV9 type=del 2024-03-09T14:28:47.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.279+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=BS635QTLXX8V type=del size=253810 2024-03-09T14:28:47.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.280+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=D5QT2WGF3N3M type=write size=402835 2024-03-09T14:28:47.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.282+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=3PL3LC813WO8 type=del size=1965085 2024-03-09T14:28:47.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.284+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=7VTA1WLE7194 type=del 2024-03-09T14:28:47.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.285+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=B5MY0YRH0KW8 type=del size=2460511 2024-03-09T14:28:47.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.286+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~6YLNTNI5QN0D.0 size=1033809 2024-03-09T14:28:47.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.288+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=6YLNTNI5QN0D tag=22QC0VRH7UM3 type=write size=2082385 2024-03-09T14:28:47.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.290+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~NU2282MA177L.0 size=1048576 2024-03-09T14:28:47.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.291+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~NU2282MA177L.1 size=308409 2024-03-09T14:28:47.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.291+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=NU2282MA177L tag=JNTASE18OV02 type=write size=2405561 2024-03-09T14:28:47.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.292+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~BA23B174SLBL.0 size=1048576 2024-03-09T14:28:47.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.293+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~BA23B174SLBL.1 size=1048576 2024-03-09T14:28:47.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.294+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~BA23B174SLBL.2 size=292109 2024-03-09T14:28:47.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.296+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=BA23B174SLBL tag=H0MC09KJ3NNM type=write size=3437837 2024-03-09T14:28:47.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.297+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=FKF7G4D5VSFB type=del size=72761 2024-03-09T14:28:47.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.298+0000 7f1c6444c780 1 < completed write operation key=0IHHFQBKKJ0G tag=HN56XOZV2PN4 type=write size=562531 2024-03-09T14:28:47.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.299+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=VNT09VDYU7DA type=del size=808696 2024-03-09T14:28:47.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.301+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=DKLXLGER3E6E type=del size=835412 2024-03-09T14:28:47.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.302+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=IIK42M5T2WBD type=del size=1810291 2024-03-09T14:28:47.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.304+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~EJZIU2U1EUDE.0 size=308923 2024-03-09T14:28:47.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.306+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=EJZIU2U1EUDE tag=VH1PXLNEZWEU type=write size=1357499 2024-03-09T14:28:47.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.307+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=7AE23G5EYJ5L type=del size=731597 2024-03-09T14:28:47.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.308+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=7KE4AV08BUR5 type=write size=823727 2024-03-09T14:28:47.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.310+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~7FWHMSM0K40N.0 size=1048576 2024-03-09T14:28:47.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.311+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~7FWHMSM0K40N.1 size=1048576 2024-03-09T14:28:47.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.312+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~7FWHMSM0K40N.2 size=739077 2024-03-09T14:28:47.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.312+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=7FWHMSM0K40N tag=Q077EYT1U57X type=write size=3884805 2024-03-09T14:28:47.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.313+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~V9DKWFBMSO2O.0 size=1048576 2024-03-09T14:28:47.314 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.314+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~V9DKWFBMSO2O.1 size=285628 2024-03-09T14:28:47.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.316+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=V9DKWFBMSO2O tag=J5614HJAS5BG type=write size=2382780 2024-03-09T14:28:47.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.317+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=2AS3RE8JNFH8 type=del size=2944474 2024-03-09T14:28:47.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.318+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~EX8BOVTYVGQR.0 size=1048576 2024-03-09T14:28:47.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.319+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~EX8BOVTYVGQR.1 size=1048576 2024-03-09T14:28:47.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.320+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~EX8BOVTYVGQR.2 size=9129 2024-03-09T14:28:47.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.322+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=EX8BOVTYVGQR tag=AEW9F9F01WSO type=write size=3154857 2024-03-09T14:28:47.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.324+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~QMU00KOLID9P.0 size=1048576 2024-03-09T14:28:47.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.325+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~QMU00KOLID9P.1 size=1048576 2024-03-09T14:28:47.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.326+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~QMU00KOLID9P.2 size=285014 2024-03-09T14:28:47.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.326+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=QMU00KOLID9P tag=K1QOFRFW9SUR type=write size=3430742 2024-03-09T14:28:47.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.327+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=IDEUYTKH4WRE type=del 2024-03-09T14:28:47.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.329+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~VPIZS03CTIDW.0 size=935815 2024-03-09T14:28:47.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.329+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=VPIZS03CTIDW tag=G7KPE0YA6POT type=write size=1984391 2024-03-09T14:28:47.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.331+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~VZKRS0HXRRDA.0 size=1048576 2024-03-09T14:28:47.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.332+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~VZKRS0HXRRDA.1 size=1048576 2024-03-09T14:28:47.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.333+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~VZKRS0HXRRDA.2 size=676528 2024-03-09T14:28:47.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.336+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=VZKRS0HXRRDA tag=POK8CA05F7R0 type=write size=3822256 2024-03-09T14:28:47.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.337+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=FZMHYICHMRZH type=del size=2091356 2024-03-09T14:28:47.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.338+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=CK7Z6QO529RP type=del 2024-03-09T14:28:47.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.341+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~8K0ZD037W140.0 size=1042476 2024-03-09T14:28:47.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.341+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=8K0ZD037W140 tag=Y4IIICZX10GM type=write size=2091052 2024-03-09T14:28:47.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.342+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=9MRPFPND80VJ type=del 2024-03-09T14:28:47.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.344+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~Q1LQ2KYEQR2X.0 size=1048576 2024-03-09T14:28:47.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.346+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~Q1LQ2KYEQR2X.1 size=1048576 2024-03-09T14:28:47.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.346+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~Q1LQ2KYEQR2X.2 size=377515 2024-03-09T14:28:47.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.346+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=Q1LQ2KYEQR2X tag=LPOARCYSU0YK type=write size=3523243 2024-03-09T14:28:47.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.348+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=P38NWRKMQALR type=del 2024-03-09T14:28:47.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.349+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=UKCZ8D7YWLLQ type=del size=1952090 2024-03-09T14:28:47.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.350+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=BS635QTLXX8V type=del 2024-03-09T14:28:47.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.352+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~RTDK2FKB81Y7.0 size=726834 2024-03-09T14:28:47.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.352+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=RTDK2FKB81Y7 tag=BYRUZZZNLEUD type=write size=1775410 2024-03-09T14:28:47.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.353+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=3PL3LC813WO8 type=del 2024-03-09T14:28:47.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.355+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~CAJ5OI2L64JF.0 size=1048576 2024-03-09T14:28:47.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.356+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~CAJ5OI2L64JF.1 size=1048576 2024-03-09T14:28:47.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.357+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~CAJ5OI2L64JF.2 size=568504 2024-03-09T14:28:47.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.357+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=CAJ5OI2L64JF tag=63DRQC9DJMY1 type=write size=3714232 2024-03-09T14:28:47.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.359+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=B5MY0YRH0KW8 type=del 2024-03-09T14:28:47.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.360+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=QNHO7I1J41K5 type=del size=252558 2024-03-09T14:28:47.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.360+0000 7f1c6444c780 1 < canceled part key=_multipart_WMO6LTCMVXD2.2~NU2282MA177L.0 size=1048576 2024-03-09T14:28:47.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.360+0000 7f1c6444c780 1 < canceled part key=_multipart_WMO6LTCMVXD2.2~NU2282MA177L.1 size=308409 2024-03-09T14:28:47.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.362+0000 7f1c6444c780 1 < canceled multipart upload key=WMO6LTCMVXD2 upload=NU2282MA177L tag=JNTASE18OV02 type=write size=2405561 2024-03-09T14:28:47.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.363+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=2HJ9LK0SFQWZ type=del size=2343753 2024-03-09T14:28:47.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.365+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=FKF7G4D5VSFB type=del 2024-03-09T14:28:47.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.367+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~B8Y0WNVK3186.0 size=841179 2024-03-09T14:28:47.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.367+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=B8Y0WNVK3186 tag=2OD5G5VMW1FL type=write size=1889755 2024-03-09T14:28:47.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.368+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=VNT09VDYU7DA type=del 2024-03-09T14:28:47.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.370+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~TQUGTL56SLU5.0 size=133353 2024-03-09T14:28:47.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.370+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=TQUGTL56SLU5 tag=RN9TZ4P3BSK2 type=write size=1181929 2024-03-09T14:28:47.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.371+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=IIK42M5T2WBD type=del 2024-03-09T14:28:47.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.372+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=HREUCB4DP91H type=write size=872140 2024-03-09T14:28:47.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.373+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=7AE23G5EYJ5L type=del 2024-03-09T14:28:47.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.375+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=3SB87MMF1S6R type=del size=4106814 2024-03-09T14:28:47.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.376+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~7FWHMSM0K40N.0 size=1048576 2024-03-09T14:28:47.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.377+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~7FWHMSM0K40N.1 size=1048576 2024-03-09T14:28:47.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.378+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~7FWHMSM0K40N.2 size=739077 2024-03-09T14:28:47.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.380+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=7FWHMSM0K40N tag=Q077EYT1U57X type=write size=3884805 2024-03-09T14:28:47.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.381+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=5RHQCE2R6O2K type=write size=1002598 2024-03-09T14:28:47.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.383+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=2AS3RE8JNFH8 type=del 2024-03-09T14:28:47.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.385+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~0Y9IOUZ3ZV9Q.0 size=1048576 2024-03-09T14:28:47.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.386+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~0Y9IOUZ3ZV9Q.1 size=1048576 2024-03-09T14:28:47.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.387+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~0Y9IOUZ3ZV9Q.2 size=314148 2024-03-09T14:28:47.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.387+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=0Y9IOUZ3ZV9Q tag=NLEI2GMKKCML type=write size=3459876 2024-03-09T14:28:47.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.388+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~QMU00KOLID9P.0 size=1048576 2024-03-09T14:28:47.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.389+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~QMU00KOLID9P.1 size=1048576 2024-03-09T14:28:47.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.390+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~QMU00KOLID9P.2 size=285014 2024-03-09T14:28:47.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.394+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=QMU00KOLID9P tag=K1QOFRFW9SUR type=write size=3430742 2024-03-09T14:28:47.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.396+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~LGGDBFI1PBH6.0 size=85216 2024-03-09T14:28:47.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.396+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=LGGDBFI1PBH6 tag=3WWFL252ZR5M type=write size=1133792 2024-03-09T14:28:47.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.397+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~VPIZS03CTIDW.0 size=935815 2024-03-09T14:28:47.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.399+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=VPIZS03CTIDW tag=G7KPE0YA6POT type=write size=1984391 2024-03-09T14:28:47.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.401+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~CP30WVT8BGN8.0 size=1048576 2024-03-09T14:28:47.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.402+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~CP30WVT8BGN8.1 size=1048576 2024-03-09T14:28:47.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.403+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~CP30WVT8BGN8.2 size=226462 2024-03-09T14:28:47.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.403+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=CP30WVT8BGN8 tag=G3KZ5A2HVI6L type=write size=3372190 2024-03-09T14:28:47.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.404+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=FZMHYICHMRZH type=del 2024-03-09T14:28:47.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.405+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=9XSA5RP4IBVR type=del size=528737 2024-03-09T14:28:47.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.406+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~8K0ZD037W140.0 size=1042476 2024-03-09T14:28:47.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.408+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=8K0ZD037W140 tag=Y4IIICZX10GM type=write size=2091052 2024-03-09T14:28:47.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.410+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~DK33HGU4G6CA.0 size=1048576 2024-03-09T14:28:47.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.411+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~DK33HGU4G6CA.1 size=198804 2024-03-09T14:28:47.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.411+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=DK33HGU4G6CA tag=BD9JOH4OUUSK type=write size=2295956 2024-03-09T14:28:47.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.412+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~Q1LQ2KYEQR2X.0 size=1048576 2024-03-09T14:28:47.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.413+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~Q1LQ2KYEQR2X.1 size=1048576 2024-03-09T14:28:47.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.414+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~Q1LQ2KYEQR2X.2 size=377515 2024-03-09T14:28:47.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.416+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=Q1LQ2KYEQR2X tag=LPOARCYSU0YK type=write size=3523243 2024-03-09T14:28:47.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.418+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~DY0IXB5ANRKN.0 size=1048576 2024-03-09T14:28:47.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.419+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~DY0IXB5ANRKN.1 size=1048576 2024-03-09T14:28:47.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.420+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~DY0IXB5ANRKN.2 size=46464 2024-03-09T14:28:47.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.420+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=DY0IXB5ANRKN tag=PDG07STISE41 type=write size=3192192 2024-03-09T14:28:47.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.421+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=UKCZ8D7YWLLQ type=del 2024-03-09T14:28:47.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.423+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~Y3O9V312K6G8.0 size=1048576 2024-03-09T14:28:47.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.424+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~Y3O9V312K6G8.1 size=28083 2024-03-09T14:28:47.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.424+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=Y3O9V312K6G8 tag=01ZV9AAMM98N type=write size=2125235 2024-03-09T14:28:47.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.425+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~RTDK2FKB81Y7.0 size=726834 2024-03-09T14:28:47.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.427+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=RTDK2FKB81Y7 tag=BYRUZZZNLEUD type=write size=1775410 2024-03-09T14:28:47.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.428+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=ZARAR2E9567R type=del size=260368 2024-03-09T14:28:47.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.430+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~CAJ5OI2L64JF.0 size=1048576 2024-03-09T14:28:47.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.430+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~CAJ5OI2L64JF.1 size=1048576 2024-03-09T14:28:47.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.431+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~CAJ5OI2L64JF.2 size=568504 2024-03-09T14:28:47.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.433+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=CAJ5OI2L64JF tag=63DRQC9DJMY1 type=write size=3714232 2024-03-09T14:28:47.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.434+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=Z8IFIUSBT1RA type=del size=3641122 2024-03-09T14:28:47.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.436+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=QNHO7I1J41K5 type=del 2024-03-09T14:28:47.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.437+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=EHBD91GA8GBW type=del size=3186730 2024-03-09T14:28:47.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.438+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=2HJ9LK0SFQWZ type=del 2024-03-09T14:28:47.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.439+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=V0NG9YQB0MQT type=del size=3141289 2024-03-09T14:28:47.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.440+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~B8Y0WNVK3186.0 size=841179 2024-03-09T14:28:47.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.442+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=B8Y0WNVK3186 tag=2OD5G5VMW1FL type=write size=1889755 2024-03-09T14:28:47.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.443+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=9ML755PARSBQ type=del size=1227657 2024-03-09T14:28:47.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.445+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~TQUGTL56SLU5.0 size=133353 2024-03-09T14:28:47.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.447+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=TQUGTL56SLU5 tag=RN9TZ4P3BSK2 type=write size=1181929 2024-03-09T14:28:47.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.448+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=LYP0AHULHYA9 type=del size=1539494 2024-03-09T14:28:47.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.449+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=HREUCB4DP91H type=write size=872140 2024-03-09T14:28:47.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.452+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~Q9WN2HVF7ST6.0 size=1048576 2024-03-09T14:28:47.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.453+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~Q9WN2HVF7ST6.1 size=222295 2024-03-09T14:28:47.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.453+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=Q9WN2HVF7ST6 tag=V5W115H0AEQ7 type=write size=2319447 2024-03-09T14:28:47.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.455+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=3SB87MMF1S6R type=del size=4106814 2024-03-09T14:28:47.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.457+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=CE8I9UA3A7IG type=write size=620776 2024-03-09T14:28:47.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.458+0000 7f1c6444c780 1 < completed write operation key=VL5EUQ52WRAN tag=5RHQCE2R6O2K type=write size=1002598 2024-03-09T14:28:47.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.459+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=S3RZ7VEVAUP0 type=write size=855401 2024-03-09T14:28:47.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.461+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~0Y9IOUZ3ZV9Q.0 size=1048576 2024-03-09T14:28:47.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.462+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~0Y9IOUZ3ZV9Q.1 size=1048576 2024-03-09T14:28:47.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.463+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~0Y9IOUZ3ZV9Q.2 size=314148 2024-03-09T14:28:47.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.465+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=0Y9IOUZ3ZV9Q tag=NLEI2GMKKCML type=write size=3459876 2024-03-09T14:28:47.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.466+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=Q055221CD8A4 type=del size=2989243 2024-03-09T14:28:47.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.467+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~LGGDBFI1PBH6.0 size=85216 2024-03-09T14:28:47.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.470+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=LGGDBFI1PBH6 tag=3WWFL252ZR5M type=write size=1133792 2024-03-09T14:28:47.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.471+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=O9PV1763YO0M type=del size=3491770 2024-03-09T14:28:47.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.473+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~CP30WVT8BGN8.0 size=1048576 2024-03-09T14:28:47.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.474+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~CP30WVT8BGN8.1 size=1048576 2024-03-09T14:28:47.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.475+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~CP30WVT8BGN8.2 size=226462 2024-03-09T14:28:47.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.477+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=CP30WVT8BGN8 tag=G3KZ5A2HVI6L type=write size=3372190 2024-03-09T14:28:47.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.478+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=EHWRML4049FI type=del size=1560985 2024-03-09T14:28:47.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.479+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=9XSA5RP4IBVR type=del 2024-03-09T14:28:47.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.480+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=DFCYDT0MRLMJ type=del size=2625870 2024-03-09T14:28:47.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.482+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~DK33HGU4G6CA.0 size=1048576 2024-03-09T14:28:47.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.483+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~DK33HGU4G6CA.1 size=198804 2024-03-09T14:28:47.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.485+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=DK33HGU4G6CA tag=BD9JOH4OUUSK type=write size=2295956 2024-03-09T14:28:47.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.487+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~0TPPMZGGBQI7.0 size=1048576 2024-03-09T14:28:47.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.488+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~0TPPMZGGBQI7.1 size=990697 2024-03-09T14:28:47.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.488+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=0TPPMZGGBQI7 tag=2L336RNU46D0 type=write size=3087849 2024-03-09T14:28:47.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.489+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~DY0IXB5ANRKN.0 size=1048576 2024-03-09T14:28:47.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.490+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~DY0IXB5ANRKN.1 size=1048576 2024-03-09T14:28:47.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.491+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~DY0IXB5ANRKN.2 size=46464 2024-03-09T14:28:47.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.493+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=DY0IXB5ANRKN tag=PDG07STISE41 type=write size=3192192 2024-03-09T14:28:47.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.494+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=M5T155Q8JYMH type=del size=3793268 2024-03-09T14:28:47.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.496+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~Y3O9V312K6G8.0 size=1048576 2024-03-09T14:28:47.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.497+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~Y3O9V312K6G8.1 size=28083 2024-03-09T14:28:47.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.499+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=Y3O9V312K6G8 tag=01ZV9AAMM98N type=write size=2125235 2024-03-09T14:28:47.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.501+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~EJ4UE0EXUM74.0 size=398005 2024-03-09T14:28:47.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.501+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=EJ4UE0EXUM74 tag=10ZS42PLLPCZ type=write size=1446581 2024-03-09T14:28:47.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.504+0000 7f1c6444c780 1 < suggested remove operation key=P33029QWKW23 tag=ZARAR2E9567R type=del 2024-03-09T14:28:47.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.506+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=1I41OFT6EYDH type=del size=1931774 2024-03-09T14:28:47.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.507+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=Z8IFIUSBT1RA type=del 2024-03-09T14:28:47.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.508+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=QARNHRPJ2Q5M type=del size=1817352 2024-03-09T14:28:47.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.509+0000 7f1c6444c780 1 < canceled operation key=NIN0FB6YTKWA tag=EHBD91GA8GBW type=del size=3186730 2024-03-09T14:28:47.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.510+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=E145M5I6CP3M type=del size=3576340 2024-03-09T14:28:47.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.512+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=V0NG9YQB0MQT type=del 2024-03-09T14:28:47.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.513+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=KF89NIUCC4GT type=del size=1684687 2024-03-09T14:28:47.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.514+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=9ML755PARSBQ type=del 2024-03-09T14:28:47.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.515+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=VDANGVMIDVMV type=write size=488266 2024-03-09T14:28:47.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.516+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=LYP0AHULHYA9 type=del 2024-03-09T14:28:47.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.517+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=IHRX1R27YZV9 type=del size=1620938 2024-03-09T14:28:47.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.519+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~Q9WN2HVF7ST6.0 size=1048576 2024-03-09T14:28:47.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.520+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~Q9WN2HVF7ST6.1 size=222295 2024-03-09T14:28:47.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.521+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=Q9WN2HVF7ST6 tag=V5W115H0AEQ7 type=write size=2319447 2024-03-09T14:28:47.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.524+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~UAFCZZC0R2BO.0 size=1048576 2024-03-09T14:28:47.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.524+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~UAFCZZC0R2BO.1 size=1048576 2024-03-09T14:28:47.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.525+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~UAFCZZC0R2BO.2 size=815151 2024-03-09T14:28:47.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.525+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=UAFCZZC0R2BO tag=JLEM2T3K7VTJ type=write size=3960879 2024-03-09T14:28:47.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.526+0000 7f1c6444c780 1 < completed write operation key=YECG84AJ5IK2 tag=CE8I9UA3A7IG type=write size=620776 2024-03-09T14:28:47.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.528+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=E2JXOQEDKCA1 type=write size=689916 2024-03-09T14:28:47.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.530+0000 7f1c6444c780 1 < suggested update operation key=HPFPL79B0GLS tag=S3RZ7VEVAUP0 type=write size=855401 2024-03-09T14:28:47.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.532+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~TS9DIN9C48P5.0 size=1048576 2024-03-09T14:28:47.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.533+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~TS9DIN9C48P5.1 size=1048576 2024-03-09T14:28:47.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.534+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~TS9DIN9C48P5.2 size=354929 2024-03-09T14:28:47.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.534+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=TS9DIN9C48P5 tag=2R57TOV7DZBB type=write size=3500657 2024-03-09T14:28:47.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.535+0000 7f1c6444c780 1 < canceled operation key=26VE2HJPD0FX tag=Q055221CD8A4 type=del size=2989243 2024-03-09T14:28:47.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.537+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~3KI20NY4VPTV.0 size=1048576 2024-03-09T14:28:47.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.538+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~3KI20NY4VPTV.1 size=891711 2024-03-09T14:28:47.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.538+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=3KI20NY4VPTV tag=FLZSIV79OWXJ type=write size=2988863 2024-03-09T14:28:47.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.540+0000 7f1c6444c780 1 < suggested remove operation key=MOVS6ZMK708G tag=O9PV1763YO0M type=del 2024-03-09T14:28:47.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.541+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=4KP225CIV6G3 type=del size=307470 2024-03-09T14:28:47.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.542+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=EHWRML4049FI type=del 2024-03-09T14:28:47.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.543+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=BR5VCA9L5AUL type=del size=2000796 2024-03-09T14:28:47.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.545+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=DFCYDT0MRLMJ type=del 2024-03-09T14:28:47.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.547+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~5HFROYXHKGWY.0 size=1048576 2024-03-09T14:28:47.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.548+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~5HFROYXHKGWY.1 size=1030003 2024-03-09T14:28:47.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.548+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=5HFROYXHKGWY tag=ICSZMDWUWF52 type=write size=3127155 2024-03-09T14:28:47.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.549+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~0TPPMZGGBQI7.0 size=1048576 2024-03-09T14:28:47.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.550+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~0TPPMZGGBQI7.1 size=990697 2024-03-09T14:28:47.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.552+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=0TPPMZGGBQI7 tag=2L336RNU46D0 type=write size=3087849 2024-03-09T14:28:47.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.553+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=T7PT2C2ACTA5 type=del size=2810432 2024-03-09T14:28:47.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.554+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=M5T155Q8JYMH type=del 2024-03-09T14:28:47.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.555+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=14Y5Y3QJE7AH type=write size=217959 2024-03-09T14:28:47.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.556+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~EJ4UE0EXUM74.0 size=398005 2024-03-09T14:28:47.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.558+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=EJ4UE0EXUM74 tag=10ZS42PLLPCZ type=write size=1446581 2024-03-09T14:28:47.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.559+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=RE5LHCXJISA5 type=write size=908413 2024-03-09T14:28:47.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.560+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=1I41OFT6EYDH type=del 2024-03-09T14:28:47.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.562+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~P32AGO7462RP.0 size=31467 2024-03-09T14:28:47.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.562+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=P32AGO7462RP tag=X5RBL3076IWN type=write size=1080043 2024-03-09T14:28:47.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.563+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=QARNHRPJ2Q5M type=del 2024-03-09T14:28:47.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.564+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=WBNUMZRZN2SP type=del size=2346935 2024-03-09T14:28:47.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.566+0000 7f1c6444c780 1 < canceled operation key=BYX1155MZ2LP tag=E145M5I6CP3M type=del size=3576340 2024-03-09T14:28:47.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.567+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=GYUO1LEP5I27 type=del size=2051450 2024-03-09T14:28:47.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.568+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=KF89NIUCC4GT type=del 2024-03-09T14:28:47.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.569+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=NGS5PCZKZU7A type=del size=1610988 2024-03-09T14:28:47.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.570+0000 7f1c6444c780 1 < completed write operation key=SGHNHOCYPM38 tag=VDANGVMIDVMV type=write size=488266 2024-03-09T14:28:47.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.571+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=MPURKBD7FLU4 type=del size=2389470 2024-03-09T14:28:47.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.574+0000 7f1c6444c780 1 < suggested update operation key=71FSR1CHFBO0 tag=IHRX1R27YZV9 type=del size=1620938 2024-03-09T14:28:47.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.575+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=9OKQC0FTQALK type=del size=1527802 2024-03-09T14:28:47.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.575+0000 7f1c6444c780 1 < canceled part key=_multipart_MX3X6ILR7J8N.2~UAFCZZC0R2BO.0 size=1048576 2024-03-09T14:28:47.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.576+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~UAFCZZC0R2BO.1 size=1048576 2024-03-09T14:28:47.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.577+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~UAFCZZC0R2BO.2 size=815151 2024-03-09T14:28:47.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.579+0000 7f1c6444c780 1 < canceled multipart upload key=MX3X6ILR7J8N upload=UAFCZZC0R2BO tag=JLEM2T3K7VTJ type=write size=3960879 2024-03-09T14:28:47.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.581+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~SNJCMSQKCJPC.0 size=1048576 2024-03-09T14:28:47.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.582+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~SNJCMSQKCJPC.1 size=1048576 2024-03-09T14:28:47.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.582+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~SNJCMSQKCJPC.2 size=398748 2024-03-09T14:28:47.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.582+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=SNJCMSQKCJPC tag=USME4981EO1H type=write size=3544476 2024-03-09T14:28:47.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.583+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=E2JXOQEDKCA1 type=write size=689916 2024-03-09T14:28:47.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.586+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~3W6EKZQAE3EH.0 size=1048576 2024-03-09T14:28:47.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.586+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~3W6EKZQAE3EH.1 size=225728 2024-03-09T14:28:47.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.586+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=3W6EKZQAE3EH tag=KUWV1IMIZVDS type=write size=2322880 2024-03-09T14:28:47.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.588+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~TS9DIN9C48P5.0 size=1048576 2024-03-09T14:28:47.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.588+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~TS9DIN9C48P5.1 size=1048576 2024-03-09T14:28:47.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.589+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~TS9DIN9C48P5.2 size=354929 2024-03-09T14:28:47.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.591+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=TS9DIN9C48P5 tag=2R57TOV7DZBB type=write size=3500657 2024-03-09T14:28:47.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.592+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=900CS23JMW8C type=del size=1491001 2024-03-09T14:28:47.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.594+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~3KI20NY4VPTV.0 size=1048576 2024-03-09T14:28:47.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.595+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~3KI20NY4VPTV.1 size=891711 2024-03-09T14:28:47.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.596+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=3KI20NY4VPTV tag=FLZSIV79OWXJ type=write size=2988863 2024-03-09T14:28:47.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.598+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=B2OJL38WMCZC type=del size=3320959 2024-03-09T14:28:47.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.599+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=4KP225CIV6G3 type=del 2024-03-09T14:28:47.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.601+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~S7E5US4G4IU9.0 size=1048576 2024-03-09T14:28:47.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.602+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~S7E5US4G4IU9.1 size=15856 2024-03-09T14:28:47.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.602+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=S7E5US4G4IU9 tag=PRR9VTXF90PC type=write size=2113008 2024-03-09T14:28:47.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.603+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=BR5VCA9L5AUL type=del 2024-03-09T14:28:47.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.605+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~FQG9UFD1A406.0 size=1048576 2024-03-09T14:28:47.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.606+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~FQG9UFD1A406.1 size=1048576 2024-03-09T14:28:47.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.607+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~FQG9UFD1A406.2 size=1029389 2024-03-09T14:28:47.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.607+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=FQG9UFD1A406 tag=SCUM7B0S4COH type=write size=4175117 2024-03-09T14:28:47.608 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.608+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~5HFROYXHKGWY.0 size=1048576 2024-03-09T14:28:47.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.609+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~5HFROYXHKGWY.1 size=1030003 2024-03-09T14:28:47.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.612+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=5HFROYXHKGWY tag=ICSZMDWUWF52 type=write size=3127155 2024-03-09T14:28:47.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.614+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~1175I7E2Z07C.0 size=1048576 2024-03-09T14:28:47.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.615+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~1175I7E2Z07C.1 size=1048576 2024-03-09T14:28:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.615+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~1175I7E2Z07C.2 size=915759 2024-03-09T14:28:47.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.615+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=1175I7E2Z07C tag=LRFW3NO9XWX0 type=write size=4061487 2024-03-09T14:28:47.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.617+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=T7PT2C2ACTA5 type=del 2024-03-09T14:28:47.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.618+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=08GILDGEY1UI type=write size=211796 2024-03-09T14:28:47.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.619+0000 7f1c6444c780 1 < canceled operation key=HPFPL79B0GLS tag=14Y5Y3QJE7AH type=write size=217959 2024-03-09T14:28:47.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.621+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~99Y4O5YC4YJS.0 size=1048576 2024-03-09T14:28:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.622+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~99Y4O5YC4YJS.1 size=1039528 2024-03-09T14:28:47.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.622+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=99Y4O5YC4YJS tag=3WJRY4NKN076 type=write size=3136680 2024-03-09T14:28:47.623 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.623+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=RE5LHCXJISA5 type=write size=908413 2024-03-09T14:28:47.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.624+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=48LMJPFWKJSZ type=del size=3938843 2024-03-09T14:28:47.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.625+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~P32AGO7462RP.0 size=31467 2024-03-09T14:28:47.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.627+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=P32AGO7462RP tag=X5RBL3076IWN type=write size=1080043 2024-03-09T14:28:47.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.629+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~16ZKV3P2M9ZM.0 size=1048576 2024-03-09T14:28:47.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.630+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~16ZKV3P2M9ZM.1 size=1048576 2024-03-09T14:28:47.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.631+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~16ZKV3P2M9ZM.2 size=996956 2024-03-09T14:28:47.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.631+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=16ZKV3P2M9ZM tag=7SOSC1BZ94JQ type=write size=4142684 2024-03-09T14:28:47.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.632+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=WBNUMZRZN2SP type=del 2024-03-09T14:28:47.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.633+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=ZZJ12JTMEW4U type=del size=982809 2024-03-09T14:28:47.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.634+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=GYUO1LEP5I27 type=del 2024-03-09T14:28:47.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.636+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~9NYNVSHGD5R3.0 size=1048576 2024-03-09T14:28:47.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.637+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~9NYNVSHGD5R3.1 size=607831 2024-03-09T14:28:47.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.637+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=9NYNVSHGD5R3 tag=01U79MV1YH1A type=write size=2704983 2024-03-09T14:28:47.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.638+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=NGS5PCZKZU7A type=del 2024-03-09T14:28:47.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.640+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~L5PX1TN0XMG5.0 size=1048576 2024-03-09T14:28:47.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.641+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~L5PX1TN0XMG5.1 size=508164 2024-03-09T14:28:47.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.641+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=L5PX1TN0XMG5 tag=HFUVC50HWXB8 type=write size=2605316 2024-03-09T14:28:47.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.642+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=MPURKBD7FLU4 type=del 2024-03-09T14:28:47.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.645+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~RP60NAZC8Q85.0 size=1048576 2024-03-09T14:28:47.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.646+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~RP60NAZC8Q85.1 size=1048576 2024-03-09T14:28:47.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.646+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~RP60NAZC8Q85.2 size=23900 2024-03-09T14:28:47.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.646+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=RP60NAZC8Q85 tag=6ATXMFYV40KF type=write size=3169628 2024-03-09T14:28:47.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.649+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=9OKQC0FTQALK type=del 2024-03-09T14:28:47.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.650+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=G365G61T36YB type=del size=3708520 2024-03-09T14:28:47.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.651+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~SNJCMSQKCJPC.0 size=1048576 2024-03-09T14:28:47.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.652+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~SNJCMSQKCJPC.1 size=1048576 2024-03-09T14:28:47.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.653+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~SNJCMSQKCJPC.2 size=398748 2024-03-09T14:28:47.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.655+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=SNJCMSQKCJPC tag=USME4981EO1H type=write size=3544476 2024-03-09T14:28:47.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.656+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=3CZO44ZALDZU type=del size=4133883 2024-03-09T14:28:47.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.657+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~3W6EKZQAE3EH.0 size=1048576 2024-03-09T14:28:47.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.658+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~3W6EKZQAE3EH.1 size=225728 2024-03-09T14:28:47.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.660+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=3W6EKZQAE3EH tag=KUWV1IMIZVDS type=write size=2322880 2024-03-09T14:28:47.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.661+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=Y9Y7M3NRYLNI type=del size=4125011 2024-03-09T14:28:47.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.662+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=900CS23JMW8C type=del size=1491001 2024-03-09T14:28:47.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.664+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~RRCYSUFL1S43.0 size=1048576 2024-03-09T14:28:47.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.665+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~RRCYSUFL1S43.1 size=1048576 2024-03-09T14:28:47.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.666+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~RRCYSUFL1S43.2 size=726768 2024-03-09T14:28:47.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.666+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=RRCYSUFL1S43 tag=LXP6DNZ3KWIC type=write size=3872496 2024-03-09T14:28:47.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.668+0000 7f1c6444c780 1 < suggested update operation key=IBVEN2JEB49N tag=B2OJL38WMCZC type=del size=3320959 2024-03-09T14:28:47.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.670+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~ZOWW5VKK4ISU.0 size=1048576 2024-03-09T14:28:47.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.671+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~ZOWW5VKK4ISU.1 size=800949 2024-03-09T14:28:47.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.671+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=ZOWW5VKK4ISU tag=Y9U4U0GHBJXA type=write size=2898101 2024-03-09T14:28:47.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.672+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~S7E5US4G4IU9.0 size=1048576 2024-03-09T14:28:47.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.673+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~S7E5US4G4IU9.1 size=15856 2024-03-09T14:28:47.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.675+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=S7E5US4G4IU9 tag=PRR9VTXF90PC type=write size=2113008 2024-03-09T14:28:47.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.676+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=4MC1OY4TCV7D type=del size=2306145 2024-03-09T14:28:47.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.677+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~FQG9UFD1A406.0 size=1048576 2024-03-09T14:28:47.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.678+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~FQG9UFD1A406.1 size=1048576 2024-03-09T14:28:47.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.679+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~FQG9UFD1A406.2 size=1029389 2024-03-09T14:28:47.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.681+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=FQG9UFD1A406 tag=SCUM7B0S4COH type=write size=4175117 2024-03-09T14:28:47.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.682+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=N28513ERHJOR type=del size=2702836 2024-03-09T14:28:47.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.684+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~1175I7E2Z07C.0 size=1048576 2024-03-09T14:28:47.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.684+0000 7f1c6444c780 1 < canceled part key=_multipart_YK7ENO4UAB2M.2~1175I7E2Z07C.1 size=1048576 2024-03-09T14:28:47.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.684+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~1175I7E2Z07C.2 size=915759 2024-03-09T14:28:47.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.686+0000 7f1c6444c780 1 < canceled multipart upload key=YK7ENO4UAB2M upload=1175I7E2Z07C tag=LRFW3NO9XWX0 type=write size=4061487 2024-03-09T14:28:47.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.689+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~G56TK21MI1MH.0 size=624361 2024-03-09T14:28:47.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.689+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=G56TK21MI1MH tag=GM4JRV5GXG3A type=write size=1672937 2024-03-09T14:28:47.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.690+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=08GILDGEY1UI type=write size=211796 2024-03-09T14:28:47.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.691+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=6M3B8RV9Z0YF type=del size=1239503 2024-03-09T14:28:47.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.692+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~99Y4O5YC4YJS.0 size=1048576 2024-03-09T14:28:47.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.693+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~99Y4O5YC4YJS.1 size=1039528 2024-03-09T14:28:47.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.695+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=99Y4O5YC4YJS tag=3WJRY4NKN076 type=write size=3136680 2024-03-09T14:28:47.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.696+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=JIT5M64I5NTR type=del size=3344704 2024-03-09T14:28:47.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.697+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=48LMJPFWKJSZ type=del 2024-03-09T14:28:47.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.699+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~T1A53PKI70FQ.0 size=1048576 2024-03-09T14:28:47.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.700+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~T1A53PKI70FQ.1 size=1048576 2024-03-09T14:28:47.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.701+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~T1A53PKI70FQ.2 size=675910 2024-03-09T14:28:47.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.701+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=T1A53PKI70FQ tag=8C50L81PLRDM type=write size=3821638 2024-03-09T14:28:47.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.702+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~16ZKV3P2M9ZM.0 size=1048576 2024-03-09T14:28:47.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.702+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~16ZKV3P2M9ZM.1 size=1048576 2024-03-09T14:28:47.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.703+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~16ZKV3P2M9ZM.2 size=996956 2024-03-09T14:28:47.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.705+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=16ZKV3P2M9ZM tag=7SOSC1BZ94JQ type=write size=4142684 2024-03-09T14:28:47.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.706+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=BZ2CADBXZ8EU type=del size=3093873 2024-03-09T14:28:47.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.708+0000 7f1c6444c780 1 < suggested remove operation key=BAWV7KY6NT8P tag=ZZJ12JTMEW4U type=del 2024-03-09T14:28:47.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.710+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~SK3O47PW45DF.0 size=1048576 2024-03-09T14:28:47.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.711+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~SK3O47PW45DF.1 size=505733 2024-03-09T14:28:47.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.711+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=SK3O47PW45DF tag=6A2S6G8AHM0A type=write size=2602885 2024-03-09T14:28:47.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.712+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~9NYNVSHGD5R3.0 size=1048576 2024-03-09T14:28:47.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.712+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~9NYNVSHGD5R3.1 size=607831 2024-03-09T14:28:47.715 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.715+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=9NYNVSHGD5R3 tag=01U79MV1YH1A type=write size=2704983 2024-03-09T14:28:47.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.716+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=Y3DKSW76D4BP type=del size=2288865 2024-03-09T14:28:47.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.718+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~L5PX1TN0XMG5.0 size=1048576 2024-03-09T14:28:47.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.719+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~L5PX1TN0XMG5.1 size=508164 2024-03-09T14:28:47.720 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.720+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=L5PX1TN0XMG5 tag=HFUVC50HWXB8 type=write size=2605316 2024-03-09T14:28:47.722 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.722+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=IEMTNPME7YOH type=del size=3457296 2024-03-09T14:28:47.723 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.723+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~RP60NAZC8Q85.0 size=1048576 2024-03-09T14:28:47.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.724+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~RP60NAZC8Q85.1 size=1048576 2024-03-09T14:28:47.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.725+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~RP60NAZC8Q85.2 size=23900 2024-03-09T14:28:47.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.727+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=RP60NAZC8Q85 tag=6ATXMFYV40KF type=write size=3169628 2024-03-09T14:28:47.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.729+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~069D4SAV6BBN.0 size=553197 2024-03-09T14:28:47.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.729+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=069D4SAV6BBN tag=FN3TWTFL94OY type=write size=1601773 2024-03-09T14:28:47.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.730+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=G365G61T36YB type=del 2024-03-09T14:28:47.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.731+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=2DO25F6S3127 type=del size=285251 2024-03-09T14:28:47.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.732+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=3CZO44ZALDZU type=del 2024-03-09T14:28:47.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.733+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=CEP6LO00WKHI type=del size=3441075 2024-03-09T14:28:47.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.734+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=Y9Y7M3NRYLNI type=del 2024-03-09T14:28:47.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.736+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=YUIE9P1E0X9M type=del size=1150602 2024-03-09T14:28:47.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.737+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~RRCYSUFL1S43.0 size=1048576 2024-03-09T14:28:47.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.738+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~RRCYSUFL1S43.1 size=1048576 2024-03-09T14:28:47.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.738+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~RRCYSUFL1S43.2 size=726768 2024-03-09T14:28:47.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.740+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=RRCYSUFL1S43 tag=LXP6DNZ3KWIC type=write size=3872496 2024-03-09T14:28:47.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.742+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=811I2EZ8J78X type=write size=431007 2024-03-09T14:28:47.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.743+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~ZOWW5VKK4ISU.0 size=1048576 2024-03-09T14:28:47.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.744+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~ZOWW5VKK4ISU.1 size=800949 2024-03-09T14:28:47.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.745+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=ZOWW5VKK4ISU tag=Y9U4U0GHBJXA type=write size=2898101 2024-03-09T14:28:47.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.747+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~EIO93RNO8FS5.0 size=1048576 2024-03-09T14:28:47.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.748+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~EIO93RNO8FS5.1 size=1048576 2024-03-09T14:28:47.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.749+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~EIO93RNO8FS5.2 size=25866 2024-03-09T14:28:47.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.749+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=EIO93RNO8FS5 tag=I7M5U1JIEPN1 type=write size=3171594 2024-03-09T14:28:47.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.750+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=4MC1OY4TCV7D type=del size=2306145 2024-03-09T14:28:47.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.751+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=39K87EGPMTR4 type=del size=3768346 2024-03-09T14:28:47.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.753+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=N28513ERHJOR type=del 2024-03-09T14:28:47.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.755+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~QD3IH8J46UML.0 size=1048576 2024-03-09T14:28:47.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.755+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~QD3IH8J46UML.1 size=45769 2024-03-09T14:28:47.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.755+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=QD3IH8J46UML tag=RS4WEB3WLCYW type=write size=2142921 2024-03-09T14:28:47.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.757+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~G56TK21MI1MH.0 size=624361 2024-03-09T14:28:47.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.759+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=G56TK21MI1MH tag=GM4JRV5GXG3A type=write size=1672937 2024-03-09T14:28:47.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.760+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=ZFMLB044UDAG type=write size=752676 2024-03-09T14:28:47.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.762+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=6M3B8RV9Z0YF type=del size=1239503 2024-03-09T14:28:47.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.764+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~Z3VNT9ROPVUJ.0 size=1048576 2024-03-09T14:28:47.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.765+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~Z3VNT9ROPVUJ.1 size=1048576 2024-03-09T14:28:47.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.766+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~Z3VNT9ROPVUJ.2 size=495751 2024-03-09T14:28:47.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.766+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=Z3VNT9ROPVUJ tag=OJ13E2WYKMH4 type=write size=3641479 2024-03-09T14:28:47.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.768+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=JIT5M64I5NTR type=del 2024-03-09T14:28:47.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.769+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=8OFMBVLBYQEX type=del size=102044 2024-03-09T14:28:47.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.770+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~T1A53PKI70FQ.0 size=1048576 2024-03-09T14:28:47.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.771+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~T1A53PKI70FQ.1 size=1048576 2024-03-09T14:28:47.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.772+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~T1A53PKI70FQ.2 size=675910 2024-03-09T14:28:47.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.774+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=T1A53PKI70FQ tag=8C50L81PLRDM type=write size=3821638 2024-03-09T14:28:47.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.776+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~GK4U1DOF8N8Y.0 size=338833 2024-03-09T14:28:47.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.776+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=GK4U1DOF8N8Y tag=52BTKZUTMTPX type=write size=1387409 2024-03-09T14:28:47.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.777+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=BZ2CADBXZ8EU type=del 2024-03-09T14:28:47.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.778+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=WS254BAGW79C type=del size=661461 2024-03-09T14:28:47.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.779+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~SK3O47PW45DF.0 size=1048576 2024-03-09T14:28:47.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.780+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~SK3O47PW45DF.1 size=505733 2024-03-09T14:28:47.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.782+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=SK3O47PW45DF tag=6A2S6G8AHM0A type=write size=2602885 2024-03-09T14:28:47.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.783+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=VLBGS7SFP2K3 type=write size=562939 2024-03-09T14:28:47.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.784+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=Y3DKSW76D4BP type=del 2024-03-09T14:28:47.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.787+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~W2ADYRQ90V7C.0 size=1048576 2024-03-09T14:28:47.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.787+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~W2ADYRQ90V7C.1 size=808484 2024-03-09T14:28:47.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.787+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=W2ADYRQ90V7C tag=XZT6JG24QLTA type=write size=2905636 2024-03-09T14:28:47.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.789+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=IEMTNPME7YOH type=del 2024-03-09T14:28:47.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.791+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~YVMIUF26LSTE.0 size=674919 2024-03-09T14:28:47.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.791+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=YVMIUF26LSTE tag=QGV3JIKFOXF5 type=write size=1723495 2024-03-09T14:28:47.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.792+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~069D4SAV6BBN.0 size=553197 2024-03-09T14:28:47.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.794+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=069D4SAV6BBN tag=FN3TWTFL94OY type=write size=1601773 2024-03-09T14:28:47.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.795+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=ZSYTE09D9S4P type=del size=3202777 2024-03-09T14:28:47.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.796+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=2DO25F6S3127 type=del 2024-03-09T14:28:47.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.798+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~W1AJ22GAXN7O.0 size=1048576 2024-03-09T14:28:47.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.799+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~W1AJ22GAXN7O.1 size=1048576 2024-03-09T14:28:47.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.800+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~W1AJ22GAXN7O.2 size=85556 2024-03-09T14:28:47.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.800+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=W1AJ22GAXN7O tag=K12W70RRVFVA type=write size=3231284 2024-03-09T14:28:47.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.801+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=CEP6LO00WKHI type=del 2024-03-09T14:28:47.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.803+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=UB9O1C99PVCK type=del size=3855496 2024-03-09T14:28:47.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.805+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=YUIE9P1E0X9M type=del size=1150602 2024-03-09T14:28:47.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.807+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~EEWONSB0FI1S.0 size=1048576 2024-03-09T14:28:47.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.808+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~EEWONSB0FI1S.1 size=1048576 2024-03-09T14:28:47.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.809+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~EEWONSB0FI1S.2 size=937930 2024-03-09T14:28:47.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.809+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=EEWONSB0FI1S tag=FS236MLS1QGR type=write size=4083658 2024-03-09T14:28:47.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.810+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=811I2EZ8J78X type=write size=431007 2024-03-09T14:28:47.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.812+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~EVAPRYAA679P.0 size=1048576 2024-03-09T14:28:47.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.813+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~EVAPRYAA679P.1 size=1048576 2024-03-09T14:28:47.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.814+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~EVAPRYAA679P.2 size=573311 2024-03-09T14:28:47.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.814+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=EVAPRYAA679P tag=9T0MW0DZQ0NL type=write size=3719039 2024-03-09T14:28:47.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.815+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~EIO93RNO8FS5.0 size=1048576 2024-03-09T14:28:47.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.815+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~EIO93RNO8FS5.1 size=1048576 2024-03-09T14:28:47.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.816+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~EIO93RNO8FS5.2 size=25866 2024-03-09T14:28:47.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.819+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=EIO93RNO8FS5 tag=I7M5U1JIEPN1 type=write size=3171594 2024-03-09T14:28:47.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.821+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~JNF6XRLAAWSP.0 size=1048576 2024-03-09T14:28:47.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.821+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~JNF6XRLAAWSP.1 size=1048576 2024-03-09T14:28:47.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.822+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~JNF6XRLAAWSP.2 size=102809 2024-03-09T14:28:47.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.822+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=JNF6XRLAAWSP tag=UTSZNWAEZQOC type=write size=3248537 2024-03-09T14:28:47.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.823+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=39K87EGPMTR4 type=del 2024-03-09T14:28:47.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.824+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=EWVWDC3PUM65 type=del size=3574997 2024-03-09T14:28:47.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.826+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~QD3IH8J46UML.0 size=1048576 2024-03-09T14:28:47.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.826+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~QD3IH8J46UML.1 size=45769 2024-03-09T14:28:47.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.828+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=QD3IH8J46UML tag=RS4WEB3WLCYW type=write size=2142921 2024-03-09T14:28:47.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.830+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~4ZWCF6H2NKI9.0 size=1048576 2024-03-09T14:28:47.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.831+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~4ZWCF6H2NKI9.1 size=1048576 2024-03-09T14:28:47.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.832+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~4ZWCF6H2NKI9.2 size=642261 2024-03-09T14:28:47.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.832+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=4ZWCF6H2NKI9 tag=648OPBB69X3X type=write size=3787989 2024-03-09T14:28:47.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.834+0000 7f1c6444c780 1 < suggested remove operation key=KWDIDE9AE3JP tag=ZFMLB044UDAG type=write 2024-03-09T14:28:47.836 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.836+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~BXHAG8R5LCRM.0 size=1048576 2024-03-09T14:28:47.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.837+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~BXHAG8R5LCRM.1 size=295643 2024-03-09T14:28:47.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.837+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=BXHAG8R5LCRM tag=CSZ2PIXFCWSC type=write size=2392795 2024-03-09T14:28:47.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.838+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~Z3VNT9ROPVUJ.0 size=1048576 2024-03-09T14:28:47.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.839+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~Z3VNT9ROPVUJ.1 size=1048576 2024-03-09T14:28:47.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.840+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~Z3VNT9ROPVUJ.2 size=495751 2024-03-09T14:28:47.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.842+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=Z3VNT9ROPVUJ tag=OJ13E2WYKMH4 type=write size=3641479 2024-03-09T14:28:47.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.843+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=PS05FLIZ9D1O type=del size=393043 2024-03-09T14:28:47.844 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.844+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=8OFMBVLBYQEX type=del 2024-03-09T14:28:47.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.846+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~LA1J08S4Z6MB.0 size=822851 2024-03-09T14:28:47.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.846+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=LA1J08S4Z6MB tag=QGO3D42EZJVN type=write size=1871427 2024-03-09T14:28:47.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.847+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~GK4U1DOF8N8Y.0 size=338833 2024-03-09T14:28:47.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.849+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=GK4U1DOF8N8Y tag=52BTKZUTMTPX type=write size=1387409 2024-03-09T14:28:47.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.850+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=S4R91S74NKLL type=del size=1564767 2024-03-09T14:28:47.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.851+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=WS254BAGW79C type=del 2024-03-09T14:28:47.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.852+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=KZN58GGFQWYL type=del size=777102 2024-03-09T14:28:47.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.853+0000 7f1c6444c780 1 < completed write operation key=EREG1M13901A tag=VLBGS7SFP2K3 type=write size=562939 2024-03-09T14:28:47.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.854+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=F1FRCF4PSNXM type=del size=4072634 2024-03-09T14:28:47.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.855+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~W2ADYRQ90V7C.0 size=1048576 2024-03-09T14:28:47.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.856+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~W2ADYRQ90V7C.1 size=808484 2024-03-09T14:28:47.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.858+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=W2ADYRQ90V7C tag=XZT6JG24QLTA type=write size=2905636 2024-03-09T14:28:47.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.860+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~0X04DXCGCVCV.0 size=770629 2024-03-09T14:28:47.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.860+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=0X04DXCGCVCV tag=WF0EFJT3ISJM type=write size=1819205 2024-03-09T14:28:47.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.861+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~YVMIUF26LSTE.0 size=674919 2024-03-09T14:28:47.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.863+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=YVMIUF26LSTE tag=QGV3JIKFOXF5 type=write size=1723495 2024-03-09T14:28:47.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.864+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=2CQ69CBHW2TN type=del size=2459960 2024-03-09T14:28:47.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.865+0000 7f1c6444c780 1 < canceled operation key=YK7ENO4UAB2M tag=ZSYTE09D9S4P type=del size=3202777 2024-03-09T14:28:47.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.867+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~PR2HJ67V233S.0 size=1048576 2024-03-09T14:28:47.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.868+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~PR2HJ67V233S.1 size=1048576 2024-03-09T14:28:47.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.868+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~PR2HJ67V233S.2 size=59755 2024-03-09T14:28:47.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.868+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=PR2HJ67V233S tag=OBLH80S320QF type=write size=3205483 2024-03-09T14:28:47.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.869+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~W1AJ22GAXN7O.0 size=1048576 2024-03-09T14:28:47.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.870+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~W1AJ22GAXN7O.1 size=1048576 2024-03-09T14:28:47.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.871+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~W1AJ22GAXN7O.2 size=85556 2024-03-09T14:28:47.873 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.873+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=W1AJ22GAXN7O tag=K12W70RRVFVA type=write size=3231284 2024-03-09T14:28:47.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.874+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=AI3GXTE7PTRQ type=del size=3207239 2024-03-09T14:28:47.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.875+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=UB9O1C99PVCK type=del 2024-03-09T14:28:47.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.878+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~XM9CR12XC21C.0 size=1048576 2024-03-09T14:28:47.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.879+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~XM9CR12XC21C.1 size=1048576 2024-03-09T14:28:47.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.880+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~XM9CR12XC21C.2 size=878184 2024-03-09T14:28:47.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.880+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=XM9CR12XC21C tag=LG4TEWDWAF7J type=write size=4023912 2024-03-09T14:28:47.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.881+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~EEWONSB0FI1S.0 size=1048576 2024-03-09T14:28:47.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.882+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~EEWONSB0FI1S.1 size=1048576 2024-03-09T14:28:47.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.883+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~EEWONSB0FI1S.2 size=937930 2024-03-09T14:28:47.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.886+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=EEWONSB0FI1S tag=FS236MLS1QGR type=write size=4083658 2024-03-09T14:28:47.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.887+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=2DI3IV9YRITX type=del size=1060456 2024-03-09T14:28:47.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.887+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~EVAPRYAA679P.0 size=1048576 2024-03-09T14:28:47.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.889+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~EVAPRYAA679P.1 size=1048576 2024-03-09T14:28:47.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.890+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~EVAPRYAA679P.2 size=573311 2024-03-09T14:28:47.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.892+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=EVAPRYAA679P tag=9T0MW0DZQ0NL type=write size=3719039 2024-03-09T14:28:47.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.894+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~SSYEHS1DCFWC.0 size=776127 2024-03-09T14:28:47.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.894+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=SSYEHS1DCFWC tag=ARDUASOGEW0C type=write size=1824703 2024-03-09T14:28:47.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.896+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~JNF6XRLAAWSP.0 size=1048576 2024-03-09T14:28:47.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.897+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~JNF6XRLAAWSP.1 size=1048576 2024-03-09T14:28:47.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.898+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~JNF6XRLAAWSP.2 size=102809 2024-03-09T14:28:47.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.900+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=JNF6XRLAAWSP tag=UTSZNWAEZQOC type=write size=3248537 2024-03-09T14:28:47.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.901+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=8ZIYZ533M9S8 type=del size=2866480 2024-03-09T14:28:47.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.903+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=EWVWDC3PUM65 type=del 2024-03-09T14:28:47.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.904+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=6SZ1U02WK3VQ type=del size=400614 2024-03-09T14:28:47.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.905+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~4ZWCF6H2NKI9.0 size=1048576 2024-03-09T14:28:47.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.906+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~4ZWCF6H2NKI9.1 size=1048576 2024-03-09T14:28:47.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.907+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~4ZWCF6H2NKI9.2 size=642261 2024-03-09T14:28:47.909 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.909+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=4ZWCF6H2NKI9 tag=648OPBB69X3X type=write size=3787989 2024-03-09T14:28:47.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.910+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=V2HNGGGI2BQ7 type=del size=3509047 2024-03-09T14:28:47.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.911+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~BXHAG8R5LCRM.0 size=1048576 2024-03-09T14:28:47.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.912+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~BXHAG8R5LCRM.1 size=295643 2024-03-09T14:28:47.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.914+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=BXHAG8R5LCRM tag=CSZ2PIXFCWSC type=write size=2392795 2024-03-09T14:28:47.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.915+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=WS0M7LGJAS45 type=del size=2434478 2024-03-09T14:28:47.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.918+0000 7f1c6444c780 1 < suggested update operation key=IBVEN2JEB49N tag=PS05FLIZ9D1O type=del size=393043 2024-03-09T14:28:47.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.919+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=OOT3SSJCTXZC type=del size=1022820 2024-03-09T14:28:47.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.920+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~LA1J08S4Z6MB.0 size=822851 2024-03-09T14:28:47.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.922+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=LA1J08S4Z6MB tag=QGO3D42EZJVN type=write size=1871427 2024-03-09T14:28:47.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.925+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=IV1PZ1501B8O type=del size=3601319 2024-03-09T14:28:47.926 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.926+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=S4R91S74NKLL type=del 2024-03-09T14:28:47.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.927+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=0P69LZ10DJHP type=write size=11252 2024-03-09T14:28:47.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.928+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=KZN58GGFQWYL type=del 2024-03-09T14:28:47.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.930+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~SJ7B97P16RQF.0 size=1048576 2024-03-09T14:28:47.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.931+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~SJ7B97P16RQF.1 size=1048576 2024-03-09T14:28:47.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.932+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~SJ7B97P16RQF.2 size=178056 2024-03-09T14:28:47.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.932+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=SJ7B97P16RQF tag=RBG6R7S1JY64 type=write size=3323784 2024-03-09T14:28:47.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.933+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=F1FRCF4PSNXM type=del 2024-03-09T14:28:47.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.934+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=PG5B32DGPJ4K type=del size=1190794 2024-03-09T14:28:47.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.935+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~0X04DXCGCVCV.0 size=770629 2024-03-09T14:28:47.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.937+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=0X04DXCGCVCV tag=WF0EFJT3ISJM type=write size=1819205 2024-03-09T14:28:47.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.939+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~89HOE13X5V3O.0 size=1048576 2024-03-09T14:28:47.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.940+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~89HOE13X5V3O.1 size=1048576 2024-03-09T14:28:47.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.940+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~89HOE13X5V3O.2 size=665316 2024-03-09T14:28:47.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.940+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=89HOE13X5V3O tag=BOPYMKMHHFPW type=write size=3811044 2024-03-09T14:28:47.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.942+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=2CQ69CBHW2TN type=del 2024-03-09T14:28:47.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.943+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=PNH9G0O4UVOV type=del size=2180244 2024-03-09T14:28:47.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.944+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~PR2HJ67V233S.0 size=1048576 2024-03-09T14:28:47.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.945+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~PR2HJ67V233S.1 size=1048576 2024-03-09T14:28:47.946 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.946+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~PR2HJ67V233S.2 size=59755 2024-03-09T14:28:47.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.948+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=PR2HJ67V233S tag=OBLH80S320QF type=write size=3205483 2024-03-09T14:28:47.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.950+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~0A84WH6Y7VTE.0 size=1048576 2024-03-09T14:28:47.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.951+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~0A84WH6Y7VTE.1 size=1048576 2024-03-09T14:28:47.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.951+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~0A84WH6Y7VTE.2 size=655204 2024-03-09T14:28:47.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.951+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=0A84WH6Y7VTE tag=2WL3MU1ABCP3 type=write size=3800932 2024-03-09T14:28:47.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.953+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=AI3GXTE7PTRQ type=del 2024-03-09T14:28:47.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.954+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=1NZXJ2YW2PPT type=del size=224073 2024-03-09T14:28:47.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.955+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~XM9CR12XC21C.0 size=1048576 2024-03-09T14:28:47.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.956+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~XM9CR12XC21C.1 size=1048576 2024-03-09T14:28:47.957 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.957+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~XM9CR12XC21C.2 size=878184 2024-03-09T14:28:47.959 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.959+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=XM9CR12XC21C tag=LG4TEWDWAF7J type=write size=4023912 2024-03-09T14:28:47.960 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.960+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=8L4XFA9FWID2 type=del size=2337533 2024-03-09T14:28:47.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.961+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=2DI3IV9YRITX type=del 2024-03-09T14:28:47.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.962+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=TDVV8WJP1XQE type=del size=2643111 2024-03-09T14:28:47.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.964+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~SSYEHS1DCFWC.0 size=776127 2024-03-09T14:28:47.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.965+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=SSYEHS1DCFWC tag=ARDUASOGEW0C type=write size=1824703 2024-03-09T14:28:47.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.966+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=SJ91WX6I07OJ type=del size=1904058 2024-03-09T14:28:47.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.968+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=8ZIYZ533M9S8 type=del 2024-03-09T14:28:47.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.969+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=8XHV2PU9SFMO type=del size=2640370 2024-03-09T14:28:47.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.970+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=6SZ1U02WK3VQ type=del 2024-03-09T14:28:47.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.971+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=GRB9MQKQ10ON type=del size=3670836 2024-03-09T14:28:47.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.972+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=V2HNGGGI2BQ7 type=del 2024-03-09T14:28:47.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.973+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=QCWLP6H2XQGK type=del size=380364 2024-03-09T14:28:47.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.976+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=WS0M7LGJAS45 type=del size=2434478 2024-03-09T14:28:47.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.978+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~SHS9TW52CD61.0 size=1048576 2024-03-09T14:28:47.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.979+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~SHS9TW52CD61.1 size=1048576 2024-03-09T14:28:47.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.980+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~SHS9TW52CD61.2 size=230302 2024-03-09T14:28:47.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.980+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=SHS9TW52CD61 tag=1POU3BNXDAMM type=write size=3376030 2024-03-09T14:28:47.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.981+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=OOT3SSJCTXZC type=del 2024-03-09T14:28:47.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.982+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=6LUA4QNE47TU type=write size=857833 2024-03-09T14:28:47.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.983+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=IV1PZ1501B8O type=del 2024-03-09T14:28:47.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.984+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=8PA8R9Z3OKSV type=del size=595560 2024-03-09T14:28:47.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.986+0000 7f1c6444c780 1 < completed write operation key=VL5EUQ52WRAN tag=0P69LZ10DJHP type=write size=11252 2024-03-09T14:28:47.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.988+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~80C5AW73CGPF.0 size=1048576 2024-03-09T14:28:47.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.989+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~80C5AW73CGPF.1 size=738759 2024-03-09T14:28:47.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.989+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=80C5AW73CGPF tag=CYIY2S12W6AX type=write size=2835911 2024-03-09T14:28:47.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.990+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~SJ7B97P16RQF.0 size=1048576 2024-03-09T14:28:47.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.991+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~SJ7B97P16RQF.1 size=1048576 2024-03-09T14:28:47.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.992+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~SJ7B97P16RQF.2 size=178056 2024-03-09T14:28:47.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.994+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=SJ7B97P16RQF tag=RBG6R7S1JY64 type=write size=3323784 2024-03-09T14:28:47.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.995+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=N3WUQED7J91Q type=del size=3499860 2024-03-09T14:28:47.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.996+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=PG5B32DGPJ4K type=del 2024-03-09T14:28:47.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.997+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=P9ZAJIVISNDC type=del size=2818793 2024-03-09T14:28:47.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:47.999+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~89HOE13X5V3O.0 size=1048576 2024-03-09T14:28:48.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.000+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~89HOE13X5V3O.1 size=1048576 2024-03-09T14:28:48.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.001+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~89HOE13X5V3O.2 size=665316 2024-03-09T14:28:48.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.003+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=89HOE13X5V3O tag=BOPYMKMHHFPW type=write size=3811044 2024-03-09T14:28:48.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.004+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=JQ1XNO7L2AE0 type=del size=322777 2024-03-09T14:28:48.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.006+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=PNH9G0O4UVOV type=del 2024-03-09T14:28:48.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.007+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=0QJXUW7VJB31 type=del size=1749826 2024-03-09T14:28:48.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.007+0000 7f1c6444c780 1 < canceled part key=_multipart_KMX7TNIOKWOA.2~0A84WH6Y7VTE.0 size=1048576 2024-03-09T14:28:48.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.008+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~0A84WH6Y7VTE.1 size=1048576 2024-03-09T14:28:48.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.009+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~0A84WH6Y7VTE.2 size=655204 2024-03-09T14:28:48.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.011+0000 7f1c6444c780 1 < canceled multipart upload key=KMX7TNIOKWOA upload=0A84WH6Y7VTE tag=2WL3MU1ABCP3 type=write size=3800932 2024-03-09T14:28:48.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.012+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=ODOVHQ55JRLM type=del size=671739 2024-03-09T14:28:48.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.013+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=1NZXJ2YW2PPT type=del 2024-03-09T14:28:48.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.015+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=HH86YR6JXJD8 type=del size=1581569 2024-03-09T14:28:48.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.017+0000 7f1c6444c780 1 < suggested update operation key=1NQRJ8ICZNM6 tag=8L4XFA9FWID2 type=del size=2337533 2024-03-09T14:28:48.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.019+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~SMAKB8J7WNTU.0 size=934624 2024-03-09T14:28:48.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.019+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=SMAKB8J7WNTU tag=HZF0UIB1NGRP type=write size=1983200 2024-03-09T14:28:48.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.020+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=TDVV8WJP1XQE type=del 2024-03-09T14:28:48.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.021+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=BU218C1U8ICL type=del size=3280773 2024-03-09T14:28:48.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.022+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=SJ91WX6I07OJ type=del 2024-03-09T14:28:48.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.024+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=AZLHGI9NO7X4 type=del size=1382325 2024-03-09T14:28:48.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.026+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=8XHV2PU9SFMO type=del 2024-03-09T14:28:48.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.027+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=2IAPXY6BV41U type=del size=3551767 2024-03-09T14:28:48.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.028+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=GRB9MQKQ10ON type=del 2024-03-09T14:28:48.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.029+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=XGU43CQW22YP type=del size=15573 2024-03-09T14:28:48.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.030+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=0IHHFQBKKJ0G tag=QCWLP6H2XQGK type=del size=380364: (2) No such file or directory 2024-03-09T14:28:48.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.031+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=HBOBPGGPQTDF type=del size=1783182 2024-03-09T14:28:48.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.032+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~SHS9TW52CD61.0 size=1048576 2024-03-09T14:28:48.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.034+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~SHS9TW52CD61.1 size=1048576 2024-03-09T14:28:48.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.035+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~SHS9TW52CD61.2 size=230302 2024-03-09T14:28:48.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.037+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=SHS9TW52CD61 tag=1POU3BNXDAMM type=write size=3376030 2024-03-09T14:28:48.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.038+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=F8E51362GPPO type=del size=1703253 2024-03-09T14:28:48.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.039+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=6LUA4QNE47TU type=write size=857833 2024-03-09T14:28:48.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.041+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~JYZ116GA3GKM.0 size=1048576 2024-03-09T14:28:48.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.042+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~JYZ116GA3GKM.1 size=1048576 2024-03-09T14:28:48.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.043+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~JYZ116GA3GKM.2 size=936725 2024-03-09T14:28:48.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.043+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=JYZ116GA3GKM tag=PJG1FHKY9MLH type=write size=4082453 2024-03-09T14:28:48.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.044+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=8PA8R9Z3OKSV type=del 2024-03-09T14:28:48.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.045+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=I0HCLVSL34RN type=del size=1230985 2024-03-09T14:28:48.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.045+0000 7f1c6444c780 1 < canceled part key=_multipart_MX3X6ILR7J8N.2~80C5AW73CGPF.0 size=1048576 2024-03-09T14:28:48.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.046+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~80C5AW73CGPF.1 size=738759 2024-03-09T14:28:48.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.048+0000 7f1c6444c780 1 < canceled multipart upload key=MX3X6ILR7J8N upload=80C5AW73CGPF tag=CYIY2S12W6AX type=write size=2835911 2024-03-09T14:28:48.049 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.049+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=90VJ6NX0P34P type=del size=1267645 2024-03-09T14:28:48.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.050+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=N3WUQED7J91Q type=del 2024-03-09T14:28:48.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.051+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=9BKT708PIG3D type=del size=1625838 2024-03-09T14:28:48.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.054+0000 7f1c6444c780 1 < suggested update operation key=3CC018VYSRHN tag=P9ZAJIVISNDC type=del size=2818793 2024-03-09T14:28:48.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.055+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=F4WRCDZT8AF9 type=del size=3933346 2024-03-09T14:28:48.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.056+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=JQ1XNO7L2AE0 type=del 2024-03-09T14:28:48.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.057+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=A02X2VWMD40X type=del size=2932082 2024-03-09T14:28:48.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.059+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=0QJXUW7VJB31 type=del size=1749826 2024-03-09T14:28:48.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.060+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=L7P0OR6W65JO type=del size=787614 2024-03-09T14:28:48.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.061+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=ODOVHQ55JRLM type=del 2024-03-09T14:28:48.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.063+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=RRTCQV21QYLU type=write size=106485 2024-03-09T14:28:48.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.064+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=HH86YR6JXJD8 type=del 2024-03-09T14:28:48.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.066+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~WZUOMHXV9FU2.0 size=51951 2024-03-09T14:28:48.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.066+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=WZUOMHXV9FU2 tag=HQG5W6JY1E5N type=write size=1100527 2024-03-09T14:28:48.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.067+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~SMAKB8J7WNTU.0 size=934624 2024-03-09T14:28:48.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.069+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=SMAKB8J7WNTU tag=HZF0UIB1NGRP type=write size=1983200 2024-03-09T14:28:48.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.070+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=ZT4HKN0E6BIT type=del size=1055437 2024-03-09T14:28:48.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.071+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=BU218C1U8ICL type=del 2024-03-09T14:28:48.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.072+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=GWDV04X05879 type=del size=1221197 2024-03-09T14:28:48.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.073+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=AZLHGI9NO7X4 type=del 2024-03-09T14:28:48.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.074+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=I01PGY3DU0SG type=del size=2286811 2024-03-09T14:28:48.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.075+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=2IAPXY6BV41U type=del 2024-03-09T14:28:48.076 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.076+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=6S53W2J6TNHK type=del size=2663783 2024-03-09T14:28:48.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.078+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=XGU43CQW22YP type=del size=15573 2024-03-09T14:28:48.080 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.080+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=A39N9QC5KI1H type=del size=2181132 2024-03-09T14:28:48.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.081+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=HBOBPGGPQTDF type=del 2024-03-09T14:28:48.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.082+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=4T092IHAOBCT type=write size=473849 2024-03-09T14:28:48.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.083+0000 7f1c6444c780 1 < canceled operation key=BYX1155MZ2LP tag=F8E51362GPPO type=del size=1703253 2024-03-09T14:28:48.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.084+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=I5KP2191BJ82 type=del size=1802548 2024-03-09T14:28:48.085 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.085+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~JYZ116GA3GKM.0 size=1048576 2024-03-09T14:28:48.086 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.086+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~JYZ116GA3GKM.1 size=1048576 2024-03-09T14:28:48.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.087+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~JYZ116GA3GKM.2 size=936725 2024-03-09T14:28:48.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.089+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=JYZ116GA3GKM tag=PJG1FHKY9MLH type=write size=4082453 2024-03-09T14:28:48.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.090+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=X4WOJHIW11YR type=write size=281877 2024-03-09T14:28:48.091 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.091+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=I0HCLVSL34RN type=del 2024-03-09T14:28:48.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.092+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=FZB79BQ2KTL5 type=write size=311312 2024-03-09T14:28:48.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.093+0000 7f1c6444c780 1 < canceled operation key=SGHNHOCYPM38 tag=90VJ6NX0P34P type=del size=1267645 2024-03-09T14:28:48.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.094+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=R3L3FH2PNLAK type=write size=605913 2024-03-09T14:28:48.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.097+0000 7f1c6444c780 1 < suggested remove operation key=MX3X6ILR7J8N tag=9BKT708PIG3D type=del 2024-03-09T14:28:48.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.098+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=TE3LDSSLZNZ3 type=write size=635421 2024-03-09T14:28:48.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.100+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=F4WRCDZT8AF9 type=del 2024-03-09T14:28:48.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.101+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=5PE9K5GM33S6 type=del size=3886953 2024-03-09T14:28:48.102 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.102+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=A02X2VWMD40X type=del 2024-03-09T14:28:48.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.105+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~K3CIWP1294GL.0 size=1048576 2024-03-09T14:28:48.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.106+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~K3CIWP1294GL.1 size=1048576 2024-03-09T14:28:48.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.106+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~K3CIWP1294GL.2 size=738033 2024-03-09T14:28:48.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.106+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=K3CIWP1294GL tag=OW8LGC8LM81T type=write size=3883761 2024-03-09T14:28:48.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.109+0000 7f1c6444c780 1 < suggested remove operation key=MOVS6ZMK708G tag=L7P0OR6W65JO type=del 2024-03-09T14:28:48.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.110+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=2VMM3NQVOKPN type=del size=1146740 2024-03-09T14:28:48.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.112+0000 7f1c6444c780 1 < suggested update operation key=KNOEGKSERB6Z tag=RRTCQV21QYLU type=write size=106485 2024-03-09T14:28:48.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.113+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=J01O53THQPUQ type=del size=2223466 2024-03-09T14:28:48.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.114+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~WZUOMHXV9FU2.0 size=51951 2024-03-09T14:28:48.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.116+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=WZUOMHXV9FU2 tag=HQG5W6JY1E5N type=write size=1100527 2024-03-09T14:28:48.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.117+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=XWUNVONX9JUR type=write size=894173 2024-03-09T14:28:48.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.119+0000 7f1c6444c780 1 < canceled operation key=49YOZGJ8XC4K tag=ZT4HKN0E6BIT type=del size=1055437 2024-03-09T14:28:48.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.121+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~MESPYTTDV2IH.0 size=1048576 2024-03-09T14:28:48.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.121+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~MESPYTTDV2IH.1 size=1048576 2024-03-09T14:28:48.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.122+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~MESPYTTDV2IH.2 size=265112 2024-03-09T14:28:48.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.122+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=MESPYTTDV2IH tag=EUSWR4ZMENVN type=write size=3410840 2024-03-09T14:28:48.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.124+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=GWDV04X05879 type=del 2024-03-09T14:28:48.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.125+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=0ASYEOWS19KR type=del size=2110550 2024-03-09T14:28:48.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.126+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=I01PGY3DU0SG type=del 2024-03-09T14:28:48.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.127+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=TXD11JEL7PLR type=del size=2141390 2024-03-09T14:28:48.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.128+0000 7f1c6444c780 1 < canceled operation key=BAWV7KY6NT8P tag=6S53W2J6TNHK type=del size=2663783 2024-03-09T14:28:48.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.129+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=VQ59YNI50FNZ type=write size=568511 2024-03-09T14:28:48.130 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.130+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=A39N9QC5KI1H type=del 2024-03-09T14:28:48.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.132+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=BF6J3BWQXJEG type=write size=1016904 2024-03-09T14:28:48.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.133+0000 7f1c6444c780 1 < completed write operation key=YK7ENO4UAB2M tag=4T092IHAOBCT type=write size=473849 2024-03-09T14:28:48.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.134+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=AJWXDFLU0Q1G type=del size=3363923 2024-03-09T14:28:48.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.137+0000 7f1c6444c780 1 < suggested remove operation key=3CC018VYSRHN tag=I5KP2191BJ82 type=del 2024-03-09T14:28:48.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.138+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=98OORQCR353R type=del size=3277512 2024-03-09T14:28:48.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.139+0000 7f1c6444c780 1 < completed write operation key=NIN0FB6YTKWA tag=X4WOJHIW11YR type=write size=281877 2024-03-09T14:28:48.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.141+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~37PCD6708610.0 size=1048576 2024-03-09T14:28:48.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.144+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~37PCD6708610.1 size=132152 2024-03-09T14:28:48.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.144+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=37PCD6708610 tag=NX0QD6H0FOXI type=write size=2229304 2024-03-09T14:28:48.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.145+0000 7f1c6444c780 1 < completed write operation key=SGHNHOCYPM38 tag=FZB79BQ2KTL5 type=write size=311312 2024-03-09T14:28:48.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.147+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~LAOZ03F6I0OB.0 size=410327 2024-03-09T14:28:48.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.147+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=LAOZ03F6I0OB tag=RN93Y5Z4IZHS type=write size=1458903 2024-03-09T14:28:48.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.148+0000 7f1c6444c780 1 < completed write operation key=CVD0EGQUVJYR tag=R3L3FH2PNLAK type=write size=605913 2024-03-09T14:28:48.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.150+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=KGV841SQXX3X type=del size=1584374 2024-03-09T14:28:48.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.151+0000 7f1c6444c780 1 < completed write operation key=VL5EUQ52WRAN tag=TE3LDSSLZNZ3 type=write size=635421 2024-03-09T14:28:48.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.152+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=LOWBPJFVBJ82 type=del size=635874 2024-03-09T14:28:48.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.153+0000 7f1c6444c780 1 < canceled operation key=BYX1155MZ2LP tag=5PE9K5GM33S6 type=del size=3886953 2024-03-09T14:28:48.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.154+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=W4IBPB0ICYHG type=del size=3482809 2024-03-09T14:28:48.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.156+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~K3CIWP1294GL.0 size=1048576 2024-03-09T14:28:48.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.156+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~K3CIWP1294GL.1 size=1048576 2024-03-09T14:28:48.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.157+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~K3CIWP1294GL.2 size=738033 2024-03-09T14:28:48.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.159+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=K3CIWP1294GL tag=OW8LGC8LM81T type=write size=3883761 2024-03-09T14:28:48.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.161+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=A2KJQVWX1NUW type=del size=1849704 2024-03-09T14:28:48.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.162+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=2VMM3NQVOKPN type=del 2024-03-09T14:28:48.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.164+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~LDPM8X1UEW2Z.0 size=174677 2024-03-09T14:28:48.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.164+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=LDPM8X1UEW2Z tag=5MBLDUZYGFQ9 type=write size=1223253 2024-03-09T14:28:48.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.166+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=J01O53THQPUQ type=del size=2223466 2024-03-09T14:28:48.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.168+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~OBDEK8QD4YV0.0 size=1048576 2024-03-09T14:28:48.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.169+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~OBDEK8QD4YV0.1 size=1048576 2024-03-09T14:28:48.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.170+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~OBDEK8QD4YV0.2 size=502117 2024-03-09T14:28:48.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.170+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=OBDEK8QD4YV0 tag=NZPCJFOOBB59 type=write size=3647845 2024-03-09T14:28:48.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.171+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=XWUNVONX9JUR type=write size=894173 2024-03-09T14:28:48.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.173+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=XIA0GAN7FSZ3 type=del size=760678 2024-03-09T14:28:48.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.174+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~MESPYTTDV2IH.0 size=1048576 2024-03-09T14:28:48.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.175+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~MESPYTTDV2IH.1 size=1048576 2024-03-09T14:28:48.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.176+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~MESPYTTDV2IH.2 size=265112 2024-03-09T14:28:48.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.178+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=MESPYTTDV2IH tag=EUSWR4ZMENVN type=write size=3410840 2024-03-09T14:28:48.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.180+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~AX4OM0SAGCUP.0 size=1048576 2024-03-09T14:28:48.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.181+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~AX4OM0SAGCUP.1 size=1048576 2024-03-09T14:28:48.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.181+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~AX4OM0SAGCUP.2 size=277991 2024-03-09T14:28:48.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.182+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=AX4OM0SAGCUP tag=11LIAGX2RZNH type=write size=3423719 2024-03-09T14:28:48.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.183+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=0ASYEOWS19KR type=del 2024-03-09T14:28:48.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.184+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=EXVMBTAXRNED type=write size=623026 2024-03-09T14:28:48.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.185+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=TXD11JEL7PLR type=del 2024-03-09T14:28:48.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.186+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=7ENHRFI7HC1J type=del size=1349186 2024-03-09T14:28:48.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.188+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=VQ59YNI50FNZ type=write size=568511 2024-03-09T14:28:48.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.189+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=D9IBBXYX6TJ2 type=del size=4011741 2024-03-09T14:28:48.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.190+0000 7f1c6444c780 1 < canceled operation key=VL5EUQ52WRAN tag=BF6J3BWQXJEG type=write size=1016904 2024-03-09T14:28:48.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.191+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=XXZLXJWDZ579 type=del size=4125252 2024-03-09T14:28:48.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.192+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=AJWXDFLU0Q1G type=del size=3363923 2024-03-09T14:28:48.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.193+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=LDOF0HCE18DY type=del size=702430 2024-03-09T14:28:48.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.195+0000 7f1c6444c780 1 < suggested remove operation key=NIN0FB6YTKWA tag=98OORQCR353R type=del 2024-03-09T14:28:48.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.198+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~CJCL5NH13ZHY.0 size=1048576 2024-03-09T14:28:48.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.199+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~CJCL5NH13ZHY.1 size=952299 2024-03-09T14:28:48.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.199+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=CJCL5NH13ZHY tag=YRPHK4SAPCKT type=write size=3049451 2024-03-09T14:28:48.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.200+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~37PCD6708610.0 size=1048576 2024-03-09T14:28:48.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.201+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~37PCD6708610.1 size=132152 2024-03-09T14:28:48.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.203+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=37PCD6708610 tag=NX0QD6H0FOXI type=write size=2229304 2024-03-09T14:28:48.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.204+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=IV8WT2K0KTBR type=write size=462230 2024-03-09T14:28:48.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.205+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~LAOZ03F6I0OB.0 size=410327 2024-03-09T14:28:48.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.207+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=LAOZ03F6I0OB tag=RN93Y5Z4IZHS type=write size=1458903 2024-03-09T14:28:48.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.209+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=3M7D9EZ43RE1 type=del size=282454 2024-03-09T14:28:48.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.210+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=KGV841SQXX3X type=del 2024-03-09T14:28:48.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.211+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=B6FNDCDF911L type=del size=1913106 2024-03-09T14:28:48.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.212+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=LOWBPJFVBJ82 type=del size=635874 2024-03-09T14:28:48.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.213+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=QSTMDCZC2RR8 type=write size=676713 2024-03-09T14:28:48.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.215+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=W4IBPB0ICYHG type=del 2024-03-09T14:28:48.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.217+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~6ES59E1AXF1V.0 size=260956 2024-03-09T14:28:48.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.217+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=6ES59E1AXF1V tag=2NESBK2ELMCG type=write size=1309532 2024-03-09T14:28:48.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.219+0000 7f1c6444c780 1 < suggested update operation key=V05XJ56M53T8 tag=A2KJQVWX1NUW type=del size=1849704 2024-03-09T14:28:48.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.221+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~RHDEU0O3JC3J.0 size=1048576 2024-03-09T14:28:48.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.222+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~RHDEU0O3JC3J.1 size=807832 2024-03-09T14:28:48.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.222+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=RHDEU0O3JC3J tag=XKS2SB0R8405 type=write size=2904984 2024-03-09T14:28:48.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.223+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~LDPM8X1UEW2Z.0 size=174677 2024-03-09T14:28:48.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.225+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=LDPM8X1UEW2Z tag=5MBLDUZYGFQ9 type=write size=1223253 2024-03-09T14:28:48.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.226+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=JXTGNQG0K22M type=write size=406745 2024-03-09T14:28:48.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.227+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~OBDEK8QD4YV0.0 size=1048576 2024-03-09T14:28:48.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.228+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~OBDEK8QD4YV0.1 size=1048576 2024-03-09T14:28:48.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.229+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~OBDEK8QD4YV0.2 size=502117 2024-03-09T14:28:48.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.231+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=OBDEK8QD4YV0 tag=NZPCJFOOBB59 type=write size=3647845 2024-03-09T14:28:48.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.232+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=2EQ2A1XDS18S type=del size=1813504 2024-03-09T14:28:48.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.234+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=XIA0GAN7FSZ3 type=del 2024-03-09T14:28:48.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.235+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=DGYJ0TFTZCX2 type=del size=911304 2024-03-09T14:28:48.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.236+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~AX4OM0SAGCUP.0 size=1048576 2024-03-09T14:28:48.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.236+0000 7f1c6444c780 1 < canceled part key=_multipart_YK7ENO4UAB2M.2~AX4OM0SAGCUP.1 size=1048576 2024-03-09T14:28:48.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.237+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~AX4OM0SAGCUP.2 size=277991 2024-03-09T14:28:48.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.239+0000 7f1c6444c780 1 < canceled multipart upload key=YK7ENO4UAB2M upload=AX4OM0SAGCUP tag=11LIAGX2RZNH type=write size=3423719 2024-03-09T14:28:48.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.240+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=E0WZLPDT01JR type=del size=1881393 2024-03-09T14:28:48.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.242+0000 7f1c6444c780 1 < suggested remove operation key=Z34QOCZB3DFX tag=EXVMBTAXRNED type=write 2024-03-09T14:28:48.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.245+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~FTUP7KA2AMXF.0 size=932562 2024-03-09T14:28:48.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.245+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=FTUP7KA2AMXF tag=PBJQ15ND5UYI type=write size=1981138 2024-03-09T14:28:48.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.247+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=7ENHRFI7HC1J type=del size=1349186 2024-03-09T14:28:48.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.249+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~J71AASPP92ND.0 size=252792 2024-03-09T14:28:48.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.249+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=J71AASPP92ND tag=47738YW0GLG8 type=write size=1301368 2024-03-09T14:28:48.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.250+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=D9IBBXYX6TJ2 type=del 2024-03-09T14:28:48.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.251+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=QUA1AGEJ576Y type=write size=647433 2024-03-09T14:28:48.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.255+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=XXZLXJWDZ579 type=del 2024-03-09T14:28:48.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.256+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=U2EQFY0TDMTB type=del size=849885 2024-03-09T14:28:48.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.257+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=LDOF0HCE18DY type=del 2024-03-09T14:28:48.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.259+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~DBCVD1PTUXMU.0 size=1048576 2024-03-09T14:28:48.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.260+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~DBCVD1PTUXMU.1 size=20881 2024-03-09T14:28:48.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.260+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=DBCVD1PTUXMU tag=6PMZ4RGGEI0Y type=write size=2118033 2024-03-09T14:28:48.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.261+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~CJCL5NH13ZHY.0 size=1048576 2024-03-09T14:28:48.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.261+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~CJCL5NH13ZHY.1 size=952299 2024-03-09T14:28:48.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.263+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=CJCL5NH13ZHY tag=YRPHK4SAPCKT type=write size=3049451 2024-03-09T14:28:48.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.265+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~AU3YBTE4SHKJ.0 size=1048576 2024-03-09T14:28:48.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.266+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~AU3YBTE4SHKJ.1 size=1048576 2024-03-09T14:28:48.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.267+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~AU3YBTE4SHKJ.2 size=267124 2024-03-09T14:28:48.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.267+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=AU3YBTE4SHKJ tag=YJWS664VQL5B type=write size=3412852 2024-03-09T14:28:48.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.268+0000 7f1c6444c780 1 < completed write operation key=71FSR1CHFBO0 tag=IV8WT2K0KTBR type=write size=462230 2024-03-09T14:28:48.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.270+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~CNMQ0SJEWS2R.0 size=1048576 2024-03-09T14:28:48.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.271+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~CNMQ0SJEWS2R.1 size=734635 2024-03-09T14:28:48.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.271+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=CNMQ0SJEWS2R tag=HNM2XOUX1VKG type=write size=2831787 2024-03-09T14:28:48.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.272+0000 7f1c6444c780 1 < canceled operation key=BYX1155MZ2LP tag=3M7D9EZ43RE1 type=del size=282454 2024-03-09T14:28:48.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.273+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=NDN5AWW1ZKD8 type=write size=88133 2024-03-09T14:28:48.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.274+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=B6FNDCDF911L type=del 2024-03-09T14:28:48.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.276+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~4Z7P0RA3D8BW.0 size=1013019 2024-03-09T14:28:48.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.276+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=4Z7P0RA3D8BW tag=XUXUEX3R3L7F type=write size=2061595 2024-03-09T14:28:48.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.277+0000 7f1c6444c780 1 < completed write operation key=3CC018VYSRHN tag=QSTMDCZC2RR8 type=write size=676713 2024-03-09T14:28:48.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.279+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~EHOYFRZB6SLH.0 size=1048576 2024-03-09T14:28:48.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.280+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~EHOYFRZB6SLH.1 size=45716 2024-03-09T14:28:48.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.280+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=EHOYFRZB6SLH tag=EUNEXF8LZFHR type=write size=2142868 2024-03-09T14:28:48.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.282+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~6ES59E1AXF1V.0 size=260956 2024-03-09T14:28:48.283 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.283+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=6ES59E1AXF1V tag=2NESBK2ELMCG type=write size=1309532 2024-03-09T14:28:48.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.285+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=EVI4AVD0U01D type=del size=2345196 2024-03-09T14:28:48.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.285+0000 7f1c6444c780 1 < canceled part key=_multipart_MOVS6ZMK708G.2~RHDEU0O3JC3J.0 size=1048576 2024-03-09T14:28:48.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.286+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~RHDEU0O3JC3J.1 size=807832 2024-03-09T14:28:48.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.288+0000 7f1c6444c780 1 < canceled multipart upload key=MOVS6ZMK708G upload=RHDEU0O3JC3J tag=XKS2SB0R8405 type=write size=2904984 2024-03-09T14:28:48.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.289+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=8BUXKV3IBINK type=write size=990947 2024-03-09T14:28:48.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.290+0000 7f1c6444c780 1 < canceled operation key=KMX7TNIOKWOA tag=JXTGNQG0K22M type=write size=406745 2024-03-09T14:28:48.291 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.291+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=RL7RTVHBCXCE type=del size=2459066 2024-03-09T14:28:48.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.292+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=2EQ2A1XDS18S type=del 2024-03-09T14:28:48.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.294+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~U4HP9KMNFY4I.0 size=1048576 2024-03-09T14:28:48.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.295+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~U4HP9KMNFY4I.1 size=1048576 2024-03-09T14:28:48.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.296+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~U4HP9KMNFY4I.2 size=485325 2024-03-09T14:28:48.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.296+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=U4HP9KMNFY4I tag=5MY3LRYLUWOE type=write size=3631053 2024-03-09T14:28:48.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.297+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=DGYJ0TFTZCX2 type=del 2024-03-09T14:28:48.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.298+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=0EIJIC2YTGT4 type=del size=2659343 2024-03-09T14:28:48.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.299+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=E0WZLPDT01JR type=del 2024-03-09T14:28:48.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.300+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=1YO1UWZ8JJE9 type=del size=3133489 2024-03-09T14:28:48.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.301+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~FTUP7KA2AMXF.0 size=932562 2024-03-09T14:28:48.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.303+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=FTUP7KA2AMXF tag=PBJQ15ND5UYI type=write size=1981138 2024-03-09T14:28:48.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.304+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=E0LG1WC2FJEN type=write size=448718 2024-03-09T14:28:48.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.306+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~J71AASPP92ND.0 size=252792 2024-03-09T14:28:48.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.308+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=J71AASPP92ND tag=47738YW0GLG8 type=write size=1301368 2024-03-09T14:28:48.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.309+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=9GLKK3I2QRT5 type=del size=1004183 2024-03-09T14:28:48.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.310+0000 7f1c6444c780 1 < canceled operation key=0ZZ0P8Y7KSAX tag=QUA1AGEJ576Y type=write size=647433 2024-03-09T14:28:48.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.312+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~JEHZVCIBX6DB.0 size=255737 2024-03-09T14:28:48.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.312+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=JEHZVCIBX6DB tag=8FP1WME1J258 type=write size=1304313 2024-03-09T14:28:48.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.313+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=U2EQFY0TDMTB type=del 2024-03-09T14:28:48.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.315+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~I4ZKQJODN3CL.0 size=153660 2024-03-09T14:28:48.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.315+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=I4ZKQJODN3CL tag=D8JR31YSU77C type=write size=1202236 2024-03-09T14:28:48.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.315+0000 7f1c6444c780 1 < canceled part key=_multipart_QSMTZR754455.2~DBCVD1PTUXMU.0 size=1048576 2024-03-09T14:28:48.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.316+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~DBCVD1PTUXMU.1 size=20881 2024-03-09T14:28:48.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.318+0000 7f1c6444c780 1 < canceled multipart upload key=QSMTZR754455 upload=DBCVD1PTUXMU tag=6PMZ4RGGEI0Y type=write size=2118033 2024-03-09T14:28:48.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.320+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~IVZOOR6TRPHO.0 size=471782 2024-03-09T14:28:48.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.320+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=IVZOOR6TRPHO tag=1H230M1NULWC type=write size=1520358 2024-03-09T14:28:48.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.321+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~AU3YBTE4SHKJ.0 size=1048576 2024-03-09T14:28:48.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.322+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~AU3YBTE4SHKJ.1 size=1048576 2024-03-09T14:28:48.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.322+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~AU3YBTE4SHKJ.2 size=267124 2024-03-09T14:28:48.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.324+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=AU3YBTE4SHKJ tag=YJWS664VQL5B type=write size=3412852 2024-03-09T14:28:48.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.325+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=NV8Y435C2T8W type=del size=4146915 2024-03-09T14:28:48.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.326+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~CNMQ0SJEWS2R.0 size=1048576 2024-03-09T14:28:48.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.327+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~CNMQ0SJEWS2R.1 size=734635 2024-03-09T14:28:48.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.329+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=CNMQ0SJEWS2R tag=HNM2XOUX1VKG type=write size=2831787 2024-03-09T14:28:48.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.331+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~POFOFTZH3W2J.0 size=1048576 2024-03-09T14:28:48.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.332+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~POFOFTZH3W2J.1 size=1048576 2024-03-09T14:28:48.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.333+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~POFOFTZH3W2J.2 size=637807 2024-03-09T14:28:48.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.333+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=POFOFTZH3W2J tag=IVOV5CDX4VOP type=write size=3783535 2024-03-09T14:28:48.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.334+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=NDN5AWW1ZKD8 type=write size=88133 2024-03-09T14:28:48.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.336+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~DR7GGWZYBBHO.0 size=1048576 2024-03-09T14:28:48.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.337+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~DR7GGWZYBBHO.1 size=1048576 2024-03-09T14:28:48.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.338+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~DR7GGWZYBBHO.2 size=632582 2024-03-09T14:28:48.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.338+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=DR7GGWZYBBHO tag=V70BS5ZCZMR7 type=write size=3778310 2024-03-09T14:28:48.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.339+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~4Z7P0RA3D8BW.0 size=1013019 2024-03-09T14:28:48.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.341+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=4Z7P0RA3D8BW tag=XUXUEX3R3L7F type=write size=2061595 2024-03-09T14:28:48.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.342+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=8YXASQ0B6F2J type=del size=3039092 2024-03-09T14:28:48.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.343+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~EHOYFRZB6SLH.0 size=1048576 2024-03-09T14:28:48.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.344+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~EHOYFRZB6SLH.1 size=45716 2024-03-09T14:28:48.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.346+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=EHOYFRZB6SLH tag=EUNEXF8LZFHR type=write size=2142868 2024-03-09T14:28:48.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.347+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=SZJZ0TOYQE7U type=write size=631376 2024-03-09T14:28:48.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.348+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=EVI4AVD0U01D type=del size=2345196 2024-03-09T14:28:48.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.350+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~AEZW667VO2ZN.0 size=1048576 2024-03-09T14:28:48.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.351+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~AEZW667VO2ZN.1 size=1048576 2024-03-09T14:28:48.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.352+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~AEZW667VO2ZN.2 size=347 2024-03-09T14:28:48.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.352+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=AEZW667VO2ZN tag=BKEUZ6Q36V8F type=write size=3146075 2024-03-09T14:28:48.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.353+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=8BUXKV3IBINK type=write size=990947 2024-03-09T14:28:48.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.354+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=BBL60W8SQ90Y type=write size=449852 2024-03-09T14:28:48.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.356+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=RL7RTVHBCXCE type=del size=2459066 2024-03-09T14:28:48.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.357+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=J42P79G1M5J9 type=del size=1635441 2024-03-09T14:28:48.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.359+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~U4HP9KMNFY4I.0 size=1048576 2024-03-09T14:28:48.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.359+0000 7f1c6444c780 1 < canceled part key=_multipart_QSMTZR754455.2~U4HP9KMNFY4I.1 size=1048576 2024-03-09T14:28:48.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.360+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~U4HP9KMNFY4I.2 size=485325 2024-03-09T14:28:48.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.362+0000 7f1c6444c780 1 < canceled multipart upload key=QSMTZR754455 upload=U4HP9KMNFY4I tag=5MY3LRYLUWOE type=write size=3631053 2024-03-09T14:28:48.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.363+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=QJ11XKP4N7CT type=del size=2272802 2024-03-09T14:28:48.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.364+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=0EIJIC2YTGT4 type=del 2024-03-09T14:28:48.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.365+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=BTSW57FBR233 type=del size=4122701 2024-03-09T14:28:48.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.366+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=1YO1UWZ8JJE9 type=del 2024-03-09T14:28:48.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.368+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=GH5ZJGC9BU5F type=del size=20573 2024-03-09T14:28:48.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.370+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=E0LG1WC2FJEN type=write 2024-03-09T14:28:48.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.371+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=9UKWCL9QJPO7 type=write size=381351 2024-03-09T14:28:48.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.373+0000 7f1c6444c780 1 < suggested update operation key=P33029QWKW23 tag=9GLKK3I2QRT5 type=del size=1004183 2024-03-09T14:28:48.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.375+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=3EMI2OP813HM type=del size=3496374 2024-03-09T14:28:48.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.376+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~JEHZVCIBX6DB.0 size=255737 2024-03-09T14:28:48.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.377+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=JEHZVCIBX6DB tag=8FP1WME1J258 type=write size=1304313 2024-03-09T14:28:48.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.379+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~52AF9JSG0JSV.0 size=378325 2024-03-09T14:28:48.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.379+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=52AF9JSG0JSV tag=VEYIF1QDG45P type=write size=1426901 2024-03-09T14:28:48.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.381+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~I4ZKQJODN3CL.0 size=153660 2024-03-09T14:28:48.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.382+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=I4ZKQJODN3CL tag=D8JR31YSU77C type=write size=1202236 2024-03-09T14:28:48.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.383+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=UI6LD0GJ4IMB type=del size=3642037 2024-03-09T14:28:48.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.385+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~IVZOOR6TRPHO.0 size=471782 2024-03-09T14:28:48.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.386+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=IVZOOR6TRPHO tag=1H230M1NULWC type=write size=1520358 2024-03-09T14:28:48.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.387+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=YQD540VH9UQJ type=del size=361932 2024-03-09T14:28:48.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.388+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=NV8Y435C2T8W type=del 2024-03-09T14:28:48.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.390+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=4U83QM0F059E type=del size=2625374 2024-03-09T14:28:48.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.391+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~POFOFTZH3W2J.0 size=1048576 2024-03-09T14:28:48.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.392+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~POFOFTZH3W2J.1 size=1048576 2024-03-09T14:28:48.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.392+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~POFOFTZH3W2J.2 size=637807 2024-03-09T14:28:48.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.394+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=POFOFTZH3W2J tag=IVOV5CDX4VOP type=write size=3783535 2024-03-09T14:28:48.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.396+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~H4DQY3HCUGK3.0 size=243405 2024-03-09T14:28:48.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.396+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=H4DQY3HCUGK3 tag=1OT06VW017O5 type=write size=1291981 2024-03-09T14:28:48.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.397+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~DR7GGWZYBBHO.0 size=1048576 2024-03-09T14:28:48.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.398+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~DR7GGWZYBBHO.1 size=1048576 2024-03-09T14:28:48.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.399+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~DR7GGWZYBBHO.2 size=632582 2024-03-09T14:28:48.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.401+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=DR7GGWZYBBHO tag=V70BS5ZCZMR7 type=write size=3778310 2024-03-09T14:28:48.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.402+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=K2URRVCH74QK type=del size=2970811 2024-03-09T14:28:48.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.403+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=8YXASQ0B6F2J type=del size=3039092 2024-03-09T14:28:48.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.404+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=ADIDHWGMEWUK type=del size=2778961 2024-03-09T14:28:48.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.405+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=SZJZ0TOYQE7U type=write size=631376 2024-03-09T14:28:48.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.407+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~BAZ7AOHXZHFZ.0 size=1048576 2024-03-09T14:28:48.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.408+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~BAZ7AOHXZHFZ.1 size=711332 2024-03-09T14:28:48.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.408+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=BAZ7AOHXZHFZ tag=G9BBAATH6EH1 type=write size=2808484 2024-03-09T14:28:48.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.409+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~AEZW667VO2ZN.0 size=1048576 2024-03-09T14:28:48.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.410+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~AEZW667VO2ZN.1 size=1048576 2024-03-09T14:28:48.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.411+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~AEZW667VO2ZN.2 size=347 2024-03-09T14:28:48.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.413+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=AEZW667VO2ZN tag=BKEUZ6Q36V8F type=write size=3146075 2024-03-09T14:28:48.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.414+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=J9IBLA7SGHMH type=del size=3329010 2024-03-09T14:28:48.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.415+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=BBL60W8SQ90Y type=write size=449852 2024-03-09T14:28:48.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.417+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~7TM0V1ZHQO3Q.0 size=254177 2024-03-09T14:28:48.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.417+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=7TM0V1ZHQO3Q tag=O7I1MUEZBA40 type=write size=1302753 2024-03-09T14:28:48.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.418+0000 7f1c6444c780 -1 < failed to complete operation key=P33029QWKW23 tag=J42P79G1M5J9 type=del size=1635441: (22) Invalid argument 2024-03-09T14:28:48.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.419+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=OBSK0S645213 type=write size=610221 2024-03-09T14:28:48.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.420+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=QJ11XKP4N7CT type=del 2024-03-09T14:28:48.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.422+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=6LDGCPWXMVW0 type=del size=3646422 2024-03-09T14:28:48.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.423+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=BTSW57FBR233 type=del size=4122701 2024-03-09T14:28:48.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.425+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~XOKLXUSZ1SW3.0 size=1048576 2024-03-09T14:28:48.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.426+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~XOKLXUSZ1SW3.1 size=1048576 2024-03-09T14:28:48.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.427+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~XOKLXUSZ1SW3.2 size=994625 2024-03-09T14:28:48.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.427+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=XOKLXUSZ1SW3 tag=9LYDHMP88J78 type=write size=4140353 2024-03-09T14:28:48.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.428+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=GH5ZJGC9BU5F type=del 2024-03-09T14:28:48.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.429+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=NEH020DWB9UC type=write size=507173 2024-03-09T14:28:48.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.430+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=9UKWCL9QJPO7 type=write size=381351 2024-03-09T14:28:48.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.432+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=2AJPLE6S6NXY type=del size=274815 2024-03-09T14:28:48.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.433+0000 7f1c6444c780 1 < canceled operation key=YECG84AJ5IK2 tag=3EMI2OP813HM type=del size=3496374 2024-03-09T14:28:48.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.434+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=0PL1US6K9MCB type=del size=746391 2024-03-09T14:28:48.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.434+0000 7f1c6444c780 1 < canceled part key=_multipart_KWDIDE9AE3JP.2~52AF9JSG0JSV.0 size=378325 2024-03-09T14:28:48.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.436+0000 7f1c6444c780 1 < canceled multipart upload key=KWDIDE9AE3JP upload=52AF9JSG0JSV tag=VEYIF1QDG45P type=write size=1426901 2024-03-09T14:28:48.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.437+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=MH0K2CGWLS60 type=del size=3176573 2024-03-09T14:28:48.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.439+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=UI6LD0GJ4IMB type=del 2024-03-09T14:28:48.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.440+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=4YX4YONH647D type=del size=1542255 2024-03-09T14:28:48.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.441+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=YQD540VH9UQJ type=del 2024-03-09T14:28:48.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.442+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=43GSWQWF70XC type=del size=4017703 2024-03-09T14:28:48.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.443+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=4U83QM0F059E type=del 2024-03-09T14:28:48.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.444+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=M7KV47FZXW78 type=del size=2559280 2024-03-09T14:28:48.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.446+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~H4DQY3HCUGK3.0 size=243405 2024-03-09T14:28:48.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.448+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=H4DQY3HCUGK3 tag=1OT06VW017O5 type=write size=1291981 2024-03-09T14:28:48.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.450+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~G9W8GXZ4RRC7.0 size=1048576 2024-03-09T14:28:48.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.451+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~G9W8GXZ4RRC7.1 size=1048576 2024-03-09T14:28:48.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.452+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~G9W8GXZ4RRC7.2 size=283908 2024-03-09T14:28:48.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.452+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=G9W8GXZ4RRC7 tag=XUAVVYZP1WPA type=write size=3429636 2024-03-09T14:28:48.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.453+0000 7f1c6444c780 1 < canceled operation key=HPFPL79B0GLS tag=K2URRVCH74QK type=del size=2970811 2024-03-09T14:28:48.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.454+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=28VMGGM4FNKG type=del size=3301108 2024-03-09T14:28:48.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.455+0000 7f1c6444c780 1 < canceled operation key=CVD0EGQUVJYR tag=ADIDHWGMEWUK type=del size=2778961 2024-03-09T14:28:48.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.457+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=53M8YGDJPZXT type=write size=822643 2024-03-09T14:28:48.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.458+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~BAZ7AOHXZHFZ.0 size=1048576 2024-03-09T14:28:48.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.459+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~BAZ7AOHXZHFZ.1 size=711332 2024-03-09T14:28:48.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.461+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=BAZ7AOHXZHFZ tag=G9BBAATH6EH1 type=write size=2808484 2024-03-09T14:28:48.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.463+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~V2EFN0DTPCCI.0 size=1048576 2024-03-09T14:28:48.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.464+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~V2EFN0DTPCCI.1 size=483321 2024-03-09T14:28:48.464 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.464+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=V2EFN0DTPCCI tag=RCQN5I2YZM3A type=write size=2580473 2024-03-09T14:28:48.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.466+0000 7f1c6444c780 1 < canceled operation key=49YOZGJ8XC4K tag=J9IBLA7SGHMH type=del size=3329010 2024-03-09T14:28:48.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.468+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~Q2C14J8RRXQW.0 size=747410 2024-03-09T14:28:48.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.468+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=Q2C14J8RRXQW tag=BE376OX4NC5L type=write size=1795986 2024-03-09T14:28:48.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.469+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~7TM0V1ZHQO3Q.0 size=254177 2024-03-09T14:28:48.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.471+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=7TM0V1ZHQO3Q tag=O7I1MUEZBA40 type=write size=1302753 2024-03-09T14:28:48.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.473+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~U51AZZLFCA3B.0 size=1048576 2024-03-09T14:28:48.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.474+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~U51AZZLFCA3B.1 size=128443 2024-03-09T14:28:48.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.474+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=U51AZZLFCA3B tag=UUWUF2I6UK0U type=write size=2225595 2024-03-09T14:28:48.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.475+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=OBSK0S645213 type=write size=610221 2024-03-09T14:28:48.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.477+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~7SA1VNJV8QV1.0 size=56908 2024-03-09T14:28:48.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.477+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=7SA1VNJV8QV1 tag=ND0LD5J859DR type=write size=1105484 2024-03-09T14:28:48.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.479+0000 7f1c6444c780 1 < suggested update operation key=CVD0EGQUVJYR tag=6LDGCPWXMVW0 type=del size=3646422 2024-03-09T14:28:48.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.480+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=D5WI9OMOH25X type=del size=963419 2024-03-09T14:28:48.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.481+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~XOKLXUSZ1SW3.0 size=1048576 2024-03-09T14:28:48.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.482+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~XOKLXUSZ1SW3.1 size=1048576 2024-03-09T14:28:48.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.483+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~XOKLXUSZ1SW3.2 size=994625 2024-03-09T14:28:48.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.485+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=XOKLXUSZ1SW3 tag=9LYDHMP88J78 type=write size=4140353 2024-03-09T14:28:48.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.486+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=DRUMGP0DJCRS type=del size=878543 2024-03-09T14:28:48.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.487+0000 7f1c6444c780 1 < completed write operation key=49YOZGJ8XC4K tag=NEH020DWB9UC type=write size=507173 2024-03-09T14:28:48.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.489+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~XDTM0716NF4K.0 size=1048576 2024-03-09T14:28:48.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.490+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~XDTM0716NF4K.1 size=456469 2024-03-09T14:28:48.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.490+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=XDTM0716NF4K tag=9B4R50T07GBI type=write size=2553621 2024-03-09T14:28:48.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.491+0000 7f1c6444c780 1 < completed delete operation key=YK7ENO4UAB2M tag=2AJPLE6S6NXY type=del 2024-03-09T14:28:48.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.494+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~9MGS3TZ44FU9.0 size=1048576 2024-03-09T14:28:48.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.495+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~9MGS3TZ44FU9.1 size=10209 2024-03-09T14:28:48.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.495+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=9MGS3TZ44FU9 tag=07A579VH3DS4 type=write size=2107361 2024-03-09T14:28:48.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.496+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=0PL1US6K9MCB type=del 2024-03-09T14:28:48.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.497+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=BFQ5VDMW5Q6P type=write size=280837 2024-03-09T14:28:48.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.499+0000 7f1c6444c780 1 < suggested update operation key=KMX7TNIOKWOA tag=MH0K2CGWLS60 type=del size=3176573 2024-03-09T14:28:48.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.501+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~L8DUDU5YA3T1.0 size=291508 2024-03-09T14:28:48.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.501+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=L8DUDU5YA3T1 tag=R21GJPG4OX4U type=write size=1340084 2024-03-09T14:28:48.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.503+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=4YX4YONH647D type=del 2024-03-09T14:28:48.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.504+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=OCH4CYCACWTF type=write size=353505 2024-03-09T14:28:48.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.505+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=43GSWQWF70XC type=del 2024-03-09T14:28:48.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.507+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~K03PYZQ5P5BG.0 size=1048576 2024-03-09T14:28:48.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.508+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~K03PYZQ5P5BG.1 size=1048576 2024-03-09T14:28:48.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.509+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~K03PYZQ5P5BG.2 size=199089 2024-03-09T14:28:48.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.509+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=K03PYZQ5P5BG tag=KCTCMVOREMYG type=write size=3344817 2024-03-09T14:28:48.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.510+0000 7f1c6444c780 1 < completed delete operation key=YK7ENO4UAB2M tag=M7KV47FZXW78 type=del 2024-03-09T14:28:48.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.511+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=AVGG4WMTD5JH type=del size=60426 2024-03-09T14:28:48.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.512+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~G9W8GXZ4RRC7.0 size=1048576 2024-03-09T14:28:48.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.513+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~G9W8GXZ4RRC7.1 size=1048576 2024-03-09T14:28:48.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.514+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~G9W8GXZ4RRC7.2 size=283908 2024-03-09T14:28:48.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.516+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=G9W8GXZ4RRC7 tag=XUAVVYZP1WPA type=write size=3429636 2024-03-09T14:28:48.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.518+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=M9AWZG07QPAW type=write size=351592 2024-03-09T14:28:48.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.520+0000 7f1c6444c780 1 < suggested update operation key=KNOEGKSERB6Z tag=28VMGGM4FNKG type=del size=3301108 2024-03-09T14:28:48.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.522+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~RQVOQSDL1ZMB.0 size=1048576 2024-03-09T14:28:48.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.523+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~RQVOQSDL1ZMB.1 size=426082 2024-03-09T14:28:48.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.523+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=RQVOQSDL1ZMB tag=EEV5SYM7ANW7 type=write size=2523234 2024-03-09T14:28:48.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.525+0000 7f1c6444c780 1 < suggested update operation key=MX3X6ILR7J8N tag=53M8YGDJPZXT type=write size=822643 2024-03-09T14:28:48.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.527+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~C0U5Q3OB3D31.0 size=1048576 2024-03-09T14:28:48.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.528+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~C0U5Q3OB3D31.1 size=985264 2024-03-09T14:28:48.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.528+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=C0U5Q3OB3D31 tag=5F9G4HJBS2NA type=write size=3082416 2024-03-09T14:28:48.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.530+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~V2EFN0DTPCCI.0 size=1048576 2024-03-09T14:28:48.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.531+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~V2EFN0DTPCCI.1 size=483321 2024-03-09T14:28:48.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.533+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=V2EFN0DTPCCI tag=RCQN5I2YZM3A type=write size=2580473 2024-03-09T14:28:48.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.534+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=J1FXETMDZQ16 type=del size=1891013 2024-03-09T14:28:48.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.535+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~Q2C14J8RRXQW.0 size=747410 2024-03-09T14:28:48.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.537+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=Q2C14J8RRXQW tag=BE376OX4NC5L type=write size=1795986 2024-03-09T14:28:48.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.538+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=M4F6YMSJTZQA type=del size=377577 2024-03-09T14:28:48.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.538+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~U51AZZLFCA3B.0 size=1048576 2024-03-09T14:28:48.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.539+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~U51AZZLFCA3B.1 size=128443 2024-03-09T14:28:48.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.541+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=U51AZZLFCA3B tag=UUWUF2I6UK0U type=write size=2225595 2024-03-09T14:28:48.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.542+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=N7Q4O4X7Y3FO type=del size=3387608 2024-03-09T14:28:48.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.543+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~7SA1VNJV8QV1.0 size=56908 2024-03-09T14:28:48.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.545+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=7SA1VNJV8QV1 tag=ND0LD5J859DR type=write size=1105484 2024-03-09T14:28:48.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.548+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~2IEYWBE9CGLA.0 size=1048576 2024-03-09T14:28:48.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.549+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~2IEYWBE9CGLA.1 size=1048576 2024-03-09T14:28:48.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.550+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~2IEYWBE9CGLA.2 size=88270 2024-03-09T14:28:48.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.550+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=2IEYWBE9CGLA tag=B3KOFSSPRW9T type=write size=3233998 2024-03-09T14:28:48.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.551+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=D5WI9OMOH25X type=del 2024-03-09T14:28:48.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.552+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=6WIS5B468KY9 type=del size=12934 2024-03-09T14:28:48.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.553+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=DRUMGP0DJCRS type=del 2024-03-09T14:28:48.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.554+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=DSXZHG17HV4E type=del size=854546 2024-03-09T14:28:48.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.555+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~XDTM0716NF4K.0 size=1048576 2024-03-09T14:28:48.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.556+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~XDTM0716NF4K.1 size=456469 2024-03-09T14:28:48.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.558+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=XDTM0716NF4K tag=9B4R50T07GBI type=write size=2553621 2024-03-09T14:28:48.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.560+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5VKGDCUCFBM0.0 size=1048576 2024-03-09T14:28:48.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.561+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5VKGDCUCFBM0.1 size=150402 2024-03-09T14:28:48.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.561+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=5VKGDCUCFBM0 tag=OU44X7AV7ZAV type=write size=2247554 2024-03-09T14:28:48.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.563+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~9MGS3TZ44FU9.0 size=1048576 2024-03-09T14:28:48.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.564+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~9MGS3TZ44FU9.1 size=10209 2024-03-09T14:28:48.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.566+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=9MGS3TZ44FU9 tag=07A579VH3DS4 type=write size=2107361 2024-03-09T14:28:48.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.567+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=AX7H2PFR9ZWY type=del size=2530922 2024-03-09T14:28:48.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.568+0000 7f1c6444c780 -1 < failed to complete operation key=MX3X6ILR7J8N tag=BFQ5VDMW5Q6P type=write size=280837: (22) Invalid argument 2024-03-09T14:28:48.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.570+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IJ0NEGUPXTP9.0 size=1048576 2024-03-09T14:28:48.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.571+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IJ0NEGUPXTP9.1 size=1048576 2024-03-09T14:28:48.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.573+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IJ0NEGUPXTP9.2 size=529945 2024-03-09T14:28:48.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.573+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=IJ0NEGUPXTP9 tag=25ZJH71FTL4D type=write size=3675673 2024-03-09T14:28:48.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.574+0000 7f1c6444c780 1 < canceled part key=_multipart_HNK7POWS6FSU.2~L8DUDU5YA3T1.0 size=291508 2024-03-09T14:28:48.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.575+0000 7f1c6444c780 1 < canceled multipart upload key=HNK7POWS6FSU upload=L8DUDU5YA3T1 tag=R21GJPG4OX4U type=write size=1340084 2024-03-09T14:28:48.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.577+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~6GPSNQIIW1DA.0 size=1048576 2024-03-09T14:28:48.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.578+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~6GPSNQIIW1DA.1 size=1048576 2024-03-09T14:28:48.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.579+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~6GPSNQIIW1DA.2 size=1016434 2024-03-09T14:28:48.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.579+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=6GPSNQIIW1DA tag=LWETU0MS6PWZ type=write size=4162162 2024-03-09T14:28:48.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.580+0000 7f1c6444c780 1 < completed write operation key=WMO6LTCMVXD2 tag=OCH4CYCACWTF type=write size=353505 2024-03-09T14:28:48.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.581+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=2DAO59D4F69Q type=del size=3180746 2024-03-09T14:28:48.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.583+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~K03PYZQ5P5BG.0 size=1048576 2024-03-09T14:28:48.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.583+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~K03PYZQ5P5BG.1 size=1048576 2024-03-09T14:28:48.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.584+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~K03PYZQ5P5BG.2 size=199089 2024-03-09T14:28:48.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.586+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=K03PYZQ5P5BG tag=KCTCMVOREMYG type=write size=3344817 2024-03-09T14:28:48.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.587+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=PG9L4Z1797C9 type=del size=2037118 2024-03-09T14:28:48.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.588+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=AVGG4WMTD5JH type=del 2024-03-09T14:28:48.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.590+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=NJJDZC72X5SI type=del size=4041103 2024-03-09T14:28:48.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.591+0000 7f1c6444c780 1 < completed write operation key=BYX1155MZ2LP tag=M9AWZG07QPAW type=write size=351592 2024-03-09T14:28:48.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.593+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~L8OFOPLJK97O.0 size=1048576 2024-03-09T14:28:48.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.594+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~L8OFOPLJK97O.1 size=1048576 2024-03-09T14:28:48.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.595+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~L8OFOPLJK97O.2 size=823749 2024-03-09T14:28:48.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.595+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=L8OFOPLJK97O tag=1TBD3RP6JFKS type=write size=3969477 2024-03-09T14:28:48.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.595+0000 7f1c6444c780 1 < canceled part key=_multipart_KMX7TNIOKWOA.2~RQVOQSDL1ZMB.0 size=1048576 2024-03-09T14:28:48.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.596+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~RQVOQSDL1ZMB.1 size=426082 2024-03-09T14:28:48.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.598+0000 7f1c6444c780 1 < canceled multipart upload key=KMX7TNIOKWOA upload=RQVOQSDL1ZMB tag=EEV5SYM7ANW7 type=write size=2523234 2024-03-09T14:28:48.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.599+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=BPUUJA7JVY2P type=del size=3451953 2024-03-09T14:28:48.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.600+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~C0U5Q3OB3D31.0 size=1048576 2024-03-09T14:28:48.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.601+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~C0U5Q3OB3D31.1 size=985264 2024-03-09T14:28:48.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.603+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=C0U5Q3OB3D31 tag=5F9G4HJBS2NA type=write size=3082416 2024-03-09T14:28:48.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.606+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~933SKADJ6NGA.0 size=1048576 2024-03-09T14:28:48.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.606+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~933SKADJ6NGA.1 size=1048576 2024-03-09T14:28:48.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.607+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~933SKADJ6NGA.2 size=375896 2024-03-09T14:28:48.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.607+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=933SKADJ6NGA tag=C4IIB20ITUEF type=write size=3521624 2024-03-09T14:28:48.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.609+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=J1FXETMDZQ16 type=del 2024-03-09T14:28:48.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.610+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=PGVPFTCGABW1 type=del size=1579155 2024-03-09T14:28:48.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.611+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=M4F6YMSJTZQA type=del 2024-03-09T14:28:48.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.613+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=JWTLOMKAPQ0Y type=del size=3894636 2024-03-09T14:28:48.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.614+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=N7Q4O4X7Y3FO type=del 2024-03-09T14:28:48.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.616+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~BUV8K6ZMM5V1.0 size=1048576 2024-03-09T14:28:48.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.618+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~BUV8K6ZMM5V1.1 size=598907 2024-03-09T14:28:48.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.618+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=BUV8K6ZMM5V1 tag=Z5AS31Y2IAS4 type=write size=2696059 2024-03-09T14:28:48.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.619+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~2IEYWBE9CGLA.0 size=1048576 2024-03-09T14:28:48.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.620+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~2IEYWBE9CGLA.1 size=1048576 2024-03-09T14:28:48.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.621+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~2IEYWBE9CGLA.2 size=88270 2024-03-09T14:28:48.623 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.623+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=2IEYWBE9CGLA tag=B3KOFSSPRW9T type=write size=3233998 2024-03-09T14:28:48.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.625+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~T9FH33Q08H2J.0 size=320451 2024-03-09T14:28:48.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.625+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=T9FH33Q08H2J tag=D4EGY1V5MW4X type=write size=1369027 2024-03-09T14:28:48.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.627+0000 7f1c6444c780 1 < suggested update operation key=0IHHFQBKKJ0G tag=6WIS5B468KY9 type=del size=12934 2024-03-09T14:28:48.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.629+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=2QPZ6TBZ2Q1C type=del size=2095592 2024-03-09T14:28:48.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.630+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=DSXZHG17HV4E type=del 2024-03-09T14:28:48.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.632+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~I47XLP6ZD47U.0 size=471252 2024-03-09T14:28:48.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.632+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=I47XLP6ZD47U tag=JFYI0G2DUJZE type=write size=1519828 2024-03-09T14:28:48.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.633+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5VKGDCUCFBM0.0 size=1048576 2024-03-09T14:28:48.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.634+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5VKGDCUCFBM0.1 size=150402 2024-03-09T14:28:48.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.636+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=5VKGDCUCFBM0 tag=OU44X7AV7ZAV type=write size=2247554 2024-03-09T14:28:48.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.638+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~7SMJOX880RBY.0 size=1048576 2024-03-09T14:28:48.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.639+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~7SMJOX880RBY.1 size=1048576 2024-03-09T14:28:48.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.640+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~7SMJOX880RBY.2 size=922490 2024-03-09T14:28:48.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.640+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=7SMJOX880RBY tag=YU8FH6MV1QDR type=write size=4068218 2024-03-09T14:28:48.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.641+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=AX7H2PFR9ZWY type=del 2024-03-09T14:28:48.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.643+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~STPGE3Y6GCI9.0 size=1048576 2024-03-09T14:28:48.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.644+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~STPGE3Y6GCI9.1 size=742965 2024-03-09T14:28:48.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.644+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=STPGE3Y6GCI9 tag=U1KTTKVVAJ7N type=write size=2840117 2024-03-09T14:28:48.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.645+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IJ0NEGUPXTP9.0 size=1048576 2024-03-09T14:28:48.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.647+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IJ0NEGUPXTP9.1 size=1048576 2024-03-09T14:28:48.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.647+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IJ0NEGUPXTP9.2 size=529945 2024-03-09T14:28:48.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.649+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=IJ0NEGUPXTP9 tag=25ZJH71FTL4D type=write size=3675673 2024-03-09T14:28:48.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.650+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=04JUXZWY9T11 type=del size=4096579 2024-03-09T14:28:48.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.652+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~6GPSNQIIW1DA.0 size=1048576 2024-03-09T14:28:48.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.653+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~6GPSNQIIW1DA.1 size=1048576 2024-03-09T14:28:48.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.654+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~6GPSNQIIW1DA.2 size=1016434 2024-03-09T14:28:48.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.656+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=6GPSNQIIW1DA tag=LWETU0MS6PWZ type=write size=4162162 2024-03-09T14:28:48.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.657+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=R2BCOJASIY74 type=del size=3758994 2024-03-09T14:28:48.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.659+0000 7f1c6444c780 1 < suggested remove operation key=BYX1155MZ2LP tag=2DAO59D4F69Q type=del 2024-03-09T14:28:48.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.660+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=DFC9UP3JLYB7 type=write size=830913 2024-03-09T14:28:48.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.661+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=PG9L4Z1797C9 type=del size=2037118 2024-03-09T14:28:48.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.663+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=7OP09CNHU7ZI type=del size=2311764 2024-03-09T14:28:48.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.664+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=NJJDZC72X5SI type=del 2024-03-09T14:28:48.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.665+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=LQZ9DB61AHDF type=del size=62886 2024-03-09T14:28:48.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.666+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~L8OFOPLJK97O.0 size=1048576 2024-03-09T14:28:48.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.666+0000 7f1c6444c780 1 < canceled part key=_multipart_SGHNHOCYPM38.2~L8OFOPLJK97O.1 size=1048576 2024-03-09T14:28:48.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.667+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~L8OFOPLJK97O.2 size=823749 2024-03-09T14:28:48.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.670+0000 7f1c6444c780 1 < canceled multipart upload key=SGHNHOCYPM38 upload=L8OFOPLJK97O tag=1TBD3RP6JFKS type=write size=3969477 2024-03-09T14:28:48.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.672+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~KPF8QQPNBCVO.0 size=1048576 2024-03-09T14:28:48.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.673+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~KPF8QQPNBCVO.1 size=342358 2024-03-09T14:28:48.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.673+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=KPF8QQPNBCVO tag=DQBCX116ZYU6 type=write size=2439510 2024-03-09T14:28:48.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.675+0000 7f1c6444c780 1 < suggested remove operation key=PBM4ICXZ2497 tag=BPUUJA7JVY2P type=del 2024-03-09T14:28:48.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.677+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~4N5191C97F30.0 size=424015 2024-03-09T14:28:48.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.677+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=4N5191C97F30 tag=SHO122DETR32 type=write size=1472591 2024-03-09T14:28:48.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.679+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~933SKADJ6NGA.0 size=1048576 2024-03-09T14:28:48.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.680+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~933SKADJ6NGA.1 size=1048576 2024-03-09T14:28:48.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.681+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~933SKADJ6NGA.2 size=375896 2024-03-09T14:28:48.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.684+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=933SKADJ6NGA tag=C4IIB20ITUEF type=write size=3521624 2024-03-09T14:28:48.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.686+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~J6LY73CZEOCR.0 size=497581 2024-03-09T14:28:48.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.686+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=J6LY73CZEOCR tag=RXXQMD35UDC4 type=write size=1546157 2024-03-09T14:28:48.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.687+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=PGVPFTCGABW1 type=del 2024-03-09T14:28:48.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.689+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~ZA64XJZ2YKK7.0 size=72622 2024-03-09T14:28:48.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.689+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=ZA64XJZ2YKK7 tag=65UAX8QNEOMY type=write size=1121198 2024-03-09T14:28:48.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.690+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=JWTLOMKAPQ0Y type=del 2024-03-09T14:28:48.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.693+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~KRTVERLY9FAS.0 size=561683 2024-03-09T14:28:48.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.693+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=KRTVERLY9FAS tag=JBYUGGANDYTL type=write size=1610259 2024-03-09T14:28:48.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.694+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~BUV8K6ZMM5V1.0 size=1048576 2024-03-09T14:28:48.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.695+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~BUV8K6ZMM5V1.1 size=598907 2024-03-09T14:28:48.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.697+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=BUV8K6ZMM5V1 tag=Z5AS31Y2IAS4 type=write size=2696059 2024-03-09T14:28:48.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.698+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=JRVID7EC58X2 type=del size=1633861 2024-03-09T14:28:48.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.699+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~T9FH33Q08H2J.0 size=320451 2024-03-09T14:28:48.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.701+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=T9FH33Q08H2J tag=D4EGY1V5MW4X type=write size=1369027 2024-03-09T14:28:48.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.702+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=1ID9ZA4Y9ZZQ type=del size=2852875 2024-03-09T14:28:48.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.703+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=2QPZ6TBZ2Q1C type=del 2024-03-09T14:28:48.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.705+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~J1ZHKN1TL33V.0 size=1048576 2024-03-09T14:28:48.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.706+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~J1ZHKN1TL33V.1 size=1048576 2024-03-09T14:28:48.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.707+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~J1ZHKN1TL33V.2 size=712778 2024-03-09T14:28:48.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.707+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=J1ZHKN1TL33V tag=FL1E5OUK0TBG type=write size=3858506 2024-03-09T14:28:48.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.708+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~I47XLP6ZD47U.0 size=471252 2024-03-09T14:28:48.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.710+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=I47XLP6ZD47U tag=JFYI0G2DUJZE type=write size=1519828 2024-03-09T14:28:48.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.711+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=RC3UBDN0FDKL type=del size=1336652 2024-03-09T14:28:48.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.712+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~7SMJOX880RBY.0 size=1048576 2024-03-09T14:28:48.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.713+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~7SMJOX880RBY.1 size=1048576 2024-03-09T14:28:48.714 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.714+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~7SMJOX880RBY.2 size=922490 2024-03-09T14:28:48.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.716+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=7SMJOX880RBY tag=YU8FH6MV1QDR type=write size=4068218 2024-03-09T14:28:48.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.718+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~GZ0MR742Z1UW.0 size=1048576 2024-03-09T14:28:48.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.719+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~GZ0MR742Z1UW.1 size=1048576 2024-03-09T14:28:48.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.720+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~GZ0MR742Z1UW.2 size=180603 2024-03-09T14:28:48.720 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.720+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=GZ0MR742Z1UW tag=6JM9Q1GRPUGY type=write size=3326331 2024-03-09T14:28:48.721 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.721+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~STPGE3Y6GCI9.0 size=1048576 2024-03-09T14:28:48.722 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.722+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~STPGE3Y6GCI9.1 size=742965 2024-03-09T14:28:48.723 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.723+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=STPGE3Y6GCI9 tag=U1KTTKVVAJ7N type=write size=2840117 2024-03-09T14:28:48.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.725+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~XM3SXZ268OTQ.0 size=99024 2024-03-09T14:28:48.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.725+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=XM3SXZ268OTQ tag=TCXCCYD7Z3DI type=write size=1147600 2024-03-09T14:28:48.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.727+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=04JUXZWY9T11 type=del 2024-03-09T14:28:48.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.729+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~7B66402FS37J.0 size=1048576 2024-03-09T14:28:48.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.730+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~7B66402FS37J.1 size=614084 2024-03-09T14:28:48.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.730+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=7B66402FS37J tag=YWFN3B4HT08Q type=write size=2711236 2024-03-09T14:28:48.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.731+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=R2BCOJASIY74 type=del 2024-03-09T14:28:48.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.733+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~JT9UBHQBJW49.0 size=196101 2024-03-09T14:28:48.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.733+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=JT9UBHQBJW49 tag=Y2E1NTZNWIPO type=write size=1244677 2024-03-09T14:28:48.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.735+0000 7f1c6444c780 1 < completed write operation key=KMX7TNIOKWOA tag=DFC9UP3JLYB7 type=write size=830913 2024-03-09T14:28:48.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.736+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=2L2EZXTHLZXO type=del size=1046458 2024-03-09T14:28:48.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.737+0000 7f1c6444c780 1 < canceled operation key=KMX7TNIOKWOA tag=7OP09CNHU7ZI type=del size=2311764 2024-03-09T14:28:48.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.739+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~WQLYR6V32SQ4.0 size=1048576 2024-03-09T14:28:48.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.740+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~WQLYR6V32SQ4.1 size=377967 2024-03-09T14:28:48.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.740+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=WQLYR6V32SQ4 tag=IYPZJW1YFEIJ type=write size=2475119 2024-03-09T14:28:48.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.741+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=LQZ9DB61AHDF type=del 2024-03-09T14:28:48.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.743+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~763O01KILXHZ.0 size=1048576 2024-03-09T14:28:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.744+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~763O01KILXHZ.1 size=372505 2024-03-09T14:28:48.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.744+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=763O01KILXHZ tag=NOWGAP2101UJ type=write size=2469657 2024-03-09T14:28:48.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.745+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~KPF8QQPNBCVO.0 size=1048576 2024-03-09T14:28:48.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.746+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~KPF8QQPNBCVO.1 size=342358 2024-03-09T14:28:48.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.748+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=KPF8QQPNBCVO tag=DQBCX116ZYU6 type=write size=2439510 2024-03-09T14:28:48.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.750+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~LXA7O5F9FVO9.0 size=144783 2024-03-09T14:28:48.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.750+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=LXA7O5F9FVO9 tag=HQ53YDEVTBSK type=write size=1193359 2024-03-09T14:28:48.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.751+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~4N5191C97F30.0 size=424015 2024-03-09T14:28:48.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.753+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=4N5191C97F30 tag=SHO122DETR32 type=write size=1472591 2024-03-09T14:28:48.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.755+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~KKV0K0FFFGJ9.0 size=1045837 2024-03-09T14:28:48.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.755+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=KKV0K0FFFGJ9 tag=QJ7XBZKBWJ3A type=write size=2094413 2024-03-09T14:28:48.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.757+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~J6LY73CZEOCR.0 size=497581 2024-03-09T14:28:48.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.758+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=J6LY73CZEOCR tag=RXXQMD35UDC4 type=write size=1546157 2024-03-09T14:28:48.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.760+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~BT3CJ1IOPX0D.0 size=1048576 2024-03-09T14:28:48.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.761+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~BT3CJ1IOPX0D.1 size=99267 2024-03-09T14:28:48.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.761+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=BT3CJ1IOPX0D tag=8E4EX5DFIIF0 type=write size=2196419 2024-03-09T14:28:48.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.762+0000 7f1c6444c780 1 < canceled part key=_multipart_BYX1155MZ2LP.2~ZA64XJZ2YKK7.0 size=72622 2024-03-09T14:28:48.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.763+0000 7f1c6444c780 1 < canceled multipart upload key=BYX1155MZ2LP upload=ZA64XJZ2YKK7 tag=65UAX8QNEOMY type=write size=1121198 2024-03-09T14:28:48.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.765+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=S5ZB9YUMQO26 type=del size=1084237 2024-03-09T14:28:48.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.766+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~KRTVERLY9FAS.0 size=561683 2024-03-09T14:28:48.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.767+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=KRTVERLY9FAS tag=JBYUGGANDYTL type=write size=1610259 2024-03-09T14:28:48.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.769+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=WODPJ9FHASBK type=write size=11170 2024-03-09T14:28:48.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.770+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=JRVID7EC58X2 type=del 2024-03-09T14:28:48.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.772+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~B8I3GNY993U0.0 size=1048576 2024-03-09T14:28:48.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.773+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~B8I3GNY993U0.1 size=1048576 2024-03-09T14:28:48.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.774+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~B8I3GNY993U0.2 size=663702 2024-03-09T14:28:48.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.774+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=B8I3GNY993U0 tag=O1UWDK1LQ6YG type=write size=3809430 2024-03-09T14:28:48.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.775+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=1ID9ZA4Y9ZZQ type=del 2024-03-09T14:28:48.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.777+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~FM556ZNYPWW3.0 size=923875 2024-03-09T14:28:48.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.777+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=FM556ZNYPWW3 tag=7T51ZLATT176 type=write size=1972451 2024-03-09T14:28:48.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.778+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~J1ZHKN1TL33V.0 size=1048576 2024-03-09T14:28:48.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.779+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~J1ZHKN1TL33V.1 size=1048576 2024-03-09T14:28:48.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.780+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~J1ZHKN1TL33V.2 size=712778 2024-03-09T14:28:48.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.782+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=J1ZHKN1TL33V tag=FL1E5OUK0TBG type=write size=3858506 2024-03-09T14:28:48.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.784+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~77JR2Y290G02.0 size=768277 2024-03-09T14:28:48.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.784+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=77JR2Y290G02 tag=1UQQ65WV0SNK type=write size=1816853 2024-03-09T14:28:48.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.785+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=RC3UBDN0FDKL type=del size=1336652 2024-03-09T14:28:48.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.788+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=KTTJ5Z3EKYL0 type=del size=380903 2024-03-09T14:28:48.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.789+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~GZ0MR742Z1UW.0 size=1048576 2024-03-09T14:28:48.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.789+0000 7f1c6444c780 1 < canceled part key=_multipart_IBVEN2JEB49N.2~GZ0MR742Z1UW.1 size=1048576 2024-03-09T14:28:48.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.790+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~GZ0MR742Z1UW.2 size=180603 2024-03-09T14:28:48.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.792+0000 7f1c6444c780 1 < canceled multipart upload key=IBVEN2JEB49N upload=GZ0MR742Z1UW tag=6JM9Q1GRPUGY type=write size=3326331 2024-03-09T14:28:48.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.793+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=V8I0SQXVAWJU type=write size=138446 2024-03-09T14:28:48.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.794+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~XM3SXZ268OTQ.0 size=99024 2024-03-09T14:28:48.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.796+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=XM3SXZ268OTQ tag=TCXCCYD7Z3DI type=write size=1147600 2024-03-09T14:28:48.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.797+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=A9E87US81QS2 type=del size=1386944 2024-03-09T14:28:48.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.798+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~7B66402FS37J.0 size=1048576 2024-03-09T14:28:48.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.799+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~7B66402FS37J.1 size=614084 2024-03-09T14:28:48.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.801+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=7B66402FS37J tag=YWFN3B4HT08Q type=write size=2711236 2024-03-09T14:28:48.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.802+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=NOH2E9YV6BEW type=del size=345059 2024-03-09T14:28:48.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.803+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~JT9UBHQBJW49.0 size=196101 2024-03-09T14:28:48.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.805+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=JT9UBHQBJW49 tag=Y2E1NTZNWIPO type=write size=1244677 2024-03-09T14:28:48.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.807+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~2CEP7QMCK8R1.0 size=1048576 2024-03-09T14:28:48.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.808+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~2CEP7QMCK8R1.1 size=271759 2024-03-09T14:28:48.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.808+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=2CEP7QMCK8R1 tag=7G8ER5ZHAA7O type=write size=2368911 2024-03-09T14:28:48.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.809+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=2L2EZXTHLZXO type=del 2024-03-09T14:28:48.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.811+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~K5FL8SPBPQ2Q.0 size=1048576 2024-03-09T14:28:48.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.812+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~K5FL8SPBPQ2Q.1 size=731408 2024-03-09T14:28:48.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.812+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=K5FL8SPBPQ2Q tag=2BW5XPJ3D6L6 type=write size=2828560 2024-03-09T14:28:48.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.814+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~WQLYR6V32SQ4.0 size=1048576 2024-03-09T14:28:48.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.815+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~WQLYR6V32SQ4.1 size=377967 2024-03-09T14:28:48.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.817+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=WQLYR6V32SQ4 tag=IYPZJW1YFEIJ type=write size=2475119 2024-03-09T14:28:48.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.818+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=LB7S6FB43AGK type=del size=918917 2024-03-09T14:28:48.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.818+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~763O01KILXHZ.0 size=1048576 2024-03-09T14:28:48.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.819+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~763O01KILXHZ.1 size=372505 2024-03-09T14:28:48.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.821+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=763O01KILXHZ tag=NOWGAP2101UJ type=write size=2469657 2024-03-09T14:28:48.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.823+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~B6ABE067P9E8.0 size=1048576 2024-03-09T14:28:48.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.824+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~B6ABE067P9E8.1 size=1048576 2024-03-09T14:28:48.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.825+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~B6ABE067P9E8.2 size=759492 2024-03-09T14:28:48.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.825+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=B6ABE067P9E8 tag=X6FAD1NRNWSF type=write size=3905220 2024-03-09T14:28:48.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.825+0000 7f1c6444c780 1 < canceled part key=_multipart_SGHNHOCYPM38.2~LXA7O5F9FVO9.0 size=144783 2024-03-09T14:28:48.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.827+0000 7f1c6444c780 1 < canceled multipart upload key=SGHNHOCYPM38 upload=LXA7O5F9FVO9 tag=HQ53YDEVTBSK type=write size=1193359 2024-03-09T14:28:48.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.828+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=4B1JY6H85T66 type=del size=854113 2024-03-09T14:28:48.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.830+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~KKV0K0FFFGJ9.0 size=1045837 2024-03-09T14:28:48.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.832+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=KKV0K0FFFGJ9 tag=QJ7XBZKBWJ3A type=write size=2094413 2024-03-09T14:28:48.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.833+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=HFFKS1R5JYBH type=write size=289391 2024-03-09T14:28:48.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.834+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~BT3CJ1IOPX0D.0 size=1048576 2024-03-09T14:28:48.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.835+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~BT3CJ1IOPX0D.1 size=99267 2024-03-09T14:28:48.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.837+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=BT3CJ1IOPX0D tag=8E4EX5DFIIF0 type=write size=2196419 2024-03-09T14:28:48.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.838+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=VRLE2A0VOTE8 type=del size=944085 2024-03-09T14:28:48.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.839+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=S5ZB9YUMQO26 type=del 2024-03-09T14:28:48.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.840+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=KB0UD2BAAAM8 type=del size=687064 2024-03-09T14:28:48.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.842+0000 7f1c6444c780 1 < completed write operation key=VL5EUQ52WRAN tag=WODPJ9FHASBK type=write size=11170 2024-03-09T14:28:48.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.843+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=H0OSTXWFBM59 type=del size=3709251 2024-03-09T14:28:48.844 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.844+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~B8I3GNY993U0.0 size=1048576 2024-03-09T14:28:48.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.845+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~B8I3GNY993U0.1 size=1048576 2024-03-09T14:28:48.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.846+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~B8I3GNY993U0.2 size=663702 2024-03-09T14:28:48.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.847+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=B8I3GNY993U0 tag=O1UWDK1LQ6YG type=write size=3809430 2024-03-09T14:28:48.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.849+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=K34FKJHQF4EI type=del size=3549441 2024-03-09T14:28:48.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.850+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~FM556ZNYPWW3.0 size=923875 2024-03-09T14:28:48.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.851+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=FM556ZNYPWW3 tag=7T51ZLATT176 type=write size=1972451 2024-03-09T14:28:48.853 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.853+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=YRIZNDD9JLKB type=del size=689709 2024-03-09T14:28:48.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.854+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~77JR2Y290G02.0 size=768277 2024-03-09T14:28:48.856 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.856+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=77JR2Y290G02 tag=1UQQ65WV0SNK type=write size=1816853 2024-03-09T14:28:48.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.857+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=IQ7D8CV1K4FE type=del size=3011215 2024-03-09T14:28:48.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.858+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=KTTJ5Z3EKYL0 type=del 2024-03-09T14:28:48.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.859+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=BHJMXF1WBJFR type=del size=3702111 2024-03-09T14:28:48.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.860+0000 7f1c6444c780 1 < completed write operation key=KNOEGKSERB6Z tag=V8I0SQXVAWJU type=write size=138446 2024-03-09T14:28:48.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.862+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~BNKVGPMWK7X6.0 size=1048576 2024-03-09T14:28:48.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.863+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~BNKVGPMWK7X6.1 size=1048576 2024-03-09T14:28:48.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.864+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~BNKVGPMWK7X6.2 size=427163 2024-03-09T14:28:48.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.864+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=BNKVGPMWK7X6 tag=DGSCV9IIJ4G1 type=write size=3572891 2024-03-09T14:28:48.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.865+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=A9E87US81QS2 type=del 2024-03-09T14:28:48.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.867+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~189A7JHE19V6.0 size=1048576 2024-03-09T14:28:48.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.868+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~189A7JHE19V6.1 size=889282 2024-03-09T14:28:48.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.868+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=189A7JHE19V6 tag=WYTE19DZBEWT type=write size=2986434 2024-03-09T14:28:48.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.869+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=NOH2E9YV6BEW type=del 2024-03-09T14:28:48.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.871+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=1ZEXHNL18SXD type=del size=2072991 2024-03-09T14:28:48.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.872+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~2CEP7QMCK8R1.0 size=1048576 2024-03-09T14:28:48.873 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.873+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~2CEP7QMCK8R1.1 size=271759 2024-03-09T14:28:48.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.875+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=2CEP7QMCK8R1 tag=7G8ER5ZHAA7O type=write size=2368911 2024-03-09T14:28:48.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.877+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~8119QMYVHRPR.0 size=1048576 2024-03-09T14:28:48.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.878+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~8119QMYVHRPR.1 size=1048576 2024-03-09T14:28:48.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.879+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~8119QMYVHRPR.2 size=650780 2024-03-09T14:28:48.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.879+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=8119QMYVHRPR tag=3E0WH7YHJ9UB type=write size=3796508 2024-03-09T14:28:48.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.880+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~K5FL8SPBPQ2Q.0 size=1048576 2024-03-09T14:28:48.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.881+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~K5FL8SPBPQ2Q.1 size=731408 2024-03-09T14:28:48.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.883+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=K5FL8SPBPQ2Q tag=2BW5XPJ3D6L6 type=write size=2828560 2024-03-09T14:28:48.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.884+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=A4YH1ZNXTCIU type=del size=2737553 2024-03-09T14:28:48.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.886+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=LB7S6FB43AGK type=del 2024-03-09T14:28:48.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.887+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=IB9KUF3M6TSD type=del size=3664543 2024-03-09T14:28:48.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.889+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~B6ABE067P9E8.0 size=1048576 2024-03-09T14:28:48.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.890+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~B6ABE067P9E8.1 size=1048576 2024-03-09T14:28:48.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.891+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~B6ABE067P9E8.2 size=759492 2024-03-09T14:28:48.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.894+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=B6ABE067P9E8 tag=X6FAD1NRNWSF type=write size=3905220 2024-03-09T14:28:48.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.895+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=MBZMPCX9LYD7 type=del size=2380055 2024-03-09T14:28:48.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.896+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=4B1JY6H85T66 type=del 2024-03-09T14:28:48.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.898+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=IAZRK8SKJ1XI type=del size=882722 2024-03-09T14:28:48.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.900+0000 7f1c6444c780 1 < suggested remove operation key=EREG1M13901A tag=HFFKS1R5JYBH type=write 2024-03-09T14:28:48.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.901+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=9ULOSDP2HHI6 type=del size=2031377 2024-03-09T14:28:48.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.902+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=VRLE2A0VOTE8 type=del size=944085 2024-03-09T14:28:48.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.903+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=Y7B1612E3ESF type=del size=3514174 2024-03-09T14:28:48.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.906+0000 7f1c6444c780 1 < suggested update operation key=YECG84AJ5IK2 tag=KB0UD2BAAAM8 type=del size=687064 2024-03-09T14:28:48.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.907+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=N484KAIHXM9A type=del size=3758557 2024-03-09T14:28:48.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.908+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=H0OSTXWFBM59 type=del 2024-03-09T14:28:48.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.911+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~TOKGPMHYT83L.0 size=1048576 2024-03-09T14:28:48.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.911+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~TOKGPMHYT83L.1 size=1048576 2024-03-09T14:28:48.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.912+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~TOKGPMHYT83L.2 size=484216 2024-03-09T14:28:48.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.912+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=TOKGPMHYT83L tag=EY0TDAMPQAKY type=write size=3629944 2024-03-09T14:28:48.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.914+0000 7f1c6444c780 1 < suggested update operation key=HNK7POWS6FSU tag=K34FKJHQF4EI type=del size=3549441 2024-03-09T14:28:48.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.917+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~KUKNELJJEEV2.0 size=1048576 2024-03-09T14:28:48.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.918+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~KUKNELJJEEV2.1 size=814654 2024-03-09T14:28:48.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.918+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=KUKNELJJEEV2 tag=GA9D19S0DAIL type=write size=2911806 2024-03-09T14:28:48.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.918+0000 7f1c6444c780 -1 < no bi entry to suggest for operation key=EREG1M13901A tag=YRIZNDD9JLKB type=del size=689709: (2) No such file or directory 2024-03-09T14:28:48.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.920+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~NTC6JK0JVNM6.0 size=1048576 2024-03-09T14:28:48.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.921+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~NTC6JK0JVNM6.1 size=1048576 2024-03-09T14:28:48.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.922+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~NTC6JK0JVNM6.2 size=33850 2024-03-09T14:28:48.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.922+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=NTC6JK0JVNM6 tag=WXRHLKG4A1SL type=write size=3179578 2024-03-09T14:28:48.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.923+0000 7f1c6444c780 1 < canceled operation key=3CC018VYSRHN tag=IQ7D8CV1K4FE type=del size=3011215 2024-03-09T14:28:48.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.924+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=5G3B8XYCMUKP type=write size=813210 2024-03-09T14:28:48.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.927+0000 7f1c6444c780 1 < suggested remove operation key=MOVS6ZMK708G tag=BHJMXF1WBJFR type=del 2024-03-09T14:28:48.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.929+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~TM1ACHPP5VIF.0 size=391473 2024-03-09T14:28:48.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.929+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=TM1ACHPP5VIF tag=EA65NPB87NVF type=write size=1440049 2024-03-09T14:28:48.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.930+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~BNKVGPMWK7X6.0 size=1048576 2024-03-09T14:28:48.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.931+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~BNKVGPMWK7X6.1 size=1048576 2024-03-09T14:28:48.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.932+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~BNKVGPMWK7X6.2 size=427163 2024-03-09T14:28:48.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.934+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=BNKVGPMWK7X6 tag=DGSCV9IIJ4G1 type=write size=3572891 2024-03-09T14:28:48.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.935+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=HHGD09HQICIB type=del size=2428166 2024-03-09T14:28:48.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.937+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~189A7JHE19V6.0 size=1048576 2024-03-09T14:28:48.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.938+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~189A7JHE19V6.1 size=889282 2024-03-09T14:28:48.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.940+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=189A7JHE19V6 tag=WYTE19DZBEWT type=write size=2986434 2024-03-09T14:28:48.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.941+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=JYKB1EGBBU46 type=del size=299199 2024-03-09T14:28:48.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.942+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=1ZEXHNL18SXD type=del 2024-03-09T14:28:48.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.943+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=IX4D2ITD0J92 type=del size=1212679 2024-03-09T14:28:48.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.944+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~8119QMYVHRPR.0 size=1048576 2024-03-09T14:28:48.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.945+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~8119QMYVHRPR.1 size=1048576 2024-03-09T14:28:48.946 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.946+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~8119QMYVHRPR.2 size=650780 2024-03-09T14:28:48.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.948+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=8119QMYVHRPR tag=3E0WH7YHJ9UB type=write size=3796508 2024-03-09T14:28:48.949 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.949+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=EXQGDBJBMYN2 type=del size=817224 2024-03-09T14:28:48.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.950+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=A4YH1ZNXTCIU type=del 2024-03-09T14:28:48.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.952+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=W1AG03QCJBRE type=del size=149400 2024-03-09T14:28:48.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.953+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=IB9KUF3M6TSD type=del 2024-03-09T14:28:48.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.954+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=UY6VDO09W7SI type=del size=2526824 2024-03-09T14:28:48.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.955+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=MBZMPCX9LYD7 type=del 2024-03-09T14:28:48.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.956+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=W4P6DO2DO0R0 type=del size=646291 2024-03-09T14:28:48.957 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.957+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=IAZRK8SKJ1XI type=del 2024-03-09T14:28:48.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.958+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=GBUPWA2M2VEC type=del size=4142457 2024-03-09T14:28:48.960 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.960+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=9ULOSDP2HHI6 type=del 2024-03-09T14:28:48.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.962+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~G4SZKRBP6Y90.0 size=398076 2024-03-09T14:28:48.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.962+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=G4SZKRBP6Y90 tag=6MU0F73X42CG type=write size=1446652 2024-03-09T14:28:48.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.963+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=Y7B1612E3ESF type=del 2024-03-09T14:28:48.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.964+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=SP4RCC1RQMR5 type=del size=3291086 2024-03-09T14:28:48.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.965+0000 7f1c6444c780 -1 < failed to complete operation key=MOVS6ZMK708G tag=N484KAIHXM9A type=del size=3758557: (22) Invalid argument 2024-03-09T14:28:48.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.967+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~40NBX10TZSVN.0 size=1048576 2024-03-09T14:28:48.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.968+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~40NBX10TZSVN.1 size=1048576 2024-03-09T14:28:48.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.969+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~40NBX10TZSVN.2 size=161661 2024-03-09T14:28:48.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.969+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=40NBX10TZSVN tag=WR6VW2ZXBQN7 type=write size=3307389 2024-03-09T14:28:48.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.970+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~TOKGPMHYT83L.0 size=1048576 2024-03-09T14:28:48.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.971+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~TOKGPMHYT83L.1 size=1048576 2024-03-09T14:28:48.972 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.972+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~TOKGPMHYT83L.2 size=484216 2024-03-09T14:28:48.974 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.974+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=TOKGPMHYT83L tag=EY0TDAMPQAKY type=write size=3629944 2024-03-09T14:28:48.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.975+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=38LYMETWV02D type=del size=1057833 2024-03-09T14:28:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.976+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~KUKNELJJEEV2.0 size=1048576 2024-03-09T14:28:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.976+0000 7f1c6444c780 1 < canceled part key=_multipart_HNK7POWS6FSU.2~KUKNELJJEEV2.1 size=814654 2024-03-09T14:28:48.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.978+0000 7f1c6444c780 1 < canceled multipart upload key=HNK7POWS6FSU upload=KUKNELJJEEV2 tag=GA9D19S0DAIL type=write size=2911806 2024-03-09T14:28:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.980+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~A9JWFG49IINT.0 size=1048576 2024-03-09T14:28:48.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.981+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~A9JWFG49IINT.1 size=1048576 2024-03-09T14:28:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.982+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~A9JWFG49IINT.2 size=247948 2024-03-09T14:28:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.982+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=A9JWFG49IINT tag=OQNMDZQDRHJD type=write size=3393676 2024-03-09T14:28:48.983 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.983+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~NTC6JK0JVNM6.0 size=1048576 2024-03-09T14:28:48.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.984+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~NTC6JK0JVNM6.1 size=1048576 2024-03-09T14:28:48.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.985+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~NTC6JK0JVNM6.2 size=33850 2024-03-09T14:28:48.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.987+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=NTC6JK0JVNM6 tag=WXRHLKG4A1SL type=write size=3179578 2024-03-09T14:28:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.989+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~3ZYNRKWVNIRM.0 size=1048576 2024-03-09T14:28:48.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.990+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~3ZYNRKWVNIRM.1 size=1048576 2024-03-09T14:28:48.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.991+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~3ZYNRKWVNIRM.2 size=624732 2024-03-09T14:28:48.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.991+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=3ZYNRKWVNIRM tag=4W0N3X1AIEV7 type=write size=3770460 2024-03-09T14:28:48.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.993+0000 7f1c6444c780 1 < suggested update operation key=JX05U3G6NLLO tag=5G3B8XYCMUKP type=write size=813210 2024-03-09T14:28:48.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.995+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~J7YVTF3HKYVQ.0 size=1048576 2024-03-09T14:28:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.996+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~J7YVTF3HKYVQ.1 size=992078 2024-03-09T14:28:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.996+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=J7YVTF3HKYVQ tag=4ABE0TCFNKRM type=write size=3089230 2024-03-09T14:28:48.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.997+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~TM1ACHPP5VIF.0 size=391473 2024-03-09T14:28:48.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:48.999+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=TM1ACHPP5VIF tag=EA65NPB87NVF type=write size=1440049 2024-03-09T14:28:49.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.002+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~OVPS0W4TSYN9.0 size=1048576 2024-03-09T14:28:49.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.003+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~OVPS0W4TSYN9.1 size=910123 2024-03-09T14:28:49.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.003+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=OVPS0W4TSYN9 tag=BV3SFH67RZ00 type=write size=3007275 2024-03-09T14:28:49.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.004+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=HHGD09HQICIB type=del 2024-03-09T14:28:49.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.005+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=9O22KOLSY6VI type=del size=2141185 2024-03-09T14:28:49.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.008+0000 7f1c6444c780 1 < suggested update operation key=HNK7POWS6FSU tag=JYKB1EGBBU46 type=del size=299199 2024-03-09T14:28:49.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.009+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=4ZWY4UNDKV8O type=write size=729906 2024-03-09T14:28:49.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.010+0000 7f1c6444c780 -1 < failed to complete operation key=HNK7POWS6FSU tag=IX4D2ITD0J92 type=del size=1212679: (22) Invalid argument 2024-03-09T14:28:49.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.011+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=3B4UZHQNUR18 type=del size=3374 2024-03-09T14:28:49.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.012+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=EXQGDBJBMYN2 type=del 2024-03-09T14:28:49.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.014+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~JHHO8DRYTN3B.0 size=597109 2024-03-09T14:28:49.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.014+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=JHHO8DRYTN3B tag=N4D3VKB02OKB type=write size=1645685 2024-03-09T14:28:49.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.015+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=W1AG03QCJBRE type=del 2024-03-09T14:28:49.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.017+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~5SCSSZMRNZA4.0 size=1048576 2024-03-09T14:28:49.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.018+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~5SCSSZMRNZA4.1 size=1048576 2024-03-09T14:28:49.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.019+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~5SCSSZMRNZA4.2 size=936071 2024-03-09T14:28:49.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.019+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=5SCSSZMRNZA4 tag=PEXGFFF64THC type=write size=4081799 2024-03-09T14:28:49.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.021+0000 7f1c6444c780 1 < suggested remove operation key=KMX7TNIOKWOA tag=UY6VDO09W7SI type=del 2024-03-09T14:28:49.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.022+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=K5BEKBUHJEWJ type=del size=2958601 2024-03-09T14:28:49.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.025+0000 7f1c6444c780 1 < suggested remove operation key=PBM4ICXZ2497 tag=W4P6DO2DO0R0 type=del 2024-03-09T14:28:49.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.026+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=J8CTOM217SKE type=del size=3118363 2024-03-09T14:28:49.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.028+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=GBUPWA2M2VEC type=del size=4142457 2024-03-09T14:28:49.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.029+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=ZRPAXKUW9DWA type=del size=3207698 2024-03-09T14:28:49.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.030+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~G4SZKRBP6Y90.0 size=398076 2024-03-09T14:28:49.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.032+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=G4SZKRBP6Y90 tag=6MU0F73X42CG type=write size=1446652 2024-03-09T14:28:49.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.033+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=TQQ5EJVJE0SY type=del size=2428640 2024-03-09T14:28:49.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.034+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=SP4RCC1RQMR5 type=del 2024-03-09T14:28:49.036 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.036+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~9WMW047IBNLP.0 size=1048576 2024-03-09T14:28:49.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.037+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~9WMW047IBNLP.1 size=925503 2024-03-09T14:28:49.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.037+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=9WMW047IBNLP tag=T03R6SEIR98H type=write size=3022655 2024-03-09T14:28:49.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.038+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~40NBX10TZSVN.0 size=1048576 2024-03-09T14:28:49.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.039+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~40NBX10TZSVN.1 size=1048576 2024-03-09T14:28:49.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.040+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~40NBX10TZSVN.2 size=161661 2024-03-09T14:28:49.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.042+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=40NBX10TZSVN tag=WR6VW2ZXBQN7 type=write size=3307389 2024-03-09T14:28:49.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.043+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=VD0XTXL0C4B4 type=del size=805254 2024-03-09T14:28:49.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.044+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=38LYMETWV02D type=del 2024-03-09T14:28:49.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.045+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=W8UKY5JV3Y2H type=del size=1609246 2024-03-09T14:28:49.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.047+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~A9JWFG49IINT.0 size=1048576 2024-03-09T14:28:49.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.047+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~A9JWFG49IINT.1 size=1048576 2024-03-09T14:28:49.049 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.048+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~A9JWFG49IINT.2 size=247948 2024-03-09T14:28:49.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.050+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=A9JWFG49IINT tag=OQNMDZQDRHJD type=write size=3393676 2024-03-09T14:28:49.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.051+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=L52YOCIOZT22 type=del size=3983043 2024-03-09T14:28:49.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.053+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~3ZYNRKWVNIRM.0 size=1048576 2024-03-09T14:28:49.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.054+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~3ZYNRKWVNIRM.1 size=1048576 2024-03-09T14:28:49.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.054+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~3ZYNRKWVNIRM.2 size=624732 2024-03-09T14:28:49.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.057+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=3ZYNRKWVNIRM tag=4W0N3X1AIEV7 type=write size=3770460 2024-03-09T14:28:49.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.058+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=55FKXOPWOIZ8 type=write size=1044544 2024-03-09T14:28:49.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.059+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~J7YVTF3HKYVQ.0 size=1048576 2024-03-09T14:28:49.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.060+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~J7YVTF3HKYVQ.1 size=992078 2024-03-09T14:28:49.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.062+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=J7YVTF3HKYVQ tag=4ABE0TCFNKRM type=write size=3089230 2024-03-09T14:28:49.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.063+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=O4WSBIE1930H type=del size=1395812 2024-03-09T14:28:49.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.064+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~OVPS0W4TSYN9.0 size=1048576 2024-03-09T14:28:49.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.065+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~OVPS0W4TSYN9.1 size=910123 2024-03-09T14:28:49.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.067+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=OVPS0W4TSYN9 tag=BV3SFH67RZ00 type=write size=3007275 2024-03-09T14:28:49.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.069+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=Z0NDR6NXXCB7 type=write size=843694 2024-03-09T14:28:49.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.071+0000 7f1c6444c780 1 < suggested update operation key=KWDIDE9AE3JP tag=9O22KOLSY6VI type=del size=2141185 2024-03-09T14:28:49.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.073+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~G8PKX1274T1O.0 size=808524 2024-03-09T14:28:49.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.073+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=G8PKX1274T1O tag=PD6KFAV5SHXI type=write size=1857100 2024-03-09T14:28:49.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.074+0000 7f1c6444c780 1 < canceled operation key=26VE2HJPD0FX tag=4ZWY4UNDKV8O type=write size=729906 2024-03-09T14:28:49.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.077+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~BV5QDH55J0F4.0 size=1048576 2024-03-09T14:28:49.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.077+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~BV5QDH55J0F4.1 size=1048576 2024-03-09T14:28:49.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.078+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~BV5QDH55J0F4.2 size=858463 2024-03-09T14:28:49.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.078+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=BV5QDH55J0F4 tag=GP6WYQ0F23N1 type=write size=4004191 2024-03-09T14:28:49.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.079+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=3B4UZHQNUR18 type=del 2024-03-09T14:28:49.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.081+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=0DPFF126WUD3 type=del size=1417432 2024-03-09T14:28:49.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.082+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~JHHO8DRYTN3B.0 size=597109 2024-03-09T14:28:49.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.084+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=JHHO8DRYTN3B tag=N4D3VKB02OKB type=write size=1645685 2024-03-09T14:28:49.086 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.086+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~N37TCFFN43IR.0 size=1048576 2024-03-09T14:28:49.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.087+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~N37TCFFN43IR.1 size=331351 2024-03-09T14:28:49.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.087+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=N37TCFFN43IR tag=2WE76A7VUFOB type=write size=2428503 2024-03-09T14:28:49.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.088+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~5SCSSZMRNZA4.0 size=1048576 2024-03-09T14:28:49.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.089+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~5SCSSZMRNZA4.1 size=1048576 2024-03-09T14:28:49.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.090+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~5SCSSZMRNZA4.2 size=936071 2024-03-09T14:28:49.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.092+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=5SCSSZMRNZA4 tag=PEXGFFF64THC type=write size=4081799 2024-03-09T14:28:49.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.093+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=4ENV8HS0CPFE type=del size=3397627 2024-03-09T14:28:49.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.094+0000 7f1c6444c780 1 < canceled operation key=IBVEN2JEB49N tag=K5BEKBUHJEWJ type=del size=2958601 2024-03-09T14:28:49.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.095+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=IOL8VIPSW4VH type=del size=2311503 2024-03-09T14:28:49.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.096+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=J8CTOM217SKE type=del 2024-03-09T14:28:49.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.098+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~LPIOYMNIG082.0 size=1048576 2024-03-09T14:28:49.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.099+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~LPIOYMNIG082.1 size=361176 2024-03-09T14:28:49.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.099+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=LPIOYMNIG082 tag=4M9UM5ZKPDTV type=write size=2458328 2024-03-09T14:28:49.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.100+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=ZRPAXKUW9DWA type=del 2024-03-09T14:28:49.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.102+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~L78XDMIWSW3Z.0 size=233603 2024-03-09T14:28:49.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.102+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=L78XDMIWSW3Z tag=4SI06F891ZVK type=write size=1282179 2024-03-09T14:28:49.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.104+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=TQQ5EJVJE0SY type=del 2024-03-09T14:28:49.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.105+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=HWNVXXRXL5ZY type=del size=376844 2024-03-09T14:28:49.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.105+0000 7f1c6444c780 1 < canceled part key=_multipart_1NQRJ8ICZNM6.2~9WMW047IBNLP.0 size=1048576 2024-03-09T14:28:49.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.106+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~9WMW047IBNLP.1 size=925503 2024-03-09T14:28:49.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.109+0000 7f1c6444c780 1 < canceled multipart upload key=1NQRJ8ICZNM6 upload=9WMW047IBNLP tag=T03R6SEIR98H type=write size=3022655 2024-03-09T14:28:49.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.110+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=26AQEOGBE1SK type=del size=2187553 2024-03-09T14:28:49.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.111+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=VD0XTXL0C4B4 type=del 2024-03-09T14:28:49.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.114+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~0P4U6K7S0R1S.0 size=818018 2024-03-09T14:28:49.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.114+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=0P4U6K7S0R1S tag=VO19TKWO24M6 type=write size=1866594 2024-03-09T14:28:49.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.115+0000 7f1c6444c780 1 < canceled operation key=SGHNHOCYPM38 tag=W8UKY5JV3Y2H type=del size=1609246 2024-03-09T14:28:49.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.117+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~4WE5QNBZ3CF4.0 size=1048576 2024-03-09T14:28:49.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.118+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~4WE5QNBZ3CF4.1 size=1048576 2024-03-09T14:28:49.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.119+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~4WE5QNBZ3CF4.2 size=135532 2024-03-09T14:28:49.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.119+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=4WE5QNBZ3CF4 tag=WJVTE0WS8X2N type=write size=3281260 2024-03-09T14:28:49.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.120+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=L52YOCIOZT22 type=del 2024-03-09T14:28:49.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.121+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=C9GX36CLL13X type=del size=2280183 2024-03-09T14:28:49.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.122+0000 7f1c6444c780 1 < canceled operation key=Z34QOCZB3DFX tag=55FKXOPWOIZ8 type=write size=1044544 2024-03-09T14:28:49.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.124+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=N5LE3W3YP2FG type=del size=3062521 2024-03-09T14:28:49.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.125+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=O4WSBIE1930H type=del 2024-03-09T14:28:49.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.127+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~FEVCNV8Y39FE.0 size=1048576 2024-03-09T14:28:49.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.128+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~FEVCNV8Y39FE.1 size=109249 2024-03-09T14:28:49.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.128+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=FEVCNV8Y39FE tag=LZK1T2AIR7MZ type=write size=2206401 2024-03-09T14:28:49.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.129+0000 7f1c6444c780 1 < canceled operation key=0ZZ0P8Y7KSAX tag=Z0NDR6NXXCB7 type=write size=843694 2024-03-09T14:28:49.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.132+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~10UHF3GANGLA.0 size=1048576 2024-03-09T14:28:49.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.133+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~10UHF3GANGLA.1 size=150571 2024-03-09T14:28:49.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.133+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=10UHF3GANGLA tag=WI5WOPFUYGHO type=write size=2247723 2024-03-09T14:28:49.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.134+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~G8PKX1274T1O.0 size=808524 2024-03-09T14:28:49.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.136+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=G8PKX1274T1O tag=PD6KFAV5SHXI type=write size=1857100 2024-03-09T14:28:49.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.137+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=I9NL7MZEVTMQ type=del size=3689287 2024-03-09T14:28:49.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.138+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~BV5QDH55J0F4.0 size=1048576 2024-03-09T14:28:49.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.139+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~BV5QDH55J0F4.1 size=1048576 2024-03-09T14:28:49.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.140+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~BV5QDH55J0F4.2 size=858463 2024-03-09T14:28:49.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.142+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=BV5QDH55J0F4 tag=GP6WYQ0F23N1 type=write size=4004191 2024-03-09T14:28:49.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.144+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=I05WHEDDQL1X type=write size=90860 2024-03-09T14:28:49.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.145+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=0DPFF126WUD3 type=del 2024-03-09T14:28:49.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.146+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=KTQIHZGZLNDJ type=write size=594271 2024-03-09T14:28:49.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.148+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~N37TCFFN43IR.0 size=1048576 2024-03-09T14:28:49.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.149+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~N37TCFFN43IR.1 size=331351 2024-03-09T14:28:49.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.151+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=N37TCFFN43IR tag=2WE76A7VUFOB type=write size=2428503 2024-03-09T14:28:49.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.152+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=02Y0CBARBX2D type=del size=3371451 2024-03-09T14:28:49.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.153+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=4ENV8HS0CPFE type=del 2024-03-09T14:28:49.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.155+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=W9B8GJMKXFGB type=del size=3225730 2024-03-09T14:28:49.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.156+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=IOL8VIPSW4VH type=del 2024-03-09T14:28:49.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.158+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~BGGWB9SV7L9Z.0 size=1048576 2024-03-09T14:28:49.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.159+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~BGGWB9SV7L9Z.1 size=401078 2024-03-09T14:28:49.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.159+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=BGGWB9SV7L9Z tag=2T9TDOAYC7HX type=write size=2498230 2024-03-09T14:28:49.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.160+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~LPIOYMNIG082.0 size=1048576 2024-03-09T14:28:49.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.162+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~LPIOYMNIG082.1 size=361176 2024-03-09T14:28:49.163 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.163+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=LPIOYMNIG082 tag=4M9UM5ZKPDTV type=write size=2458328 2024-03-09T14:28:49.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.165+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=KG5EQ6INGUMQ type=del size=826366 2024-03-09T14:28:49.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.166+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~L78XDMIWSW3Z.0 size=233603 2024-03-09T14:28:49.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.168+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=L78XDMIWSW3Z tag=4SI06F891ZVK type=write size=1282179 2024-03-09T14:28:49.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.170+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~61I19KEUW91L.0 size=85632 2024-03-09T14:28:49.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.170+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=61I19KEUW91L tag=79QUCNRBMH4R type=write size=1134208 2024-03-09T14:28:49.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.171+0000 7f1c6444c780 1 < canceled operation key=MOVS6ZMK708G tag=HWNVXXRXL5ZY type=del size=376844 2024-03-09T14:28:49.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.173+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~D31DZ86ORHE8.0 size=1048576 2024-03-09T14:28:49.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.174+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~D31DZ86ORHE8.1 size=1048576 2024-03-09T14:28:49.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.175+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~D31DZ86ORHE8.2 size=306234 2024-03-09T14:28:49.175 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.175+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=D31DZ86ORHE8 tag=5JJYC56K8MSL type=write size=3451962 2024-03-09T14:28:49.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.176+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=26AQEOGBE1SK type=del 2024-03-09T14:28:49.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.177+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=2G59H9B14WAQ type=del size=1439930 2024-03-09T14:28:49.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.179+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~0P4U6K7S0R1S.0 size=818018 2024-03-09T14:28:49.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.181+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=0P4U6K7S0R1S tag=VO19TKWO24M6 type=write size=1866594 2024-03-09T14:28:49.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.182+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=G11GEMSU6AZK type=del size=2655088 2024-03-09T14:28:49.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.183+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~4WE5QNBZ3CF4.0 size=1048576 2024-03-09T14:28:49.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.184+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~4WE5QNBZ3CF4.1 size=1048576 2024-03-09T14:28:49.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.185+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~4WE5QNBZ3CF4.2 size=135532 2024-03-09T14:28:49.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.187+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=4WE5QNBZ3CF4 tag=WJVTE0WS8X2N type=write size=3281260 2024-03-09T14:28:49.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.189+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~5MRCK2ANZRIA.0 size=807662 2024-03-09T14:28:49.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.189+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=5MRCK2ANZRIA tag=8VLGN69LC0P9 type=write size=1856238 2024-03-09T14:28:49.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.191+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=C9GX36CLL13X type=del 2024-03-09T14:28:49.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.192+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=CYK1Y1NYU9JG type=del size=276925 2024-03-09T14:28:49.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.193+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=N5LE3W3YP2FG type=del 2024-03-09T14:28:49.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.194+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=CA9UCRUE51XO type=del size=1189836 2024-03-09T14:28:49.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.195+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~FEVCNV8Y39FE.0 size=1048576 2024-03-09T14:28:49.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.196+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~FEVCNV8Y39FE.1 size=109249 2024-03-09T14:28:49.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.198+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=FEVCNV8Y39FE tag=LZK1T2AIR7MZ type=write size=2206401 2024-03-09T14:28:49.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.199+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=WY82AMLRANXR type=write size=182512 2024-03-09T14:28:49.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.201+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~10UHF3GANGLA.0 size=1048576 2024-03-09T14:28:49.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.202+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~10UHF3GANGLA.1 size=150571 2024-03-09T14:28:49.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.203+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=10UHF3GANGLA tag=WI5WOPFUYGHO type=write size=2247723 2024-03-09T14:28:49.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.206+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~UY4UFJEB8S13.0 size=1048576 2024-03-09T14:28:49.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.207+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~UY4UFJEB8S13.1 size=697817 2024-03-09T14:28:49.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.207+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=UY4UFJEB8S13 tag=JXBJNE6XDLIT type=write size=2794969 2024-03-09T14:28:49.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.208+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=I9NL7MZEVTMQ type=del 2024-03-09T14:28:49.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.210+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~BHWMIVY3VKFN.0 size=1048576 2024-03-09T14:28:49.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.211+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~BHWMIVY3VKFN.1 size=1048576 2024-03-09T14:28:49.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.212+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~BHWMIVY3VKFN.2 size=758244 2024-03-09T14:28:49.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.212+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=BHWMIVY3VKFN tag=NJ1QP86CY5JB type=write size=3903972 2024-03-09T14:28:49.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.213+0000 7f1c6444c780 1 < canceled operation key=YK7ENO4UAB2M tag=I05WHEDDQL1X type=write size=90860 2024-03-09T14:28:49.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.215+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=AQ9D7O0PYQ5I type=del size=568576 2024-03-09T14:28:49.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.216+0000 7f1c6444c780 1 < completed write operation key=WMO6LTCMVXD2 tag=KTQIHZGZLNDJ type=write size=594271 2024-03-09T14:28:49.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.217+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=7862DY59XWQZ type=del size=1823715 2024-03-09T14:28:49.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.219+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=02Y0CBARBX2D type=del 2024-03-09T14:28:49.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.220+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=SXI31JZIH1JC type=del size=1688606 2024-03-09T14:28:49.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.223+0000 7f1c6444c780 1 < suggested update operation key=WMO6LTCMVXD2 tag=W9B8GJMKXFGB type=del size=3225730 2024-03-09T14:28:49.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.226+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~5M4ZZR83J2OJ.0 size=1048576 2024-03-09T14:28:49.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.227+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~5M4ZZR83J2OJ.1 size=1048576 2024-03-09T14:28:49.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.228+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~5M4ZZR83J2OJ.2 size=508100 2024-03-09T14:28:49.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.228+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=5M4ZZR83J2OJ tag=S6RUYDZGFJ5C type=write size=3653828 2024-03-09T14:28:49.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.229+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~BGGWB9SV7L9Z.0 size=1048576 2024-03-09T14:28:49.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.230+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~BGGWB9SV7L9Z.1 size=401078 2024-03-09T14:28:49.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.232+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=BGGWB9SV7L9Z tag=2T9TDOAYC7HX type=write size=2498230 2024-03-09T14:28:49.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.234+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~BCY0H97QLI5I.0 size=1048576 2024-03-09T14:28:49.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.235+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~BCY0H97QLI5I.1 size=1048576 2024-03-09T14:28:49.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.235+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~BCY0H97QLI5I.2 size=492366 2024-03-09T14:28:49.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.236+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=BCY0H97QLI5I tag=7LFLXVQE0I8N type=write size=3638094 2024-03-09T14:28:49.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.237+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=KG5EQ6INGUMQ type=del 2024-03-09T14:28:49.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.238+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=7CGRCM6KR6OY type=write size=453221 2024-03-09T14:28:49.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.239+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~61I19KEUW91L.0 size=85632 2024-03-09T14:28:49.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.241+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=61I19KEUW91L tag=79QUCNRBMH4R type=write size=1134208 2024-03-09T14:28:49.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.243+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~CCQV4Q4XSYC6.0 size=611351 2024-03-09T14:28:49.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.243+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=CCQV4Q4XSYC6 tag=X6H6NYP5E5UJ type=write size=1659927 2024-03-09T14:28:49.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.244+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~D31DZ86ORHE8.0 size=1048576 2024-03-09T14:28:49.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.244+0000 7f1c6444c780 1 < canceled part key=_multipart_35Y98D5U0M8O.2~D31DZ86ORHE8.1 size=1048576 2024-03-09T14:28:49.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.245+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~D31DZ86ORHE8.2 size=306234 2024-03-09T14:28:49.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.247+0000 7f1c6444c780 1 < canceled multipart upload key=35Y98D5U0M8O upload=D31DZ86ORHE8 tag=5JJYC56K8MSL type=write size=3451962 2024-03-09T14:28:49.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.248+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=56FNOA0NIOUX type=write size=232317 2024-03-09T14:28:49.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.249+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=2G59H9B14WAQ type=del size=1439930 2024-03-09T14:28:49.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.250+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=N8YXEF0RPEEY type=del size=380566 2024-03-09T14:28:49.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.251+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=G11GEMSU6AZK type=del 2024-03-09T14:28:49.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.253+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~82M439TDQ6TZ.0 size=1048576 2024-03-09T14:28:49.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.254+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~82M439TDQ6TZ.1 size=846144 2024-03-09T14:28:49.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.254+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=82M439TDQ6TZ tag=6JR1V2RIS6N8 type=write size=2943296 2024-03-09T14:28:49.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.255+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~5MRCK2ANZRIA.0 size=807662 2024-03-09T14:28:49.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.257+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=5MRCK2ANZRIA tag=8VLGN69LC0P9 type=write size=1856238 2024-03-09T14:28:49.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.258+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=0TWT8X5453VF type=del size=3325077 2024-03-09T14:28:49.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.259+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=CYK1Y1NYU9JG type=del 2024-03-09T14:28:49.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.260+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=HT6ZTXOIMVB4 type=del size=687581 2024-03-09T14:28:49.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.261+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=CA9UCRUE51XO type=del 2024-03-09T14:28:49.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.262+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=QUOZ1X4D2H4D type=del size=756401 2024-03-09T14:28:49.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.264+0000 7f1c6444c780 1 < canceled operation key=26VE2HJPD0FX tag=WY82AMLRANXR type=write size=182512 2024-03-09T14:28:49.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.266+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~FJDFRWIE44VO.0 size=411652 2024-03-09T14:28:49.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.266+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=FJDFRWIE44VO tag=6TJ2M9SNFH2J type=write size=1460228 2024-03-09T14:28:49.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.267+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~UY4UFJEB8S13.0 size=1048576 2024-03-09T14:28:49.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.268+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~UY4UFJEB8S13.1 size=697817 2024-03-09T14:28:49.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.270+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=UY4UFJEB8S13 tag=JXBJNE6XDLIT type=write size=2794969 2024-03-09T14:28:49.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.271+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=4Z28A3YQ2FC0 type=del size=1418219 2024-03-09T14:28:49.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.272+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~BHWMIVY3VKFN.0 size=1048576 2024-03-09T14:28:49.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.273+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~BHWMIVY3VKFN.1 size=1048576 2024-03-09T14:28:49.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.274+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~BHWMIVY3VKFN.2 size=758244 2024-03-09T14:28:49.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.276+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=BHWMIVY3VKFN tag=NJ1QP86CY5JB type=write size=3903972 2024-03-09T14:28:49.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.277+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=85VP0D6TL8YG type=del size=1098282 2024-03-09T14:28:49.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.278+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=AQ9D7O0PYQ5I type=del 2024-03-09T14:28:49.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.279+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=QOYNLUHV38ZJ type=del size=3505202 2024-03-09T14:28:49.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.281+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=7862DY59XWQZ type=del 2024-03-09T14:28:49.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.282+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=D2E48QQ5G30Z type=del size=2920275 2024-03-09T14:28:49.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.284+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=SXI31JZIH1JC type=del 2024-03-09T14:28:49.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.286+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~HZ6ONNA5WZ5C.0 size=1048576 2024-03-09T14:28:49.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.287+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~HZ6ONNA5WZ5C.1 size=1048576 2024-03-09T14:28:49.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.287+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~HZ6ONNA5WZ5C.2 size=423666 2024-03-09T14:28:49.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.287+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=HZ6ONNA5WZ5C tag=CB96MGXWGL7F type=write size=3569394 2024-03-09T14:28:49.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.289+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~5M4ZZR83J2OJ.0 size=1048576 2024-03-09T14:28:49.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.289+0000 7f1c6444c780 1 < canceled part key=_multipart_BYX1155MZ2LP.2~5M4ZZR83J2OJ.1 size=1048576 2024-03-09T14:28:49.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.290+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~5M4ZZR83J2OJ.2 size=508100 2024-03-09T14:28:49.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.292+0000 7f1c6444c780 1 < canceled multipart upload key=BYX1155MZ2LP upload=5M4ZZR83J2OJ tag=S6RUYDZGFJ5C type=write size=3653828 2024-03-09T14:28:49.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.294+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~YB6P8OBNNIXM.0 size=403626 2024-03-09T14:28:49.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.294+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=YB6P8OBNNIXM tag=KC55DUGZSO9L type=write size=1452202 2024-03-09T14:28:49.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.295+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~BCY0H97QLI5I.0 size=1048576 2024-03-09T14:28:49.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.296+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~BCY0H97QLI5I.1 size=1048576 2024-03-09T14:28:49.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.296+0000 7f1c6444c780 1 < canceled part key=_multipart_0IHHFQBKKJ0G.2~BCY0H97QLI5I.2 size=492366 2024-03-09T14:28:49.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.298+0000 7f1c6444c780 1 < canceled multipart upload key=0IHHFQBKKJ0G upload=BCY0H97QLI5I tag=7LFLXVQE0I8N type=write size=3638094 2024-03-09T14:28:49.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.300+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~04G888B10KWX.0 size=1048576 2024-03-09T14:28:49.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.301+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~04G888B10KWX.1 size=133736 2024-03-09T14:28:49.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.301+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=04G888B10KWX tag=GR96RUDZ2VJG type=write size=2230888 2024-03-09T14:28:49.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.302+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=7CGRCM6KR6OY type=write size=453221 2024-03-09T14:28:49.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.304+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=OV2TNM3UD87N type=del size=172464 2024-03-09T14:28:49.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.305+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~CCQV4Q4XSYC6.0 size=611351 2024-03-09T14:28:49.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.307+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=CCQV4Q4XSYC6 tag=X6H6NYP5E5UJ type=write size=1659927 2024-03-09T14:28:49.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.309+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~4KXVFENUHMIG.0 size=1048576 2024-03-09T14:28:49.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.310+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~4KXVFENUHMIG.1 size=885128 2024-03-09T14:28:49.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.310+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=4KXVFENUHMIG tag=PH4YTR441DGV type=write size=2982280 2024-03-09T14:28:49.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.311+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=56FNOA0NIOUX type=write size=232317 2024-03-09T14:28:49.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.312+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=CCSF93AI4I66 type=del size=1106105 2024-03-09T14:28:49.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.313+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=N8YXEF0RPEEY type=del 2024-03-09T14:28:49.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.315+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=1LTQ2N0PD1X6 type=del size=2050281 2024-03-09T14:28:49.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.316+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~82M439TDQ6TZ.0 size=1048576 2024-03-09T14:28:49.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.317+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~82M439TDQ6TZ.1 size=846144 2024-03-09T14:28:49.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.319+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=82M439TDQ6TZ tag=6JR1V2RIS6N8 type=write size=2943296 2024-03-09T14:28:49.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.320+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=QGJTJAT47OTW type=write size=378834 2024-03-09T14:28:49.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.322+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=0TWT8X5453VF type=del size=3325077 2024-03-09T14:28:49.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.323+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=QELCW8ST6ZAC type=del size=1783480 2024-03-09T14:28:49.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.324+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=HT6ZTXOIMVB4 type=del 2024-03-09T14:28:49.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.326+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~61M6UT3P9IXB.0 size=1048576 2024-03-09T14:28:49.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.327+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~61M6UT3P9IXB.1 size=1016130 2024-03-09T14:28:49.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.327+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=61M6UT3P9IXB tag=O260GYU9BIXC type=write size=3113282 2024-03-09T14:28:49.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.328+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=QUOZ1X4D2H4D type=del 2024-03-09T14:28:49.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.330+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=N0DFJXH6RN2Q type=del size=772714 2024-03-09T14:28:49.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.332+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~FJDFRWIE44VO.0 size=411652 2024-03-09T14:28:49.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.334+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=FJDFRWIE44VO tag=6TJ2M9SNFH2J type=write size=1460228 2024-03-09T14:28:49.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.336+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~U3NPTSA39R9N.0 size=1048576 2024-03-09T14:28:49.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.337+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~U3NPTSA39R9N.1 size=476535 2024-03-09T14:28:49.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.337+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=U3NPTSA39R9N tag=JFVKJXZT3XE4 type=write size=2573687 2024-03-09T14:28:49.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.338+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=4Z28A3YQ2FC0 type=del 2024-03-09T14:28:49.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.340+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~RTOP01POJR2Z.0 size=329043 2024-03-09T14:28:49.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.340+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=RTOP01POJR2Z tag=K4B1Z3E4WWLA type=write size=1377619 2024-03-09T14:28:49.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.341+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=85VP0D6TL8YG type=del 2024-03-09T14:28:49.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.342+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=1CTSHTW3VNQI type=del size=1954804 2024-03-09T14:28:49.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.344+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=QOYNLUHV38ZJ type=del 2024-03-09T14:28:49.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.345+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=QIFOG8T2O46R type=del size=3968950 2024-03-09T14:28:49.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.347+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=D2E48QQ5G30Z type=del 2024-03-09T14:28:49.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.348+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=KL06HQW8GP4D type=write size=861718 2024-03-09T14:28:49.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.349+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~HZ6ONNA5WZ5C.0 size=1048576 2024-03-09T14:28:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.350+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~HZ6ONNA5WZ5C.1 size=1048576 2024-03-09T14:28:49.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.352+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~HZ6ONNA5WZ5C.2 size=423666 2024-03-09T14:28:49.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.354+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=HZ6ONNA5WZ5C tag=CB96MGXWGL7F type=write size=3569394 2024-03-09T14:28:49.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.355+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=CSTP06QSATXZ type=del size=3123372 2024-03-09T14:28:49.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.356+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~YB6P8OBNNIXM.0 size=403626 2024-03-09T14:28:49.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.358+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=YB6P8OBNNIXM tag=KC55DUGZSO9L type=write size=1452202 2024-03-09T14:28:49.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.359+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=DZZ4I1WGDW7W type=del size=2593823 2024-03-09T14:28:49.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.361+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~04G888B10KWX.0 size=1048576 2024-03-09T14:28:49.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.362+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~04G888B10KWX.1 size=133736 2024-03-09T14:28:49.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.363+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=04G888B10KWX tag=GR96RUDZ2VJG type=write size=2230888 2024-03-09T14:28:49.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.365+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~02TLCE6CSHDK.0 size=108293 2024-03-09T14:28:49.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.365+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=02TLCE6CSHDK tag=FY2SS3SBR27D type=write size=1156869 2024-03-09T14:28:49.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.367+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=OV2TNM3UD87N type=del 2024-03-09T14:28:49.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.369+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~ME451FGAYRG3.0 size=887890 2024-03-09T14:28:49.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.369+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=ME451FGAYRG3 tag=O9SHFCQGGXWV type=write size=1936466 2024-03-09T14:28:49.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.370+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~4KXVFENUHMIG.0 size=1048576 2024-03-09T14:28:49.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.370+0000 7f1c6444c780 1 < canceled part key=_multipart_SGHNHOCYPM38.2~4KXVFENUHMIG.1 size=885128 2024-03-09T14:28:49.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.372+0000 7f1c6444c780 1 < canceled multipart upload key=SGHNHOCYPM38 upload=4KXVFENUHMIG tag=PH4YTR441DGV type=write size=2982280 2024-03-09T14:28:49.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.373+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=VGJ2QF0058IE type=del size=3643795 2024-03-09T14:28:49.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.374+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=CCSF93AI4I66 type=del 2024-03-09T14:28:49.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.375+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=3XHWUCDGLZ90 type=del size=2892614 2024-03-09T14:28:49.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.376+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=1LTQ2N0PD1X6 type=del 2024-03-09T14:28:49.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.378+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~BRL5R2RJFIHX.0 size=9139 2024-03-09T14:28:49.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.378+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=BRL5R2RJFIHX tag=N3UTRYN6GOJ9 type=write size=1057715 2024-03-09T14:28:49.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.379+0000 7f1c6444c780 1 < canceled operation key=BAWV7KY6NT8P tag=QGJTJAT47OTW type=write size=378834 2024-03-09T14:28:49.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.381+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=C7XF65EPT7B5 type=del size=277453 2024-03-09T14:28:49.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.382+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=QELCW8ST6ZAC type=del 2024-03-09T14:28:49.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.384+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~KT5MFJA1KDVB.0 size=526664 2024-03-09T14:28:49.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.384+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=KT5MFJA1KDVB tag=OH8HKZJQTO74 type=write size=1575240 2024-03-09T14:28:49.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.385+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~61M6UT3P9IXB.0 size=1048576 2024-03-09T14:28:49.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.386+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~61M6UT3P9IXB.1 size=1016130 2024-03-09T14:28:49.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.388+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=61M6UT3P9IXB tag=O260GYU9BIXC type=write size=3113282 2024-03-09T14:28:49.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.389+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=HIJSMJ5U4C6J type=del size=2746402 2024-03-09T14:28:49.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.390+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=N0DFJXH6RN2Q type=del 2024-03-09T14:28:49.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.391+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=CCDYCV55PONL type=del size=2620766 2024-03-09T14:28:49.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.392+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~U3NPTSA39R9N.0 size=1048576 2024-03-09T14:28:49.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.393+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~U3NPTSA39R9N.1 size=476535 2024-03-09T14:28:49.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.395+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=U3NPTSA39R9N tag=JFVKJXZT3XE4 type=write size=2573687 2024-03-09T14:28:49.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.396+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=F16TGS5PWFUV type=del size=3266170 2024-03-09T14:28:49.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.397+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~RTOP01POJR2Z.0 size=329043 2024-03-09T14:28:49.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.399+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=RTOP01POJR2Z tag=K4B1Z3E4WWLA type=write size=1377619 2024-03-09T14:28:49.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.400+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=PLM7UQBZMXHV type=del size=2963521 2024-03-09T14:28:49.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.402+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=1CTSHTW3VNQI type=del 2024-03-09T14:28:49.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.403+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=M7O0TONJ6QPQ type=del size=3731964 2024-03-09T14:28:49.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.405+0000 7f1c6444c780 1 < suggested update operation key=0IHHFQBKKJ0G tag=QIFOG8T2O46R type=del size=3968950 2024-03-09T14:28:49.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.406+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=PCGSTEWX4JWH type=del size=2353060 2024-03-09T14:28:49.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.407+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=KL06HQW8GP4D type=write size=861718 2024-03-09T14:28:49.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.408+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=9TTHL343H6T0 type=write size=866524 2024-03-09T14:28:49.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.410+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=CSTP06QSATXZ type=del 2024-03-09T14:28:49.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.411+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=Y9FQ2KX332G0 type=del size=292486 2024-03-09T14:28:49.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.412+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=DZZ4I1WGDW7W type=del 2024-03-09T14:28:49.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.413+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=X6KLZYSVFDOP type=del size=805213 2024-03-09T14:28:49.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.414+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~02TLCE6CSHDK.0 size=108293 2024-03-09T14:28:49.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.416+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=02TLCE6CSHDK tag=FY2SS3SBR27D type=write size=1156869 2024-03-09T14:28:49.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.417+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=JX0N6HNU7UF2 type=del size=573717 2024-03-09T14:28:49.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.418+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~ME451FGAYRG3.0 size=887890 2024-03-09T14:28:49.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.420+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=ME451FGAYRG3 tag=O9SHFCQGGXWV type=write size=1936466 2024-03-09T14:28:49.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.422+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~SEH46EYFUWVI.0 size=1048576 2024-03-09T14:28:49.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.423+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~SEH46EYFUWVI.1 size=16948 2024-03-09T14:28:49.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.423+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=SEH46EYFUWVI tag=H525OV63KK4J type=write size=2114100 2024-03-09T14:28:49.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.424+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=VGJ2QF0058IE type=del 2024-03-09T14:28:49.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.426+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=W6GMQUVZWE2E type=del size=1266253 2024-03-09T14:28:49.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.427+0000 7f1c6444c780 1 < canceled operation key=IBVEN2JEB49N tag=3XHWUCDGLZ90 type=del size=2892614 2024-03-09T14:28:49.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.428+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=PH60FL70U0BQ type=del size=4138682 2024-03-09T14:28:49.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.429+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~BRL5R2RJFIHX.0 size=9139 2024-03-09T14:28:49.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.431+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=BRL5R2RJFIHX tag=N3UTRYN6GOJ9 type=write size=1057715 2024-03-09T14:28:49.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.433+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~W2QCWT01NDYU.0 size=1048576 2024-03-09T14:28:49.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.434+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~W2QCWT01NDYU.1 size=1048576 2024-03-09T14:28:49.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.435+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~W2QCWT01NDYU.2 size=390528 2024-03-09T14:28:49.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.435+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=W2QCWT01NDYU tag=GL75IWV33O3G type=write size=3536256 2024-03-09T14:28:49.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.436+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=C7XF65EPT7B5 type=del 2024-03-09T14:28:49.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.437+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=PYDDFMU2V40X type=write size=497737 2024-03-09T14:28:49.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.438+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~KT5MFJA1KDVB.0 size=526664 2024-03-09T14:28:49.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.442+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=KT5MFJA1KDVB tag=OH8HKZJQTO74 type=write size=1575240 2024-03-09T14:28:49.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.444+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~26VDDUY5PZC5.0 size=1048576 2024-03-09T14:28:49.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.445+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~26VDDUY5PZC5.1 size=976706 2024-03-09T14:28:49.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.445+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=26VDDUY5PZC5 tag=S5HVAM3H75CR type=write size=3073858 2024-03-09T14:28:49.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.447+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=HIJSMJ5U4C6J type=del size=2746402 2024-03-09T14:28:49.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.448+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=22BW5250ABNO type=write size=739759 2024-03-09T14:28:49.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.449+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=CCDYCV55PONL type=del 2024-03-09T14:28:49.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.451+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=X8Z4AWJUMBMW type=write size=917368 2024-03-09T14:28:49.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.452+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=F16TGS5PWFUV type=del 2024-03-09T14:28:49.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.453+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=CW7UNB4SAU1X type=write size=871848 2024-03-09T14:28:49.454 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.454+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=PLM7UQBZMXHV type=del 2024-03-09T14:28:49.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.455+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=H3EJVVVPW293 type=del size=1906163 2024-03-09T14:28:49.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.458+0000 7f1c6444c780 1 < suggested remove operation key=MOVS6ZMK708G tag=M7O0TONJ6QPQ type=del 2024-03-09T14:28:49.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.460+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~HSCIT11XYTCZ.0 size=1048576 2024-03-09T14:28:49.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.461+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~HSCIT11XYTCZ.1 size=192297 2024-03-09T14:28:49.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.461+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=HSCIT11XYTCZ tag=R2BFUYD15NBR type=write size=2289449 2024-03-09T14:28:49.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.463+0000 7f1c6444c780 1 < suggested update operation key=EREG1M13901A tag=PCGSTEWX4JWH type=del size=2353060 2024-03-09T14:28:49.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.465+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~VTGHRVUK29PA.0 size=961942 2024-03-09T14:28:49.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.465+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=VTGHRVUK29PA tag=APHK03FB8RBV type=write size=2010518 2024-03-09T14:28:49.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.466+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=9TTHL343H6T0 type=write size=866524 2024-03-09T14:28:49.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.468+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~Q5AO12EX0RTE.0 size=707950 2024-03-09T14:28:49.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.468+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=Q5AO12EX0RTE tag=00UO36ZRSQ4L type=write size=1756526 2024-03-09T14:28:49.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.470+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=Y9FQ2KX332G0 type=del 2024-03-09T14:28:49.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.471+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=KKBGSIYFKFK3 type=del size=1891501 2024-03-09T14:28:49.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.472+0000 7f1c6444c780 -1 < failed to complete operation key=EREG1M13901A tag=X6KLZYSVFDOP type=del size=805213: (22) Invalid argument 2024-03-09T14:28:49.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.474+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~X5EM8BQRZEK0.0 size=1048576 2024-03-09T14:28:49.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.475+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~X5EM8BQRZEK0.1 size=1048576 2024-03-09T14:28:49.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.476+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~X5EM8BQRZEK0.2 size=981844 2024-03-09T14:28:49.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.476+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=X5EM8BQRZEK0 tag=QMXYBAR9JD86 type=write size=4127572 2024-03-09T14:28:49.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.478+0000 7f1c6444c780 1 < suggested remove operation key=35Y98D5U0M8O tag=JX0N6HNU7UF2 type=del 2024-03-09T14:28:49.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.479+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=GIRD1LD0XIRO type=del size=1501098 2024-03-09T14:28:49.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.480+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~SEH46EYFUWVI.0 size=1048576 2024-03-09T14:28:49.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.481+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~SEH46EYFUWVI.1 size=16948 2024-03-09T14:28:49.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.483+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=SEH46EYFUWVI tag=H525OV63KK4J type=write size=2114100 2024-03-09T14:28:49.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.484+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=O0YU560PPOX5 type=del size=661701 2024-03-09T14:28:49.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.485+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=W6GMQUVZWE2E type=del 2024-03-09T14:28:49.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.486+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=QPGSZ5T655HT type=del size=1507737 2024-03-09T14:28:49.488 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.488+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=PH60FL70U0BQ type=del 2024-03-09T14:28:49.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.489+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=GL83EYKKXPGL type=del size=1400208 2024-03-09T14:28:49.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.490+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~W2QCWT01NDYU.0 size=1048576 2024-03-09T14:28:49.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.491+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~W2QCWT01NDYU.1 size=1048576 2024-03-09T14:28:49.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.492+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~W2QCWT01NDYU.2 size=390528 2024-03-09T14:28:49.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.494+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=W2QCWT01NDYU tag=GL75IWV33O3G type=write size=3536256 2024-03-09T14:28:49.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.495+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=PEQ52GGU7FF7 type=del size=4085398 2024-03-09T14:28:49.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.496+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=PYDDFMU2V40X type=write size=497737 2024-03-09T14:28:49.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.497+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=SVXGOV59K03R type=del size=2636714 2024-03-09T14:28:49.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.498+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~26VDDUY5PZC5.0 size=1048576 2024-03-09T14:28:49.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.499+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~26VDDUY5PZC5.1 size=976706 2024-03-09T14:28:49.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.501+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=26VDDUY5PZC5 tag=S5HVAM3H75CR type=write size=3073858 2024-03-09T14:28:49.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.502+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=4L4GMZPGVZRZ type=del size=3554139 2024-03-09T14:28:49.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.503+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=22BW5250ABNO type=write size=739759 2024-03-09T14:28:49.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.504+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=T4H2OZ0ADY77 type=write size=358253 2024-03-09T14:28:49.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.505+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=X8Z4AWJUMBMW type=write size=917368 2024-03-09T14:28:49.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.507+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=VSGQ3VG6GCLU type=del size=610243 2024-03-09T14:28:49.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.508+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=CW7UNB4SAU1X type=write size=871848 2024-03-09T14:28:49.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.510+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~5JK7UTX03TZU.0 size=1048576 2024-03-09T14:28:49.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.511+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~5JK7UTX03TZU.1 size=1048576 2024-03-09T14:28:49.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.512+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~5JK7UTX03TZU.2 size=192351 2024-03-09T14:28:49.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.512+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=5JK7UTX03TZU tag=NEJ5XDWVI44E type=write size=3338079 2024-03-09T14:28:49.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.513+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=H3EJVVVPW293 type=del 2024-03-09T14:28:49.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.514+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=619HHOZ5MS5R type=del size=3099562 2024-03-09T14:28:49.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.515+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~HSCIT11XYTCZ.0 size=1048576 2024-03-09T14:28:49.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.516+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~HSCIT11XYTCZ.1 size=192297 2024-03-09T14:28:49.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.518+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=HSCIT11XYTCZ tag=R2BFUYD15NBR type=write size=2289449 2024-03-09T14:28:49.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.521+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~HF284QHU0WAQ.0 size=113771 2024-03-09T14:28:49.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.521+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=HF284QHU0WAQ tag=R039S2NEZOH3 type=write size=1162347 2024-03-09T14:28:49.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.522+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~VTGHRVUK29PA.0 size=961942 2024-03-09T14:28:49.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.524+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=VTGHRVUK29PA tag=APHK03FB8RBV type=write size=2010518 2024-03-09T14:28:49.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.526+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=UKO7SYILGPEY type=del size=1325875 2024-03-09T14:28:49.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.527+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~Q5AO12EX0RTE.0 size=707950 2024-03-09T14:28:49.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.529+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=Q5AO12EX0RTE tag=00UO36ZRSQ4L type=write size=1756526 2024-03-09T14:28:49.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.530+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=OBOC33LG6A07 type=del size=1913328 2024-03-09T14:28:49.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.531+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=KKBGSIYFKFK3 type=del 2024-03-09T14:28:49.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.532+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=WHURCLALRMGZ type=del size=1531807 2024-03-09T14:28:49.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.534+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~X5EM8BQRZEK0.0 size=1048576 2024-03-09T14:28:49.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.534+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~X5EM8BQRZEK0.1 size=1048576 2024-03-09T14:28:49.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.535+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~X5EM8BQRZEK0.2 size=981844 2024-03-09T14:28:49.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.538+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=X5EM8BQRZEK0 tag=QMXYBAR9JD86 type=write size=4127572 2024-03-09T14:28:49.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.539+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=P6S6U8X222UD type=del size=2384172 2024-03-09T14:28:49.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.540+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=GIRD1LD0XIRO type=del 2024-03-09T14:28:49.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.541+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=PDEZUGKGEBU3 type=write size=398183 2024-03-09T14:28:49.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.542+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=O0YU560PPOX5 type=del 2024-03-09T14:28:49.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.544+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~3WG71REQ7PV2.0 size=1048576 2024-03-09T14:28:49.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.545+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~3WG71REQ7PV2.1 size=1048576 2024-03-09T14:28:49.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.546+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~3WG71REQ7PV2.2 size=432328 2024-03-09T14:28:49.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.546+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=3WG71REQ7PV2 tag=HSIX3BRSE3TW type=write size=3578056 2024-03-09T14:28:49.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.547+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=QPGSZ5T655HT type=del 2024-03-09T14:28:49.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.551+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~HAQ1PD5BB3S2.0 size=72042 2024-03-09T14:28:49.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.551+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=HAQ1PD5BB3S2 tag=52KK68HMJS1N type=write size=1120618 2024-03-09T14:28:49.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.552+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=GL83EYKKXPGL type=del 2024-03-09T14:28:49.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.554+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~Q2316E3GFKVI.0 size=480364 2024-03-09T14:28:49.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.554+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=Q2316E3GFKVI tag=O91VFP040C3O type=write size=1528940 2024-03-09T14:28:49.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.555+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=PEQ52GGU7FF7 type=del 2024-03-09T14:28:49.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.556+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=UVU2CPJ47D3N type=del size=2713523 2024-03-09T14:28:49.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.559+0000 7f1c6444c780 1 < suggested update operation key=26VE2HJPD0FX tag=SVXGOV59K03R type=del size=2636714 2024-03-09T14:28:49.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.560+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=X59QVKO7C1IS type=del size=2774507 2024-03-09T14:28:49.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.561+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=4L4GMZPGVZRZ type=del size=3554139 2024-03-09T14:28:49.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.563+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~QUHB5XA827EL.0 size=1048576 2024-03-09T14:28:49.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.564+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~QUHB5XA827EL.1 size=1048576 2024-03-09T14:28:49.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.565+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~QUHB5XA827EL.2 size=956343 2024-03-09T14:28:49.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.565+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=QUHB5XA827EL tag=Q3JMQDC50M00 type=write size=4102071 2024-03-09T14:28:49.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.566+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=T4H2OZ0ADY77 type=write size=358253 2024-03-09T14:28:49.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.567+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=P5ATX1BU8NCD type=del size=3317536 2024-03-09T14:28:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.569+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=VSGQ3VG6GCLU type=del 2024-03-09T14:28:49.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.571+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~KKLJV7CI4YQS.0 size=535396 2024-03-09T14:28:49.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.571+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=KKLJV7CI4YQS tag=YYD74GC4H0P8 type=write size=1583972 2024-03-09T14:28:49.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.573+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~5JK7UTX03TZU.0 size=1048576 2024-03-09T14:28:49.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.573+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~5JK7UTX03TZU.1 size=1048576 2024-03-09T14:28:49.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.574+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~5JK7UTX03TZU.2 size=192351 2024-03-09T14:28:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.577+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=5JK7UTX03TZU tag=NEJ5XDWVI44E type=write size=3338079 2024-03-09T14:28:49.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.578+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=F5UJI5TPAOBN type=del size=1185119 2024-03-09T14:28:49.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.579+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=619HHOZ5MS5R type=del 2024-03-09T14:28:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.581+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~AZVYDFTN7JQE.0 size=1048576 2024-03-09T14:28:49.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.582+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~AZVYDFTN7JQE.1 size=1048576 2024-03-09T14:28:49.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.583+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~AZVYDFTN7JQE.2 size=1046950 2024-03-09T14:28:49.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.583+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=AZVYDFTN7JQE tag=SDU33SRNI0Q7 type=write size=4192678 2024-03-09T14:28:49.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.584+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~HF284QHU0WAQ.0 size=113771 2024-03-09T14:28:49.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.586+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=HF284QHU0WAQ tag=R039S2NEZOH3 type=write size=1162347 2024-03-09T14:28:49.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.588+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~WHQGCYMK39RJ.0 size=1048576 2024-03-09T14:28:49.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.589+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~WHQGCYMK39RJ.1 size=1048576 2024-03-09T14:28:49.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.590+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~WHQGCYMK39RJ.2 size=280332 2024-03-09T14:28:49.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.590+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=WHQGCYMK39RJ tag=F6NZUSETRID7 type=write size=3426060 2024-03-09T14:28:49.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.591+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=UKO7SYILGPEY type=del 2024-03-09T14:28:49.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.593+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~046KKKP7NIKO.0 size=693999 2024-03-09T14:28:49.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.593+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=046KKKP7NIKO tag=PZ19WI0J6VX6 type=write size=1742575 2024-03-09T14:28:49.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.594+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=OBOC33LG6A07 type=del size=1913328 2024-03-09T14:28:49.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.596+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=1ZUSFEE0QRGJ type=del size=1194031 2024-03-09T14:28:49.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.598+0000 7f1c6444c780 1 < suggested remove operation key=QSMTZR754455 tag=WHURCLALRMGZ type=del 2024-03-09T14:28:49.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.599+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=IT8N72P6TA08 type=del size=2807390 2024-03-09T14:28:49.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.600+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=P6S6U8X222UD type=del 2024-03-09T14:28:49.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.603+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~8R4ADQRGT7L3.0 size=1048576 2024-03-09T14:28:49.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.604+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~8R4ADQRGT7L3.1 size=276622 2024-03-09T14:28:49.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.604+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=8R4ADQRGT7L3 tag=JQV15QSGYE04 type=write size=2373774 2024-03-09T14:28:49.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.605+0000 7f1c6444c780 1 < completed write operation key=MOVS6ZMK708G tag=PDEZUGKGEBU3 type=write size=398183 2024-03-09T14:28:49.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.606+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=A7519PRL5JYI type=del size=2979903 2024-03-09T14:28:49.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.607+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~3WG71REQ7PV2.0 size=1048576 2024-03-09T14:28:49.608 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.608+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~3WG71REQ7PV2.1 size=1048576 2024-03-09T14:28:49.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.609+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~3WG71REQ7PV2.2 size=432328 2024-03-09T14:28:49.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.611+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=3WG71REQ7PV2 tag=HSIX3BRSE3TW type=write size=3578056 2024-03-09T14:28:49.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.613+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~6S3UJVNNRD6V.0 size=916681 2024-03-09T14:28:49.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.613+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=6S3UJVNNRD6V tag=J3YF5B2VW2BB type=write size=1965257 2024-03-09T14:28:49.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.614+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~HAQ1PD5BB3S2.0 size=72042 2024-03-09T14:28:49.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.616+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=HAQ1PD5BB3S2 tag=52KK68HMJS1N type=write size=1120618 2024-03-09T14:28:49.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.618+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=0A22L8YN6E1X type=del size=253834 2024-03-09T14:28:49.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.619+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~Q2316E3GFKVI.0 size=480364 2024-03-09T14:28:49.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.620+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=Q2316E3GFKVI tag=O91VFP040C3O type=write size=1528940 2024-03-09T14:28:49.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.622+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=3X65XWEEUA1D type=write size=755666 2024-03-09T14:28:49.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.624+0000 7f1c6444c780 1 < suggested update operation key=PBM4ICXZ2497 tag=UVU2CPJ47D3N type=del size=2713523 2024-03-09T14:28:49.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.625+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=M55EWB0RK2UX type=del size=2542852 2024-03-09T14:28:49.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.626+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=X59QVKO7C1IS type=del 2024-03-09T14:28:49.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.627+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=4JW5YQKY5UYL type=del size=1287944 2024-03-09T14:28:49.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.629+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~QUHB5XA827EL.0 size=1048576 2024-03-09T14:28:49.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.630+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~QUHB5XA827EL.1 size=1048576 2024-03-09T14:28:49.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.631+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~QUHB5XA827EL.2 size=956343 2024-03-09T14:28:49.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.633+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=QUHB5XA827EL tag=Q3JMQDC50M00 type=write size=4102071 2024-03-09T14:28:49.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.635+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~KRGL99MDN89U.0 size=102516 2024-03-09T14:28:49.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.635+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=KRGL99MDN89U tag=W4UZA2W31M0G type=write size=1151092 2024-03-09T14:28:49.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.636+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=P5ATX1BU8NCD type=del 2024-03-09T14:28:49.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.637+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=060OLJ31CVDV type=write size=157686 2024-03-09T14:28:49.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.638+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~KKLJV7CI4YQS.0 size=535396 2024-03-09T14:28:49.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.641+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=KKLJV7CI4YQS tag=YYD74GC4H0P8 type=write size=1583972 2024-03-09T14:28:49.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.642+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=BM0OLYLDSBFA type=write size=616579 2024-03-09T14:28:49.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.643+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=F5UJI5TPAOBN type=del 2024-03-09T14:28:49.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.645+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~SPCYWNPOFT3D.0 size=1048576 2024-03-09T14:28:49.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.646+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~SPCYWNPOFT3D.1 size=221474 2024-03-09T14:28:49.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.646+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=SPCYWNPOFT3D tag=0RY93QDY8B4C type=write size=2318626 2024-03-09T14:28:49.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.647+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~AZVYDFTN7JQE.0 size=1048576 2024-03-09T14:28:49.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.648+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~AZVYDFTN7JQE.1 size=1048576 2024-03-09T14:28:49.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.649+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~AZVYDFTN7JQE.2 size=1046950 2024-03-09T14:28:49.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.651+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=AZVYDFTN7JQE tag=SDU33SRNI0Q7 type=write size=4192678 2024-03-09T14:28:49.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.652+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=UIVBE94BAXFK type=del size=1732968 2024-03-09T14:28:49.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.653+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~WHQGCYMK39RJ.0 size=1048576 2024-03-09T14:28:49.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.654+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~WHQGCYMK39RJ.1 size=1048576 2024-03-09T14:28:49.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.655+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~WHQGCYMK39RJ.2 size=280332 2024-03-09T14:28:49.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.657+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=WHQGCYMK39RJ tag=F6NZUSETRID7 type=write size=3426060 2024-03-09T14:28:49.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.660+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~AIXWIJRF4GK4.0 size=1048576 2024-03-09T14:28:49.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.661+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~AIXWIJRF4GK4.1 size=145337 2024-03-09T14:28:49.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.661+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=AIXWIJRF4GK4 tag=BGRTXUJV05TA type=write size=2242489 2024-03-09T14:28:49.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.662+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~046KKKP7NIKO.0 size=693999 2024-03-09T14:28:49.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.664+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=046KKKP7NIKO tag=PZ19WI0J6VX6 type=write size=1742575 2024-03-09T14:28:49.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.666+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~2L8M012PTJAV.0 size=820071 2024-03-09T14:28:49.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.666+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=2L8M012PTJAV tag=ZKVR44K1JSKZ type=write size=1868647 2024-03-09T14:28:49.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.669+0000 7f1c6444c780 1 < suggested remove operation key=Z34QOCZB3DFX tag=1ZUSFEE0QRGJ type=del 2024-03-09T14:28:49.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.670+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=81CRGK07FQVP type=del size=2287642 2024-03-09T14:28:49.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.671+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=IT8N72P6TA08 type=del 2024-03-09T14:28:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.673+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~ED82XF8RNFAZ.0 size=1048576 2024-03-09T14:28:49.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.674+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~ED82XF8RNFAZ.1 size=1048576 2024-03-09T14:28:49.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.675+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~ED82XF8RNFAZ.2 size=514771 2024-03-09T14:28:49.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.675+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=ED82XF8RNFAZ tag=HUKQNKWQ3J6Z type=write size=3660499 2024-03-09T14:28:49.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.676+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~8R4ADQRGT7L3.0 size=1048576 2024-03-09T14:28:49.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.677+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~8R4ADQRGT7L3.1 size=276622 2024-03-09T14:28:49.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.679+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=8R4ADQRGT7L3 tag=JQV15QSGYE04 type=write size=2373774 2024-03-09T14:28:49.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.681+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~CQYY52664E3L.0 size=1048576 2024-03-09T14:28:49.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.682+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~CQYY52664E3L.1 size=1048576 2024-03-09T14:28:49.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.683+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~CQYY52664E3L.2 size=390974 2024-03-09T14:28:49.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.683+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=CQYY52664E3L tag=D0QLOX79KGAK type=write size=3536702 2024-03-09T14:28:49.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.685+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=A7519PRL5JYI type=del 2024-03-09T14:28:49.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.686+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=CXGLEVILT3XA type=del size=1332906 2024-03-09T14:28:49.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.688+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~6S3UJVNNRD6V.0 size=916681 2024-03-09T14:28:49.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.690+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=6S3UJVNNRD6V tag=J3YF5B2VW2BB type=write size=1965257 2024-03-09T14:28:49.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.691+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=ZHBLPEG0ZUNL type=write size=579324 2024-03-09T14:28:49.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.692+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=0A22L8YN6E1X type=del 2024-03-09T14:28:49.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.693+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=G176KLUFV7ZT type=write size=336758 2024-03-09T14:28:49.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.695+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=3X65XWEEUA1D type=write size=755666 2024-03-09T14:28:49.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.696+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=ZB6F5QJMYZQ0 type=del size=466062 2024-03-09T14:28:49.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.697+0000 7f1c6444c780 -1 < failed to complete operation key=Z34QOCZB3DFX tag=M55EWB0RK2UX type=del size=2542852: (22) Invalid argument 2024-03-09T14:28:49.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.698+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=WLU013RD4Q5G type=del size=171139 2024-03-09T14:28:49.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.699+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=4JW5YQKY5UYL type=del 2024-03-09T14:28:49.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.700+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=N84KYM70VFAW type=write size=657121 2024-03-09T14:28:49.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.701+0000 7f1c6444c780 1 < canceled part key=_multipart_QSMTZR754455.2~KRGL99MDN89U.0 size=102516 2024-03-09T14:28:49.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.702+0000 7f1c6444c780 1 < canceled multipart upload key=QSMTZR754455 upload=KRGL99MDN89U tag=W4UZA2W31M0G type=write size=1151092 2024-03-09T14:28:49.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.704+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=21COF80KEPWH type=del size=1468865 2024-03-09T14:28:49.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.705+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=060OLJ31CVDV type=write size=157686 2024-03-09T14:28:49.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.706+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=4SDHITAODU2Z type=del size=3008017 2024-03-09T14:28:49.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.707+0000 7f1c6444c780 1 < completed write operation key=71FSR1CHFBO0 tag=BM0OLYLDSBFA type=write size=616579 2024-03-09T14:28:49.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.708+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=7KIENTCDZEDC type=del size=3102 2024-03-09T14:28:49.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.709+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~SPCYWNPOFT3D.0 size=1048576 2024-03-09T14:28:49.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.710+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~SPCYWNPOFT3D.1 size=221474 2024-03-09T14:28:49.712 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.712+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=SPCYWNPOFT3D tag=0RY93QDY8B4C type=write size=2318626 2024-03-09T14:28:49.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.713+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=IYDW3GGM6WD2 type=write size=289559 2024-03-09T14:28:49.714 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.714+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=UIVBE94BAXFK type=del size=1732968 2024-03-09T14:28:49.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.716+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~JE1YJKOQ2Z4U.0 size=1048576 2024-03-09T14:28:49.717 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.717+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~JE1YJKOQ2Z4U.1 size=749683 2024-03-09T14:28:49.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.717+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=JE1YJKOQ2Z4U tag=P2QT9WTNFGJH type=write size=2846835 2024-03-09T14:28:49.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.718+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~AIXWIJRF4GK4.0 size=1048576 2024-03-09T14:28:49.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.719+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~AIXWIJRF4GK4.1 size=145337 2024-03-09T14:28:49.721 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.721+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=AIXWIJRF4GK4 tag=BGRTXUJV05TA type=write size=2242489 2024-03-09T14:28:49.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.723+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=5XZH9TFDDIB9 type=write size=54564 2024-03-09T14:28:49.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.724+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~2L8M012PTJAV.0 size=820071 2024-03-09T14:28:49.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.726+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=2L8M012PTJAV tag=ZKVR44K1JSKZ type=write size=1868647 2024-03-09T14:28:49.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.727+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=6C0BSZFMM9P3 type=del size=2371576 2024-03-09T14:28:49.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.728+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=81CRGK07FQVP type=del 2024-03-09T14:28:49.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.730+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~IKVHX1PV7GF3.0 size=1048576 2024-03-09T14:28:49.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.731+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~IKVHX1PV7GF3.1 size=152715 2024-03-09T14:28:49.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.731+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=IKVHX1PV7GF3 tag=SXIKW3SO6CQR type=write size=2249867 2024-03-09T14:28:49.732 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.732+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~ED82XF8RNFAZ.0 size=1048576 2024-03-09T14:28:49.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.733+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~ED82XF8RNFAZ.1 size=1048576 2024-03-09T14:28:49.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.734+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~ED82XF8RNFAZ.2 size=514771 2024-03-09T14:28:49.736 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.736+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=ED82XF8RNFAZ tag=HUKQNKWQ3J6Z type=write size=3660499 2024-03-09T14:28:49.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.737+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=THLGC4MV2TL1 type=del size=1400938 2024-03-09T14:28:49.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.738+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~CQYY52664E3L.0 size=1048576 2024-03-09T14:28:49.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.739+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~CQYY52664E3L.1 size=1048576 2024-03-09T14:28:49.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.740+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~CQYY52664E3L.2 size=390974 2024-03-09T14:28:49.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.742+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=CQYY52664E3L tag=D0QLOX79KGAK type=write size=3536702 2024-03-09T14:28:49.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.743+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=XAS4ULOUOCYV type=write size=188682 2024-03-09T14:28:49.744 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.744+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=CXGLEVILT3XA type=del 2024-03-09T14:28:49.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.746+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5F9F5M21Q7WG.0 size=1048576 2024-03-09T14:28:49.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.747+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5F9F5M21Q7WG.1 size=1048576 2024-03-09T14:28:49.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.748+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5F9F5M21Q7WG.2 size=646251 2024-03-09T14:28:49.748 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.748+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=5F9F5M21Q7WG tag=N331T2LVDXSP type=write size=3791979 2024-03-09T14:28:49.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.750+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=ZHBLPEG0ZUNL type=write size=579324 2024-03-09T14:28:49.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.751+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=BAHGK40A1UM4 type=del size=314282 2024-03-09T14:28:49.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.753+0000 7f1c6444c780 1 < completed write operation key=MX3X6ILR7J8N tag=G176KLUFV7ZT type=write size=336758 2024-03-09T14:28:49.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.755+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~INQ2ZW1EGM3X.0 size=1048576 2024-03-09T14:28:49.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.756+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~INQ2ZW1EGM3X.1 size=1048576 2024-03-09T14:28:49.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.756+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~INQ2ZW1EGM3X.2 size=1023800 2024-03-09T14:28:49.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.756+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=INQ2ZW1EGM3X tag=VUFIR61L7YB6 type=write size=4169528 2024-03-09T14:28:49.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.758+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=ZB6F5QJMYZQ0 type=del size=466062 2024-03-09T14:28:49.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.759+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=IGPR5GTGI8ZN type=del size=1345428 2024-03-09T14:28:49.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.760+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=WLU013RD4Q5G type=del 2024-03-09T14:28:49.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.762+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~4KNCVSU6C393.0 size=1048576 2024-03-09T14:28:49.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.763+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~4KNCVSU6C393.1 size=1048576 2024-03-09T14:28:49.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.764+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~4KNCVSU6C393.2 size=554649 2024-03-09T14:28:49.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.764+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=4KNCVSU6C393 tag=ZJ9A6WPRS8RM type=write size=3700377 2024-03-09T14:28:49.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.765+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=N84KYM70VFAW type=write size=657121 2024-03-09T14:28:49.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.768+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~VT9Y4IAXC4PM.0 size=1048576 2024-03-09T14:28:49.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.769+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~VT9Y4IAXC4PM.1 size=963345 2024-03-09T14:28:49.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.769+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=VT9Y4IAXC4PM tag=9KF3N7TK4V0J type=write size=3060497 2024-03-09T14:28:49.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.770+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=21COF80KEPWH type=del 2024-03-09T14:28:49.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.771+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=C21BGNUQ06AX type=del size=1428697 2024-03-09T14:28:49.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.772+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=4SDHITAODU2Z type=del 2024-03-09T14:28:49.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.774+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~5II8BT5SGCOH.0 size=257790 2024-03-09T14:28:49.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.774+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=5II8BT5SGCOH tag=7LBF9P38DEUZ type=write size=1306366 2024-03-09T14:28:49.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.775+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=7KIENTCDZEDC type=del 2024-03-09T14:28:49.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.776+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=GRJKZKES6NE8 type=del size=1183423 2024-03-09T14:28:49.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.778+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=IYDW3GGM6WD2 type=write size=289559 2024-03-09T14:28:49.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.779+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=BVOLMY15CTL7 type=write size=551663 2024-03-09T14:28:49.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.780+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~JE1YJKOQ2Z4U.0 size=1048576 2024-03-09T14:28:49.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.781+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~JE1YJKOQ2Z4U.1 size=749683 2024-03-09T14:28:49.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.783+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=JE1YJKOQ2Z4U tag=P2QT9WTNFGJH type=write size=2846835 2024-03-09T14:28:49.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.784+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=NJ458KQQMQWU type=write size=43301 2024-03-09T14:28:49.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.786+0000 7f1c6444c780 1 < suggested update operation key=PBM4ICXZ2497 tag=5XZH9TFDDIB9 type=write size=54564 2024-03-09T14:28:49.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.787+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=G4EMUO3Q7H5H type=write size=1018596 2024-03-09T14:28:49.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.788+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=6C0BSZFMM9P3 type=del 2024-03-09T14:28:49.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.790+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~F1FZSE6RL5D6.0 size=1048576 2024-03-09T14:28:49.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.791+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~F1FZSE6RL5D6.1 size=737742 2024-03-09T14:28:49.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.791+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=F1FZSE6RL5D6 tag=1V0UU164Q8GG type=write size=2834894 2024-03-09T14:28:49.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.792+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~IKVHX1PV7GF3.0 size=1048576 2024-03-09T14:28:49.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.793+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~IKVHX1PV7GF3.1 size=152715 2024-03-09T14:28:49.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.795+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=IKVHX1PV7GF3 tag=SXIKW3SO6CQR type=write size=2249867 2024-03-09T14:28:49.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.797+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~ZFT1UOZXWR9F.0 size=941533 2024-03-09T14:28:49.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.797+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=ZFT1UOZXWR9F tag=89HZ1X379PBV type=write size=1990109 2024-03-09T14:28:49.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.798+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=THLGC4MV2TL1 type=del 2024-03-09T14:28:49.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.800+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~FR91DFZ64WFB.0 size=1048576 2024-03-09T14:28:49.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.801+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~FR91DFZ64WFB.1 size=1048576 2024-03-09T14:28:49.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.802+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~FR91DFZ64WFB.2 size=983345 2024-03-09T14:28:49.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.802+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=FR91DFZ64WFB tag=X3B9VWM14L9H type=write size=4129073 2024-03-09T14:28:49.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.804+0000 7f1c6444c780 1 < suggested remove operation key=Z34QOCZB3DFX tag=XAS4ULOUOCYV type=write 2024-03-09T14:28:49.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.805+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=B7ZG49UQH84A type=del size=604448 2024-03-09T14:28:49.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.807+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5F9F5M21Q7WG.0 size=1048576 2024-03-09T14:28:49.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.808+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5F9F5M21Q7WG.1 size=1048576 2024-03-09T14:28:49.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.809+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5F9F5M21Q7WG.2 size=646251 2024-03-09T14:28:49.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.810+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=5F9F5M21Q7WG tag=N331T2LVDXSP type=write size=3791979 2024-03-09T14:28:49.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.812+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=G9E53XAGY870 type=del size=2593213 2024-03-09T14:28:49.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.813+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=BAHGK40A1UM4 type=del 2024-03-09T14:28:49.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.815+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~9QROZKX92V1E.0 size=1048576 2024-03-09T14:28:49.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.816+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~9QROZKX92V1E.1 size=1048576 2024-03-09T14:28:49.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.816+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~9QROZKX92V1E.2 size=229974 2024-03-09T14:28:49.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.816+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=9QROZKX92V1E tag=LPE7Y6BW3C42 type=write size=3375702 2024-03-09T14:28:49.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.818+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~INQ2ZW1EGM3X.0 size=1048576 2024-03-09T14:28:49.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.819+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~INQ2ZW1EGM3X.1 size=1048576 2024-03-09T14:28:49.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.819+0000 7f1c6444c780 1 < canceled part key=_multipart_IBVEN2JEB49N.2~INQ2ZW1EGM3X.2 size=1023800 2024-03-09T14:28:49.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.821+0000 7f1c6444c780 1 < canceled multipart upload key=IBVEN2JEB49N upload=INQ2ZW1EGM3X tag=VUFIR61L7YB6 type=write size=4169528 2024-03-09T14:28:49.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.823+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~R3BCTENVPZ4G.0 size=1048576 2024-03-09T14:28:49.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.824+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~R3BCTENVPZ4G.1 size=65744 2024-03-09T14:28:49.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.824+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=R3BCTENVPZ4G tag=GW4JCU0ZYVFH type=write size=2162896 2024-03-09T14:28:49.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.825+0000 7f1c6444c780 1 < canceled operation key=V05XJ56M53T8 tag=IGPR5GTGI8ZN type=del size=1345428 2024-03-09T14:28:49.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.826+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=SF8AHPHCKJOA type=write size=513540 2024-03-09T14:28:49.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.827+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~4KNCVSU6C393.0 size=1048576 2024-03-09T14:28:49.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.828+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~4KNCVSU6C393.1 size=1048576 2024-03-09T14:28:49.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.829+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~4KNCVSU6C393.2 size=554649 2024-03-09T14:28:49.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.831+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=4KNCVSU6C393 tag=ZJ9A6WPRS8RM type=write size=3700377 2024-03-09T14:28:49.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.833+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~19ROSEJZD3NO.0 size=1048576 2024-03-09T14:28:49.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.834+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~19ROSEJZD3NO.1 size=645757 2024-03-09T14:28:49.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.834+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=19ROSEJZD3NO tag=5WM0G80QFAV8 type=write size=2742909 2024-03-09T14:28:49.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.835+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~VT9Y4IAXC4PM.0 size=1048576 2024-03-09T14:28:49.836 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.836+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~VT9Y4IAXC4PM.1 size=963345 2024-03-09T14:28:49.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.838+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=VT9Y4IAXC4PM tag=9KF3N7TK4V0J type=write size=3060497 2024-03-09T14:28:49.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.839+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=RJA77AN0SFI8 type=del size=1732957 2024-03-09T14:28:49.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.841+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=C21BGNUQ06AX type=del 2024-03-09T14:28:49.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.842+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=OB0OF7MP3AN9 type=del size=1575027 2024-03-09T14:28:49.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.843+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~5II8BT5SGCOH.0 size=257790 2024-03-09T14:28:49.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.845+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=5II8BT5SGCOH tag=7LBF9P38DEUZ type=write size=1306366 2024-03-09T14:28:49.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.846+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=WPLX5150EY58 type=del size=1825977 2024-03-09T14:28:49.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.847+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=GRJKZKES6NE8 type=del 2024-03-09T14:28:49.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.849+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=FO0GUU2LP4WM type=del size=2015191 2024-03-09T14:28:49.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.850+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=BVOLMY15CTL7 type=write size=551663 2024-03-09T14:28:49.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.852+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~2105RII1C67U.0 size=1048576 2024-03-09T14:28:49.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.853+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~2105RII1C67U.1 size=591418 2024-03-09T14:28:49.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.853+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=2105RII1C67U tag=310CKJQ77OXN type=write size=2688570 2024-03-09T14:28:49.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.854+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=NJ458KQQMQWU type=write size=43301 2024-03-09T14:28:49.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.855+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=600ISVOPUQWS type=write size=217341 2024-03-09T14:28:49.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.857+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=G4EMUO3Q7H5H type=write 2024-03-09T14:28:49.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.858+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=8LXBC22HJ1A3 type=del size=1612851 2024-03-09T14:28:49.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.860+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~F1FZSE6RL5D6.0 size=1048576 2024-03-09T14:28:49.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.861+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~F1FZSE6RL5D6.1 size=737742 2024-03-09T14:28:49.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.862+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=F1FZSE6RL5D6 tag=1V0UU164Q8GG type=write size=2834894 2024-03-09T14:28:49.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.864+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=T8EAALPEEEVQ type=del size=1780206 2024-03-09T14:28:49.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.865+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~ZFT1UOZXWR9F.0 size=941533 2024-03-09T14:28:49.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.867+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=ZFT1UOZXWR9F tag=89HZ1X379PBV type=write size=1990109 2024-03-09T14:28:49.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.868+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=7KD5U711XW7Y type=del size=522220 2024-03-09T14:28:49.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.869+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~FR91DFZ64WFB.0 size=1048576 2024-03-09T14:28:49.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.870+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~FR91DFZ64WFB.1 size=1048576 2024-03-09T14:28:49.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.871+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~FR91DFZ64WFB.2 size=983345 2024-03-09T14:28:49.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.874+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=FR91DFZ64WFB tag=X3B9VWM14L9H type=write size=4129073 2024-03-09T14:28:49.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.876+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~F8JOLXR1MBJ9.0 size=1048576 2024-03-09T14:28:49.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.877+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~F8JOLXR1MBJ9.1 size=1048576 2024-03-09T14:28:49.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.878+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~F8JOLXR1MBJ9.2 size=331332 2024-03-09T14:28:49.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.878+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=F8JOLXR1MBJ9 tag=N4NP62D1XJAW type=write size=3477060 2024-03-09T14:28:49.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.879+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=B7ZG49UQH84A type=del 2024-03-09T14:28:49.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.881+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~PEL20KOGHVQZ.0 size=718478 2024-03-09T14:28:49.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.881+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=PEL20KOGHVQZ tag=DJB7ZPSEICA8 type=write size=1767054 2024-03-09T14:28:49.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.882+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=G9E53XAGY870 type=del 2024-03-09T14:28:49.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.883+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=4GAGSWGCGHT9 type=del size=1332890 2024-03-09T14:28:49.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.884+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~9QROZKX92V1E.0 size=1048576 2024-03-09T14:28:49.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.885+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~9QROZKX92V1E.1 size=1048576 2024-03-09T14:28:49.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.886+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~9QROZKX92V1E.2 size=229974 2024-03-09T14:28:49.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.888+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=9QROZKX92V1E tag=LPE7Y6BW3C42 type=write size=3375702 2024-03-09T14:28:49.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.889+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=T811KFET110Z type=del size=2093617 2024-03-09T14:28:49.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.890+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~R3BCTENVPZ4G.0 size=1048576 2024-03-09T14:28:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.891+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~R3BCTENVPZ4G.1 size=65744 2024-03-09T14:28:49.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.893+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=R3BCTENVPZ4G tag=GW4JCU0ZYVFH type=write size=2162896 2024-03-09T14:28:49.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.894+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=3PTCSXL02P9P type=del size=3634481 2024-03-09T14:28:49.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.896+0000 7f1c6444c780 1 < suggested remove operation key=SGHNHOCYPM38 tag=SF8AHPHCKJOA type=write 2024-03-09T14:28:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.898+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~89P25W0DEY3Z.0 size=1048576 2024-03-09T14:28:49.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.899+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~89P25W0DEY3Z.1 size=814929 2024-03-09T14:28:49.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.899+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=89P25W0DEY3Z tag=XUI6Z74X6Y5S type=write size=2912081 2024-03-09T14:28:49.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.900+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~19ROSEJZD3NO.0 size=1048576 2024-03-09T14:28:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.901+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~19ROSEJZD3NO.1 size=645757 2024-03-09T14:28:49.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.904+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=19ROSEJZD3NO tag=5WM0G80QFAV8 type=write size=2742909 2024-03-09T14:28:49.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.905+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=SUAW2ALN222F type=write size=657112 2024-03-09T14:28:49.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.906+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=RJA77AN0SFI8 type=del 2024-03-09T14:28:49.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.907+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=02TOV3G8CLRI type=write size=205553 2024-03-09T14:28:49.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.909+0000 7f1c6444c780 -1 < failed to complete operation key=WMO6LTCMVXD2 tag=OB0OF7MP3AN9 type=del size=1575027: (22) Invalid argument 2024-03-09T14:28:49.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.911+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~WPYFFIKHVXB1.0 size=489380 2024-03-09T14:28:49.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.911+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=WPYFFIKHVXB1 tag=KKTL1QB4FGOE type=write size=1537956 2024-03-09T14:28:49.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.912+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=WPLX5150EY58 type=del 2024-03-09T14:28:49.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.913+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=NXC4WWYLOJED type=del size=981580 2024-03-09T14:28:49.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.914+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=FO0GUU2LP4WM type=del 2024-03-09T14:28:49.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.915+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=79185O3MICT0 type=write size=313910 2024-03-09T14:28:49.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.917+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~2105RII1C67U.0 size=1048576 2024-03-09T14:28:49.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.917+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~2105RII1C67U.1 size=591418 2024-03-09T14:28:49.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.919+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=2105RII1C67U tag=310CKJQ77OXN type=write size=2688570 2024-03-09T14:28:49.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.921+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~3QUD7JK2FTAO.0 size=1048576 2024-03-09T14:28:49.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.922+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~3QUD7JK2FTAO.1 size=1048576 2024-03-09T14:28:49.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.923+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~3QUD7JK2FTAO.2 size=171478 2024-03-09T14:28:49.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.923+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=3QUD7JK2FTAO tag=LZCV3W1JLRT6 type=write size=3317206 2024-03-09T14:28:49.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.924+0000 7f1c6444c780 -1 < failed to complete operation key=SGHNHOCYPM38 tag=600ISVOPUQWS type=write size=217341: (22) Invalid argument 2024-03-09T14:28:49.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.925+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=8OBZW7R4W86F type=write size=1018039 2024-03-09T14:28:49.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.927+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=8LXBC22HJ1A3 type=del 2024-03-09T14:28:49.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.928+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=8BTDPPOA1MGA type=del size=271955 2024-03-09T14:28:49.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.929+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=T8EAALPEEEVQ type=del 2024-03-09T14:28:49.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.930+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=IU13SBHT4FIV type=del size=796252 2024-03-09T14:28:49.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.932+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=7KD5U711XW7Y type=del 2024-03-09T14:28:49.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.933+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=54WVS9ZXSKIQ type=del size=1110323 2024-03-09T14:28:49.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.934+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~F8JOLXR1MBJ9.0 size=1048576 2024-03-09T14:28:49.935 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.935+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~F8JOLXR1MBJ9.1 size=1048576 2024-03-09T14:28:49.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.936+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~F8JOLXR1MBJ9.2 size=331332 2024-03-09T14:28:49.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.938+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=F8JOLXR1MBJ9 tag=N4NP62D1XJAW type=write size=3477060 2024-03-09T14:28:49.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.939+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=U1770CHLTAO5 type=del size=2787734 2024-03-09T14:28:49.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.940+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~PEL20KOGHVQZ.0 size=718478 2024-03-09T14:28:49.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.942+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=PEL20KOGHVQZ tag=DJB7ZPSEICA8 type=write size=1767054 2024-03-09T14:28:49.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.944+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~3JT9HVJUZ6XX.0 size=433891 2024-03-09T14:28:49.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.944+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=3JT9HVJUZ6XX tag=499MV4Q323PW type=write size=1482467 2024-03-09T14:28:49.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.945+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=4GAGSWGCGHT9 type=del 2024-03-09T14:28:49.946 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.946+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=4U246UNSA6VM type=del size=2203204 2024-03-09T14:28:49.948 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.948+0000 7f1c6444c780 1 < suggested remove operation key=26VE2HJPD0FX tag=T811KFET110Z type=del 2024-03-09T14:28:49.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.951+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~IHZZZYHHP5SY.0 size=1048576 2024-03-09T14:28:49.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.952+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~IHZZZYHHP5SY.1 size=819732 2024-03-09T14:28:49.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.952+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=IHZZZYHHP5SY tag=G9PGQVJH5BXJ type=write size=2916884 2024-03-09T14:28:49.953 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.953+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=3PTCSXL02P9P type=del 2024-03-09T14:28:49.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.954+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=AURA3O7SNFLH type=del size=3248120 2024-03-09T14:28:49.955 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.955+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~89P25W0DEY3Z.0 size=1048576 2024-03-09T14:28:49.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.956+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~89P25W0DEY3Z.1 size=814929 2024-03-09T14:28:49.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.958+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=89P25W0DEY3Z tag=XUI6Z74X6Y5S type=write size=2912081 2024-03-09T14:28:49.960 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.960+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~RALP7ND3LBT1.0 size=582991 2024-03-09T14:28:49.960 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.960+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=RALP7ND3LBT1 tag=L7EYWKHPMAJC type=write size=1631567 2024-03-09T14:28:49.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.961+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=SUAW2ALN222F type=write size=657112 2024-03-09T14:28:49.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.963+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~X2VKEX8Q9GQ8.0 size=1048576 2024-03-09T14:28:49.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.964+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~X2VKEX8Q9GQ8.1 size=1048576 2024-03-09T14:28:49.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.965+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~X2VKEX8Q9GQ8.2 size=179558 2024-03-09T14:28:49.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.965+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=X2VKEX8Q9GQ8 tag=29E084EK46J7 type=write size=3325286 2024-03-09T14:28:49.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.966+0000 7f1c6444c780 1 < completed write operation key=QSMTZR754455 tag=02TOV3G8CLRI type=write size=205553 2024-03-09T14:28:49.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.968+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=RSZ0MNZQ6ULY type=write size=999063 2024-03-09T14:28:49.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.969+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~WPYFFIKHVXB1.0 size=489380 2024-03-09T14:28:49.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.971+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=WPYFFIKHVXB1 tag=KKTL1QB4FGOE type=write size=1537956 2024-03-09T14:28:49.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.972+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~CAJKHIBWCWE1.0 size=114682 2024-03-09T14:28:49.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.972+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=CAJKHIBWCWE1 tag=UPQ0XUYA749C type=write size=1163258 2024-03-09T14:28:49.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.975+0000 7f1c6444c780 1 < suggested update operation key=YECG84AJ5IK2 tag=NXC4WWYLOJED type=del size=981580 2024-03-09T14:28:49.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.976+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=PYD4BDPQU32R type=del size=1475643 2024-03-09T14:28:49.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.977+0000 7f1c6444c780 1 < completed write operation key=YK7ENO4UAB2M tag=79185O3MICT0 type=write size=313910 2024-03-09T14:28:49.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.978+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=O97OGQH4VTII type=del size=776815 2024-03-09T14:28:49.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.980+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~3QUD7JK2FTAO.0 size=1048576 2024-03-09T14:28:49.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.981+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~3QUD7JK2FTAO.1 size=1048576 2024-03-09T14:28:49.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.982+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~3QUD7JK2FTAO.2 size=171478 2024-03-09T14:28:49.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.984+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=3QUD7JK2FTAO tag=LZCV3W1JLRT6 type=write size=3317206 2024-03-09T14:28:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.986+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~YFJEJ3U0JGF7.0 size=396928 2024-03-09T14:28:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.986+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=YFJEJ3U0JGF7 tag=AU5EPOVSJVU7 type=write size=1445504 2024-03-09T14:28:49.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.987+0000 7f1c6444c780 1 < completed write operation key=KNOEGKSERB6Z tag=8OBZW7R4W86F type=write size=1018039 2024-03-09T14:28:49.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.989+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~9BNHRXC0BVAF.0 size=1048576 2024-03-09T14:28:49.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.990+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~9BNHRXC0BVAF.1 size=736286 2024-03-09T14:28:49.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.990+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=9BNHRXC0BVAF tag=GACZ1DK3KVGC type=write size=2833438 2024-03-09T14:28:49.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.991+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=8BTDPPOA1MGA type=del 2024-03-09T14:28:49.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.993+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=ES0W0I8PMRMF type=del size=2694133 2024-03-09T14:28:49.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.994+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=IU13SBHT4FIV type=del 2024-03-09T14:28:49.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.996+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~XUFN3UO9UALH.0 size=1048576 2024-03-09T14:28:49.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.997+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~XUFN3UO9UALH.1 size=1048576 2024-03-09T14:28:49.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.997+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~XUFN3UO9UALH.2 size=210234 2024-03-09T14:28:49.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.997+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=XUFN3UO9UALH tag=2D4W91RXJWBV type=write size=3355962 2024-03-09T14:28:49.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:49.999+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=54WVS9ZXSKIQ type=del 2024-03-09T14:28:50.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.000+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=9V4F2EZ3I4ME type=del size=1412094 2024-03-09T14:28:50.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.001+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=U1770CHLTAO5 type=del 2024-03-09T14:28:50.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.002+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=ZT18ICBITXNB type=del size=4066205 2024-03-09T14:28:50.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.003+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~3JT9HVJUZ6XX.0 size=433891 2024-03-09T14:28:50.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.005+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=3JT9HVJUZ6XX tag=499MV4Q323PW type=write size=1482467 2024-03-09T14:28:50.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.006+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=LXPZ6ON1DGP8 type=del size=253337 2024-03-09T14:28:50.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.008+0000 7f1c6444c780 1 < suggested update operation key=35Y98D5U0M8O tag=4U246UNSA6VM type=del size=2203204 2024-03-09T14:28:50.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.009+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=7VWCLEB2A2OR type=del size=793831 2024-03-09T14:28:50.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.011+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~IHZZZYHHP5SY.0 size=1048576 2024-03-09T14:28:50.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.012+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~IHZZZYHHP5SY.1 size=819732 2024-03-09T14:28:50.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.013+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=IHZZZYHHP5SY tag=G9PGQVJH5BXJ type=write size=2916884 2024-03-09T14:28:50.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.015+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~K951AY74Q945.0 size=1048576 2024-03-09T14:28:50.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.016+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~K951AY74Q945.1 size=631289 2024-03-09T14:28:50.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.016+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=K951AY74Q945 tag=0H3DIBFB5GKL type=write size=2728441 2024-03-09T14:28:50.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.017+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=AURA3O7SNFLH type=del 2024-03-09T14:28:50.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.020+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~9G8O7CZDZ1FB.0 size=1000299 2024-03-09T14:28:50.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.020+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=9G8O7CZDZ1FB tag=DOGHUW9KXAOR type=write size=2048875 2024-03-09T14:28:50.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.020+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~RALP7ND3LBT1.0 size=582991 2024-03-09T14:28:50.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.022+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=RALP7ND3LBT1 tag=L7EYWKHPMAJC type=write size=1631567 2024-03-09T14:28:50.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.023+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=Q4EP5TH9H294 type=del size=1319577 2024-03-09T14:28:50.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.024+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~X2VKEX8Q9GQ8.0 size=1048576 2024-03-09T14:28:50.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.025+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~X2VKEX8Q9GQ8.1 size=1048576 2024-03-09T14:28:50.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.026+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~X2VKEX8Q9GQ8.2 size=179558 2024-03-09T14:28:50.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.028+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=X2VKEX8Q9GQ8 tag=29E084EK46J7 type=write size=3325286 2024-03-09T14:28:50.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.029+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=B341L0E8KGIL type=del size=3349747 2024-03-09T14:28:50.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.030+0000 7f1c6444c780 1 < completed write operation key=MOVS6ZMK708G tag=RSZ0MNZQ6ULY type=write size=999063 2024-03-09T14:28:50.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.032+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~N931WKXFESQ8.0 size=1048576 2024-03-09T14:28:50.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.033+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~N931WKXFESQ8.1 size=1048576 2024-03-09T14:28:50.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.034+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~N931WKXFESQ8.2 size=193588 2024-03-09T14:28:50.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.034+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=N931WKXFESQ8 tag=BJV1FCOUCJKI type=write size=3339316 2024-03-09T14:28:50.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.035+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~CAJKHIBWCWE1.0 size=114682 2024-03-09T14:28:50.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.037+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=CAJKHIBWCWE1 tag=UPQ0XUYA749C type=write size=1163258 2024-03-09T14:28:50.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.038+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=SWNAVSSIU8V0 type=del size=616094 2024-03-09T14:28:50.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.039+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=PYD4BDPQU32R type=del 2024-03-09T14:28:50.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.041+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=QGTS0EVIGO3S type=write size=1030931 2024-03-09T14:28:50.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.042+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=O97OGQH4VTII type=del 2024-03-09T14:28:50.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.043+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=O8C5M1O2DSEB type=write size=620408 2024-03-09T14:28:50.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.044+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~YFJEJ3U0JGF7.0 size=396928 2024-03-09T14:28:50.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.046+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=YFJEJ3U0JGF7 tag=AU5EPOVSJVU7 type=write size=1445504 2024-03-09T14:28:50.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.048+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~9AY98DJ81B1F.0 size=1048576 2024-03-09T14:28:50.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.049+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~9AY98DJ81B1F.1 size=687783 2024-03-09T14:28:50.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.049+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=9AY98DJ81B1F tag=0EEVNC0M9U51 type=write size=2784935 2024-03-09T14:28:50.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.050+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~9BNHRXC0BVAF.0 size=1048576 2024-03-09T14:28:50.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.051+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~9BNHRXC0BVAF.1 size=736286 2024-03-09T14:28:50.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.053+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=9BNHRXC0BVAF tag=GACZ1DK3KVGC type=write size=2833438 2024-03-09T14:28:50.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.055+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~FNKF3VVGT33I.0 size=1048576 2024-03-09T14:28:50.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.056+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~FNKF3VVGT33I.1 size=79362 2024-03-09T14:28:50.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.056+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=FNKF3VVGT33I tag=WZ4VEMBG25B7 type=write size=2176514 2024-03-09T14:28:50.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.057+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=ES0W0I8PMRMF type=del 2024-03-09T14:28:50.059 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.059+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=OA966MP34LCF type=del size=591511 2024-03-09T14:28:50.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.060+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~XUFN3UO9UALH.0 size=1048576 2024-03-09T14:28:50.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.061+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~XUFN3UO9UALH.1 size=1048576 2024-03-09T14:28:50.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.062+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~XUFN3UO9UALH.2 size=210234 2024-03-09T14:28:50.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.064+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=XUFN3UO9UALH tag=2D4W91RXJWBV type=write size=3355962 2024-03-09T14:28:50.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.065+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=E3QK30E0UHT1 type=del size=761610 2024-03-09T14:28:50.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.066+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=9V4F2EZ3I4ME type=del 2024-03-09T14:28:50.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.068+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~D4WBXN1T4QJK.0 size=1048576 2024-03-09T14:28:50.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.069+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~D4WBXN1T4QJK.1 size=573813 2024-03-09T14:28:50.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.069+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=D4WBXN1T4QJK tag=7WDWMM7M7QTS type=write size=2670965 2024-03-09T14:28:50.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.070+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=ZT18ICBITXNB type=del 2024-03-09T14:28:50.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.072+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~MW65T927JO2V.0 size=1048576 2024-03-09T14:28:50.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.073+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~MW65T927JO2V.1 size=111300 2024-03-09T14:28:50.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.073+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=MW65T927JO2V tag=H05P6EIY024I type=write size=2208452 2024-03-09T14:28:50.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.075+0000 7f1c6444c780 1 < suggested remove operation key=CVD0EGQUVJYR tag=LXPZ6ON1DGP8 type=del 2024-03-09T14:28:50.077 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.077+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=ZV6D7HTFBW0G type=write size=894769 2024-03-09T14:28:50.078 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.078+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=7VWCLEB2A2OR type=del 2024-03-09T14:28:50.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.079+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=GD2NYFFZVIB1 type=del size=3488136 2024-03-09T14:28:50.079 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.079+0000 7f1c6444c780 1 < canceled part key=_multipart_BAWV7KY6NT8P.2~K951AY74Q945.0 size=1048576 2024-03-09T14:28:50.080 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.080+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~K951AY74Q945.1 size=631289 2024-03-09T14:28:50.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.082+0000 7f1c6444c780 1 < canceled multipart upload key=BAWV7KY6NT8P upload=K951AY74Q945 tag=0H3DIBFB5GKL type=write size=2728441 2024-03-09T14:28:50.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.083+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=64QMDX1NB0VW type=del size=2282150 2024-03-09T14:28:50.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.084+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~9G8O7CZDZ1FB.0 size=1000299 2024-03-09T14:28:50.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.087+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=9G8O7CZDZ1FB tag=DOGHUW9KXAOR type=write size=2048875 2024-03-09T14:28:50.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.089+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~YI9OAMQT64DJ.0 size=1048576 2024-03-09T14:28:50.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.090+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~YI9OAMQT64DJ.1 size=232280 2024-03-09T14:28:50.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.090+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=YI9OAMQT64DJ tag=GCGR9B3IV0AV type=write size=2329432 2024-03-09T14:28:50.091 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.091+0000 7f1c6444c780 1 < canceled operation key=0IHHFQBKKJ0G tag=Q4EP5TH9H294 type=del size=1319577 2024-03-09T14:28:50.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.092+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=W58062RJSUFE type=del size=1554186 2024-03-09T14:28:50.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.094+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=B341L0E8KGIL type=del 2024-03-09T14:28:50.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.095+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=UOL7U6DMNHIV type=del size=2075342 2024-03-09T14:28:50.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.096+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~N931WKXFESQ8.0 size=1048576 2024-03-09T14:28:50.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.097+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~N931WKXFESQ8.1 size=1048576 2024-03-09T14:28:50.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.097+0000 7f1c6444c780 1 < canceled part key=_multipart_V05XJ56M53T8.2~N931WKXFESQ8.2 size=193588 2024-03-09T14:28:50.098 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.098+0000 7f1c6444c780 1 < canceled multipart upload key=V05XJ56M53T8 upload=N931WKXFESQ8 tag=BJV1FCOUCJKI type=write size=3339316 2024-03-09T14:28:50.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.100+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=QMUFMROPOJB6 type=del size=2554954 2024-03-09T14:28:50.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.101+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=SWNAVSSIU8V0 type=del 2024-03-09T14:28:50.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.103+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~BCPWANYQ4V5D.0 size=1048576 2024-03-09T14:28:50.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.103+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~BCPWANYQ4V5D.1 size=1048576 2024-03-09T14:28:50.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.104+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~BCPWANYQ4V5D.2 size=966239 2024-03-09T14:28:50.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.104+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=BCPWANYQ4V5D tag=RM8FLW8GR0WH type=write size=4111967 2024-03-09T14:28:50.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.105+0000 7f1c6444c780 1 < completed write operation key=MX3X6ILR7J8N tag=QGTS0EVIGO3S type=write size=1030931 2024-03-09T14:28:50.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.106+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=KCWS5PF1S74X type=del size=3007749 2024-03-09T14:28:50.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.108+0000 7f1c6444c780 1 < completed write operation key=PBM4ICXZ2497 tag=O8C5M1O2DSEB type=write size=620408 2024-03-09T14:28:50.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.109+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=4PYCMWT1LCIF type=write size=567948 2024-03-09T14:28:50.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.110+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~9AY98DJ81B1F.0 size=1048576 2024-03-09T14:28:50.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.111+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~9AY98DJ81B1F.1 size=687783 2024-03-09T14:28:50.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.113+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=9AY98DJ81B1F tag=0EEVNC0M9U51 type=write size=2784935 2024-03-09T14:28:50.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.115+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~W5LRF3836SZQ.0 size=1048576 2024-03-09T14:28:50.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.116+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~W5LRF3836SZQ.1 size=285004 2024-03-09T14:28:50.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.116+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=W5LRF3836SZQ tag=GGNW8Z2GA2KD type=write size=2382156 2024-03-09T14:28:50.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.117+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~FNKF3VVGT33I.0 size=1048576 2024-03-09T14:28:50.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.118+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~FNKF3VVGT33I.1 size=79362 2024-03-09T14:28:50.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.120+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=FNKF3VVGT33I tag=WZ4VEMBG25B7 type=write size=2176514 2024-03-09T14:28:50.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.121+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=G3EDP3YSQLNL type=del size=2973869 2024-03-09T14:28:50.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.122+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=OA966MP34LCF type=del 2024-03-09T14:28:50.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.123+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=7RQTZ2FOQHV9 type=write size=868847 2024-03-09T14:28:50.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.124+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=E3QK30E0UHT1 type=del 2024-03-09T14:28:50.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.126+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~SUX3XP1D9FRO.0 size=1048576 2024-03-09T14:28:50.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.127+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~SUX3XP1D9FRO.1 size=789231 2024-03-09T14:28:50.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.127+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=SUX3XP1D9FRO tag=MSJX789JUYT0 type=write size=2886383 2024-03-09T14:28:50.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.128+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~D4WBXN1T4QJK.0 size=1048576 2024-03-09T14:28:50.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.129+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~D4WBXN1T4QJK.1 size=573813 2024-03-09T14:28:50.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.131+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=D4WBXN1T4QJK tag=7WDWMM7M7QTS type=write size=2670965 2024-03-09T14:28:50.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.133+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~IVUHD6YMI89D.0 size=1048576 2024-03-09T14:28:50.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.134+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~IVUHD6YMI89D.1 size=1048576 2024-03-09T14:28:50.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.135+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~IVUHD6YMI89D.2 size=423513 2024-03-09T14:28:50.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.135+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=IVUHD6YMI89D tag=A8VVDZJ25DSA type=write size=3569241 2024-03-09T14:28:50.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.136+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~MW65T927JO2V.0 size=1048576 2024-03-09T14:28:50.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.137+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~MW65T927JO2V.1 size=111300 2024-03-09T14:28:50.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.139+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=MW65T927JO2V tag=H05P6EIY024I type=write size=2208452 2024-03-09T14:28:50.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.141+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~JZ3RSDB9GXFN.0 size=1048576 2024-03-09T14:28:50.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.142+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~JZ3RSDB9GXFN.1 size=1048576 2024-03-09T14:28:50.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.143+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~JZ3RSDB9GXFN.2 size=519763 2024-03-09T14:28:50.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.143+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=JZ3RSDB9GXFN tag=W17CX6OUCIHV type=write size=3665491 2024-03-09T14:28:50.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.144+0000 7f1c6444c780 1 < completed write operation key=35Y98D5U0M8O tag=ZV6D7HTFBW0G type=write size=894769 2024-03-09T14:28:50.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.145+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=QM6C259P2BIA type=del size=2340584 2024-03-09T14:28:50.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.147+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=GD2NYFFZVIB1 type=del 2024-03-09T14:28:50.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.148+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=B2NL57HV3A84 type=del size=396305 2024-03-09T14:28:50.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.149+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=64QMDX1NB0VW type=del 2024-03-09T14:28:50.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.152+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~WHLO2S4O9UOA.0 size=1048576 2024-03-09T14:28:50.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.152+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~WHLO2S4O9UOA.1 size=473315 2024-03-09T14:28:50.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.152+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=WHLO2S4O9UOA tag=KJ01GJE5TU3G type=write size=2570467 2024-03-09T14:28:50.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.154+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~YI9OAMQT64DJ.0 size=1048576 2024-03-09T14:28:50.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.155+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~YI9OAMQT64DJ.1 size=232280 2024-03-09T14:28:50.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.157+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=YI9OAMQT64DJ tag=GCGR9B3IV0AV type=write size=2329432 2024-03-09T14:28:50.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.158+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~VXRC2OSVGF4T.0 size=20160 2024-03-09T14:28:50.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.158+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=VXRC2OSVGF4T tag=LAG1Q770AUJ5 type=write size=1068736 2024-03-09T14:28:50.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.161+0000 7f1c6444c780 1 < suggested update operation key=HNK7POWS6FSU tag=W58062RJSUFE type=del size=1554186 2024-03-09T14:28:50.163 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.163+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=JOECYTIVNRZ7 type=del size=3380325 2024-03-09T14:28:50.164 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.164+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=UOL7U6DMNHIV type=del 2024-03-09T14:28:50.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.165+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=393OTR9765BJ type=del size=2634058 2024-03-09T14:28:50.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.166+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=QMUFMROPOJB6 type=del 2024-03-09T14:28:50.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.167+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=AGDP685SG4QC type=del size=990033 2024-03-09T14:28:50.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.169+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~BCPWANYQ4V5D.0 size=1048576 2024-03-09T14:28:50.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.170+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~BCPWANYQ4V5D.1 size=1048576 2024-03-09T14:28:50.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.171+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~BCPWANYQ4V5D.2 size=966239 2024-03-09T14:28:50.172 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.172+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=BCPWANYQ4V5D tag=RM8FLW8GR0WH type=write size=4111967 2024-03-09T14:28:50.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.174+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=UT0BFNKJXWS1 type=write size=129553 2024-03-09T14:28:50.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.176+0000 7f1c6444c780 1 < suggested update operation key=CVD0EGQUVJYR tag=KCWS5PF1S74X type=del size=3007749 2024-03-09T14:28:50.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.177+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=WCCK5677AMGF type=del size=2250562 2024-03-09T14:28:50.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.178+0000 7f1c6444c780 1 < completed write operation key=MOVS6ZMK708G tag=4PYCMWT1LCIF type=write size=567948 2024-03-09T14:28:50.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.180+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~ASIY843A24MF.0 size=1048576 2024-03-09T14:28:50.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.181+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~ASIY843A24MF.1 size=1048576 2024-03-09T14:28:50.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.182+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~ASIY843A24MF.2 size=957873 2024-03-09T14:28:50.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.182+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=ASIY843A24MF tag=MLU5EP82A49F type=write size=4103601 2024-03-09T14:28:50.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.183+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~W5LRF3836SZQ.0 size=1048576 2024-03-09T14:28:50.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.183+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~W5LRF3836SZQ.1 size=285004 2024-03-09T14:28:50.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.186+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=W5LRF3836SZQ tag=GGNW8Z2GA2KD type=write size=2382156 2024-03-09T14:28:50.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.187+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=Z9W2XBRLYYHD type=del size=3115536 2024-03-09T14:28:50.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.188+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=G3EDP3YSQLNL type=del 2024-03-09T14:28:50.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.189+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=QJPCDG8B1W4Q type=del size=2214732 2024-03-09T14:28:50.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.190+0000 7f1c6444c780 1 < completed write operation key=IBVEN2JEB49N tag=7RQTZ2FOQHV9 type=write size=868847 2024-03-09T14:28:50.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.194+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~L2WLPLLPMGAZ.0 size=583466 2024-03-09T14:28:50.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.194+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=L2WLPLLPMGAZ tag=UPLPRIQM9INA type=write size=1632042 2024-03-09T14:28:50.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.195+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~SUX3XP1D9FRO.0 size=1048576 2024-03-09T14:28:50.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.196+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~SUX3XP1D9FRO.1 size=789231 2024-03-09T14:28:50.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.198+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=SUX3XP1D9FRO tag=MSJX789JUYT0 type=write size=2886383 2024-03-09T14:28:50.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.201+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~YRR50YQEMGBP.0 size=1048576 2024-03-09T14:28:50.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.202+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~YRR50YQEMGBP.1 size=1048576 2024-03-09T14:28:50.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.202+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~YRR50YQEMGBP.2 size=765951 2024-03-09T14:28:50.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.202+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=YRR50YQEMGBP tag=1UN0IJ4CCYS7 type=write size=3911679 2024-03-09T14:28:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.204+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~IVUHD6YMI89D.0 size=1048576 2024-03-09T14:28:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.205+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~IVUHD6YMI89D.1 size=1048576 2024-03-09T14:28:50.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.206+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~IVUHD6YMI89D.2 size=423513 2024-03-09T14:28:50.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.207+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=IVUHD6YMI89D tag=A8VVDZJ25DSA type=write size=3569241 2024-03-09T14:28:50.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.210+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~WWOD2OS6WHGO.0 size=129291 2024-03-09T14:28:50.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.210+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=WWOD2OS6WHGO tag=VH1V8FYOPLV5 type=write size=1177867 2024-03-09T14:28:50.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.211+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~JZ3RSDB9GXFN.0 size=1048576 2024-03-09T14:28:50.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.211+0000 7f1c6444c780 1 < canceled part key=_multipart_SGHNHOCYPM38.2~JZ3RSDB9GXFN.1 size=1048576 2024-03-09T14:28:50.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.212+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~JZ3RSDB9GXFN.2 size=519763 2024-03-09T14:28:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.214+0000 7f1c6444c780 1 < canceled multipart upload key=SGHNHOCYPM38 upload=JZ3RSDB9GXFN tag=W17CX6OUCIHV type=write size=3665491 2024-03-09T14:28:50.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.216+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~9KQFZRV1N3XQ.0 size=1048576 2024-03-09T14:28:50.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.217+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~9KQFZRV1N3XQ.1 size=666014 2024-03-09T14:28:50.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.217+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=9KQFZRV1N3XQ tag=MM95IN0ZLUOC type=write size=2763166 2024-03-09T14:28:50.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.218+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=QM6C259P2BIA type=del 2024-03-09T14:28:50.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.220+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=32GWIPPK109P type=del size=511860 2024-03-09T14:28:50.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.221+0000 7f1c6444c780 -1 < failed to complete operation key=HNK7POWS6FSU tag=B2NL57HV3A84 type=del size=396305: (22) Invalid argument 2024-03-09T14:28:50.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.222+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=YZ1DV8M4I9G4 type=del size=110560 2024-03-09T14:28:50.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.223+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~WHLO2S4O9UOA.0 size=1048576 2024-03-09T14:28:50.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.224+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~WHLO2S4O9UOA.1 size=473315 2024-03-09T14:28:50.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.227+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=WHLO2S4O9UOA tag=KJ01GJE5TU3G type=write size=2570467 2024-03-09T14:28:50.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.228+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=0R13IK2BJL0E type=del size=2974011 2024-03-09T14:28:50.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.229+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~VXRC2OSVGF4T.0 size=20160 2024-03-09T14:28:50.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.232+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=VXRC2OSVGF4T tag=LAG1Q770AUJ5 type=write size=1068736 2024-03-09T14:28:50.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.233+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=0OM1KI762SBU type=del size=1438286 2024-03-09T14:28:50.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.234+0000 7f1c6444c780 1 < canceled operation key=PBM4ICXZ2497 tag=JOECYTIVNRZ7 type=del size=3380325 2024-03-09T14:28:50.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.235+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=WORFFARXW2WL type=del size=4021009 2024-03-09T14:28:50.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.238+0000 7f1c6444c780 1 < suggested update operation key=0IHHFQBKKJ0G tag=393OTR9765BJ type=del size=2634058 2024-03-09T14:28:50.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.240+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=IDYSA7UU00RA type=write size=442299 2024-03-09T14:28:50.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.241+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=AGDP685SG4QC type=del 2024-03-09T14:28:50.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.242+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=4J9OBBQB0ERM type=del size=1143189 2024-03-09T14:28:50.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.243+0000 7f1c6444c780 -1 < failed to complete operation key=0IHHFQBKKJ0G tag=UT0BFNKJXWS1 type=write size=129553: (22) Invalid argument 2024-03-09T14:28:50.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.244+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=OF421HIINZ0J type=del size=3032733 2024-03-09T14:28:50.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.246+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=WCCK5677AMGF type=del 2024-03-09T14:28:50.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.248+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~NVT9DSMX7T45.0 size=1005295 2024-03-09T14:28:50.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.248+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=NVT9DSMX7T45 tag=JDUYYRN18457 type=write size=2053871 2024-03-09T14:28:50.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.249+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~ASIY843A24MF.0 size=1048576 2024-03-09T14:28:50.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.250+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~ASIY843A24MF.1 size=1048576 2024-03-09T14:28:50.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.251+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~ASIY843A24MF.2 size=957873 2024-03-09T14:28:50.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.253+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=ASIY843A24MF tag=MLU5EP82A49F type=write size=4103601 2024-03-09T14:28:50.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.255+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=25XKCYCNY8KO type=del size=1876192 2024-03-09T14:28:50.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.256+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=Z9W2XBRLYYHD type=del 2024-03-09T14:28:50.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.257+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=IOPY9V4XFORC type=del size=537845 2024-03-09T14:28:50.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.259+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=QJPCDG8B1W4Q type=del 2024-03-09T14:28:50.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.260+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=42CQEA8VEW5M type=del size=3307008 2024-03-09T14:28:50.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.262+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~L2WLPLLPMGAZ.0 size=583466 2024-03-09T14:28:50.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.264+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=L2WLPLLPMGAZ tag=UPLPRIQM9INA type=write size=1632042 2024-03-09T14:28:50.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.265+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=LR0BUZ17MNHJ type=del size=3876387 2024-03-09T14:28:50.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.266+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~YRR50YQEMGBP.0 size=1048576 2024-03-09T14:28:50.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.266+0000 7f1c6444c780 1 < canceled part key=_multipart_KWDIDE9AE3JP.2~YRR50YQEMGBP.1 size=1048576 2024-03-09T14:28:50.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.267+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~YRR50YQEMGBP.2 size=765951 2024-03-09T14:28:50.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.269+0000 7f1c6444c780 1 < canceled multipart upload key=KWDIDE9AE3JP upload=YRR50YQEMGBP tag=1UN0IJ4CCYS7 type=write size=3911679 2024-03-09T14:28:50.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.271+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=QN4ABZCME5TA type=del size=51094 2024-03-09T14:28:50.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.272+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~WWOD2OS6WHGO.0 size=129291 2024-03-09T14:28:50.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.274+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=WWOD2OS6WHGO tag=VH1V8FYOPLV5 type=write size=1177867 2024-03-09T14:28:50.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.275+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=S9P118V4KFCR type=write size=282533 2024-03-09T14:28:50.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.276+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~9KQFZRV1N3XQ.0 size=1048576 2024-03-09T14:28:50.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.277+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~9KQFZRV1N3XQ.1 size=666014 2024-03-09T14:28:50.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.279+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=9KQFZRV1N3XQ tag=MM95IN0ZLUOC type=write size=2763166 2024-03-09T14:28:50.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.280+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=3XQDO2ZQ6FRV type=del size=1930718 2024-03-09T14:28:50.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.281+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=32GWIPPK109P type=del 2024-03-09T14:28:50.283 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.283+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~J8QDK93JT77L.0 size=1048576 2024-03-09T14:28:50.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.284+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~J8QDK93JT77L.1 size=1048576 2024-03-09T14:28:50.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.285+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~J8QDK93JT77L.2 size=902891 2024-03-09T14:28:50.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.285+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=J8QDK93JT77L tag=IJ67EY4K90T3 type=write size=4048619 2024-03-09T14:28:50.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.287+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=YZ1DV8M4I9G4 type=del 2024-03-09T14:28:50.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.288+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=F14W0PTYB653 type=del size=2383045 2024-03-09T14:28:50.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.289+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=0R13IK2BJL0E type=del 2024-03-09T14:28:50.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.290+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=ZEJVUOKTUOA4 type=del size=3229574 2024-03-09T14:28:50.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.292+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=0OM1KI762SBU type=del 2024-03-09T14:28:50.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.293+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=GMAUSW6OH3LW type=write size=775448 2024-03-09T14:28:50.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.295+0000 7f1c6444c780 1 < suggested remove operation key=QSMTZR754455 tag=WORFFARXW2WL type=del 2024-03-09T14:28:50.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.298+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~IUE1L1V8P064.0 size=398409 2024-03-09T14:28:50.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.298+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=IUE1L1V8P064 tag=KMKVHDQIWLK0 type=write size=1446985 2024-03-09T14:28:50.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.299+0000 7f1c6444c780 1 < completed write operation key=1NQRJ8ICZNM6 tag=IDYSA7UU00RA type=write size=442299 2024-03-09T14:28:50.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.300+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=65E8C74PPUGJ type=del size=243405 2024-03-09T14:28:50.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.302+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=4J9OBBQB0ERM type=del 2024-03-09T14:28:50.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.303+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=2WAMUVA2IUD1 type=write size=634857 2024-03-09T14:28:50.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.304+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=OF421HIINZ0J type=del 2024-03-09T14:28:50.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.306+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=23ERAEXF04KH type=write size=455919 2024-03-09T14:28:50.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.307+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~NVT9DSMX7T45.0 size=1005295 2024-03-09T14:28:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.309+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=NVT9DSMX7T45 tag=JDUYYRN18457 type=write size=2053871 2024-03-09T14:28:50.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.313+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~WEYB14PI0I2S.0 size=1048576 2024-03-09T14:28:50.314 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.314+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~WEYB14PI0I2S.1 size=755545 2024-03-09T14:28:50.314 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.314+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=WEYB14PI0I2S tag=44LP313CYEKA type=write size=2852697 2024-03-09T14:28:50.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.315+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=25XKCYCNY8KO type=del 2024-03-09T14:28:50.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.316+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=VZ0ROFRAFQEI type=del size=2991858 2024-03-09T14:28:50.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.319+0000 7f1c6444c780 1 < suggested remove operation key=49YOZGJ8XC4K tag=IOPY9V4XFORC type=del 2024-03-09T14:28:50.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.320+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=3HKZW4X4L0FZ type=del size=3107035 2024-03-09T14:28:50.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.321+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=42CQEA8VEW5M type=del 2024-03-09T14:28:50.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.323+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=3SQU3EQAGYYK type=del size=1992724 2024-03-09T14:28:50.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.324+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=LR0BUZ17MNHJ type=del 2024-03-09T14:28:50.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.325+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=UTDVF2XDWRA4 type=del size=3678469 2024-03-09T14:28:50.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.327+0000 7f1c6444c780 1 < suggested remove operation key=Z34QOCZB3DFX tag=QN4ABZCME5TA type=del 2024-03-09T14:28:50.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.329+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~IVBFNFYTR41F.0 size=1048576 2024-03-09T14:28:50.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.330+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~IVBFNFYTR41F.1 size=1048576 2024-03-09T14:28:50.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.331+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~IVBFNFYTR41F.2 size=918760 2024-03-09T14:28:50.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.331+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=IVBFNFYTR41F tag=00TBVSI8QSNV type=write size=4064488 2024-03-09T14:28:50.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.332+0000 7f1c6444c780 1 < canceled operation key=YECG84AJ5IK2 tag=S9P118V4KFCR type=write size=282533 2024-03-09T14:28:50.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.334+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=34XTSFTN6CBN type=del size=2173675 2024-03-09T14:28:50.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.336+0000 7f1c6444c780 1 < suggested update operation key=KMX7TNIOKWOA tag=3XQDO2ZQ6FRV type=del size=1930718 2024-03-09T14:28:50.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.337+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=JIOQ6JYNGQ3L type=del size=3902388 2024-03-09T14:28:50.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.339+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~J8QDK93JT77L.0 size=1048576 2024-03-09T14:28:50.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.340+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~J8QDK93JT77L.1 size=1048576 2024-03-09T14:28:50.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.341+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~J8QDK93JT77L.2 size=902891 2024-03-09T14:28:50.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.343+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=J8QDK93JT77L tag=IJ67EY4K90T3 type=write size=4048619 2024-03-09T14:28:50.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.344+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=WEE9CW7H6RUP type=del size=604820 2024-03-09T14:28:50.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.346+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=F14W0PTYB653 type=del 2024-03-09T14:28:50.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.347+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=VHBUZW1LHNBW type=del size=2557689 2024-03-09T14:28:50.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.348+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=ZEJVUOKTUOA4 type=del 2024-03-09T14:28:50.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.351+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~RLH4NIZOWWAB.0 size=1048576 2024-03-09T14:28:50.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.352+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~RLH4NIZOWWAB.1 size=416687 2024-03-09T14:28:50.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.352+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=RLH4NIZOWWAB tag=MIBU4FO20R0K type=write size=2513839 2024-03-09T14:28:50.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.353+0000 7f1c6444c780 1 < completed write operation key=EREG1M13901A tag=GMAUSW6OH3LW type=write size=775448 2024-03-09T14:28:50.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.354+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=IYV3BRCVKAN9 type=del size=884815 2024-03-09T14:28:50.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.355+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~IUE1L1V8P064.0 size=398409 2024-03-09T14:28:50.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.357+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=IUE1L1V8P064 tag=KMKVHDQIWLK0 type=write size=1446985 2024-03-09T14:28:50.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.358+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=RXTXJA91J36E type=write size=675242 2024-03-09T14:28:50.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.360+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=65E8C74PPUGJ type=del 2024-03-09T14:28:50.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.362+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~WMK73QN6T8LX.0 size=594580 2024-03-09T14:28:50.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.362+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=WMK73QN6T8LX tag=SRP2VN3RT786 type=write size=1643156 2024-03-09T14:28:50.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.363+0000 7f1c6444c780 1 < completed write operation key=V05XJ56M53T8 tag=2WAMUVA2IUD1 type=write size=634857 2024-03-09T14:28:50.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.366+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~AF53UK9O3O2U.0 size=686754 2024-03-09T14:28:50.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.366+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=AF53UK9O3O2U tag=J58J1HQNOEUY type=write size=1735330 2024-03-09T14:28:50.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.367+0000 7f1c6444c780 1 < canceled operation key=0ZZ0P8Y7KSAX tag=23ERAEXF04KH type=write size=455919 2024-03-09T14:28:50.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.368+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=VSOHS2QKI5UR type=del size=3505503 2024-03-09T14:28:50.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.370+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~WEYB14PI0I2S.0 size=1048576 2024-03-09T14:28:50.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.371+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~WEYB14PI0I2S.1 size=755545 2024-03-09T14:28:50.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.373+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=WEYB14PI0I2S tag=44LP313CYEKA type=write size=2852697 2024-03-09T14:28:50.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.375+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=LH3F02QZGKD5 type=write size=410803 2024-03-09T14:28:50.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.376+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=VZ0ROFRAFQEI type=del 2024-03-09T14:28:50.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.378+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~T16QQPLDUHP1.0 size=1048576 2024-03-09T14:28:50.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.379+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~T16QQPLDUHP1.1 size=1048576 2024-03-09T14:28:50.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.380+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~T16QQPLDUHP1.2 size=876680 2024-03-09T14:28:50.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.380+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=T16QQPLDUHP1 tag=LJQJZOHJ4PVV type=write size=4022408 2024-03-09T14:28:50.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.381+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=3HKZW4X4L0FZ type=del 2024-03-09T14:28:50.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.382+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=W0XGGR65Y48F type=write size=698975 2024-03-09T14:28:50.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.383+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=3SQU3EQAGYYK type=del 2024-03-09T14:28:50.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.385+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~DLN3H0CFV9KD.0 size=1048576 2024-03-09T14:28:50.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.386+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~DLN3H0CFV9KD.1 size=938618 2024-03-09T14:28:50.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.386+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=DLN3H0CFV9KD tag=PGO0KP30T9JI type=write size=3035770 2024-03-09T14:28:50.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.387+0000 7f1c6444c780 1 < completed delete operation key=0IHHFQBKKJ0G tag=UTDVF2XDWRA4 type=del 2024-03-09T14:28:50.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.388+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=ZNTD3I1WRZ1N type=del size=1187005 2024-03-09T14:28:50.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.390+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~IVBFNFYTR41F.0 size=1048576 2024-03-09T14:28:50.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.390+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~IVBFNFYTR41F.1 size=1048576 2024-03-09T14:28:50.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.391+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~IVBFNFYTR41F.2 size=918760 2024-03-09T14:28:50.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.394+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=IVBFNFYTR41F tag=00TBVSI8QSNV type=write size=4064488 2024-03-09T14:28:50.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.395+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=SW77TFHGIV79 type=del size=4050970 2024-03-09T14:28:50.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.396+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=34XTSFTN6CBN type=del 2024-03-09T14:28:50.397 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.397+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=QM870OMQQRKZ type=del size=854896 2024-03-09T14:28:50.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.398+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=JIOQ6JYNGQ3L type=del 2024-03-09T14:28:50.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.399+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=XJ8SOLUSSZPF type=del size=1236235 2024-03-09T14:28:50.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.401+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=WEE9CW7H6RUP type=del size=604820 2024-03-09T14:28:50.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.402+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=DLK28540W0E6 type=write size=100025 2024-03-09T14:28:50.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.403+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=VHBUZW1LHNBW type=del size=2557689 2024-03-09T14:28:50.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.404+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=PSV2YU0KF05I type=del size=2449045 2024-03-09T14:28:50.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.405+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~RLH4NIZOWWAB.0 size=1048576 2024-03-09T14:28:50.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.406+0000 7f1c6444c780 1 < completed part key=_multipart_0ZZ0P8Y7KSAX.2~RLH4NIZOWWAB.1 size=416687 2024-03-09T14:28:50.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.408+0000 7f1c6444c780 1 < completed multipart upload key=0ZZ0P8Y7KSAX upload=RLH4NIZOWWAB tag=MIBU4FO20R0K type=write size=2513839 2024-03-09T14:28:50.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.410+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~HJMS3Y959RUQ.0 size=1048576 2024-03-09T14:28:50.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.411+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~HJMS3Y959RUQ.1 size=1048576 2024-03-09T14:28:50.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.412+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~HJMS3Y959RUQ.2 size=201059 2024-03-09T14:28:50.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.412+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=HJMS3Y959RUQ tag=K13Y8FJI7S1Q type=write size=3346787 2024-03-09T14:28:50.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.413+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=IYV3BRCVKAN9 type=del 2024-03-09T14:28:50.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.415+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~P2C4QB2OY7W0.0 size=1048576 2024-03-09T14:28:50.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.416+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~P2C4QB2OY7W0.1 size=255839 2024-03-09T14:28:50.416 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.416+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=P2C4QB2OY7W0 tag=KMUQAWI5UK2C type=write size=2352991 2024-03-09T14:28:50.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.418+0000 7f1c6444c780 1 < suggested remove operation key=V05XJ56M53T8 tag=RXTXJA91J36E type=write 2024-03-09T14:28:50.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.420+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=7UDGI273JVTO type=del size=3817371 2024-03-09T14:28:50.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.421+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~WMK73QN6T8LX.0 size=594580 2024-03-09T14:28:50.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.423+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=WMK73QN6T8LX tag=SRP2VN3RT786 type=write size=1643156 2024-03-09T14:28:50.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.426+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~TCFQYFX44YN7.0 size=327086 2024-03-09T14:28:50.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.426+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=TCFQYFX44YN7 tag=5NRB22B5ERNK type=write size=1375662 2024-03-09T14:28:50.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.427+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~AF53UK9O3O2U.0 size=686754 2024-03-09T14:28:50.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.429+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=AF53UK9O3O2U tag=J58J1HQNOEUY type=write size=1735330 2024-03-09T14:28:50.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.431+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=X7XIUHI1HNEY type=del size=3397676 2024-03-09T14:28:50.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.433+0000 7f1c6444c780 1 < suggested remove operation key=KNOEGKSERB6Z tag=VSOHS2QKI5UR type=del 2024-03-09T14:28:50.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.435+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~LFKH2B01E0D1.0 size=459908 2024-03-09T14:28:50.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.435+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=LFKH2B01E0D1 tag=TB76K0FSC4E8 type=write size=1508484 2024-03-09T14:28:50.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.436+0000 7f1c6444c780 1 < completed write operation key=SGHNHOCYPM38 tag=LH3F02QZGKD5 type=write size=410803 2024-03-09T14:28:50.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.438+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~MRROZ3Q6K6NA.0 size=1048576 2024-03-09T14:28:50.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.439+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~MRROZ3Q6K6NA.1 size=136546 2024-03-09T14:28:50.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.439+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=MRROZ3Q6K6NA tag=CFU5D0GPOVG4 type=write size=2233698 2024-03-09T14:28:50.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.440+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~T16QQPLDUHP1.0 size=1048576 2024-03-09T14:28:50.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.442+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~T16QQPLDUHP1.1 size=1048576 2024-03-09T14:28:50.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.443+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~T16QQPLDUHP1.2 size=876680 2024-03-09T14:28:50.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.444+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=T16QQPLDUHP1 tag=LJQJZOHJ4PVV type=write size=4022408 2024-03-09T14:28:50.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.446+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=Z1114FDO7RCW type=del size=24340 2024-03-09T14:28:50.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.447+0000 7f1c6444c780 1 < completed write operation key=BYX1155MZ2LP tag=W0XGGR65Y48F type=write size=698975 2024-03-09T14:28:50.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.448+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=5OGE0X85IAA8 type=del size=2433348 2024-03-09T14:28:50.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.449+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~DLN3H0CFV9KD.0 size=1048576 2024-03-09T14:28:50.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.450+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~DLN3H0CFV9KD.1 size=938618 2024-03-09T14:28:50.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.452+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=DLN3H0CFV9KD tag=PGO0KP30T9JI type=write size=3035770 2024-03-09T14:28:50.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.453+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=QPQ32A5EZUVC type=del size=2457603 2024-03-09T14:28:50.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.455+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=ZNTD3I1WRZ1N type=del 2024-03-09T14:28:50.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.456+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=3FB3BIW87CJ2 type=del size=1908067 2024-03-09T14:28:50.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.457+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=SW77TFHGIV79 type=del 2024-03-09T14:28:50.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.458+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=RXOYVVLRPP9U type=del size=2480873 2024-03-09T14:28:50.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.459+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=QM870OMQQRKZ type=del 2024-03-09T14:28:50.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.462+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~2B82TA1R1IYG.0 size=622150 2024-03-09T14:28:50.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.462+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=2B82TA1R1IYG tag=DGKBT2FP62LC type=write size=1670726 2024-03-09T14:28:50.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.463+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=XJ8SOLUSSZPF type=del 2024-03-09T14:28:50.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.465+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~I9M1X44PVTUR.0 size=1048576 2024-03-09T14:28:50.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.466+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~I9M1X44PVTUR.1 size=836861 2024-03-09T14:28:50.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.466+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=I9M1X44PVTUR tag=L1E0P5UDQJ81 type=write size=2934013 2024-03-09T14:28:50.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.467+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=DLK28540W0E6 type=write size=100025 2024-03-09T14:28:50.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.468+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=TXQ8A5U59790 type=del size=3702243 2024-03-09T14:28:50.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.470+0000 7f1c6444c780 1 < suggested remove operation key=P33029QWKW23 tag=PSV2YU0KF05I type=del 2024-03-09T14:28:50.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.472+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~Y8F24OA33Q3E.0 size=1048576 2024-03-09T14:28:50.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.473+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~Y8F24OA33Q3E.1 size=1048576 2024-03-09T14:28:50.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.474+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~Y8F24OA33Q3E.2 size=764140 2024-03-09T14:28:50.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.474+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=Y8F24OA33Q3E tag=BPC3WGG701HX type=write size=3909868 2024-03-09T14:28:50.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.475+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~HJMS3Y959RUQ.0 size=1048576 2024-03-09T14:28:50.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.476+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~HJMS3Y959RUQ.1 size=1048576 2024-03-09T14:28:50.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.477+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~HJMS3Y959RUQ.2 size=201059 2024-03-09T14:28:50.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.480+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=HJMS3Y959RUQ tag=K13Y8FJI7S1Q type=write size=3346787 2024-03-09T14:28:50.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.481+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=7UVKWF63COBN type=del size=967795 2024-03-09T14:28:50.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.482+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~P2C4QB2OY7W0.0 size=1048576 2024-03-09T14:28:50.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.483+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~P2C4QB2OY7W0.1 size=255839 2024-03-09T14:28:50.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.485+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=P2C4QB2OY7W0 tag=KMUQAWI5UK2C type=write size=2352991 2024-03-09T14:28:50.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.486+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=QNQJOQOESLH7 type=del size=1232281 2024-03-09T14:28:50.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.489+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=7UDGI273JVTO type=del 2024-03-09T14:28:50.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.490+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=FQNAPZAEYOX8 type=del size=1654809 2024-03-09T14:28:50.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.490+0000 7f1c6444c780 1 < canceled part key=_multipart_V05XJ56M53T8.2~TCFQYFX44YN7.0 size=327086 2024-03-09T14:28:50.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.492+0000 7f1c6444c780 1 < canceled multipart upload key=V05XJ56M53T8 upload=TCFQYFX44YN7 tag=5NRB22B5ERNK type=write size=1375662 2024-03-09T14:28:50.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.494+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~1WW06GAT13YX.0 size=1048576 2024-03-09T14:28:50.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.495+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~1WW06GAT13YX.1 size=716647 2024-03-09T14:28:50.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.495+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=1WW06GAT13YX tag=ARZZPT75FSEJ type=write size=2813799 2024-03-09T14:28:50.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.497+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=X7XIUHI1HNEY type=del size=3397676 2024-03-09T14:28:50.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.499+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IXJ5OTJBH736.0 size=1048576 2024-03-09T14:28:50.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.500+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IXJ5OTJBH736.1 size=1048576 2024-03-09T14:28:50.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.501+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~IXJ5OTJBH736.2 size=368680 2024-03-09T14:28:50.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.501+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=IXJ5OTJBH736 tag=P8YHIU0U9GPJ type=write size=3514408 2024-03-09T14:28:50.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.501+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~LFKH2B01E0D1.0 size=459908 2024-03-09T14:28:50.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.503+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=LFKH2B01E0D1 tag=TB76K0FSC4E8 type=write size=1508484 2024-03-09T14:28:50.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.504+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=GFSVYKGIYOKJ type=write size=58118 2024-03-09T14:28:50.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.505+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~MRROZ3Q6K6NA.0 size=1048576 2024-03-09T14:28:50.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.506+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~MRROZ3Q6K6NA.1 size=136546 2024-03-09T14:28:50.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.508+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=MRROZ3Q6K6NA tag=CFU5D0GPOVG4 type=write size=2233698 2024-03-09T14:28:50.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.509+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=G5KJ5XRA07WF type=del size=3668839 2024-03-09T14:28:50.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.510+0000 7f1c6444c780 -1 < failed to complete operation key=YK7ENO4UAB2M tag=Z1114FDO7RCW type=del size=24340: (22) Invalid argument 2024-03-09T14:28:50.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.511+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=DPM2U1MJS5HV type=del size=188470 2024-03-09T14:28:50.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.513+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=5OGE0X85IAA8 type=del 2024-03-09T14:28:50.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.515+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~GHS570IRTPH1.0 size=1048576 2024-03-09T14:28:50.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.515+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~GHS570IRTPH1.1 size=1048576 2024-03-09T14:28:50.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.516+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~GHS570IRTPH1.2 size=468988 2024-03-09T14:28:50.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.516+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=GHS570IRTPH1 tag=A171SLTR4GI1 type=write size=3614716 2024-03-09T14:28:50.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.519+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=QPQ32A5EZUVC type=del 2024-03-09T14:28:50.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.521+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~KBW1T4JOI24H.0 size=1048576 2024-03-09T14:28:50.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.521+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~KBW1T4JOI24H.1 size=780065 2024-03-09T14:28:50.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.521+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=KBW1T4JOI24H tag=SRHU0J3OSCV8 type=write size=2877217 2024-03-09T14:28:50.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.523+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=3FB3BIW87CJ2 type=del 2024-03-09T14:28:50.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.524+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=JEKCHO7DLQX3 type=del size=1040292 2024-03-09T14:28:50.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.525+0000 7f1c6444c780 1 < completed delete operation key=BAWV7KY6NT8P tag=RXOYVVLRPP9U type=del 2024-03-09T14:28:50.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.526+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=5D19SX2DSQ7N type=del size=1651675 2024-03-09T14:28:50.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.527+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~2B82TA1R1IYG.0 size=622150 2024-03-09T14:28:50.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.529+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=2B82TA1R1IYG tag=DGKBT2FP62LC type=write size=1670726 2024-03-09T14:28:50.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.531+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~F7YWVQS6BXPR.0 size=950446 2024-03-09T14:28:50.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.531+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=F7YWVQS6BXPR tag=15HSEIHQ5ZWA type=write size=1999022 2024-03-09T14:28:50.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.532+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~I9M1X44PVTUR.0 size=1048576 2024-03-09T14:28:50.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.534+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~I9M1X44PVTUR.1 size=836861 2024-03-09T14:28:50.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.536+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=I9M1X44PVTUR tag=L1E0P5UDQJ81 type=write size=2934013 2024-03-09T14:28:50.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.537+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=SUTEIQ9W5K6N type=del size=2451174 2024-03-09T14:28:50.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.538+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=TXQ8A5U59790 type=del 2024-03-09T14:28:50.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.540+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~YY0D4TM4DF3D.0 size=983807 2024-03-09T14:28:50.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.540+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=YY0D4TM4DF3D tag=WYOK673CNJ71 type=write size=2032383 2024-03-09T14:28:50.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.540+0000 7f1c6444c780 1 < canceled part key=_multipart_35Y98D5U0M8O.2~Y8F24OA33Q3E.0 size=1048576 2024-03-09T14:28:50.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.541+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~Y8F24OA33Q3E.1 size=1048576 2024-03-09T14:28:50.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.542+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~Y8F24OA33Q3E.2 size=764140 2024-03-09T14:28:50.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.543+0000 7f1c6444c780 1 < canceled multipart upload key=35Y98D5U0M8O upload=Y8F24OA33Q3E tag=BPC3WGG701HX type=write size=3909868 2024-03-09T14:28:50.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.545+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=08G6MXWEQ33H type=del size=183844 2024-03-09T14:28:50.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.547+0000 7f1c6444c780 1 < suggested remove operation key=35Y98D5U0M8O tag=7UVKWF63COBN type=del 2024-03-09T14:28:50.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.548+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=YV2M15Z0KTXM type=del size=2624897 2024-03-09T14:28:50.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.549+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=QNQJOQOESLH7 type=del 2024-03-09T14:28:50.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.551+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~ABF00Q4W29ZG.0 size=1048576 2024-03-09T14:28:50.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.552+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~ABF00Q4W29ZG.1 size=1048576 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.553+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~ABF00Q4W29ZG.2 size=756847 2024-03-09T14:28:50.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.553+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=ABF00Q4W29ZG tag=KQ2T973PJ23H type=write size=3902575 2024-03-09T14:28:50.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.554+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=FQNAPZAEYOX8 type=del 2024-03-09T14:28:50.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.556+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~T81DG0O8VUVF.0 size=980894 2024-03-09T14:28:50.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.556+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=T81DG0O8VUVF tag=QL3NMRAXVV09 type=write size=2029470 2024-03-09T14:28:50.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.557+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~1WW06GAT13YX.0 size=1048576 2024-03-09T14:28:50.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.558+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~1WW06GAT13YX.1 size=716647 2024-03-09T14:28:50.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.560+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=1WW06GAT13YX tag=ARZZPT75FSEJ type=write size=2813799 2024-03-09T14:28:50.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.561+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=LDHH78PWAJGY type=del size=2391320 2024-03-09T14:28:50.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.563+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IXJ5OTJBH736.0 size=1048576 2024-03-09T14:28:50.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.564+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IXJ5OTJBH736.1 size=1048576 2024-03-09T14:28:50.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.564+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~IXJ5OTJBH736.2 size=368680 2024-03-09T14:28:50.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.566+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=IXJ5OTJBH736 tag=P8YHIU0U9GPJ type=write size=3514408 2024-03-09T14:28:50.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.568+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=6I5K2I21RRCG type=del size=3240801 2024-03-09T14:28:50.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.569+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=GFSVYKGIYOKJ type=write size=58118 2024-03-09T14:28:50.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.571+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~RPT9JJXGGZ8S.0 size=620916 2024-03-09T14:28:50.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.571+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=RPT9JJXGGZ8S tag=K1BWQKX7NRU9 type=write size=1669492 2024-03-09T14:28:50.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.572+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=G5KJ5XRA07WF type=del 2024-03-09T14:28:50.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.573+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=VK9250TUU5EB type=del size=603428 2024-03-09T14:28:50.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.575+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=DPM2U1MJS5HV type=del 2024-03-09T14:28:50.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.576+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=UF2IFD7P0TA9 type=del size=522440 2024-03-09T14:28:50.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.578+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~GHS570IRTPH1.0 size=1048576 2024-03-09T14:28:50.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.579+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~GHS570IRTPH1.1 size=1048576 2024-03-09T14:28:50.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.580+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~GHS570IRTPH1.2 size=468988 2024-03-09T14:28:50.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.581+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=GHS570IRTPH1 tag=A171SLTR4GI1 type=write size=3614716 2024-03-09T14:28:50.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.584+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~TIMJSBB5LN7N.0 size=634490 2024-03-09T14:28:50.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.584+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=TIMJSBB5LN7N tag=25JAOB5PDI9F type=write size=1683066 2024-03-09T14:28:50.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.584+0000 7f1c6444c780 1 < canceled part key=_multipart_IBVEN2JEB49N.2~KBW1T4JOI24H.0 size=1048576 2024-03-09T14:28:50.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.585+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~KBW1T4JOI24H.1 size=780065 2024-03-09T14:28:50.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.587+0000 7f1c6444c780 1 < canceled multipart upload key=IBVEN2JEB49N upload=KBW1T4JOI24H tag=SRHU0J3OSCV8 type=write size=2877217 2024-03-09T14:28:50.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.589+0000 7f1c6444c780 1 > prepared part key=_multipart_0ZZ0P8Y7KSAX.2~N2G6GAF1AS0S.0 size=829569 2024-03-09T14:28:50.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.589+0000 7f1c6444c780 1 > prepared multipart upload key=0ZZ0P8Y7KSAX upload=N2G6GAF1AS0S tag=V4397MMYYEDV type=write size=1878145 2024-03-09T14:28:50.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.591+0000 7f1c6444c780 1 < suggested remove operation key=71FSR1CHFBO0 tag=JEKCHO7DLQX3 type=del 2024-03-09T14:28:50.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.592+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=B3FVUHTCW54L type=del size=901055 2024-03-09T14:28:50.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.593+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=5D19SX2DSQ7N type=del 2024-03-09T14:28:50.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.595+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=VBIHWY56X3IO type=del size=1747812 2024-03-09T14:28:50.596 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.596+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~F7YWVQS6BXPR.0 size=950446 2024-03-09T14:28:50.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.598+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=F7YWVQS6BXPR tag=15HSEIHQ5ZWA type=write size=1999022 2024-03-09T14:28:50.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.599+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=5945O5LHROFU type=del size=2716761 2024-03-09T14:28:50.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.600+0000 7f1c6444c780 1 < canceled operation key=HPFPL79B0GLS tag=SUTEIQ9W5K6N type=del size=2451174 2024-03-09T14:28:50.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.601+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=IDFL9Z3AHU73 type=del size=1333344 2024-03-09T14:28:50.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.602+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~YY0D4TM4DF3D.0 size=983807 2024-03-09T14:28:50.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.604+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=YY0D4TM4DF3D tag=WYOK673CNJ71 type=write size=2032383 2024-03-09T14:28:50.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.606+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~1B90O4SC5738.0 size=500650 2024-03-09T14:28:50.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.606+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=1B90O4SC5738 tag=JPEAVWKEBS0N type=write size=1549226 2024-03-09T14:28:50.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.607+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=08G6MXWEQ33H type=del 2024-03-09T14:28:50.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.609+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=9IPBA2WI0L4F type=del size=3621966 2024-03-09T14:28:50.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.611+0000 7f1c6444c780 1 < suggested remove operation key=VL5EUQ52WRAN tag=YV2M15Z0KTXM type=del 2024-03-09T14:28:50.612 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.612+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=ZC1MUVLI7GO8 type=del size=1773527 2024-03-09T14:28:50.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.613+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~ABF00Q4W29ZG.0 size=1048576 2024-03-09T14:28:50.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.614+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~ABF00Q4W29ZG.1 size=1048576 2024-03-09T14:28:50.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.615+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~ABF00Q4W29ZG.2 size=756847 2024-03-09T14:28:50.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.617+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=ABF00Q4W29ZG tag=KQ2T973PJ23H type=write size=3902575 2024-03-09T14:28:50.618 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.618+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=67Y6UKHEY3R6 type=del size=2846702 2024-03-09T14:28:50.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.619+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~T81DG0O8VUVF.0 size=980894 2024-03-09T14:28:50.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.621+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=T81DG0O8VUVF tag=QL3NMRAXVV09 type=write size=2029470 2024-03-09T14:28:50.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.622+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=QJ2W4X5A0ZM5 type=del size=2976116 2024-03-09T14:28:50.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.624+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=LDHH78PWAJGY type=del 2024-03-09T14:28:50.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.626+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~5XEE4EP0HL0S.0 size=1048576 2024-03-09T14:28:50.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.626+0000 7f1c6444c780 1 > prepared part key=_multipart_PBM4ICXZ2497.2~5XEE4EP0HL0S.1 size=154768 2024-03-09T14:28:50.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.626+0000 7f1c6444c780 1 > prepared multipart upload key=PBM4ICXZ2497 upload=5XEE4EP0HL0S tag=IJWNA4Z4LGK5 type=write size=2251920 2024-03-09T14:28:50.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.628+0000 7f1c6444c780 1 < canceled operation key=CVD0EGQUVJYR tag=6I5K2I21RRCG type=del size=3240801 2024-03-09T14:28:50.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.629+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=AC7O0KCO59EV type=del size=3330641 2024-03-09T14:28:50.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.630+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~RPT9JJXGGZ8S.0 size=620916 2024-03-09T14:28:50.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.632+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=RPT9JJXGGZ8S tag=K1BWQKX7NRU9 type=write size=1669492 2024-03-09T14:28:50.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.634+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~1COIM41PTPIR.0 size=1048576 2024-03-09T14:28:50.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.635+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~1COIM41PTPIR.1 size=1048576 2024-03-09T14:28:50.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.636+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~1COIM41PTPIR.2 size=775422 2024-03-09T14:28:50.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.636+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=1COIM41PTPIR tag=NNO0BO2I6X3V type=write size=3921150 2024-03-09T14:28:50.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.637+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=VK9250TUU5EB type=del 2024-03-09T14:28:50.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.638+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=2MGN0QIX3WKN type=del size=1014560 2024-03-09T14:28:50.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.641+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=UF2IFD7P0TA9 type=del 2024-03-09T14:28:50.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.642+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=YNB12UUDNWPH type=del size=3552972 2024-03-09T14:28:50.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.643+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~TIMJSBB5LN7N.0 size=634490 2024-03-09T14:28:50.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.645+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=TIMJSBB5LN7N tag=25JAOB5PDI9F type=write size=1683066 2024-03-09T14:28:50.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.646+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=JGX701V2L6NY type=del size=837657 2024-03-09T14:28:50.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.646+0000 7f1c6444c780 1 < canceled part key=_multipart_0ZZ0P8Y7KSAX.2~N2G6GAF1AS0S.0 size=829569 2024-03-09T14:28:50.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.648+0000 7f1c6444c780 1 < canceled multipart upload key=0ZZ0P8Y7KSAX upload=N2G6GAF1AS0S tag=V4397MMYYEDV type=write size=1878145 2024-03-09T14:28:50.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.650+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~WO6TRJPAU014.0 size=1048576 2024-03-09T14:28:50.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.651+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~WO6TRJPAU014.1 size=1048576 2024-03-09T14:28:50.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.652+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~WO6TRJPAU014.2 size=1007757 2024-03-09T14:28:50.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.652+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=WO6TRJPAU014 tag=P3VGVA07ZNV5 type=write size=4153485 2024-03-09T14:28:50.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.653+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=B3FVUHTCW54L type=del 2024-03-09T14:28:50.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.655+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=N1ZBW9NEUX5Y type=del size=208349 2024-03-09T14:28:50.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.657+0000 7f1c6444c780 1 < suggested remove operation key=WMO6LTCMVXD2 tag=VBIHWY56X3IO type=del 2024-03-09T14:28:50.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.658+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=VREAF20KGOE3 type=write size=343562 2024-03-09T14:28:50.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.659+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=5945O5LHROFU type=del 2024-03-09T14:28:50.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.661+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~668ZASED082J.0 size=1048576 2024-03-09T14:28:50.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.662+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~668ZASED082J.1 size=1048576 2024-03-09T14:28:50.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.663+0000 7f1c6444c780 1 > prepared part key=_multipart_P33029QWKW23.2~668ZASED082J.2 size=748542 2024-03-09T14:28:50.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.663+0000 7f1c6444c780 1 > prepared multipart upload key=P33029QWKW23 upload=668ZASED082J tag=SJX5OFYYT0KW type=write size=3894270 2024-03-09T14:28:50.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.665+0000 7f1c6444c780 1 < suggested remove operation key=YECG84AJ5IK2 tag=IDFL9Z3AHU73 type=del 2024-03-09T14:28:50.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.666+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=IHD3FIEPVQLH type=del size=3253090 2024-03-09T14:28:50.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.667+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~1B90O4SC5738.0 size=500650 2024-03-09T14:28:50.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.669+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=1B90O4SC5738 tag=JPEAVWKEBS0N type=write size=1549226 2024-03-09T14:28:50.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.670+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=BN1E750BIVNB type=write size=689125 2024-03-09T14:28:50.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.671+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=9IPBA2WI0L4F type=del 2024-03-09T14:28:50.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.673+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~SBKNZD86W18K.0 size=1048576 2024-03-09T14:28:50.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.674+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~SBKNZD86W18K.1 size=615487 2024-03-09T14:28:50.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.674+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=SBKNZD86W18K tag=UGTO4XB27T93 type=write size=2712639 2024-03-09T14:28:50.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.675+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=ZC1MUVLI7GO8 type=del 2024-03-09T14:28:50.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.677+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=RXLKGT863XBC type=write size=202579 2024-03-09T14:28:50.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.679+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=67Y6UKHEY3R6 type=del size=2846702 2024-03-09T14:28:50.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.680+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=KCEAI97U3GI8 type=del size=3201809 2024-03-09T14:28:50.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.681+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=QJ2W4X5A0ZM5 type=del 2024-03-09T14:28:50.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.682+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=KYRGK37778JG type=del size=1640522 2024-03-09T14:28:50.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.683+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~5XEE4EP0HL0S.0 size=1048576 2024-03-09T14:28:50.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.684+0000 7f1c6444c780 1 < completed part key=_multipart_PBM4ICXZ2497.2~5XEE4EP0HL0S.1 size=154768 2024-03-09T14:28:50.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.686+0000 7f1c6444c780 1 < completed multipart upload key=PBM4ICXZ2497 upload=5XEE4EP0HL0S tag=IJWNA4Z4LGK5 type=write size=2251920 2024-03-09T14:28:50.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.688+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~T39PFJJLGSJR.0 size=1048576 2024-03-09T14:28:50.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.689+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~T39PFJJLGSJR.1 size=1048576 2024-03-09T14:28:50.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.690+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~T39PFJJLGSJR.2 size=752720 2024-03-09T14:28:50.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.690+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=T39PFJJLGSJR tag=AYT7CDKCYT6U type=write size=3898448 2024-03-09T14:28:50.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.691+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=AC7O0KCO59EV type=del 2024-03-09T14:28:50.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.693+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~Y2C212TXU3FZ.0 size=1048576 2024-03-09T14:28:50.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.694+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~Y2C212TXU3FZ.1 size=1048576 2024-03-09T14:28:50.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.695+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~Y2C212TXU3FZ.2 size=464066 2024-03-09T14:28:50.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.695+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=Y2C212TXU3FZ tag=2CE5F3416VSA type=write size=3609794 2024-03-09T14:28:50.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.696+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~1COIM41PTPIR.0 size=1048576 2024-03-09T14:28:50.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.697+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~1COIM41PTPIR.1 size=1048576 2024-03-09T14:28:50.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.698+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~1COIM41PTPIR.2 size=775422 2024-03-09T14:28:50.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.700+0000 7f1c6444c780 1 < completed multipart upload key=P33029QWKW23 upload=1COIM41PTPIR tag=NNO0BO2I6X3V type=write size=3921150 2024-03-09T14:28:50.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.701+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=8WO0OM259A6N type=del size=3177746 2024-03-09T14:28:50.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.702+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=2MGN0QIX3WKN type=del 2024-03-09T14:28:50.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.703+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=EYVVT4H6FVZN type=write size=854389 2024-03-09T14:28:50.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.704+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=YNB12UUDNWPH type=del 2024-03-09T14:28:50.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.706+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=0KQNUEYEXZ60 type=del size=2971386 2024-03-09T14:28:50.707 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.707+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=JGX701V2L6NY type=del 2024-03-09T14:28:50.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.708+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=IUX3JL1ORNR1 type=del size=2533411 2024-03-09T14:28:50.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.709+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~WO6TRJPAU014.0 size=1048576 2024-03-09T14:28:50.710 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.710+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~WO6TRJPAU014.1 size=1048576 2024-03-09T14:28:50.711 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.711+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~WO6TRJPAU014.2 size=1007757 2024-03-09T14:28:50.713 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.713+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=WO6TRJPAU014 tag=P3VGVA07ZNV5 type=write size=4153485 2024-03-09T14:28:50.714 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.714+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=YMV91LRYABS2 type=del size=437440 2024-03-09T14:28:50.715 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.715+0000 7f1c6444c780 -1 < failed to complete operation key=0ZZ0P8Y7KSAX tag=N1ZBW9NEUX5Y type=del size=208349: (22) Invalid argument 2024-03-09T14:28:50.716 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.716+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=N7UHT2K8BYCS type=del size=74537 2024-03-09T14:28:50.718 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.718+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=VREAF20KGOE3 type=write size=343562 2024-03-09T14:28:50.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.719+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=XX011T509NXB type=del size=3349110 2024-03-09T14:28:50.719 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.719+0000 7f1c6444c780 1 < canceled part key=_multipart_P33029QWKW23.2~668ZASED082J.0 size=1048576 2024-03-09T14:28:50.720 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.720+0000 7f1c6444c780 1 < completed part key=_multipart_P33029QWKW23.2~668ZASED082J.1 size=1048576 2024-03-09T14:28:50.721 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.720+0000 7f1c6444c780 1 < canceled part key=_multipart_P33029QWKW23.2~668ZASED082J.2 size=748542 2024-03-09T14:28:50.722 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.722+0000 7f1c6444c780 1 < canceled multipart upload key=P33029QWKW23 upload=668ZASED082J tag=SJX5OFYYT0KW type=write size=3894270 2024-03-09T14:28:50.724 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.724+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=HJO3Z22ISPUX type=write size=548741 2024-03-09T14:28:50.725 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.725+0000 7f1c6444c780 1 < completed delete operation key=PBM4ICXZ2497 tag=IHD3FIEPVQLH type=del 2024-03-09T14:28:50.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.726+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=C6N3BVUSXBG8 type=del size=1799563 2024-03-09T14:28:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.727+0000 7f1c6444c780 1 < completed write operation key=BAWV7KY6NT8P tag=BN1E750BIVNB type=write size=689125 2024-03-09T14:28:50.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.728+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=ETL62C533C03 type=del size=1141389 2024-03-09T14:28:50.730 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.730+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~SBKNZD86W18K.0 size=1048576 2024-03-09T14:28:50.731 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.730+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~SBKNZD86W18K.1 size=615487 2024-03-09T14:28:50.733 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.733+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=SBKNZD86W18K tag=UGTO4XB27T93 type=write size=2712639 2024-03-09T14:28:50.734 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.734+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=M3HA0MLM1CLU type=del size=2772841 2024-03-09T14:28:50.735 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.735+0000 7f1c6444c780 1 < completed write operation key=YK7ENO4UAB2M tag=RXLKGT863XBC type=write size=202579 2024-03-09T14:28:50.737 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.737+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~OAUX5UO1NMS8.0 size=1048576 2024-03-09T14:28:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.738+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~OAUX5UO1NMS8.1 size=958785 2024-03-09T14:28:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.738+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=OAUX5UO1NMS8 tag=RKEKD7ZR2Y06 type=write size=3055937 2024-03-09T14:28:50.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.739+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=KCEAI97U3GI8 type=del 2024-03-09T14:28:50.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.741+0000 7f1c6444c780 1 > prepared part key=_multipart_HNK7POWS6FSU.2~X04KQPUA0RPD.0 size=400616 2024-03-09T14:28:50.741 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.741+0000 7f1c6444c780 1 > prepared multipart upload key=HNK7POWS6FSU upload=X04KQPUA0RPD tag=LK7VTIJ9INQA type=write size=1449192 2024-03-09T14:28:50.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.742+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=KYRGK37778JG type=del 2024-03-09T14:28:50.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.745+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~9DIPJH55AKZZ.0 size=1048576 2024-03-09T14:28:50.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.745+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~9DIPJH55AKZZ.1 size=620852 2024-03-09T14:28:50.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.745+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=9DIPJH55AKZZ tag=X3J479Y712N9 type=write size=2718004 2024-03-09T14:28:50.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.746+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~T39PFJJLGSJR.0 size=1048576 2024-03-09T14:28:50.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.746+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~T39PFJJLGSJR.1 size=1048576 2024-03-09T14:28:50.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.746+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~T39PFJJLGSJR.2 size=752720 2024-03-09T14:28:50.749 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.749+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=T39PFJJLGSJR tag=AYT7CDKCYT6U type=write size=3898448 2024-03-09T14:28:50.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.750+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=MQ45DS4UA79H type=del size=1679386 2024-03-09T14:28:50.751 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.751+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~Y2C212TXU3FZ.0 size=1048576 2024-03-09T14:28:50.752 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.752+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~Y2C212TXU3FZ.1 size=1048576 2024-03-09T14:28:50.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.753+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~Y2C212TXU3FZ.2 size=464066 2024-03-09T14:28:50.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.755+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=Y2C212TXU3FZ tag=2CE5F3416VSA type=write size=3609794 2024-03-09T14:28:50.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.756+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=P3ENS8PBWZ4C type=write size=654576 2024-03-09T14:28:50.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.757+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=8WO0OM259A6N type=del 2024-03-09T14:28:50.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.760+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~DBJH134240DT.0 size=1048576 2024-03-09T14:28:50.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.760+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~DBJH134240DT.1 size=1048576 2024-03-09T14:28:50.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.761+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~DBJH134240DT.2 size=470775 2024-03-09T14:28:50.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.761+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=DBJH134240DT tag=U29SDO12G39U type=write size=3616503 2024-03-09T14:28:50.763 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.763+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=EYVVT4H6FVZN type=write size=854389 2024-03-09T14:28:50.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.765+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~9TPKAKL00RL1.0 size=818316 2024-03-09T14:28:50.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.765+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=9TPKAKL00RL1 tag=H2AIE2FME20M type=write size=1866892 2024-03-09T14:28:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.767+0000 7f1c6444c780 1 < suggested remove operation key=YK7ENO4UAB2M tag=0KQNUEYEXZ60 type=del 2024-03-09T14:28:50.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.769+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~30AT3YA0GXOA.0 size=947015 2024-03-09T14:28:50.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.769+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=30AT3YA0GXOA tag=LCEKS10Y1C1V type=write size=1995591 2024-03-09T14:28:50.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.770+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=IUX3JL1ORNR1 type=del 2024-03-09T14:28:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.771+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=YEZBJAAYU37Q type=write size=108371 2024-03-09T14:28:50.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.772+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=YMV91LRYABS2 type=del 2024-03-09T14:28:50.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.774+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=3IYD8UGN39VQ type=del size=2824309 2024-03-09T14:28:50.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.776+0000 7f1c6444c780 1 < suggested update operation key=BAWV7KY6NT8P tag=N7UHT2K8BYCS type=del size=74537 2024-03-09T14:28:50.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.777+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=K4EUMZFKJTNW type=del size=4150433 2024-03-09T14:28:50.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.778+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=XX011T509NXB type=del 2024-03-09T14:28:50.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.780+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~O63TD849R29C.0 size=1048576 2024-03-09T14:28:50.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.781+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~O63TD849R29C.1 size=60608 2024-03-09T14:28:50.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.781+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=O63TD849R29C tag=3XV7VYR38JK8 type=write size=2157760 2024-03-09T14:28:50.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.782+0000 7f1c6444c780 1 < completed write operation key=SGHNHOCYPM38 tag=HJO3Z22ISPUX type=write size=548741 2024-03-09T14:28:50.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.784+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~CXLGF4U8K63G.0 size=1048576 2024-03-09T14:28:50.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.785+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~CXLGF4U8K63G.1 size=1048576 2024-03-09T14:28:50.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.786+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~CXLGF4U8K63G.2 size=398511 2024-03-09T14:28:50.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.786+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=CXLGF4U8K63G tag=CQ9875NMIUUS type=write size=3544239 2024-03-09T14:28:50.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.787+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=C6N3BVUSXBG8 type=del 2024-03-09T14:28:50.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.789+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~CYIM6EW2M908.0 size=1048576 2024-03-09T14:28:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.790+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~CYIM6EW2M908.1 size=524944 2024-03-09T14:28:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.790+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=CYIM6EW2M908 tag=MI3WRP43KEYY type=write size=2622096 2024-03-09T14:28:50.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.791+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=ETL62C533C03 type=del 2024-03-09T14:28:50.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.793+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=0RBCIV4QKAH2 type=write size=673270 2024-03-09T14:28:50.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.794+0000 7f1c6444c780 1 < completed delete operation key=KWDIDE9AE3JP tag=M3HA0MLM1CLU type=del 2024-03-09T14:28:50.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.796+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~SY6NVMZXBYN3.0 size=1048576 2024-03-09T14:28:50.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.797+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~SY6NVMZXBYN3.1 size=837067 2024-03-09T14:28:50.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.797+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=SY6NVMZXBYN3 tag=NB1MY0X5V3KE type=write size=2934219 2024-03-09T14:28:50.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.798+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~OAUX5UO1NMS8.0 size=1048576 2024-03-09T14:28:50.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.799+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~OAUX5UO1NMS8.1 size=958785 2024-03-09T14:28:50.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.801+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=OAUX5UO1NMS8 tag=RKEKD7ZR2Y06 type=write size=3055937 2024-03-09T14:28:50.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.802+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=587CLR5N56VO type=del size=2291502 2024-03-09T14:28:50.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.803+0000 7f1c6444c780 1 < completed part key=_multipart_HNK7POWS6FSU.2~X04KQPUA0RPD.0 size=400616 2024-03-09T14:28:50.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.805+0000 7f1c6444c780 1 < completed multipart upload key=HNK7POWS6FSU upload=X04KQPUA0RPD tag=LK7VTIJ9INQA type=write size=1449192 2024-03-09T14:28:50.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.806+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=PQVA8DANRHFN type=del size=3479713 2024-03-09T14:28:50.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.808+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~9DIPJH55AKZZ.0 size=1048576 2024-03-09T14:28:50.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.809+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~9DIPJH55AKZZ.1 size=620852 2024-03-09T14:28:50.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.811+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=9DIPJH55AKZZ tag=X3J479Y712N9 type=write size=2718004 2024-03-09T14:28:50.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.813+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~1XARF3BVAFD3.0 size=1048576 2024-03-09T14:28:50.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.814+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~1XARF3BVAFD3.1 size=152199 2024-03-09T14:28:50.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.814+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=1XARF3BVAFD3 tag=GHQBB3VAIC0I type=write size=2249351 2024-03-09T14:28:50.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.815+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=MQ45DS4UA79H type=del 2024-03-09T14:28:50.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.817+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=QNGXPVW2OAUK type=del size=1698165 2024-03-09T14:28:50.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.818+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=P3ENS8PBWZ4C type=write size=654576 2024-03-09T14:28:50.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.819+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=V15BHLMVO41E type=write size=240114 2024-03-09T14:28:50.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.820+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~DBJH134240DT.0 size=1048576 2024-03-09T14:28:50.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.821+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~DBJH134240DT.1 size=1048576 2024-03-09T14:28:50.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.822+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~DBJH134240DT.2 size=470775 2024-03-09T14:28:50.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.824+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=DBJH134240DT tag=U29SDO12G39U type=write size=3616503 2024-03-09T14:28:50.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.825+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=4BFCGP7NFGP9 type=write size=856978 2024-03-09T14:28:50.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.826+0000 7f1c6444c780 1 < completed part key=_multipart_35Y98D5U0M8O.2~9TPKAKL00RL1.0 size=818316 2024-03-09T14:28:50.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.828+0000 7f1c6444c780 1 < completed multipart upload key=35Y98D5U0M8O upload=9TPKAKL00RL1 tag=H2AIE2FME20M type=write size=1866892 2024-03-09T14:28:50.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.830+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=GUXNQNGG1Q37 type=del size=2038688 2024-03-09T14:28:50.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.831+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~30AT3YA0GXOA.0 size=947015 2024-03-09T14:28:50.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.833+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=30AT3YA0GXOA tag=LCEKS10Y1C1V type=write size=1995591 2024-03-09T14:28:50.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.834+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=ECWGK0WPO3DZ type=write size=754995 2024-03-09T14:28:50.835 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.835+0000 7f1c6444c780 1 < completed write operation key=VL5EUQ52WRAN tag=YEZBJAAYU37Q type=write size=108371 2024-03-09T14:28:50.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.837+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~UGZTUQYA8Z82.0 size=1048576 2024-03-09T14:28:50.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.838+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~UGZTUQYA8Z82.1 size=313761 2024-03-09T14:28:50.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.838+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=UGZTUQYA8Z82 tag=VVD13X2LEP4D type=write size=2410913 2024-03-09T14:28:50.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.839+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=3IYD8UGN39VQ type=del 2024-03-09T14:28:50.840 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.840+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=2UTADWVQC6JI type=del size=1684566 2024-03-09T14:28:50.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.841+0000 7f1c6444c780 1 < canceled operation key=35Y98D5U0M8O tag=K4EUMZFKJTNW type=del size=4150433 2024-03-09T14:28:50.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.843+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=OHG54JSP27Q1 type=del size=4126626 2024-03-09T14:28:50.844 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.844+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~O63TD849R29C.0 size=1048576 2024-03-09T14:28:50.845 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.845+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~O63TD849R29C.1 size=60608 2024-03-09T14:28:50.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.847+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=O63TD849R29C tag=3XV7VYR38JK8 type=write size=2157760 2024-03-09T14:28:50.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.848+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=74WJMM511OJN type=del size=2008047 2024-03-09T14:28:50.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.849+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~CXLGF4U8K63G.0 size=1048576 2024-03-09T14:28:50.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.849+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~CXLGF4U8K63G.1 size=1048576 2024-03-09T14:28:50.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.850+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~CXLGF4U8K63G.2 size=398511 2024-03-09T14:28:50.852 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.852+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=CXLGF4U8K63G tag=CQ9875NMIUUS type=write size=3544239 2024-03-09T14:28:50.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.854+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~65QP5RXG05SV.0 size=1048576 2024-03-09T14:28:50.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.855+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~65QP5RXG05SV.1 size=155651 2024-03-09T14:28:50.855 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.855+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=65QP5RXG05SV tag=OQRKQ5UDHOO0 type=write size=2252803 2024-03-09T14:28:50.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.858+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~CYIM6EW2M908.0 size=1048576 2024-03-09T14:28:50.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.859+0000 7f1c6444c780 1 < completed part key=_multipart_KNOEGKSERB6Z.2~CYIM6EW2M908.1 size=524944 2024-03-09T14:28:50.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.861+0000 7f1c6444c780 1 < completed multipart upload key=KNOEGKSERB6Z upload=CYIM6EW2M908 tag=MI3WRP43KEYY type=write size=2622096 2024-03-09T14:28:50.862 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.862+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=J6AT3PTS3PKK type=del size=1547557 2024-03-09T14:28:50.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.864+0000 7f1c6444c780 1 < suggested update operation key=BYX1155MZ2LP tag=0RBCIV4QKAH2 type=write size=673270 2024-03-09T14:28:50.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.865+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=DOS37BOSCK4A type=del size=2144731 2024-03-09T14:28:50.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.866+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~SY6NVMZXBYN3.0 size=1048576 2024-03-09T14:28:50.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.867+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~SY6NVMZXBYN3.1 size=837067 2024-03-09T14:28:50.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.869+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=SY6NVMZXBYN3 tag=NB1MY0X5V3KE type=write size=2934219 2024-03-09T14:28:50.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.870+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=4UU1NRF0K1ZB type=del size=373413 2024-03-09T14:28:50.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.871+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=587CLR5N56VO type=del 2024-03-09T14:28:50.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.872+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=9ZRH491BFVGC type=del size=1899722 2024-03-09T14:28:50.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.874+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=PQVA8DANRHFN type=del 2024-03-09T14:28:50.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.875+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=1C1L1DK3X713 type=del size=367875 2024-03-09T14:28:50.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.876+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~1XARF3BVAFD3.0 size=1048576 2024-03-09T14:28:50.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.877+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~1XARF3BVAFD3.1 size=152199 2024-03-09T14:28:50.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.879+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=1XARF3BVAFD3 tag=GHQBB3VAIC0I type=write size=2249351 2024-03-09T14:28:50.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.881+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~NMZ6EBOSXA8C.0 size=1048576 2024-03-09T14:28:50.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.882+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~NMZ6EBOSXA8C.1 size=257882 2024-03-09T14:28:50.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.882+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=NMZ6EBOSXA8C tag=XS9QET71YTKP type=write size=2355034 2024-03-09T14:28:50.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.883+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=QNGXPVW2OAUK type=del 2024-03-09T14:28:50.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.884+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=5TMJLBEJACTQ type=del size=1324983 2024-03-09T14:28:50.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.885+0000 7f1c6444c780 1 < completed write operation key=NIN0FB6YTKWA tag=V15BHLMVO41E type=write size=240114 2024-03-09T14:28:50.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.886+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=61JJN7W5CBMZ type=del size=2196532 2024-03-09T14:28:50.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.887+0000 7f1c6444c780 1 < completed write operation key=35Y98D5U0M8O tag=4BFCGP7NFGP9 type=write size=856978 2024-03-09T14:28:50.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.889+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~KOEO3JCRX1WC.0 size=1048576 2024-03-09T14:28:50.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.890+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~KOEO3JCRX1WC.1 size=660775 2024-03-09T14:28:50.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.890+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=KOEO3JCRX1WC tag=Q4YPEOGXT849 type=write size=2757927 2024-03-09T14:28:50.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.892+0000 7f1c6444c780 -1 < failed to complete operation key=BYX1155MZ2LP tag=GUXNQNGG1Q37 type=del size=2038688: (22) Invalid argument 2024-03-09T14:28:50.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.893+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=82UQFTIHQ9KD type=del size=2514748 2024-03-09T14:28:50.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.895+0000 7f1c6444c780 1 < suggested update operation key=49YOZGJ8XC4K tag=ECWGK0WPO3DZ type=write size=754995 2024-03-09T14:28:50.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.897+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~098FQC7KNSO0.0 size=473668 2024-03-09T14:28:50.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.897+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=098FQC7KNSO0 tag=B0B7PNJ6AJR3 type=write size=1522244 2024-03-09T14:28:50.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.899+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~UGZTUQYA8Z82.0 size=1048576 2024-03-09T14:28:50.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.899+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~UGZTUQYA8Z82.1 size=313761 2024-03-09T14:28:50.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.901+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=UGZTUQYA8Z82 tag=VVD13X2LEP4D type=write size=2410913 2024-03-09T14:28:50.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.903+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~X2M3E0RX8RLX.0 size=1048576 2024-03-09T14:28:50.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.904+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~X2M3E0RX8RLX.1 size=1048576 2024-03-09T14:28:50.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.905+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~X2M3E0RX8RLX.2 size=807206 2024-03-09T14:28:50.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.905+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=X2M3E0RX8RLX tag=VN5PRBK1QABT type=write size=3952934 2024-03-09T14:28:50.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.906+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=2UTADWVQC6JI type=del 2024-03-09T14:28:50.909 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.909+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~PEWNWXFXVATK.0 size=1048576 2024-03-09T14:28:50.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.910+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~PEWNWXFXVATK.1 size=39028 2024-03-09T14:28:50.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.910+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=PEWNWXFXVATK tag=7VSQFO3FXUID type=write size=2136180 2024-03-09T14:28:50.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.912+0000 7f1c6444c780 1 < suggested update operation key=YECG84AJ5IK2 tag=OHG54JSP27Q1 type=del size=4126626 2024-03-09T14:28:50.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.914+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~DMKGY1963JLB.0 size=67094 2024-03-09T14:28:50.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.914+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=DMKGY1963JLB tag=2YADGP19HYAY type=write size=1115670 2024-03-09T14:28:50.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.915+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=74WJMM511OJN type=del 2024-03-09T14:28:50.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.917+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=K5ETM45WD477 type=del size=133885 2024-03-09T14:28:50.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.918+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~65QP5RXG05SV.0 size=1048576 2024-03-09T14:28:50.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.919+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~65QP5RXG05SV.1 size=155651 2024-03-09T14:28:50.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.921+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=65QP5RXG05SV tag=OQRKQ5UDHOO0 type=write size=2252803 2024-03-09T14:28:50.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.922+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=VE9DHGXET0LX type=write size=934127 2024-03-09T14:28:50.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.923+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=J6AT3PTS3PKK type=del 2024-03-09T14:28:50.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.924+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=FRKUZ4MBFPL2 type=del size=3942740 2024-03-09T14:28:50.926 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.926+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=DOS37BOSCK4A type=del size=2144731 2024-03-09T14:28:50.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.927+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=W0AC5L3J8UAM type=del size=1961951 2024-03-09T14:28:50.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.928+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=4UU1NRF0K1ZB type=del 2024-03-09T14:28:50.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.929+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=6XDNOX318PA2 type=del size=2184995 2024-03-09T14:28:50.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.931+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=9ZRH491BFVGC type=del 2024-03-09T14:28:50.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.932+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=U1MRAN75KQU8 type=del size=3506502 2024-03-09T14:28:50.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.933+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=1C1L1DK3X713 type=del 2024-03-09T14:28:50.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.934+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=CHLTWO86GAVP type=del size=504783 2024-03-09T14:28:50.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.936+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~NMZ6EBOSXA8C.0 size=1048576 2024-03-09T14:28:50.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.937+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~NMZ6EBOSXA8C.1 size=257882 2024-03-09T14:28:50.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.939+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=NMZ6EBOSXA8C tag=XS9QET71YTKP type=write size=2355034 2024-03-09T14:28:50.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.941+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~2OL2WAFM7Q4X.0 size=1048576 2024-03-09T14:28:50.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.942+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~2OL2WAFM7Q4X.1 size=1048576 2024-03-09T14:28:50.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.943+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~2OL2WAFM7Q4X.2 size=896119 2024-03-09T14:28:50.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.943+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=2OL2WAFM7Q4X tag=YRL6U2UCW4G2 type=write size=4041847 2024-03-09T14:28:50.944 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.944+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=5TMJLBEJACTQ type=del 2024-03-09T14:28:50.945 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.945+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=Q516JZQQN0C0 type=del size=1849079 2024-03-09T14:28:50.946 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.946+0000 7f1c6444c780 1 < completed delete operation key=26VE2HJPD0FX tag=61JJN7W5CBMZ type=del 2024-03-09T14:28:50.949 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.949+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~FT6UGX2T33MN.0 size=1048576 2024-03-09T14:28:50.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.950+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~FT6UGX2T33MN.1 size=214996 2024-03-09T14:28:50.950 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.950+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=FT6UGX2T33MN tag=MFTVKA1MA760 type=write size=2312148 2024-03-09T14:28:50.951 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.951+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~KOEO3JCRX1WC.0 size=1048576 2024-03-09T14:28:50.952 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.952+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~KOEO3JCRX1WC.1 size=660775 2024-03-09T14:28:50.954 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.954+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=KOEO3JCRX1WC tag=Q4YPEOGXT849 type=write size=2757927 2024-03-09T14:28:50.956 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.956+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~43A040PD9A7J.0 size=1048576 2024-03-09T14:28:50.957 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.957+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~43A040PD9A7J.1 size=1048576 2024-03-09T14:28:50.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.958+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~43A040PD9A7J.2 size=753731 2024-03-09T14:28:50.958 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.958+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=43A040PD9A7J tag=1IB8QRXOA898 type=write size=3899459 2024-03-09T14:28:50.959 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.959+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=82UQFTIHQ9KD type=del size=2514748 2024-03-09T14:28:50.961 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.961+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5UP2N5ZPP7IE.0 size=1048576 2024-03-09T14:28:50.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.962+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5UP2N5ZPP7IE.1 size=1048576 2024-03-09T14:28:50.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.963+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~5UP2N5ZPP7IE.2 size=481535 2024-03-09T14:28:50.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.963+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=5UP2N5ZPP7IE tag=AGC94E5P4NKK type=write size=3627263 2024-03-09T14:28:50.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.964+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~098FQC7KNSO0.0 size=473668 2024-03-09T14:28:50.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.967+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=098FQC7KNSO0 tag=B0B7PNJ6AJR3 type=write size=1522244 2024-03-09T14:28:50.968 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.968+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=XUKXKTRTM1EC type=del size=214700 2024-03-09T14:28:50.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.969+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~X2M3E0RX8RLX.0 size=1048576 2024-03-09T14:28:50.970 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.970+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~X2M3E0RX8RLX.1 size=1048576 2024-03-09T14:28:50.971 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.971+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~X2M3E0RX8RLX.2 size=807206 2024-03-09T14:28:50.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.973+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=X2M3E0RX8RLX tag=VN5PRBK1QABT type=write size=3952934 2024-03-09T14:28:50.975 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.975+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~T8TJAHNG31G7.0 size=1048576 2024-03-09T14:28:50.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.976+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~T8TJAHNG31G7.1 size=165847 2024-03-09T14:28:50.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.976+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=T8TJAHNG31G7 tag=YUULV00SLKU7 type=write size=2262999 2024-03-09T14:28:50.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.977+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~PEWNWXFXVATK.0 size=1048576 2024-03-09T14:28:50.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.978+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~PEWNWXFXVATK.1 size=39028 2024-03-09T14:28:50.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.980+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=PEWNWXFXVATK tag=7VSQFO3FXUID type=write size=2136180 2024-03-09T14:28:50.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.981+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=OFKY1668VPUB type=del size=1037574 2024-03-09T14:28:50.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.982+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~DMKGY1963JLB.0 size=67094 2024-03-09T14:28:50.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.984+0000 7f1c6444c780 1 < completed multipart upload key=26VE2HJPD0FX upload=DMKGY1963JLB tag=2YADGP19HYAY type=write size=1115670 2024-03-09T14:28:50.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.985+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=MZJ5IRUZ2I50 type=del size=2934115 2024-03-09T14:28:50.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.986+0000 7f1c6444c780 1 < completed delete operation key=YK7ENO4UAB2M tag=K5ETM45WD477 type=del 2024-03-09T14:28:50.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.987+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=BWTBAK404UIN type=write size=1032887 2024-03-09T14:28:50.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.988+0000 7f1c6444c780 1 < completed write operation key=YECG84AJ5IK2 tag=VE9DHGXET0LX type=write size=934127 2024-03-09T14:28:50.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.989+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=YB9XSN9HLQ2V type=del size=2812764 2024-03-09T14:28:50.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.990+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=FRKUZ4MBFPL2 type=del size=3942740 2024-03-09T14:28:50.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.991+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=WIXRSAB2IDU0 type=write size=565785 2024-03-09T14:28:50.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.992+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=W0AC5L3J8UAM type=del 2024-03-09T14:28:50.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.994+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~WLCXXZBSPMF6.0 size=1048576 2024-03-09T14:28:50.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.995+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~WLCXXZBSPMF6.1 size=522746 2024-03-09T14:28:50.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.995+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=WLCXXZBSPMF6 tag=I2SGSXSBXLHR type=write size=2619898 2024-03-09T14:28:50.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.996+0000 7f1c6444c780 1 < completed delete operation key=BYX1155MZ2LP tag=6XDNOX318PA2 type=del 2024-03-09T14:28:50.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.998+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=TEZXEKROSPXT type=del size=3510628 2024-03-09T14:28:50.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:50.999+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=U1MRAN75KQU8 type=del 2024-03-09T14:28:51.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.000+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=F2ZMABZU0V5H type=del size=2965245 2024-03-09T14:28:51.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.001+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=CHLTWO86GAVP type=del 2024-03-09T14:28:51.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.002+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=0VQCSGGA5ITB type=del size=2465878 2024-03-09T14:28:51.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.003+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~2OL2WAFM7Q4X.0 size=1048576 2024-03-09T14:28:51.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.004+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~2OL2WAFM7Q4X.1 size=1048576 2024-03-09T14:28:51.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.005+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~2OL2WAFM7Q4X.2 size=896119 2024-03-09T14:28:51.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.007+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=2OL2WAFM7Q4X tag=YRL6U2UCW4G2 type=write size=4041847 2024-03-09T14:28:51.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.008+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=O2GJ9M3QQ78G type=del size=3330495 2024-03-09T14:28:51.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.010+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=Q516JZQQN0C0 type=del 2024-03-09T14:28:51.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.012+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~F8GQSKCEZO8S.0 size=318158 2024-03-09T14:28:51.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.012+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=F8GQSKCEZO8S tag=8KGM0H0N59FF type=write size=1366734 2024-03-09T14:28:51.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.013+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~FT6UGX2T33MN.0 size=1048576 2024-03-09T14:28:51.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.015+0000 7f1c6444c780 1 < completed part key=_multipart_MOVS6ZMK708G.2~FT6UGX2T33MN.1 size=214996 2024-03-09T14:28:51.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.017+0000 7f1c6444c780 1 < completed multipart upload key=MOVS6ZMK708G upload=FT6UGX2T33MN tag=MFTVKA1MA760 type=write size=2312148 2024-03-09T14:28:51.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.019+0000 7f1c6444c780 1 > prepared part key=_multipart_Z34QOCZB3DFX.2~SU63WCE40DY0.0 size=357316 2024-03-09T14:28:51.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.019+0000 7f1c6444c780 1 > prepared multipart upload key=Z34QOCZB3DFX upload=SU63WCE40DY0 tag=ZQ7DF94340AO type=write size=1405892 2024-03-09T14:28:51.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.021+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~43A040PD9A7J.0 size=1048576 2024-03-09T14:28:51.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.022+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~43A040PD9A7J.1 size=1048576 2024-03-09T14:28:51.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.023+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~43A040PD9A7J.2 size=753731 2024-03-09T14:28:51.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.025+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=43A040PD9A7J tag=1IB8QRXOA898 type=write size=3899459 2024-03-09T14:28:51.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.027+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~O54QLTUD918C.0 size=1048576 2024-03-09T14:28:51.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.028+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~O54QLTUD918C.1 size=1048576 2024-03-09T14:28:51.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.029+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~O54QLTUD918C.2 size=162358 2024-03-09T14:28:51.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.029+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=O54QLTUD918C tag=S70QBUOR5Z0Q type=write size=3308086 2024-03-09T14:28:51.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.030+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5UP2N5ZPP7IE.0 size=1048576 2024-03-09T14:28:51.031 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.031+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5UP2N5ZPP7IE.1 size=1048576 2024-03-09T14:28:51.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.032+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~5UP2N5ZPP7IE.2 size=481535 2024-03-09T14:28:51.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.034+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=5UP2N5ZPP7IE tag=AGC94E5P4NKK type=write size=3627263 2024-03-09T14:28:51.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.035+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=3EJ32I5PEQ32 type=del size=3662386 2024-03-09T14:28:51.036 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.036+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=XUKXKTRTM1EC type=del 2024-03-09T14:28:51.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.037+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=X9P775LHRNM3 type=del size=3731365 2024-03-09T14:28:51.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.038+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~T8TJAHNG31G7.0 size=1048576 2024-03-09T14:28:51.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.039+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~T8TJAHNG31G7.1 size=165847 2024-03-09T14:28:51.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.041+0000 7f1c6444c780 1 < completed multipart upload key=71FSR1CHFBO0 upload=T8TJAHNG31G7 tag=YUULV00SLKU7 type=write size=2262999 2024-03-09T14:28:51.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.042+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=JA0VKBPR6UZ7 type=del size=2005881 2024-03-09T14:28:51.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.044+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=OFKY1668VPUB type=del size=1037574 2024-03-09T14:28:51.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.046+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~NPRKNOLQ59P1.0 size=114892 2024-03-09T14:28:51.046 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.046+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=NPRKNOLQ59P1 tag=VLTZR76OYA64 type=write size=1163468 2024-03-09T14:28:51.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.047+0000 7f1c6444c780 1 < canceled operation key=0IHHFQBKKJ0G tag=MZJ5IRUZ2I50 type=del size=2934115 2024-03-09T14:28:51.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.048+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=1FCR216CIRE3 type=del size=3980051 2024-03-09T14:28:51.049 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.049+0000 7f1c6444c780 1 < completed write operation key=JX05U3G6NLLO tag=BWTBAK404UIN type=write size=1032887 2024-03-09T14:28:51.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.050+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=L13QTZNMT4EA type=del size=3141736 2024-03-09T14:28:51.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.052+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=YB9XSN9HLQ2V type=del 2024-03-09T14:28:51.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.054+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~5ETGSZ4E2I3X.0 size=578705 2024-03-09T14:28:51.054 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.054+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=5ETGSZ4E2I3X tag=DZF3573CG622 type=write size=1627281 2024-03-09T14:28:51.055 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.055+0000 7f1c6444c780 1 < completed write operation key=QSMTZR754455 tag=WIXRSAB2IDU0 type=write size=565785 2024-03-09T14:28:51.056 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.056+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=PJVCF4L6PZ2M type=del size=1715653 2024-03-09T14:28:51.057 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.057+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~WLCXXZBSPMF6.0 size=1048576 2024-03-09T14:28:51.058 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.058+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~WLCXXZBSPMF6.1 size=522746 2024-03-09T14:28:51.060 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.060+0000 7f1c6444c780 1 < completed multipart upload key=YECG84AJ5IK2 upload=WLCXXZBSPMF6 tag=I2SGSXSBXLHR type=write size=2619898 2024-03-09T14:28:51.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.062+0000 7f1c6444c780 1 > prepared part key=_multipart_YK7ENO4UAB2M.2~S0EUNI8LON8W.0 size=206220 2024-03-09T14:28:51.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.062+0000 7f1c6444c780 1 > prepared multipart upload key=YK7ENO4UAB2M upload=S0EUNI8LON8W tag=8XQRIF0WWGX7 type=write size=1254796 2024-03-09T14:28:51.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.065+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=TEZXEKROSPXT type=del 2024-03-09T14:28:51.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.066+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=I8MK96JAO8AD type=del size=3467131 2024-03-09T14:28:51.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.067+0000 7f1c6444c780 1 < canceled operation key=SGHNHOCYPM38 tag=F2ZMABZU0V5H type=del size=2965245 2024-03-09T14:28:51.068 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.068+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=VZAG5WTPK87Y type=del size=2232860 2024-03-09T14:28:51.069 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.069+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=0VQCSGGA5ITB type=del 2024-03-09T14:28:51.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.071+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=AUYQYFE3K0MO type=write size=906706 2024-03-09T14:28:51.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.073+0000 7f1c6444c780 1 < suggested update operation key=PBM4ICXZ2497 tag=O2GJ9M3QQ78G type=del size=3330495 2024-03-09T14:28:51.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.074+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=BEK0B9FRRQT6 type=write size=266650 2024-03-09T14:28:51.076 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.077+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~F8GQSKCEZO8S.0 size=318158 2024-03-09T14:28:51.081 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.078+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=F8GQSKCEZO8S tag=8KGM0H0N59FF type=write size=1366734 2024-03-09T14:28:51.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.080+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=S655N3B6WGNC type=del size=1796684 2024-03-09T14:28:51.082 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.081+0000 7f1c6444c780 1 < completed part key=_multipart_Z34QOCZB3DFX.2~SU63WCE40DY0.0 size=357316 2024-03-09T14:28:51.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.083+0000 7f1c6444c780 1 < completed multipart upload key=Z34QOCZB3DFX upload=SU63WCE40DY0 tag=ZQ7DF94340AO type=write size=1405892 2024-03-09T14:28:51.084 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.084+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=2X1T0N10DQXU type=del size=2791442 2024-03-09T14:28:51.086 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.086+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~O54QLTUD918C.0 size=1048576 2024-03-09T14:28:51.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.087+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~O54QLTUD918C.1 size=1048576 2024-03-09T14:28:51.088 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.088+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~O54QLTUD918C.2 size=162358 2024-03-09T14:28:51.089 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.089+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=O54QLTUD918C tag=S70QBUOR5Z0Q type=write size=3308086 2024-03-09T14:28:51.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.092+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~WM3MVHW8HO3X.0 size=1048576 2024-03-09T14:28:51.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.093+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~WM3MVHW8HO3X.1 size=1048576 2024-03-09T14:28:51.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.094+0000 7f1c6444c780 1 > prepared part key=_multipart_71FSR1CHFBO0.2~WM3MVHW8HO3X.2 size=399863 2024-03-09T14:28:51.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.094+0000 7f1c6444c780 1 > prepared multipart upload key=71FSR1CHFBO0 upload=WM3MVHW8HO3X tag=KNAK2NJQUII4 type=write size=3545591 2024-03-09T14:28:51.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.095+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=3EJ32I5PEQ32 type=del 2024-03-09T14:28:51.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.096+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=YI5CIG1L484V type=del size=2113644 2024-03-09T14:28:51.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.097+0000 7f1c6444c780 1 < canceled operation key=49YOZGJ8XC4K tag=X9P775LHRNM3 type=del size=3731365 2024-03-09T14:28:51.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.099+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~JYDRHTL3AAB6.0 size=470434 2024-03-09T14:28:51.100 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.099+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=JYDRHTL3AAB6 tag=LOSC0C95TXNQ type=write size=1519010 2024-03-09T14:28:51.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.101+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=JA0VKBPR6UZ7 type=del 2024-03-09T14:28:51.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.103+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~EK0XE9YQZH7N.0 size=1048576 2024-03-09T14:28:51.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.104+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~EK0XE9YQZH7N.1 size=163418 2024-03-09T14:28:51.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.104+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=EK0XE9YQZH7N tag=DSKXZ4LRFKJ4 type=write size=2260570 2024-03-09T14:28:51.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.105+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~NPRKNOLQ59P1.0 size=114892 2024-03-09T14:28:51.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.107+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=NPRKNOLQ59P1 tag=VLTZR76OYA64 type=write size=1163468 2024-03-09T14:28:51.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.108+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=6UW99H24FXE0 type=del size=945468 2024-03-09T14:28:51.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.110+0000 7f1c6444c780 1 < suggested update operation key=EREG1M13901A tag=1FCR216CIRE3 type=del size=3980051 2024-03-09T14:28:51.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.111+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=3T1FJ2WAKI71 type=del size=4175469 2024-03-09T14:28:51.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.113+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=L13QTZNMT4EA type=del 2024-03-09T14:28:51.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.114+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=TJ3X0EZSW4Z7 type=del size=2240913 2024-03-09T14:28:51.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.114+0000 7f1c6444c780 1 < canceled part key=_multipart_3CC018VYSRHN.2~5ETGSZ4E2I3X.0 size=578705 2024-03-09T14:28:51.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.116+0000 7f1c6444c780 1 < canceled multipart upload key=3CC018VYSRHN upload=5ETGSZ4E2I3X tag=DZF3573CG622 type=write size=1627281 2024-03-09T14:28:51.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.117+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=QC7W5GFFRGMF type=del size=3337912 2024-03-09T14:28:51.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.119+0000 7f1c6444c780 1 < suggested remove operation key=BAWV7KY6NT8P tag=PJVCF4L6PZ2M type=del 2024-03-09T14:28:51.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.120+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=9M59QOS27YSI type=del size=1995915 2024-03-09T14:28:51.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.122+0000 7f1c6444c780 1 < completed part key=_multipart_YK7ENO4UAB2M.2~S0EUNI8LON8W.0 size=206220 2024-03-09T14:28:51.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.124+0000 7f1c6444c780 1 < completed multipart upload key=YK7ENO4UAB2M upload=S0EUNI8LON8W tag=8XQRIF0WWGX7 type=write size=1254796 2024-03-09T14:28:51.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.126+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~BFGJPF9R0N14.0 size=1048576 2024-03-09T14:28:51.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.127+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~BFGJPF9R0N14.1 size=1048576 2024-03-09T14:28:51.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.127+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~BFGJPF9R0N14.2 size=761242 2024-03-09T14:28:51.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.127+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=BFGJPF9R0N14 tag=DWET702IOAWM type=write size=3906970 2024-03-09T14:28:51.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.129+0000 7f1c6444c780 1 < canceled operation key=1NQRJ8ICZNM6 tag=I8MK96JAO8AD type=del size=3467131 2024-03-09T14:28:51.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.131+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~Z3OC56CTJTIY.0 size=1048576 2024-03-09T14:28:51.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.132+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~Z3OC56CTJTIY.1 size=1048576 2024-03-09T14:28:51.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.133+0000 7f1c6444c780 1 > prepared part key=_multipart_BYX1155MZ2LP.2~Z3OC56CTJTIY.2 size=617631 2024-03-09T14:28:51.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.133+0000 7f1c6444c780 1 > prepared multipart upload key=BYX1155MZ2LP upload=Z3OC56CTJTIY tag=9Z5546SDYQW2 type=write size=3763359 2024-03-09T14:28:51.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.134+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=VZAG5WTPK87Y type=del 2024-03-09T14:28:51.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.136+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~ZQRPI1VPK220.0 size=1048576 2024-03-09T14:28:51.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.137+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~ZQRPI1VPK220.1 size=756858 2024-03-09T14:28:51.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.137+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=ZQRPI1VPK220 tag=1IPJSFG8GQQQ type=write size=2854010 2024-03-09T14:28:51.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.138+0000 7f1c6444c780 1 < completed write operation key=49YOZGJ8XC4K tag=AUYQYFE3K0MO type=write size=906706 2024-03-09T14:28:51.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.140+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~7RI3WBTP1WOC.0 size=1048576 2024-03-09T14:28:51.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.141+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~7RI3WBTP1WOC.1 size=504940 2024-03-09T14:28:51.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.141+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=7RI3WBTP1WOC tag=0JBNX7V624BE type=write size=2602092 2024-03-09T14:28:51.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.142+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=BEK0B9FRRQT6 type=write size=266650 2024-03-09T14:28:51.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.143+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=8UBGI9YF8VFC type=del size=446547 2024-03-09T14:28:51.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.144+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=S655N3B6WGNC type=del 2024-03-09T14:28:51.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.145+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=HK6OBKQ22VXJ type=del size=3920043 2024-03-09T14:28:51.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.147+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=2X1T0N10DQXU type=del 2024-03-09T14:28:51.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.148+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=GNH3P5XBZIYG type=del size=2069763 2024-03-09T14:28:51.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.149+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~WM3MVHW8HO3X.0 size=1048576 2024-03-09T14:28:51.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.149+0000 7f1c6444c780 1 < canceled part key=_multipart_71FSR1CHFBO0.2~WM3MVHW8HO3X.1 size=1048576 2024-03-09T14:28:51.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.150+0000 7f1c6444c780 1 < completed part key=_multipart_71FSR1CHFBO0.2~WM3MVHW8HO3X.2 size=399863 2024-03-09T14:28:51.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.152+0000 7f1c6444c780 1 < canceled multipart upload key=71FSR1CHFBO0 upload=WM3MVHW8HO3X tag=KNAK2NJQUII4 type=write size=3545591 2024-03-09T14:28:51.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.153+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=KS16Q1I4Y5NK type=del size=3163990 2024-03-09T14:28:51.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.154+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=YI5CIG1L484V type=del 2024-03-09T14:28:51.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.156+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~88DATDTPAAKD.0 size=1048576 2024-03-09T14:28:51.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.157+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~88DATDTPAAKD.1 size=258498 2024-03-09T14:28:51.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.157+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=88DATDTPAAKD tag=5RQVYDOVCB07 type=write size=2355650 2024-03-09T14:28:51.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.158+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~JYDRHTL3AAB6.0 size=470434 2024-03-09T14:28:51.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.160+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=JYDRHTL3AAB6 tag=LOSC0C95TXNQ type=write size=1519010 2024-03-09T14:28:51.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.162+0000 7f1c6444c780 1 > prepared part key=_multipart_QSMTZR754455.2~PUFKKS68U57S.0 size=786675 2024-03-09T14:28:51.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.162+0000 7f1c6444c780 1 > prepared multipart upload key=QSMTZR754455 upload=PUFKKS68U57S tag=RCGF3NC8RFRO type=write size=1835251 2024-03-09T14:28:51.163 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.163+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~EK0XE9YQZH7N.0 size=1048576 2024-03-09T14:28:51.163 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.163+0000 7f1c6444c780 1 < canceled part key=_multipart_MX3X6ILR7J8N.2~EK0XE9YQZH7N.1 size=163418 2024-03-09T14:28:51.165 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.165+0000 7f1c6444c780 1 < canceled multipart upload key=MX3X6ILR7J8N upload=EK0XE9YQZH7N tag=DSKXZ4LRFKJ4 type=write size=2260570 2024-03-09T14:28:51.166 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.166+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=WIP3TE37KCI7 type=del size=3247139 2024-03-09T14:28:51.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.169+0000 7f1c6444c780 1 < suggested update operation key=Z34QOCZB3DFX tag=6UW99H24FXE0 type=del size=945468 2024-03-09T14:28:51.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.170+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=FAU61VW5W4X8 type=write size=446021 2024-03-09T14:28:51.171 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.171+0000 7f1c6444c780 1 < completed delete operation key=KNOEGKSERB6Z tag=3T1FJ2WAKI71 type=del 2024-03-09T14:28:51.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.173+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~E89QSH2Y9RV2.0 size=324575 2024-03-09T14:28:51.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.173+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=E89QSH2Y9RV2 tag=RTFANK90TZ7Q type=write size=1373151 2024-03-09T14:28:51.174 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.174+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=TJ3X0EZSW4Z7 type=del 2024-03-09T14:28:51.176 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.176+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~AA6B9412PFZ5.0 size=1048576 2024-03-09T14:28:51.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.177+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~AA6B9412PFZ5.1 size=254186 2024-03-09T14:28:51.177 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.177+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=AA6B9412PFZ5 tag=XF8JTPNU7CNY type=write size=2351338 2024-03-09T14:28:51.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.178+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=QC7W5GFFRGMF type=del 2024-03-09T14:28:51.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.179+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=PK5EAY9WT2L4 type=del size=2779517 2024-03-09T14:28:51.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.181+0000 7f1c6444c780 -1 < failed to complete operation key=Z34QOCZB3DFX tag=9M59QOS27YSI type=del size=1995915: (22) Invalid argument 2024-03-09T14:28:51.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.182+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=X2KJYPJUTYM5 type=del size=1352766 2024-03-09T14:28:51.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.182+0000 7f1c6444c780 1 < canceled part key=_multipart_VL5EUQ52WRAN.2~BFGJPF9R0N14.0 size=1048576 2024-03-09T14:28:51.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.183+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~BFGJPF9R0N14.1 size=1048576 2024-03-09T14:28:51.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.185+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~BFGJPF9R0N14.2 size=761242 2024-03-09T14:28:51.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.187+0000 7f1c6444c780 1 < canceled multipart upload key=VL5EUQ52WRAN upload=BFGJPF9R0N14 tag=DWET702IOAWM type=write size=3906970 2024-03-09T14:28:51.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.188+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=D6TENQOYLFHB type=write size=286460 2024-03-09T14:28:51.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.189+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~Z3OC56CTJTIY.0 size=1048576 2024-03-09T14:28:51.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.190+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~Z3OC56CTJTIY.1 size=1048576 2024-03-09T14:28:51.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.191+0000 7f1c6444c780 1 < completed part key=_multipart_BYX1155MZ2LP.2~Z3OC56CTJTIY.2 size=617631 2024-03-09T14:28:51.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.193+0000 7f1c6444c780 1 < completed multipart upload key=BYX1155MZ2LP upload=Z3OC56CTJTIY tag=9Z5546SDYQW2 type=write size=3763359 2024-03-09T14:28:51.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.194+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=UAKD6M3CIOL4 type=del size=3336941 2024-03-09T14:28:51.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.195+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~ZQRPI1VPK220.0 size=1048576 2024-03-09T14:28:51.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.196+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~ZQRPI1VPK220.1 size=756858 2024-03-09T14:28:51.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.198+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=ZQRPI1VPK220 tag=1IPJSFG8GQQQ type=write size=2854010 2024-03-09T14:28:51.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.199+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=8W8QY9B6MSTQ type=del size=316799 2024-03-09T14:28:51.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.200+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~7RI3WBTP1WOC.0 size=1048576 2024-03-09T14:28:51.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.201+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~7RI3WBTP1WOC.1 size=504940 2024-03-09T14:28:51.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.203+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=7RI3WBTP1WOC tag=0JBNX7V624BE type=write size=2602092 2024-03-09T14:28:51.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.204+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=RNNS6D5PB7Y9 type=write size=897991 2024-03-09T14:28:51.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.205+0000 7f1c6444c780 1 < completed delete operation key=WMO6LTCMVXD2 tag=8UBGI9YF8VFC type=del 2024-03-09T14:28:51.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.206+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=AEP1FF210SV5 type=del size=1779143 2024-03-09T14:28:51.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.208+0000 7f1c6444c780 1 < suggested remove operation key=PBM4ICXZ2497 tag=HK6OBKQ22VXJ type=del 2024-03-09T14:28:51.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.210+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=XFHKCS590BF1 type=del size=3745041 2024-03-09T14:28:51.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.211+0000 7f1c6444c780 1 < completed delete operation key=SGHNHOCYPM38 tag=GNH3P5XBZIYG type=del 2024-03-09T14:28:51.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.212+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=OA73PWRWDSYM type=del size=1128411 2024-03-09T14:28:51.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.213+0000 7f1c6444c780 1 < completed delete operation key=EREG1M13901A tag=KS16Q1I4Y5NK type=del 2024-03-09T14:28:51.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.215+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~5H7XG0NLJ05W.0 size=1048576 2024-03-09T14:28:51.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.216+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~5H7XG0NLJ05W.1 size=247638 2024-03-09T14:28:51.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.216+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=5H7XG0NLJ05W tag=9Y9DH1AI9E2O type=write size=2344790 2024-03-09T14:28:51.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.217+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~88DATDTPAAKD.0 size=1048576 2024-03-09T14:28:51.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.218+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~88DATDTPAAKD.1 size=258498 2024-03-09T14:28:51.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.220+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=88DATDTPAAKD tag=5RQVYDOVCB07 type=write size=2355650 2024-03-09T14:28:51.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.221+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=Y4ABDUYMRMWL type=del size=2070901 2024-03-09T14:28:51.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.222+0000 7f1c6444c780 1 < completed part key=_multipart_QSMTZR754455.2~PUFKKS68U57S.0 size=786675 2024-03-09T14:28:51.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.224+0000 7f1c6444c780 1 < completed multipart upload key=QSMTZR754455 upload=PUFKKS68U57S tag=RCGF3NC8RFRO type=write size=1835251 2024-03-09T14:28:51.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.225+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=TJ0OS7NHCEAC type=del size=382767 2024-03-09T14:28:51.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.226+0000 7f1c6444c780 1 < completed delete operation key=71FSR1CHFBO0 tag=WIP3TE37KCI7 type=del 2024-03-09T14:28:51.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.228+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~4EXELSO687KY.0 size=313330 2024-03-09T14:28:51.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.228+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=4EXELSO687KY tag=GR2P6NZFRRSZ type=write size=1361906 2024-03-09T14:28:51.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.229+0000 7f1c6444c780 1 < completed write operation key=KNOEGKSERB6Z tag=FAU61VW5W4X8 type=write size=446021 2024-03-09T14:28:51.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.231+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~HYJOTRXTO3LC.0 size=1048576 2024-03-09T14:28:51.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.232+0000 7f1c6444c780 1 > prepared part key=_multipart_HPFPL79B0GLS.2~HYJOTRXTO3LC.1 size=618683 2024-03-09T14:28:51.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.232+0000 7f1c6444c780 1 > prepared multipart upload key=HPFPL79B0GLS upload=HYJOTRXTO3LC tag=TN06B0CH9KYH type=write size=2715835 2024-03-09T14:28:51.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.233+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~E89QSH2Y9RV2.0 size=324575 2024-03-09T14:28:51.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.235+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=E89QSH2Y9RV2 tag=RTFANK90TZ7Q type=write size=1373151 2024-03-09T14:28:51.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.236+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=AZZF05MN8PS9 type=del size=284558 2024-03-09T14:28:51.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.236+0000 7f1c6444c780 1 < canceled part key=_multipart_HPFPL79B0GLS.2~AA6B9412PFZ5.0 size=1048576 2024-03-09T14:28:51.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.237+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~AA6B9412PFZ5.1 size=254186 2024-03-09T14:28:51.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.239+0000 7f1c6444c780 1 < canceled multipart upload key=HPFPL79B0GLS upload=AA6B9412PFZ5 tag=XF8JTPNU7CNY type=write size=2351338 2024-03-09T14:28:51.240 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.240+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=RIR02J3MNGYV type=del size=3204111 2024-03-09T14:28:51.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.242+0000 7f1c6444c780 1 < suggested update operation key=HNK7POWS6FSU tag=PK5EAY9WT2L4 type=del size=2779517 2024-03-09T14:28:51.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.243+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=IUITGPK5ABL6 type=del size=30550 2024-03-09T14:28:51.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.245+0000 7f1c6444c780 1 < suggested update operation key=0ZZ0P8Y7KSAX tag=X2KJYPJUTYM5 type=del size=1352766 2024-03-09T14:28:51.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.247+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=GJDWUQT8G4D7 type=write size=370972 2024-03-09T14:28:51.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.248+0000 7f1c6444c780 1 < completed write operation key=HPFPL79B0GLS tag=D6TENQOYLFHB type=write size=286460 2024-03-09T14:28:51.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.249+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=EMF4VDCCUOFR type=del size=2941706 2024-03-09T14:28:51.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.250+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=UAKD6M3CIOL4 type=del 2024-03-09T14:28:51.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.251+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=C967Z1RPNE1T type=del size=2567077 2024-03-09T14:28:51.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.252+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=8W8QY9B6MSTQ type=del 2024-03-09T14:28:51.254 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.254+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~CU712X13VJXJ.0 size=1048576 2024-03-09T14:28:51.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.255+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~CU712X13VJXJ.1 size=1048576 2024-03-09T14:28:51.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.256+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~CU712X13VJXJ.2 size=62498 2024-03-09T14:28:51.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.256+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=CU712X13VJXJ tag=QKLQT8CRYVJD type=write size=3208226 2024-03-09T14:28:51.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.257+0000 7f1c6444c780 1 < completed write operation key=NIN0FB6YTKWA tag=RNNS6D5PB7Y9 type=write size=897991 2024-03-09T14:28:51.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.259+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~HS2E2PUOJ50R.0 size=600913 2024-03-09T14:28:51.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.259+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=HS2E2PUOJ50R tag=9CICBKF5FKR3 type=write size=1649489 2024-03-09T14:28:51.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.261+0000 7f1c6444c780 1 < completed delete operation key=1NQRJ8ICZNM6 tag=AEP1FF210SV5 type=del 2024-03-09T14:28:51.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.262+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=C9RI4PT8Q1TB type=del size=2435927 2024-03-09T14:28:51.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.263+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=XFHKCS590BF1 type=del 2024-03-09T14:28:51.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.264+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=M8BS0J9RGINO type=del size=3306486 2024-03-09T14:28:51.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.265+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=OA73PWRWDSYM type=del 2024-03-09T14:28:51.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.267+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=A9EECLPZYZRC type=del size=1201170 2024-03-09T14:28:51.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.268+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~5H7XG0NLJ05W.0 size=1048576 2024-03-09T14:28:51.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.269+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~5H7XG0NLJ05W.1 size=247638 2024-03-09T14:28:51.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.271+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=5H7XG0NLJ05W tag=9Y9DH1AI9E2O type=write size=2344790 2024-03-09T14:28:51.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.273+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~0NQ3797GI9YS.0 size=1048576 2024-03-09T14:28:51.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.274+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~0NQ3797GI9YS.1 size=1048576 2024-03-09T14:28:51.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.275+0000 7f1c6444c780 1 > prepared part key=_multipart_0IHHFQBKKJ0G.2~0NQ3797GI9YS.2 size=598761 2024-03-09T14:28:51.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.275+0000 7f1c6444c780 1 > prepared multipart upload key=0IHHFQBKKJ0G upload=0NQ3797GI9YS tag=HPY4BJFLM1RT type=write size=3744489 2024-03-09T14:28:51.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.277+0000 7f1c6444c780 1 < suggested remove operation key=BAWV7KY6NT8P tag=Y4ABDUYMRMWL type=del 2024-03-09T14:28:51.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.279+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=0ZXR5E9RJJYK type=write size=152753 2024-03-09T14:28:51.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.280+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=TJ0OS7NHCEAC type=del 2024-03-09T14:28:51.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.281+0000 7f1c6444c780 1 > prepared operation key=71FSR1CHFBO0 tag=M3RREZ29EMCO type=del size=3947485 2024-03-09T14:28:51.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.281+0000 7f1c6444c780 1 < canceled part key=_multipart_MX3X6ILR7J8N.2~4EXELSO687KY.0 size=313330 2024-03-09T14:28:51.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.283+0000 7f1c6444c780 1 < canceled multipart upload key=MX3X6ILR7J8N upload=4EXELSO687KY tag=GR2P6NZFRRSZ type=write size=1361906 2024-03-09T14:28:51.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.284+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=5NY3V20MUINO type=del size=3534120 2024-03-09T14:28:51.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.285+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~HYJOTRXTO3LC.0 size=1048576 2024-03-09T14:28:51.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.286+0000 7f1c6444c780 1 < completed part key=_multipart_HPFPL79B0GLS.2~HYJOTRXTO3LC.1 size=618683 2024-03-09T14:28:51.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.288+0000 7f1c6444c780 1 < completed multipart upload key=HPFPL79B0GLS upload=HYJOTRXTO3LC tag=TN06B0CH9KYH type=write size=2715835 2024-03-09T14:28:51.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.292+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~NWK7CPS7A7PG.0 size=1048576 2024-03-09T14:28:51.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.293+0000 7f1c6444c780 1 > prepared part key=_multipart_BAWV7KY6NT8P.2~NWK7CPS7A7PG.1 size=770473 2024-03-09T14:28:51.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.293+0000 7f1c6444c780 1 > prepared multipart upload key=BAWV7KY6NT8P upload=NWK7CPS7A7PG tag=KXQU26Q3QZNB type=write size=2867625 2024-03-09T14:28:51.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.294+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=AZZF05MN8PS9 type=del 2024-03-09T14:28:51.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.295+0000 7f1c6444c780 1 > prepared operation key=SGHNHOCYPM38 tag=V2ANR1Y4Q0G0 type=del size=4108611 2024-03-09T14:28:51.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.296+0000 7f1c6444c780 -1 < failed to complete operation key=BAWV7KY6NT8P tag=RIR02J3MNGYV type=del size=3204111: (22) Invalid argument 2024-03-09T14:28:51.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.298+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~HZKFIRAS1LDN.0 size=105448 2024-03-09T14:28:51.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.298+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=HZKFIRAS1LDN tag=OZ723ECATZ3W type=write size=1154024 2024-03-09T14:28:51.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.300+0000 7f1c6444c780 1 < suggested remove operation key=0ZZ0P8Y7KSAX tag=IUITGPK5ABL6 type=del 2024-03-09T14:28:51.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.302+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=GOKLID3AVYIM type=write size=172807 2024-03-09T14:28:51.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.303+0000 7f1c6444c780 1 < canceled operation key=YECG84AJ5IK2 tag=GJDWUQT8G4D7 type=write size=370972 2024-03-09T14:28:51.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.304+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=8KSQIN1HY4B9 type=del size=1269676 2024-03-09T14:28:51.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.305+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=EMF4VDCCUOFR type=del 2024-03-09T14:28:51.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.307+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~64M8RXWQ83EO.0 size=1048576 2024-03-09T14:28:51.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.308+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~64M8RXWQ83EO.1 size=922795 2024-03-09T14:28:51.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.308+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=64M8RXWQ83EO tag=AR020IQ962PQ type=write size=3019947 2024-03-09T14:28:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.309+0000 7f1c6444c780 1 < completed delete operation key=P33029QWKW23 tag=C967Z1RPNE1T type=del 2024-03-09T14:28:51.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.310+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=SBY0XFKMPFRC type=del size=2095632 2024-03-09T14:28:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.311+0000 7f1c6444c780 1 < canceled part key=_multipart_0IHHFQBKKJ0G.2~CU712X13VJXJ.0 size=1048576 2024-03-09T14:28:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.312+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~CU712X13VJXJ.1 size=1048576 2024-03-09T14:28:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.312+0000 7f1c6444c780 1 < canceled part key=_multipart_0IHHFQBKKJ0G.2~CU712X13VJXJ.2 size=62498 2024-03-09T14:28:51.314 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.314+0000 7f1c6444c780 1 < canceled multipart upload key=0IHHFQBKKJ0G upload=CU712X13VJXJ tag=QKLQT8CRYVJD type=write size=3208226 2024-03-09T14:28:51.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.315+0000 7f1c6444c780 1 > prepared operation key=WMO6LTCMVXD2 tag=F0LN59EZUSW9 type=del size=3801701 2024-03-09T14:28:51.315 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.315+0000 7f1c6444c780 1 < canceled part key=_multipart_NIN0FB6YTKWA.2~HS2E2PUOJ50R.0 size=600913 2024-03-09T14:28:51.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.317+0000 7f1c6444c780 1 < canceled multipart upload key=NIN0FB6YTKWA upload=HS2E2PUOJ50R tag=9CICBKF5FKR3 type=write size=1649489 2024-03-09T14:28:51.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.319+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~VE71Q24ABUP6.0 size=1048576 2024-03-09T14:28:51.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.320+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~VE71Q24ABUP6.1 size=547599 2024-03-09T14:28:51.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.320+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=VE71Q24ABUP6 tag=98NT4W7A2GWT type=write size=2644751 2024-03-09T14:28:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.321+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=C9RI4PT8Q1TB type=del size=2435927 2024-03-09T14:28:51.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.322+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=4GO7PUK2G6LC type=del size=918150 2024-03-09T14:28:51.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.323+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=M8BS0J9RGINO type=del 2024-03-09T14:28:51.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.324+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=ID0Z4F2Z7Q76 type=del size=3334724 2024-03-09T14:28:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.326+0000 7f1c6444c780 1 < completed delete operation key=HNK7POWS6FSU tag=A9EECLPZYZRC type=del 2024-03-09T14:28:51.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.327+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=45ZHW3GSNY0J type=write size=334936 2024-03-09T14:28:51.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.328+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~0NQ3797GI9YS.0 size=1048576 2024-03-09T14:28:51.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.329+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~0NQ3797GI9YS.1 size=1048576 2024-03-09T14:28:51.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.330+0000 7f1c6444c780 1 < completed part key=_multipart_0IHHFQBKKJ0G.2~0NQ3797GI9YS.2 size=598761 2024-03-09T14:28:51.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.332+0000 7f1c6444c780 1 < completed multipart upload key=0IHHFQBKKJ0G upload=0NQ3797GI9YS tag=HPY4BJFLM1RT type=write size=3744489 2024-03-09T14:28:51.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.333+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=MC2ND57KSX11 type=del size=3221685 2024-03-09T14:28:51.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.334+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=0ZXR5E9RJJYK type=write size=152753 2024-03-09T14:28:51.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.335+0000 7f1c6444c780 1 > prepared operation key=26VE2HJPD0FX tag=GL4NF1R0VNQJ type=write size=83523 2024-03-09T14:28:51.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.337+0000 7f1c6444c780 1 < canceled operation key=71FSR1CHFBO0 tag=M3RREZ29EMCO type=del size=3947485 2024-03-09T14:28:51.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.338+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=80N9YCAGSV0E type=write size=1035801 2024-03-09T14:28:51.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.339+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=5NY3V20MUINO type=del 2024-03-09T14:28:51.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.340+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=GENXP2X5CINH type=del size=2091108 2024-03-09T14:28:51.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.341+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~NWK7CPS7A7PG.0 size=1048576 2024-03-09T14:28:51.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.342+0000 7f1c6444c780 1 < completed part key=_multipart_BAWV7KY6NT8P.2~NWK7CPS7A7PG.1 size=770473 2024-03-09T14:28:51.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.345+0000 7f1c6444c780 1 < completed multipart upload key=BAWV7KY6NT8P upload=NWK7CPS7A7PG tag=KXQU26Q3QZNB type=write size=2867625 2024-03-09T14:28:51.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.346+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=WPRTKSBE13HV type=del size=74050 2024-03-09T14:28:51.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.348+0000 7f1c6444c780 1 < suggested update operation key=SGHNHOCYPM38 tag=V2ANR1Y4Q0G0 type=del size=4108611 2024-03-09T14:28:51.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.351+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~4KS0UBDFSXDB.0 size=332014 2024-03-09T14:28:51.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.351+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=4KS0UBDFSXDB tag=ADTL99Y5GLDL type=write size=1380590 2024-03-09T14:28:51.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.352+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~HZKFIRAS1LDN.0 size=105448 2024-03-09T14:28:51.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.354+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=HZKFIRAS1LDN tag=OZ723ECATZ3W type=write size=1154024 2024-03-09T14:28:51.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.356+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~C7Y8EPNDGZU8.0 size=1048576 2024-03-09T14:28:51.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.358+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~C7Y8EPNDGZU8.1 size=391170 2024-03-09T14:28:51.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.358+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=C7Y8EPNDGZU8 tag=R7QSWU51HBGR type=write size=2488322 2024-03-09T14:28:51.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.359+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=GOKLID3AVYIM type=write size=172807 2024-03-09T14:28:51.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.360+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=5Z5F2N23FLOD type=del size=2102111 2024-03-09T14:28:51.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.361+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=8KSQIN1HY4B9 type=del 2024-03-09T14:28:51.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.363+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=81OPVCMSJ9CF type=del size=4162600 2024-03-09T14:28:51.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.364+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~64M8RXWQ83EO.0 size=1048576 2024-03-09T14:28:51.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.365+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~64M8RXWQ83EO.1 size=922795 2024-03-09T14:28:51.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.367+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=64M8RXWQ83EO tag=AR020IQ962PQ type=write size=3019947 2024-03-09T14:28:51.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.368+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=7D0JGUUHM6NO type=del size=3575164 2024-03-09T14:28:51.369 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.369+0000 7f1c6444c780 1 < canceled operation key=P33029QWKW23 tag=SBY0XFKMPFRC type=del size=2095632 2024-03-09T14:28:51.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.371+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=PWNER22HRN2H type=del size=2163155 2024-03-09T14:28:51.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.372+0000 7f1c6444c780 1 < canceled operation key=WMO6LTCMVXD2 tag=F0LN59EZUSW9 type=del size=3801701 2024-03-09T14:28:51.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.373+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=X5X4YWZSN7LH type=write size=31826 2024-03-09T14:28:51.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.374+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~VE71Q24ABUP6.0 size=1048576 2024-03-09T14:28:51.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.375+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~VE71Q24ABUP6.1 size=547599 2024-03-09T14:28:51.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.377+0000 7f1c6444c780 1 < completed multipart upload key=49YOZGJ8XC4K upload=VE71Q24ABUP6 tag=98NT4W7A2GWT type=write size=2644751 2024-03-09T14:28:51.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.378+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=JBQFTUZPO6L8 type=del size=2971213 2024-03-09T14:28:51.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.380+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=4GO7PUK2G6LC type=del 2024-03-09T14:28:51.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.381+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=AEAI3A51YDU4 type=del size=2019690 2024-03-09T14:28:51.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.383+0000 7f1c6444c780 1 < suggested remove operation key=IBVEN2JEB49N tag=ID0Z4F2Z7Q76 type=del 2024-03-09T14:28:51.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.385+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=R6NQNTZKOSMC type=del size=3506554 2024-03-09T14:28:51.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.386+0000 7f1c6444c780 1 < completed write operation key=HNK7POWS6FSU tag=45ZHW3GSNY0J type=write size=334936 2024-03-09T14:28:51.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.387+0000 7f1c6444c780 1 > prepared operation key=KNOEGKSERB6Z tag=Y3FTJYJTS290 type=del size=1281185 2024-03-09T14:28:51.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.388+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=MC2ND57KSX11 type=del 2024-03-09T14:28:51.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.391+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~622I084ALI1S.0 size=638951 2024-03-09T14:28:51.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.391+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=622I084ALI1S tag=T527NV0E2E85 type=write size=1687527 2024-03-09T14:28:51.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.392+0000 7f1c6444c780 1 < completed write operation key=26VE2HJPD0FX tag=GL4NF1R0VNQJ type=write size=83523 2024-03-09T14:28:51.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.393+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=PZU22U02NCVG type=del size=4140110 2024-03-09T14:28:51.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.394+0000 7f1c6444c780 1 < completed write operation key=EREG1M13901A tag=80N9YCAGSV0E type=write size=1035801 2024-03-09T14:28:51.395 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.395+0000 7f1c6444c780 1 > prepared operation key=0IHHFQBKKJ0G tag=15ZG60E7CI2R type=del size=2910382 2024-03-09T14:28:51.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.396+0000 7f1c6444c780 1 < completed delete operation key=HPFPL79B0GLS tag=GENXP2X5CINH type=del 2024-03-09T14:28:51.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.398+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=UA8U0VFELU0Z type=write size=13877 2024-03-09T14:28:51.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.399+0000 7f1c6444c780 1 < completed delete operation key=49YOZGJ8XC4K tag=WPRTKSBE13HV type=del 2024-03-09T14:28:51.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.401+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~24K4W1ES3WI7.0 size=1048576 2024-03-09T14:28:51.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.402+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~24K4W1ES3WI7.1 size=1048576 2024-03-09T14:28:51.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.403+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~24K4W1ES3WI7.2 size=501139 2024-03-09T14:28:51.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.403+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=24K4W1ES3WI7 tag=C50Z8HL1ICP6 type=write size=3646867 2024-03-09T14:28:51.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.404+0000 7f1c6444c780 1 < completed part key=_multipart_JX05U3G6NLLO.2~4KS0UBDFSXDB.0 size=332014 2024-03-09T14:28:51.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.407+0000 7f1c6444c780 1 < completed multipart upload key=JX05U3G6NLLO upload=4KS0UBDFSXDB tag=ADTL99Y5GLDL type=write size=1380590 2024-03-09T14:28:51.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.409+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~YLNMZEX1HM5S.0 size=1048576 2024-03-09T14:28:51.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.410+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~YLNMZEX1HM5S.1 size=1048576 2024-03-09T14:28:51.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.411+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~YLNMZEX1HM5S.2 size=853023 2024-03-09T14:28:51.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.411+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=YLNMZEX1HM5S tag=8R3UEQF0K83C type=write size=3998751 2024-03-09T14:28:51.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.412+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~C7Y8EPNDGZU8.0 size=1048576 2024-03-09T14:28:51.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.413+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~C7Y8EPNDGZU8.1 size=391170 2024-03-09T14:28:51.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.415+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=C7Y8EPNDGZU8 tag=R7QSWU51HBGR type=write size=2488322 2024-03-09T14:28:51.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.417+0000 7f1c6444c780 1 > prepared operation key=HNK7POWS6FSU tag=3XGN2KHD2EZG type=write size=116612 2024-03-09T14:28:51.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.418+0000 7f1c6444c780 1 < completed delete operation key=Z34QOCZB3DFX tag=5Z5F2N23FLOD type=del 2024-03-09T14:28:51.420 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.420+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~KV2LJ3M3IGNG.0 size=1048576 2024-03-09T14:28:51.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.421+0000 7f1c6444c780 1 > prepared part key=_multipart_IBVEN2JEB49N.2~KV2LJ3M3IGNG.1 size=1011568 2024-03-09T14:28:51.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.421+0000 7f1c6444c780 1 > prepared multipart upload key=IBVEN2JEB49N upload=KV2LJ3M3IGNG tag=HC0LBLA1CD0S type=write size=3108720 2024-03-09T14:28:51.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.422+0000 7f1c6444c780 1 < completed delete operation key=35Y98D5U0M8O tag=81OPVCMSJ9CF type=del 2024-03-09T14:28:51.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.424+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~T5YQCQV3LIRC.0 size=1048576 2024-03-09T14:28:51.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.425+0000 7f1c6444c780 1 > prepared part key=_multipart_MX3X6ILR7J8N.2~T5YQCQV3LIRC.1 size=543916 2024-03-09T14:28:51.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.425+0000 7f1c6444c780 1 > prepared multipart upload key=MX3X6ILR7J8N upload=T5YQCQV3LIRC tag=NEWHLVY8U7T6 type=write size=2641068 2024-03-09T14:28:51.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.426+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=7D0JGUUHM6NO type=del 2024-03-09T14:28:51.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.428+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~PXV975F8Z6GQ.0 size=1048576 2024-03-09T14:28:51.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.429+0000 7f1c6444c780 1 > prepared part key=_multipart_NIN0FB6YTKWA.2~PXV975F8Z6GQ.1 size=969082 2024-03-09T14:28:51.429 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.429+0000 7f1c6444c780 1 > prepared multipart upload key=NIN0FB6YTKWA upload=PXV975F8Z6GQ tag=QTU4ZRU1C12C type=write size=3066234 2024-03-09T14:28:51.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.430+0000 7f1c6444c780 1 < completed delete operation key=MOVS6ZMK708G tag=PWNER22HRN2H type=del 2024-03-09T14:28:51.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.432+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~WXGIFK7X9CVJ.0 size=1048576 2024-03-09T14:28:51.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.433+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~WXGIFK7X9CVJ.1 size=1048576 2024-03-09T14:28:51.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.434+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~WXGIFK7X9CVJ.2 size=516193 2024-03-09T14:28:51.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.434+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=WXGIFK7X9CVJ tag=TOCXP09RXK9Q type=write size=3661921 2024-03-09T14:28:51.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.436+0000 7f1c6444c780 1 < canceled operation key=JX05U3G6NLLO tag=X5X4YWZSN7LH type=write size=31826 2024-03-09T14:28:51.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.438+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~R7R1KUKYJVBP.0 size=1048576 2024-03-09T14:28:51.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.439+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~R7R1KUKYJVBP.1 size=1048576 2024-03-09T14:28:51.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.439+0000 7f1c6444c780 1 > prepared part key=_multipart_26VE2HJPD0FX.2~R7R1KUKYJVBP.2 size=839422 2024-03-09T14:28:51.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.439+0000 7f1c6444c780 1 > prepared multipart upload key=26VE2HJPD0FX upload=R7R1KUKYJVBP tag=3WC1L0B32ZWR type=write size=3985150 2024-03-09T14:28:51.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.440+0000 7f1c6444c780 1 < completed delete operation key=KMX7TNIOKWOA tag=JBQFTUZPO6L8 type=del 2024-03-09T14:28:51.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.443+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~EGVA6FW26KQZ.0 size=1048576 2024-03-09T14:28:51.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.444+0000 7f1c6444c780 1 > prepared part key=_multipart_V05XJ56M53T8.2~EGVA6FW26KQZ.1 size=483294 2024-03-09T14:28:51.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.444+0000 7f1c6444c780 1 > prepared multipart upload key=V05XJ56M53T8 upload=EGVA6FW26KQZ tag=TK0OEXJM1LQQ type=write size=2580446 2024-03-09T14:28:51.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.445+0000 7f1c6444c780 1 < completed delete operation key=V05XJ56M53T8 tag=AEAI3A51YDU4 type=del 2024-03-09T14:28:51.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.446+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=TBMLC0YM0DJE type=del size=3932538 2024-03-09T14:28:51.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.449+0000 7f1c6444c780 1 < suggested remove operation key=QSMTZR754455 tag=R6NQNTZKOSMC type=del 2024-03-09T14:28:51.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.451+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~T4VFYNZ7978Q.0 size=1048576 2024-03-09T14:28:51.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.451+0000 7f1c6444c780 1 > prepared part key=_multipart_1NQRJ8ICZNM6.2~T4VFYNZ7978Q.1 size=712110 2024-03-09T14:28:51.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.451+0000 7f1c6444c780 1 > prepared multipart upload key=1NQRJ8ICZNM6 upload=T4VFYNZ7978Q tag=X9D423F2ME57 type=write size=2809262 2024-03-09T14:28:51.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.452+0000 7f1c6444c780 1 < canceled operation key=KNOEGKSERB6Z tag=Y3FTJYJTS290 type=del size=1281185 2024-03-09T14:28:51.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.454+0000 7f1c6444c780 1 > prepared operation key=P33029QWKW23 tag=E0ZKZACLRV0U type=write size=801594 2024-03-09T14:28:51.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.455+0000 7f1c6444c780 1 < completed part key=_multipart_VL5EUQ52WRAN.2~622I084ALI1S.0 size=638951 2024-03-09T14:28:51.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.457+0000 7f1c6444c780 1 < completed multipart upload key=VL5EUQ52WRAN upload=622I084ALI1S tag=T527NV0E2E85 type=write size=1687527 2024-03-09T14:28:51.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.458+0000 7f1c6444c780 1 > prepared operation key=CVD0EGQUVJYR tag=JUEIFG9BL8HO type=del size=3203193 2024-03-09T14:28:51.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.459+0000 7f1c6444c780 1 < completed delete operation key=MX3X6ILR7J8N tag=PZU22U02NCVG type=del 2024-03-09T14:28:51.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.460+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=7DU9FYVK2R3P type=del size=1629368 2024-03-09T14:28:51.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.462+0000 7f1c6444c780 1 < suggested remove operation key=0IHHFQBKKJ0G tag=15ZG60E7CI2R type=del 2024-03-09T14:28:51.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.464+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=UXAI885VZKZJ type=del size=1480846 2024-03-09T14:28:51.465 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.465+0000 7f1c6444c780 1 < completed write operation key=Z34QOCZB3DFX tag=UA8U0VFELU0Z type=write size=13877 2024-03-09T14:28:51.467 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.467+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~PLZAPOAHFFQI.0 size=1048576 2024-03-09T14:28:51.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.468+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~PLZAPOAHFFQI.1 size=1048576 2024-03-09T14:28:51.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.469+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~PLZAPOAHFFQI.2 size=442438 2024-03-09T14:28:51.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.469+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=PLZAPOAHFFQI tag=AS6GQW9L4OXG type=write size=3588166 2024-03-09T14:28:51.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.469+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~24K4W1ES3WI7.0 size=1048576 2024-03-09T14:28:51.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.470+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~24K4W1ES3WI7.1 size=1048576 2024-03-09T14:28:51.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.471+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~24K4W1ES3WI7.2 size=501139 2024-03-09T14:28:51.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.473+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=24K4W1ES3WI7 tag=C50Z8HL1ICP6 type=write size=3646867 2024-03-09T14:28:51.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.474+0000 7f1c6444c780 1 > prepared operation key=YK7ENO4UAB2M tag=21EEE219V2H8 type=write size=341601 2024-03-09T14:28:51.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.475+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~YLNMZEX1HM5S.0 size=1048576 2024-03-09T14:28:51.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.476+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~YLNMZEX1HM5S.1 size=1048576 2024-03-09T14:28:51.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.477+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~YLNMZEX1HM5S.2 size=853023 2024-03-09T14:28:51.479 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.479+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=YLNMZEX1HM5S tag=8R3UEQF0K83C type=write size=3998751 2024-03-09T14:28:51.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.480+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=XKNGXP33QMRN type=del size=3498794 2024-03-09T14:28:51.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.481+0000 7f1c6444c780 1 < completed write operation key=HNK7POWS6FSU tag=3XGN2KHD2EZG type=write size=116612 2024-03-09T14:28:51.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.483+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~3HXMK76A7AZN.0 size=1048576 2024-03-09T14:28:51.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.484+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~3HXMK76A7AZN.1 size=1048576 2024-03-09T14:28:51.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.485+0000 7f1c6444c780 1 > prepared part key=_multipart_49YOZGJ8XC4K.2~3HXMK76A7AZN.2 size=693135 2024-03-09T14:28:51.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.485+0000 7f1c6444c780 1 > prepared multipart upload key=49YOZGJ8XC4K upload=3HXMK76A7AZN tag=Z0JVZQ1QAGOS type=write size=3838863 2024-03-09T14:28:51.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.486+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~KV2LJ3M3IGNG.0 size=1048576 2024-03-09T14:28:51.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.487+0000 7f1c6444c780 1 < completed part key=_multipart_IBVEN2JEB49N.2~KV2LJ3M3IGNG.1 size=1011568 2024-03-09T14:28:51.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.489+0000 7f1c6444c780 1 < completed multipart upload key=IBVEN2JEB49N upload=KV2LJ3M3IGNG tag=HC0LBLA1CD0S type=write size=3108720 2024-03-09T14:28:51.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.490+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=8N4WGSS7T775 type=del size=2478231 2024-03-09T14:28:51.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.491+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~T5YQCQV3LIRC.0 size=1048576 2024-03-09T14:28:51.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.492+0000 7f1c6444c780 1 < completed part key=_multipart_MX3X6ILR7J8N.2~T5YQCQV3LIRC.1 size=543916 2024-03-09T14:28:51.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.494+0000 7f1c6444c780 1 < completed multipart upload key=MX3X6ILR7J8N upload=T5YQCQV3LIRC tag=NEWHLVY8U7T6 type=write size=2641068 2024-03-09T14:28:51.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.496+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~FWL843JGT0HY.0 size=1048576 2024-03-09T14:28:51.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.497+0000 7f1c6444c780 1 > prepared part key=_multipart_EREG1M13901A.2~FWL843JGT0HY.1 size=713695 2024-03-09T14:28:51.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.497+0000 7f1c6444c780 1 > prepared multipart upload key=EREG1M13901A upload=FWL843JGT0HY tag=NT7A1DEKZ88I type=write size=2810847 2024-03-09T14:28:51.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.498+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~PXV975F8Z6GQ.0 size=1048576 2024-03-09T14:28:51.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.499+0000 7f1c6444c780 1 < completed part key=_multipart_NIN0FB6YTKWA.2~PXV975F8Z6GQ.1 size=969082 2024-03-09T14:28:51.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.501+0000 7f1c6444c780 1 < completed multipart upload key=NIN0FB6YTKWA upload=PXV975F8Z6GQ tag=QTU4ZRU1C12C type=write size=3066234 2024-03-09T14:28:51.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.503+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=PTVFX7HOXW9D type=del size=2239351 2024-03-09T14:28:51.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.504+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~WXGIFK7X9CVJ.0 size=1048576 2024-03-09T14:28:51.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.505+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~WXGIFK7X9CVJ.1 size=1048576 2024-03-09T14:28:51.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.506+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~WXGIFK7X9CVJ.2 size=516193 2024-03-09T14:28:51.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.508+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=WXGIFK7X9CVJ tag=TOCXP09RXK9Q type=write size=3661921 2024-03-09T14:28:51.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.510+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~KOX9YNJ08CSP.0 size=1048576 2024-03-09T14:28:51.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.512+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~KOX9YNJ08CSP.1 size=1048576 2024-03-09T14:28:51.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.513+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~KOX9YNJ08CSP.2 size=164178 2024-03-09T14:28:51.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.513+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=KOX9YNJ08CSP tag=HRXT70GT08IA type=write size=3309906 2024-03-09T14:28:51.514 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.514+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~R7R1KUKYJVBP.0 size=1048576 2024-03-09T14:28:51.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.515+0000 7f1c6444c780 1 < completed part key=_multipart_26VE2HJPD0FX.2~R7R1KUKYJVBP.1 size=1048576 2024-03-09T14:28:51.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.515+0000 7f1c6444c780 1 < canceled part key=_multipart_26VE2HJPD0FX.2~R7R1KUKYJVBP.2 size=839422 2024-03-09T14:28:51.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.517+0000 7f1c6444c780 1 < canceled multipart upload key=26VE2HJPD0FX upload=R7R1KUKYJVBP tag=3WC1L0B32ZWR type=write size=3985150 2024-03-09T14:28:51.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.518+0000 7f1c6444c780 1 > prepared operation key=3CC018VYSRHN tag=N7VOREHSHRBC type=del size=2285249 2024-03-09T14:28:51.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.519+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~EGVA6FW26KQZ.0 size=1048576 2024-03-09T14:28:51.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.520+0000 7f1c6444c780 1 < completed part key=_multipart_V05XJ56M53T8.2~EGVA6FW26KQZ.1 size=483294 2024-03-09T14:28:51.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.522+0000 7f1c6444c780 1 < completed multipart upload key=V05XJ56M53T8 upload=EGVA6FW26KQZ tag=TK0OEXJM1LQQ type=write size=2580446 2024-03-09T14:28:51.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.523+0000 7f1c6444c780 1 > prepared operation key=1NQRJ8ICZNM6 tag=YPQRP3EJ9960 type=del size=2670569 2024-03-09T14:28:51.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.524+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=TBMLC0YM0DJE type=del 2024-03-09T14:28:51.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.526+0000 7f1c6444c780 1 > prepared operation key=HPFPL79B0GLS tag=IVNORK39I7V2 type=del size=3356532 2024-03-09T14:28:51.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.527+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~T4VFYNZ7978Q.0 size=1048576 2024-03-09T14:28:51.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.528+0000 7f1c6444c780 1 < completed part key=_multipart_1NQRJ8ICZNM6.2~T4VFYNZ7978Q.1 size=712110 2024-03-09T14:28:51.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.530+0000 7f1c6444c780 1 < completed multipart upload key=1NQRJ8ICZNM6 upload=T4VFYNZ7978Q tag=X9D423F2ME57 type=write size=2809262 2024-03-09T14:28:51.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.531+0000 7f1c6444c780 1 > prepared operation key=JX05U3G6NLLO tag=0SMZPZRACQ88 type=del size=2369549 2024-03-09T14:28:51.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.532+0000 7f1c6444c780 1 < completed write operation key=P33029QWKW23 tag=E0ZKZACLRV0U type=write size=801594 2024-03-09T14:28:51.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.534+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=V351UZWSTQ1Y type=del size=565707 2024-03-09T14:28:51.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.535+0000 7f1c6444c780 1 < completed delete operation key=CVD0EGQUVJYR tag=JUEIFG9BL8HO type=del 2024-03-09T14:28:51.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.536+0000 7f1c6444c780 1 > prepared operation key=KWDIDE9AE3JP tag=705IFNWKVWB2 type=write size=1019750 2024-03-09T14:28:51.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.538+0000 7f1c6444c780 1 < suggested remove operation key=1NQRJ8ICZNM6 tag=7DU9FYVK2R3P type=del 2024-03-09T14:28:51.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.540+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~GCM6JKERVUAA.0 size=1048576 2024-03-09T14:28:51.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.541+0000 7f1c6444c780 1 > prepared part key=_multipart_CVD0EGQUVJYR.2~GCM6JKERVUAA.1 size=333 2024-03-09T14:28:51.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.541+0000 7f1c6444c780 1 > prepared multipart upload key=CVD0EGQUVJYR upload=GCM6JKERVUAA tag=ASER1UR4BYUP type=write size=2097485 2024-03-09T14:28:51.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.542+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=UXAI885VZKZJ type=del 2024-03-09T14:28:51.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.543+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=526PGS6O895P type=del size=2415748 2024-03-09T14:28:51.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.544+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~PLZAPOAHFFQI.0 size=1048576 2024-03-09T14:28:51.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.545+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~PLZAPOAHFFQI.1 size=1048576 2024-03-09T14:28:51.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.546+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~PLZAPOAHFFQI.2 size=442438 2024-03-09T14:28:51.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.548+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=PLZAPOAHFFQI tag=AS6GQW9L4OXG type=write size=3588166 2024-03-09T14:28:51.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.549+0000 7f1c6444c780 1 > prepared operation key=NIN0FB6YTKWA tag=JY9HVTDLFK0R type=del size=3524575 2024-03-09T14:28:51.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.550+0000 7f1c6444c780 1 < completed write operation key=YK7ENO4UAB2M tag=21EEE219V2H8 type=write size=341601 2024-03-09T14:28:51.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.551+0000 7f1c6444c780 1 > prepared operation key=PBM4ICXZ2497 tag=5BPJQDUOJ7U0 type=write size=691142 2024-03-09T14:28:51.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.553+0000 7f1c6444c780 1 < canceled operation key=QSMTZR754455 tag=XKNGXP33QMRN type=del size=3498794 2024-03-09T14:28:51.554 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.554+0000 7f1c6444c780 1 > prepared operation key=MX3X6ILR7J8N tag=MTHU2H5TLI3C type=del size=2836090 2024-03-09T14:28:51.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.555+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~3HXMK76A7AZN.0 size=1048576 2024-03-09T14:28:51.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.556+0000 7f1c6444c780 1 < completed part key=_multipart_49YOZGJ8XC4K.2~3HXMK76A7AZN.1 size=1048576 2024-03-09T14:28:51.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.556+0000 7f1c6444c780 1 < canceled part key=_multipart_49YOZGJ8XC4K.2~3HXMK76A7AZN.2 size=693135 2024-03-09T14:28:51.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.558+0000 7f1c6444c780 1 < canceled multipart upload key=49YOZGJ8XC4K upload=3HXMK76A7AZN tag=Z0JVZQ1QAGOS type=write size=3838863 2024-03-09T14:28:51.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.559+0000 7f1c6444c780 1 > prepared operation key=EREG1M13901A tag=TB8090KM0XA9 type=del size=2980112 2024-03-09T14:28:51.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.562+0000 7f1c6444c780 1 < suggested remove operation key=EREG1M13901A tag=8N4WGSS7T775 type=del 2024-03-09T14:28:51.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.564+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~KDNYZ0STE92D.0 size=1048576 2024-03-09T14:28:51.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.565+0000 7f1c6444c780 1 > prepared part key=_multipart_KMX7TNIOKWOA.2~KDNYZ0STE92D.1 size=52860 2024-03-09T14:28:51.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.565+0000 7f1c6444c780 1 > prepared multipart upload key=KMX7TNIOKWOA upload=KDNYZ0STE92D tag=U5OOQECJLKPQ type=write size=2150012 2024-03-09T14:28:51.566 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.566+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~FWL843JGT0HY.0 size=1048576 2024-03-09T14:28:51.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.567+0000 7f1c6444c780 1 < completed part key=_multipart_EREG1M13901A.2~FWL843JGT0HY.1 size=713695 2024-03-09T14:28:51.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.569+0000 7f1c6444c780 1 < completed multipart upload key=EREG1M13901A upload=FWL843JGT0HY tag=NT7A1DEKZ88I type=write size=2810847 2024-03-09T14:28:51.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.570+0000 7f1c6444c780 1 > prepared operation key=49YOZGJ8XC4K tag=XTELC27I601Y type=del size=2767909 2024-03-09T14:28:51.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.571+0000 7f1c6444c780 1 < completed delete operation key=0ZZ0P8Y7KSAX tag=PTVFX7HOXW9D type=del 2024-03-09T14:28:51.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.572+0000 7f1c6444c780 1 > prepared operation key=YECG84AJ5IK2 tag=3D7T67EPG8JU type=del size=1083681 2024-03-09T14:28:51.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.573+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~KOX9YNJ08CSP.0 size=1048576 2024-03-09T14:28:51.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.574+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~KOX9YNJ08CSP.1 size=1048576 2024-03-09T14:28:51.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.575+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~KOX9YNJ08CSP.2 size=164178 2024-03-09T14:28:51.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.577+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=KOX9YNJ08CSP tag=HRXT70GT08IA type=write size=3309906 2024-03-09T14:28:51.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.579+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~1LJPZG1KVWZQ.0 size=1048576 2024-03-09T14:28:51.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.580+0000 7f1c6444c780 1 > prepared part key=_multipart_KWDIDE9AE3JP.2~1LJPZG1KVWZQ.1 size=327116 2024-03-09T14:28:51.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.580+0000 7f1c6444c780 1 > prepared multipart upload key=KWDIDE9AE3JP upload=1LJPZG1KVWZQ tag=P1M4M2I72R5R type=write size=2424268 2024-03-09T14:28:51.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.581+0000 7f1c6444c780 1 < completed delete operation key=3CC018VYSRHN tag=N7VOREHSHRBC type=del 2024-03-09T14:28:51.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.584+0000 7f1c6444c780 1 > prepared part key=_multipart_JX05U3G6NLLO.2~TZ84ANXV7JZ0.0 size=471109 2024-03-09T14:28:51.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.584+0000 7f1c6444c780 1 > prepared multipart upload key=JX05U3G6NLLO upload=TZ84ANXV7JZ0 tag=VBK4PDUYHPI3 type=write size=1519685 2024-03-09T14:28:51.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.585+0000 7f1c6444c780 -1 < failed to complete operation key=1NQRJ8ICZNM6 tag=YPQRP3EJ9960 type=del size=2670569: (22) Invalid argument 2024-03-09T14:28:51.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.587+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~063BYKH8PMTG.0 size=1048576 2024-03-09T14:28:51.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.588+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~063BYKH8PMTG.1 size=612402 2024-03-09T14:28:51.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.588+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=063BYKH8PMTG tag=PF89IY0WRR24 type=write size=2709554 2024-03-09T14:28:51.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.590+0000 7f1c6444c780 1 < suggested remove operation key=HPFPL79B0GLS tag=IVNORK39I7V2 type=del 2024-03-09T14:28:51.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.591+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=FUN2Z0VGRB9P type=del size=422303 2024-03-09T14:28:51.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.592+0000 7f1c6444c780 1 < completed delete operation key=JX05U3G6NLLO tag=0SMZPZRACQ88 type=del 2024-03-09T14:28:51.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.594+0000 7f1c6444c780 1 > prepared operation key=VL5EUQ52WRAN tag=J5OPH3S26KS1 type=del size=1005399 2024-03-09T14:28:51.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.595+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=V351UZWSTQ1Y type=del 2024-03-09T14:28:51.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.597+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~3B9F6HE1GK3Q.0 size=1048576 2024-03-09T14:28:51.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.598+0000 7f1c6444c780 1 > prepared part key=_multipart_3CC018VYSRHN.2~3B9F6HE1GK3Q.1 size=551244 2024-03-09T14:28:51.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.598+0000 7f1c6444c780 1 > prepared multipart upload key=3CC018VYSRHN upload=3B9F6HE1GK3Q tag=PF1N4XHS6TWC type=write size=2648396 2024-03-09T14:28:51.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.599+0000 7f1c6444c780 1 < completed write operation key=KWDIDE9AE3JP tag=705IFNWKVWB2 type=write size=1019750 2024-03-09T14:28:51.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.601+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~MVW2THK86A4B.0 size=1048576 2024-03-09T14:28:51.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.602+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~MVW2THK86A4B.1 size=1048576 2024-03-09T14:28:51.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.602+0000 7f1c6444c780 1 > prepared part key=_multipart_SGHNHOCYPM38.2~MVW2THK86A4B.2 size=766475 2024-03-09T14:28:51.603 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.602+0000 7f1c6444c780 1 > prepared multipart upload key=SGHNHOCYPM38 upload=MVW2THK86A4B tag=1KAI0PX6NJ1D type=write size=3912203 2024-03-09T14:28:51.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.604+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~GCM6JKERVUAA.0 size=1048576 2024-03-09T14:28:51.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.605+0000 7f1c6444c780 1 < completed part key=_multipart_CVD0EGQUVJYR.2~GCM6JKERVUAA.1 size=333 2024-03-09T14:28:51.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.606+0000 7f1c6444c780 1 < completed multipart upload key=CVD0EGQUVJYR upload=GCM6JKERVUAA tag=ASER1UR4BYUP type=write size=2097485 2024-03-09T14:28:51.608 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.608+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~EDLZT2LNXNG8.0 size=1048576 2024-03-09T14:28:51.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.609+0000 7f1c6444c780 1 > prepared part key=_multipart_WMO6LTCMVXD2.2~EDLZT2LNXNG8.1 size=872074 2024-03-09T14:28:51.609 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.609+0000 7f1c6444c780 1 > prepared multipart upload key=WMO6LTCMVXD2 upload=EDLZT2LNXNG8 tag=VF56URGA7A5G type=write size=2969226 2024-03-09T14:28:51.610 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.610+0000 7f1c6444c780 1 < completed delete operation key=IBVEN2JEB49N tag=526PGS6O895P type=del 2024-03-09T14:28:51.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.611+0000 7f1c6444c780 1 > prepared operation key=BYX1155MZ2LP tag=5SNSLWDSOZIL type=del size=861786 2024-03-09T14:28:51.613 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.613+0000 7f1c6444c780 1 < completed delete operation key=NIN0FB6YTKWA tag=JY9HVTDLFK0R type=del 2024-03-09T14:28:51.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.614+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=TBXD55E90PIT type=write size=990388 2024-03-09T14:28:51.615 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.615+0000 7f1c6444c780 1 < completed write operation key=PBM4ICXZ2497 tag=5BPJQDUOJ7U0 type=write size=691142 2024-03-09T14:28:51.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.616+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=4VR6XS88GIA7 type=del size=481609 2024-03-09T14:28:51.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.617+0000 7f1c6444c780 1 < canceled operation key=MX3X6ILR7J8N tag=MTHU2H5TLI3C type=del size=2836090 2024-03-09T14:28:51.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.620+0000 7f1c6444c780 1 > prepared operation key=0ZZ0P8Y7KSAX tag=I1Y0L138UZ3T type=write size=1010626 2024-03-09T14:28:51.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.621+0000 7f1c6444c780 -1 < failed to complete operation key=EREG1M13901A tag=TB8090KM0XA9 type=del size=2980112: (22) Invalid argument 2024-03-09T14:28:51.623 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.623+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~NJGLXJHXC7ZV.0 size=1048576 2024-03-09T14:28:51.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.624+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~NJGLXJHXC7ZV.1 size=1048576 2024-03-09T14:28:51.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.625+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~NJGLXJHXC7ZV.2 size=279732 2024-03-09T14:28:51.625 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.625+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=NJGLXJHXC7ZV tag=23F7VC4L0WS9 type=write size=3425460 2024-03-09T14:28:51.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.626+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~KDNYZ0STE92D.0 size=1048576 2024-03-09T14:28:51.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.627+0000 7f1c6444c780 1 < completed part key=_multipart_KMX7TNIOKWOA.2~KDNYZ0STE92D.1 size=52860 2024-03-09T14:28:51.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.629+0000 7f1c6444c780 1 < completed multipart upload key=KMX7TNIOKWOA upload=KDNYZ0STE92D tag=U5OOQECJLKPQ type=write size=2150012 2024-03-09T14:28:51.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.631+0000 7f1c6444c780 1 > prepared part key=_multipart_KNOEGKSERB6Z.2~QWT2P6JSAGRU.0 size=322483 2024-03-09T14:28:51.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.631+0000 7f1c6444c780 1 > prepared multipart upload key=KNOEGKSERB6Z upload=QWT2P6JSAGRU tag=MXZ84MKA5UX9 type=write size=1371059 2024-03-09T14:28:51.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.633+0000 7f1c6444c780 1 < suggested remove operation key=49YOZGJ8XC4K tag=XTELC27I601Y type=del 2024-03-09T14:28:51.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.635+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=QO20FR8QQXJZ type=del size=2548813 2024-03-09T14:28:51.636 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.636+0000 7f1c6444c780 1 < completed delete operation key=YECG84AJ5IK2 tag=3D7T67EPG8JU type=del 2024-03-09T14:28:51.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.637+0000 7f1c6444c780 1 > prepared operation key=MOVS6ZMK708G tag=7Y7L3OU31SQI type=del size=3121744 2024-03-09T14:28:51.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.638+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~1LJPZG1KVWZQ.0 size=1048576 2024-03-09T14:28:51.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.639+0000 7f1c6444c780 1 < completed part key=_multipart_KWDIDE9AE3JP.2~1LJPZG1KVWZQ.1 size=327116 2024-03-09T14:28:51.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.641+0000 7f1c6444c780 1 < completed multipart upload key=KWDIDE9AE3JP upload=1LJPZG1KVWZQ tag=P1M4M2I72R5R type=write size=2424268 2024-03-09T14:28:51.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.642+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=DYEEPZ6T9A4E type=del size=3534404 2024-03-09T14:28:51.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.642+0000 7f1c6444c780 1 < canceled part key=_multipart_JX05U3G6NLLO.2~TZ84ANXV7JZ0.0 size=471109 2024-03-09T14:28:51.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.644+0000 7f1c6444c780 1 < canceled multipart upload key=JX05U3G6NLLO upload=TZ84ANXV7JZ0 tag=VBK4PDUYHPI3 type=write size=1519685 2024-03-09T14:28:51.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.645+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=NAO4U8GAS9UB type=write size=135933 2024-03-09T14:28:51.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.646+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~063BYKH8PMTG.0 size=1048576 2024-03-09T14:28:51.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.647+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~063BYKH8PMTG.1 size=612402 2024-03-09T14:28:51.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.649+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=063BYKH8PMTG tag=PF89IY0WRR24 type=write size=2709554 2024-03-09T14:28:51.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.650+0000 7f1c6444c780 1 > prepared operation key=KMX7TNIOKWOA tag=3AV07XD27QD7 type=write size=118673 2024-03-09T14:28:51.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.652+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=FUN2Z0VGRB9P type=del 2024-03-09T14:28:51.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.653+0000 7f1c6444c780 1 > prepared operation key=35Y98D5U0M8O tag=9ZKT4Z3GI1KZ type=write size=905776 2024-03-09T14:28:51.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.654+0000 7f1c6444c780 1 < completed delete operation key=VL5EUQ52WRAN tag=J5OPH3S26KS1 type=del 2024-03-09T14:28:51.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.655+0000 7f1c6444c780 1 > prepared operation key=IBVEN2JEB49N tag=CO0634CGP500 type=del size=1521430 2024-03-09T14:28:51.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.657+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~3B9F6HE1GK3Q.0 size=1048576 2024-03-09T14:28:51.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.658+0000 7f1c6444c780 1 < completed part key=_multipart_3CC018VYSRHN.2~3B9F6HE1GK3Q.1 size=551244 2024-03-09T14:28:51.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.660+0000 7f1c6444c780 1 < completed multipart upload key=3CC018VYSRHN upload=3B9F6HE1GK3Q tag=PF1N4XHS6TWC type=write size=2648396 2024-03-09T14:28:51.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.661+0000 7f1c6444c780 1 > prepared operation key=V05XJ56M53T8 tag=7VY1GYFXKVSI type=write size=450983 2024-03-09T14:28:51.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.663+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~MVW2THK86A4B.0 size=1048576 2024-03-09T14:28:51.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.664+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~MVW2THK86A4B.1 size=1048576 2024-03-09T14:28:51.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.665+0000 7f1c6444c780 1 < completed part key=_multipart_SGHNHOCYPM38.2~MVW2THK86A4B.2 size=766475 2024-03-09T14:28:51.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.667+0000 7f1c6444c780 1 < completed multipart upload key=SGHNHOCYPM38 upload=MVW2THK86A4B tag=1KAI0PX6NJ1D type=write size=3912203 2024-03-09T14:28:51.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.669+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~RNHN35SABIKJ.0 size=1048576 2024-03-09T14:28:51.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.670+0000 7f1c6444c780 1 > prepared part key=_multipart_VL5EUQ52WRAN.2~RNHN35SABIKJ.1 size=772254 2024-03-09T14:28:51.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.670+0000 7f1c6444c780 1 > prepared multipart upload key=VL5EUQ52WRAN upload=RNHN35SABIKJ tag=9OEZWRZOC71M type=write size=2869406 2024-03-09T14:28:51.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.671+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~EDLZT2LNXNG8.0 size=1048576 2024-03-09T14:28:51.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.672+0000 7f1c6444c780 1 < completed part key=_multipart_WMO6LTCMVXD2.2~EDLZT2LNXNG8.1 size=872074 2024-03-09T14:28:51.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.674+0000 7f1c6444c780 1 < completed multipart upload key=WMO6LTCMVXD2 upload=EDLZT2LNXNG8 tag=VF56URGA7A5G type=write size=2969226 2024-03-09T14:28:51.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.676+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~PU2FX30SLV7D.0 size=1048576 2024-03-09T14:28:51.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.677+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~PU2FX30SLV7D.1 size=1048576 2024-03-09T14:28:51.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.678+0000 7f1c6444c780 1 > prepared part key=_multipart_35Y98D5U0M8O.2~PU2FX30SLV7D.2 size=140395 2024-03-09T14:28:51.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.678+0000 7f1c6444c780 1 > prepared multipart upload key=35Y98D5U0M8O upload=PU2FX30SLV7D tag=XNE56XZ9XTDJ type=write size=3286123 2024-03-09T14:28:51.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.681+0000 7f1c6444c780 1 < suggested update operation key=BYX1155MZ2LP tag=5SNSLWDSOZIL type=del size=861786 2024-03-09T14:28:51.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.682+0000 7f1c6444c780 1 > prepared operation key=BAWV7KY6NT8P tag=JF62FEHEDRON type=write size=565983 2024-03-09T14:28:51.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.683+0000 7f1c6444c780 1 < completed write operation key=IBVEN2JEB49N tag=TBXD55E90PIT type=write size=990388 2024-03-09T14:28:51.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.685+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~3VYCEYQYPIYL.0 size=1048576 2024-03-09T14:28:51.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.686+0000 7f1c6444c780 1 > prepared part key=_multipart_YECG84AJ5IK2.2~3VYCEYQYPIYL.1 size=246359 2024-03-09T14:28:51.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.686+0000 7f1c6444c780 1 > prepared multipart upload key=YECG84AJ5IK2 upload=3VYCEYQYPIYL tag=19UENNBK5JNY type=write size=2343511 2024-03-09T14:28:51.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.687+0000 7f1c6444c780 1 < completed delete operation key=QSMTZR754455 tag=4VR6XS88GIA7 type=del 2024-03-09T14:28:51.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.688+0000 7f1c6444c780 1 > prepared operation key=Z34QOCZB3DFX tag=1RRA1ZH0RARJ type=del size=4105179 2024-03-09T14:28:51.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.689+0000 7f1c6444c780 1 < completed write operation key=0ZZ0P8Y7KSAX tag=I1Y0L138UZ3T type=write size=1010626 2024-03-09T14:28:51.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.690+0000 7f1c6444c780 1 > prepared operation key=QSMTZR754455 tag=UC4SM6MXDW8H type=del size=170824 2024-03-09T14:28:51.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.692+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~NJGLXJHXC7ZV.0 size=1048576 2024-03-09T14:28:51.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.692+0000 7f1c6444c780 1 < completed part key=_multipart_YECG84AJ5IK2.2~NJGLXJHXC7ZV.1 size=1048576 2024-03-09T14:28:51.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.692+0000 7f1c6444c780 1 < canceled part key=_multipart_YECG84AJ5IK2.2~NJGLXJHXC7ZV.2 size=279732 2024-03-09T14:28:51.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.694+0000 7f1c6444c780 1 < canceled multipart upload key=YECG84AJ5IK2 upload=NJGLXJHXC7ZV tag=23F7VC4L0WS9 type=write size=3425460 2024-03-09T14:28:51.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.696+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~S8KTAMV6O46T.0 size=1048576 2024-03-09T14:28:51.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.697+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~S8KTAMV6O46T.1 size=1048576 2024-03-09T14:28:51.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.698+0000 7f1c6444c780 1 > prepared part key=_multipart_MOVS6ZMK708G.2~S8KTAMV6O46T.2 size=175327 2024-03-09T14:28:51.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:28:51.698+0000 7f1c6444c780 1 > prepared multipart upload key=MOVS6ZMK708G upload=S8KTAMV6O46T tag=8NS9U50GZ0I5 type=write size=3321055 2024-03-09T14:28:51.698 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] cls_rgw_stats.simulate (8552 ms) 2024-03-09T14:28:51.699 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 1 test from cls_rgw_stats (8552 ms total) 2024-03-09T14:28:51.699 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:28:51.699 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:28:52.160 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 1 test from 1 test suite ran. (10891 ms total) 2024-03-09T14:28:52.160 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 1 test. 2024-03-09T14:28:52.163 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:28:52.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:28:52.244 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-03-09T14:28:52.245 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-03-09T14:28:52.246 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-03-09T14:28:52.325 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:28:52.325 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 31 tests from 1 test suite. 2024-03-09T14:28:52.325 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:28:54.168 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 31 tests from CmpOmap 2024-03-09T14:28:54.168 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-03-09T14:28:54.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (18 ms) 2024-03-09T14:28:54.187 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-03-09T14:28:54.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2024-03-09T14:28:54.191 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-03-09T14:28:54.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-03-09T14:28:54.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-03-09T14:28:54.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-03-09T14:28:54.197 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-03-09T14:28:54.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-03-09T14:28:54.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-03-09T14:28:54.211 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-03-09T14:28:54.212 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-03-09T14:28:54.215 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-03-09T14:28:54.215 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-03-09T14:28:54.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-03-09T14:28:54.218 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-03-09T14:28:54.223 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-03-09T14:28:54.223 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-03-09T14:28:54.227 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-03-09T14:28:54.227 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-03-09T14:28:54.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-03-09T14:28:54.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-03-09T14:28:54.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-03-09T14:28:54.229 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-03-09T14:28:54.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-03-09T14:28:54.235 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-03-09T14:28:54.242 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-03-09T14:28:54.242 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-03-09T14:28:54.249 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-03-09T14:28:54.249 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-03-09T14:28:54.256 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-03-09T14:28:54.256 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-03-09T14:28:54.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-03-09T14:28:54.264 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-03-09T14:28:54.273 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2024-03-09T14:28:54.273 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-03-09T14:28:54.477 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (204 ms) 2024-03-09T14:28:54.477 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-03-09T14:28:54.480 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-03-09T14:28:54.480 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-03-09T14:28:54.481 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-03-09T14:28:54.481 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-03-09T14:28:54.482 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-03-09T14:28:54.482 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-03-09T14:28:54.489 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-03-09T14:28:54.489 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-03-09T14:28:54.496 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (8 ms) 2024-03-09T14:28:54.496 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-03-09T14:28:54.504 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-03-09T14:28:54.504 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-03-09T14:28:54.513 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-03-09T14:28:54.513 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-03-09T14:28:54.515 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (3 ms) 2024-03-09T14:28:54.515 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-03-09T14:28:54.518 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-03-09T14:28:54.518 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-03-09T14:28:54.519 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-03-09T14:28:54.519 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-03-09T14:28:54.520 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-03-09T14:28:54.520 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-03-09T14:28:54.528 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-03-09T14:28:54.528 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 31 tests from CmpOmap (359 ms total) 2024-03-09T14:28:54.528 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:28:54.528 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:28:55.177 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 31 tests from 1 test suite ran. (2847 ms total) 2024-03-09T14:28:55.177 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 31 tests. 2024-03-09T14:28:55.178 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:28:55.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:28:55.263 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-03-09T14:28:55.264 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-03-09T14:28:55.264 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-03-09T14:28:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:28:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:28:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:28:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from TestCls2PCQueue 2024-03-09T14:28:55.347 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-03-09T14:28:58.193 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2846 ms) 2024-03-09T14:28:58.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-03-09T14:29:01.212 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3019 ms) 2024-03-09T14:29:01.213 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-03-09T14:29:04.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.Reserve (3015 ms) 2024-03-09T14:29:04.228 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-03-09T14:29:07.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3005 ms) 2024-03-09T14:29:07.237 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-03-09T14:29:10.260 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.Commit (3028 ms) 2024-03-09T14:29:10.260 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-03-09T14:29:13.275 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.Stats (3014 ms) 2024-03-09T14:29:13.275 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-03-09T14:29:17.339 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4064 ms) 2024-03-09T14:29:17.339 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-03-09T14:29:20.358 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.Abort (3019 ms) 2024-03-09T14:29:20.358 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-03-09T14:29:23.374 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.ReserveError (3016 ms) 2024-03-09T14:29:23.374 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-03-09T14:29:26.391 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.CommitError (3017 ms) 2024-03-09T14:29:26.391 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-03-09T14:29:29.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.AbortError (3020 ms) 2024-03-09T14:29:29.410 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-03-09T14:29:32.426 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3016 ms) 2024-03-09T14:29:32.426 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-03-09T14:29:35.443 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3017 ms) 2024-03-09T14:29:35.443 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-03-09T14:29:38.465 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3022 ms) 2024-03-09T14:29:38.466 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-03-09T14:29:41.470 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3004 ms) 2024-03-09T14:29:41.470 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-03-09T14:29:44.491 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3020 ms) 2024-03-09T14:29:44.491 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-03-09T14:29:47.504 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3015 ms) 2024-03-09T14:29:47.505 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-03-09T14:29:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.Cleanup (3019 ms) 2024-03-09T14:29:50.523 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-03-09T14:30:00.559 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10035 ms) 2024-03-09T14:30:00.559 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-03-09T14:30:03.573 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3014 ms) 2024-03-09T14:30:03.573 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-03-09T14:30:15.611 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12038 ms) 2024-03-09T14:30:15.611 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-03-09T14:30:19.637 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4027 ms) 2024-03-09T14:30:19.637 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-03-09T14:30:25.661 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6023 ms) 2024-03-09T14:30:25.661 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-03-09T14:30:30.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5022 ms) 2024-03-09T14:30:30.683 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from TestCls2PCQueue (95335 ms total) 2024-03-09T14:30:30.683 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:30.683 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:30.683 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 24 tests from 1 test suite ran. (95335 ms total) 2024-03-09T14:30:30.683 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 24 tests. 2024-03-09T14:30:30.685 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:30:30.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:30.732 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-03-09T14:30:30.733 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-03-09T14:30:30.733 DEBUG:teuthology.orchestra.run.smithi046:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-03-09T14:30:30.784 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:30.785 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:30.785 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:30:30.785 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:32.687 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from ClsAccount 2024-03-09T14:30:32.687 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsAccount.add 2024-03-09T14:30:32.709 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsAccount.add (23 ms) 2024-03-09T14:30:32.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsAccount.get 2024-03-09T14:30:32.715 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsAccount.get (5 ms) 2024-03-09T14:30:32.715 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsAccount.rm 2024-03-09T14:30:32.875 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsAccount.rm (160 ms) 2024-03-09T14:30:32.875 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] ClsAccount.list 2024-03-09T14:30:32.894 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] ClsAccount.list (20 ms) 2024-03-09T14:30:32.894 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from ClsAccount (208 ms total) 2024-03-09T14:30:32.894 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:32.894 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:33.696 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (2912 ms total) 2024-03-09T14:30:33.697 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-03-09T14:30:33.700 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:30:33.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:33.743 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-03-09T14:30:33.744 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-03-09T14:30:33.745 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-03-09T14:30:33.835 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:33.835 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:33.835 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 6 tests from 1 test suite. 2024-03-09T14:30:33.836 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:35.709 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from rgw_gc_log 2024-03-09T14:30:35.709 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-03-09T14:30:35.726 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] rgw_gc_log.init_existing_queue (18 ms) 2024-03-09T14:30:35.726 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-03-09T14:30:35.730 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-03-09T14:30:35.730 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-03-09T14:30:35.733 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-03-09T14:30:35.733 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-03-09T14:30:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-03-09T14:30:35.735 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-03-09T14:30:35.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-03-09T14:30:35.737 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-03-09T14:30:35.739 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-03-09T14:30:35.739 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 6 tests from rgw_gc_log (31 ms total) 2024-03-09T14:30:35.739 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:35.739 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:36.725 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 6 tests from 1 test suite ran. (2889 ms total) 2024-03-09T14:30:36.725 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 6 tests. 2024-03-09T14:30:36.729 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:30:36.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:36.773 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-03-09T14:30:36.774 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-03-09T14:30:36.774 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-03-09T14:30:36.871 INFO:tasks.workunit.client.0.smithi046.stdout:Running main() from gmock_main.cc 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from TestRGWObj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestRGWObj.underscore 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns= i= 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns= i= 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.872 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns= i= 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.873 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.874 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.875 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.876 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.877 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns=ns i= 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns=ns i= 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.878 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns=ns i= 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.879 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.880 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.881 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.882 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.883 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns= i=v1 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns= i=v1 2024-03-09T14:30:36.884 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns= i=v1 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.885 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.886 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.887 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.888 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.889 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.890 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: _obj[v1] 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.891 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.892 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.893 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.894 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.895 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_obj", 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.897 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestRGWObj.no_underscore 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns= i= 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns= i= 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns= i= 2024-03-09T14:30:36.898 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.899 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.900 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.901 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.902 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.903 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns=ns i= 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns=ns i= 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns=ns i= 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.904 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.905 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.906 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.907 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.908 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.909 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns= i=v1 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns= i=v1 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns= i=v1 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.910 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.911 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.912 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.913 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.914 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.915 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:parsed: obj[v1] 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout: "obj1": { 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.916 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "obj2": { 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.917 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.918 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3": { 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.919 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "obj3-2": { 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.920 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "obj", 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "v1", 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.921 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.922 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.923 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker_myobj", 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.924 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.925 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.926 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.927 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker_myobj", 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.928 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.929 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.930 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.931 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.932 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.933 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.934 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.935 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.936 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.937 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.938 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.939 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.940 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.941 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.942 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.943 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.944 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.945 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.946 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.947 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.948 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.949 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.950 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.951 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.952 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.953 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.954 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.955 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.956 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.957 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj", 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.958 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.959 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.960 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.961 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj", 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.962 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.963 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.964 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.965 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.966 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.967 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.968 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.969 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.970 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.971 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.972 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.973 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.974 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.975 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.976 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.977 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.978 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.979 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.980 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.981 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.982 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.983 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.984 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.985 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.986 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.987 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.988 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.989 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.990 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:36.991 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj_", 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.992 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.993 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.994 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.995 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj_", 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.996 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.997 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:36.998 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:36.999 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.000 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.001 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.002 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.003 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.004 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.005 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.006 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.007 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.008 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.009 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.010 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.011 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.012 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.013 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.014 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.015 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": "default-placement.data", 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.016 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "test", 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": "", 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": "" 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.017 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.018 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "obj": { 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.019 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:30:37.020 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.021 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.022 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker_myobj", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.023 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker_myobj 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.024 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker_myobj", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.025 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker_myobj 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.026 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.027 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__ns_myobj 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.028 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.029 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__ns_myobj 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.030 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.031 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__:inst_myobj 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.032 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.033 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__:inst_myobj 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.034 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.035 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.036 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.037 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "myobj", 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-03-09T14:30:37.038 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj", 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.039 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker___myobj 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.040 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj", 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.041 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker___myobj 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.042 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.043 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__ns__myobj 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:30:37.044 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.045 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__ns__myobj 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:37.046 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.047 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__:inst__myobj 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj" 2024-03-09T14:30:37.048 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.049 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__:inst__myobj 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.050 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.051 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.052 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.053 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj", 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj_", 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.054 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.055 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker___myobj_ 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker___myobj_", 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.056 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.057 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker___myobj_ 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.058 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.059 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__ns__myobj_ 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.060 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.061 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "", 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.062 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.063 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "marker__myobj_" 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.064 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.065 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "" 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj": { 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.066 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj": { 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.067 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: "raw_obj2": { 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: "pool": ".data-pool", 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: "loc": "" 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.068 INFO:tasks.workunit.client.0.smithi046.stdout: "new_obj2": { 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket": { 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "ebtest", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "marker": "marker", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_id": "bucket-id", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "tenant": "", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "explicit_placement": { 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "data_pool": ".data-pool", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "data_extra_pool": "", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "index_pool": ".index-pool" 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "key": { 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "name": "_myobj_", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "instance": "inst", 2024-03-09T14:30:37.069 INFO:tasks.workunit.client.0.smithi046.stdout: "ns": "ns" 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-03-09T14:30:37.070 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 4 tests. 2024-03-09T14:30:37.071 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:30:37.071 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:37.112 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-03-09T14:30:37.113 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-03-09T14:30:37.113 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-03-09T14:30:37.224 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:37.225 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:37.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.258+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 realm 2024-03-09T14:30:37.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:30:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.259+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.261+0000 7ff6ad82e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:30:37.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.261+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.261+0000 7ff6ad82e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:30:37.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.261+0000 7ff6ad82e800 20 searching for the correct realm 2024-03-09T14:30:37.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.265+0000 7ff6a93a3640 0 -- 172.21.15.46:0/1342039817 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7ff69c02e040 msgr2=0x7ff69c093ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:30:37.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.471+0000 7ff6a8ba2640 0 -- 172.21.15.46:0/1342039817 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x563302c94d40 msgr2=0x563302c97200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:30:37.474 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.474+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 zone default found 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 4 Realm: () 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:30:37.476 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 zonegroup default 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.475+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 started sync module instance, tier type = 2024-03-09T14:30:37.478 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.476+0000 7ff6ad82e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:30:37.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=0 2024-03-09T14:30:37.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=1 2024-03-09T14:30:37.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=2 2024-03-09T14:30:37.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=3 2024-03-09T14:30:37.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=4 2024-03-09T14:30:37.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=5 2024-03-09T14:30:37.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.486+0000 7ff6ad82e800 20 add_watcher() i=6 2024-03-09T14:30:37.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.487+0000 7ff6ad82e800 20 add_watcher() i=7 2024-03-09T14:30:37.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.487+0000 7ff6ad82e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:30:37.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff55efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 5 note: GC not initialized 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff55dfe3640 20 reqs_thread_entry: start 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 20 init_complete bucket index max shards: 1 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 20 Filter name: none 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff4cf7fe640 20 reqs_thread_entry: start 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.489+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 10 cache get: name=default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= : miss 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.490+0000 7ff6ad82e800 20 rados->read ofs=0 len=0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.491+0000 7ff6ad82e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.491+0000 7ff6ad82e800 10 cache put: name=default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= info.flags=0x0 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.491+0000 7ff6ad82e800 10 adding default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= to cache LRU end 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.491+0000 7ff6ad82e800 10 cache get: name=default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= : hit (negative entry) 2024-03-09T14:30:37.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.491+0000 7ff6ad82e800 10 cache get: name=default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= : hit (negative entry) 2024-03-09T14:30:37.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.492+0000 7ff6ad82e800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-09T14:30:37.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.492+0000 7ff6ad82e800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:30:37.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.492+0000 7ff6ad82e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-03-09T14:30:37.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.493+0000 7ff57ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954817 cookie 94777090115280 notifier 5499 bl.length()=697 2024-03-09T14:30:37.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.493+0000 7ff57ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-09T14:30:37.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.493+0000 7ff57ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:30:37.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.496+0000 7ff6ad82e800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-09T14:30:37.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.496+0000 7ff6ad82e800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:30:37.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.496+0000 7ff6ad82e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-03-09T14:30:37.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.496+0000 7ff57ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954816 cookie 94777090114224 notifier 5499 bl.length()=194 2024-03-09T14:30:37.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.496+0000 7ff57ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-09T14:30:37.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.496+0000 7ff57ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:30:37.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.499+0000 7ff6ad82e800 10 cache put: name=default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= info.flags=0x7 2024-03-09T14:30:37.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.499+0000 7ff6ad82e800 10 moving default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= to cache LRU end 2024-03-09T14:30:37.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.499+0000 7ff6ad82e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:WZPD28Ij9lmt8rp8iDadfqsspnA=, ofs0, ns] 2024-03-09T14:30:37.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.499+0000 7ff57ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954821 cookie 94777090116336 notifier 5499 bl.length()=203 2024-03-09T14:30:37.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.499+0000 7ff57ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= info.flags=0x7 2024-03-09T14:30:37.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.499+0000 7ff57ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WZPD28Ij9lmt8rp8iDadfqsspnA= to cache LRU end 2024-03-09T14:30:37.500 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:37.500 INFO:tasks.workunit.client.0.smithi046.stdout: "user_id": "ceph-test-librgw-file", 2024-03-09T14:30:37.500 INFO:tasks.workunit.client.0.smithi046.stdout: "display_name": "librgw test user", 2024-03-09T14:30:37.500 INFO:tasks.workunit.client.0.smithi046.stdout: "email": "librgw@example.com", 2024-03-09T14:30:37.500 INFO:tasks.workunit.client.0.smithi046.stdout: "suspended": 0, 2024-03-09T14:30:37.500 INFO:tasks.workunit.client.0.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "subusers": [], 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "keys": [ 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: { 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "user": "ceph-test-librgw-file", 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "access_key": "WZPD28Ij9lmt8rp8iDadfqsspnA=", 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "secret_key": "ZLAmnS4W8nGehEi4sesENRpeNH3cv3NXDfps4GM1kQ7CUrJEir3bAA==", 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "active": true, 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "create_date": "2024-03-09T14:30:37.491949Z" 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: ], 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "swift_keys": [], 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "caps": [], 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "default_placement": "", 2024-03-09T14:30:37.501 INFO:tasks.workunit.client.0.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "placement_tags": [], 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_quota": { 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "enabled": false, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size": -1, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "max_objects": -1 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "user_quota": { 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "enabled": false, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size": -1, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:30:37.502 INFO:tasks.workunit.client.0.smithi046.stdout: "max_objects": -1 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "type": "rgw", 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "account_id": "", 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "path": "/", 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "create_date": "2024-03-09T14:30:37.491935Z", 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "tags": [], 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: "group_ids": [] 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:37.503 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:37.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.501+0000 7ff55efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:30:37.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.503+0000 7ff6ad82e800 20 remove_watcher() i=0 2024-03-09T14:30:37.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.503+0000 7ff6ad82e800 2 removed watcher, disabling cache 2024-03-09T14:30:37.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.505+0000 7ff6ad82e800 20 remove_watcher() i=1 2024-03-09T14:30:37.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.505+0000 7ff6ad82e800 20 remove_watcher() i=2 2024-03-09T14:30:37.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.507+0000 7ff6ad82e800 20 remove_watcher() i=3 2024-03-09T14:30:37.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.508+0000 7ff6ad82e800 20 remove_watcher() i=4 2024-03-09T14:30:37.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.508+0000 7ff6ad82e800 20 remove_watcher() i=5 2024-03-09T14:30:37.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.509+0000 7ff6ad82e800 20 remove_watcher() i=6 2024-03-09T14:30:37.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:37.510+0000 7ff6ad82e800 20 remove_watcher() i=7 2024-03-09T14:30:37.520 INFO:tasks.workunit.client.0.smithi046.stdout:phase 1.1 2024-03-09T14:30:37.540 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:30:37.540 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:37.540 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:30:37.540 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:37.551 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:37.551 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:37.730 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (190 ms) 2024-03-09T14:30:37.730 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:30:37.731 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:30:37.731 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:37.731 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:30:37.731 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:30:37.741 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/quux 2024-03-09T14:30:37.746 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/f1 2024-03-09T14:30:37.749 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/f2 2024-03-09T14:30:37.752 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/f1 2024-03-09T14:30:37.755 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/d1/ 2024-03-09T14:30:37.758 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-03-09T14:30:37.761 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-03-09T14:30:37.764 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/momma 2024-03-09T14:30:37.767 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-03-09T14:30:37.770 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-03-09T14:30:37.772 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-03-09T14:30:37.775 INFO:tasks.workunit.client.0.smithi046.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-03-09T14:30:37.778 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETUP_HIER1 (48 ms) 2024-03-09T14:30:37.778 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:30:37.868 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETUP_DIRS1 (90 ms) 2024-03-09T14:30:37.869 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:30:37.869 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:30:37.869 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:30:37.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (16 ms) 2024-03-09T14:30:37.884 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:30:37.925 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (41 ms) 2024-03-09T14:30:37.925 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:30:37.925 INFO:tasks.workunit.client.0.smithi046.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-03-09T14:30:37.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-03-09T14:30:37.932 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:30:37.932 INFO:tasks.workunit.client.0.smithi046.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-03-09T14:30:37.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2024-03-09T14:30:37.939 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:30:37.939 INFO:tasks.workunit.client.0.smithi046.stdout:scanning objects in /bdirs1/dir_0 2024-03-09T14:30:37.939 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout:scanning objects in /bdirs1/dir_1 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout:scanning objects in /bdirs1/dir_2 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:30:37.940 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:37.941 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:30:37.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:30:37.941 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:30:37.941 INFO:tasks.workunit.client.0.smithi046.stdout:read back objects in /bdirs1/dir_0 2024-03-09T14:30:37.941 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_0/sfile_0 2024-03-09T14:30:37.942 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:30:37.942 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_0/sfile_1 2024-03-09T14:30:37.944 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:30:37.944 INFO:tasks.workunit.client.0.smithi046.stdout:read back objects in /bdirs1/dir_1 2024-03-09T14:30:37.944 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_1/sfile_0 2024-03-09T14:30:37.946 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:30:37.946 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_1/sfile_1 2024-03-09T14:30:37.947 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:30:37.947 INFO:tasks.workunit.client.0.smithi046.stdout:read back objects in /bdirs1/dir_2 2024-03-09T14:30:37.947 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_2/sfile_0 2024-03-09T14:30:37.948 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:30:37.949 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_2/sfile_1 2024-03-09T14:30:37.950 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:30:37.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-03-09T14:30:37.950 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:30:38.130 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:30:38.131 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:30:38.132 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:30:38.138 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-09T14:30:38.138 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-09T14:30:38.140 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-09T14:30:38.142 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-09T14:30:38.144 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:30:38.145 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:30:38.145 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-09T14:30:38.145 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-09T14:30:38.146 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:30:38.147 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:30:38.147 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo (foo): DIR 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot (nfsroot): DIR 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.HIER1 (18 ms) 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:30:38.149 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:38.150 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:38.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:38.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:38.149+0000 7ffa2f6418c0 -1 shutting down 2024-03-09T14:30:38.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:38.150+0000 7ff908e5e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64269, si_uid : 1000, si_addr0x3e80000fb0d, si_status0 2024-03-09T14:30:38.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (45 ms) 2024-03-09T14:30:38.194 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from LibRGW (654 ms total) 2024-03-09T14:30:38.194 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:38.194 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:38.194 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 24 tests from 1 test suite ran. (654 ms total) 2024-03-09T14:30:38.194 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 24 tests. 2024-03-09T14:30:38.199 INFO:tasks.workunit.client.0.smithi046.stdout:phase 1.2 2024-03-09T14:30:38.219 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:30:38.220 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:38.220 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:30:38.220 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:38.227 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:38.227 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:38.602 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (382 ms) 2024-03-09T14:30:38.602 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:30:38.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:30:38.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:38.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:30:38.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:30:38.603 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:30:38.604 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:30:38.605 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:38.606 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:38.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:38.603+0000 7f3d66b2d8c0 -1 shutting down 2024-03-09T14:30:38.607 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:38.604+0000 7f3c40ad0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64886, si_uid : 1000, si_addr0x3e80000fd76, si_status0 2024-03-09T14:30:38.678 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (76 ms) 2024-03-09T14:30:38.678 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from LibRGW (459 ms total) 2024-03-09T14:30:38.678 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:38.678 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:38.679 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 24 tests from 1 test suite ran. (459 ms total) 2024-03-09T14:30:38.679 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 24 tests. 2024-03-09T14:30:38.683 INFO:tasks.workunit.client.0.smithi046.stdout:phase 1.3 2024-03-09T14:30:38.703 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:30:38.703 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:38.703 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:30:38.703 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:38.713 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:38.713 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:39.090 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-03-09T14:30:39.090 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:30:39.090 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:30:39.090 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:39.090 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:30:39.091 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:30:39.095 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-03-09T14:30:39.095 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-09T14:30:39.155 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout:scanning objects in /bdirs1/dir_0 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout:scanning objects in /bdirs1/dir_1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:30:39.156 INFO:tasks.workunit.client.0.smithi046.stdout:scanning objects in /bdirs1/dir_2 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:read back objects in /bdirs1/dir_0 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_0/sfile_0 2024-03-09T14:30:39.157 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_0/sfile_1 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi046.stdout:read back objects in /bdirs1/dir_1 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_1/sfile_0 2024-03-09T14:30:39.159 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:30:39.159 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_1/sfile_1 2024-03-09T14:30:39.161 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:30:39.161 INFO:tasks.workunit.client.0.smithi046.stdout:read back objects in /bdirs1/dir_2 2024-03-09T14:30:39.161 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_2/sfile_0 2024-03-09T14:30:39.162 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:30:39.162 INFO:tasks.workunit.client.0.smithi046.stdout:reading 0,256 dir_2/sfile_1 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:30:39.164 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:30:39.165 INFO:tasks.workunit.client.0.smithi046.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:30:39.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:30:39.166 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:30:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-09T14:30:39.171 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-09T14:30:39.174 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-09T14:30:39.175 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-09T14:30:39.178 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:30:39.178 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:30:39.179 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-09T14:30:39.179 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-09T14:30:39.180 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:30:39.181 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:30:39.181 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-09T14:30:39.183 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-09T14:30:39.183 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-09T14:30:39.183 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-09T14:30:39.183 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot/foo (foo): DIR 2024-03-09T14:30:39.183 INFO:tasks.workunit.client.0.smithi046.stdout:/nfsroot (nfsroot): DIR 2024-03-09T14:30:39.183 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:39.184 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:39.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:39.183+0000 7efda291d8c0 -1 shutting down 2024-03-09T14:30:39.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:39.184+0000 7efc7e5f7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65503, si_uid : 1000, si_addr0x3e80000ffdf, si_status0 2024-03-09T14:30:39.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (71 ms) 2024-03-09T14:30:39.255 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 24 tests from LibRGW (551 ms total) 2024-03-09T14:30:39.255 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:39.255 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:39.255 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 24 tests from 1 test suite ran. (551 ms total) 2024-03-09T14:30:39.255 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 24 tests. 2024-03-09T14:30:39.260 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2.1 2024-03-09T14:30:39.280 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:30:39.281 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:39.281 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRGW 2024-03-09T14:30:39.281 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:39.289 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:39.289 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:39.654 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (374 ms) 2024-03-09T14:30:39.654 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:39.654 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:30:39.655 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:30:39.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-03-09T14:30:39.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:30:39.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:30:39.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-09T14:30:39.674 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave0 2024-03-09T14:30:39.684 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave1 2024-03-09T14:30:39.693 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave2 2024-03-09T14:30:39.702 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave3 2024-03-09T14:30:39.711 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave4 2024-03-09T14:30:39.720 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave5 2024-03-09T14:30:39.729 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave6 2024-03-09T14:30:39.738 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave7 2024-03-09T14:30:39.746 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave8 2024-03-09T14:30:39.755 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave9 2024-03-09T14:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (90 ms) 2024-03-09T14:30:39.756 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-09T14:30:39.930 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (175 ms) 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:39.930+0000 7f973fd3d8c0 -1 shutting down 2024-03-09T14:30:39.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:39.931+0000 7f9619c7a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66120, si_uid : 1000, si_addr0x3e800010248, si_status0 2024-03-09T14:30:40.029 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (99 ms) 2024-03-09T14:30:40.029 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRGW (749 ms total) 2024-03-09T14:30:40.029 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:40.030 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:40.030 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 1 test suite ran. (749 ms total) 2024-03-09T14:30:40.030 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 9 tests. 2024-03-09T14:30:40.034 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2.2 2024-03-09T14:30:40.055 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:30:40.056 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:40.056 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRGW 2024-03-09T14:30:40.056 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:40.064 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:40.065 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:40.656 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (600 ms) 2024-03-09T14:30:40.656 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:40.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:40.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:30:40.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:30:40.657 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:30:40.677 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET (21 ms) 2024-03-09T14:30:40.677 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-09T14:30:40.687 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave0 2024-03-09T14:30:40.696 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave1 2024-03-09T14:30:40.705 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave2 2024-03-09T14:30:40.714 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave3 2024-03-09T14:30:40.723 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave4 2024-03-09T14:30:40.732 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave5 2024-03-09T14:30:40.740 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave6 2024-03-09T14:30:40.750 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave7 2024-03-09T14:30:40.759 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave8 2024-03-09T14:30:40.767 INFO:tasks.workunit.client.0.smithi046.stdout:created: sorrydave9 2024-03-09T14:30:40.767 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (90 ms) 2024-03-09T14:30:40.767 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-09T14:30:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (174 ms) 2024-03-09T14:30:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:40.942 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:40.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:40.941+0000 7f2318d5d8c0 -1 shutting down 2024-03-09T14:30:40.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:40.942+0000 7f21f2cff640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66737, si_uid : 1000, si_addr0x3e8000104b1, si_status0 2024-03-09T14:30:41.030 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (88 ms) 2024-03-09T14:30:41.030 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 9 tests from LibRGW (974 ms total) 2024-03-09T14:30:41.030 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:41.030 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:41.030 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 9 tests from 1 test suite ran. (974 ms total) 2024-03-09T14:30:41.030 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 9 tests. 2024-03-09T14:30:41.035 INFO:tasks.workunit.client.0.smithi046.stdout:phase 3.1 2024-03-09T14:30:41.356 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-09T14:30:41.356 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:41.356 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 13 tests from LibRGW 2024-03-09T14:30:41.356 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:41.365 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:41.365 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:41.741 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-03-09T14:30:41.742 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:41.742 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:41.742 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:30:41.752 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-03-09T14:30:41.752 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:30:41.756 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-03-09T14:30:41.756 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:30:41.757 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-03-09T14:30:41.757 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LARGE1 2024-03-09T14:30:41.830 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LARGE1 (73 ms) 2024-03-09T14:30:41.830 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LARGE2 2024-03-09T14:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LARGE2 (47 ms) 2024-03-09T14:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:30:41.878 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:41.879 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:41.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:41.877+0000 7f435b93d8c0 -1 shutting down 2024-03-09T14:30:41.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:41.879+0000 7f423587a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67354, si_uid : 1000, si_addr0x3e80001071a, si_status0 2024-03-09T14:30:41.998 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (121 ms) 2024-03-09T14:30:41.998 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 13 tests from LibRGW (643 ms total) 2024-03-09T14:30:41.999 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:41.999 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:41.999 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 13 tests from 1 test suite ran. (643 ms total) 2024-03-09T14:30:41.999 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 13 tests. 2024-03-09T14:30:42.004 INFO:tasks.workunit.client.0.smithi046.stdout:phase 3.2 2024-03-09T14:30:42.330 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-09T14:30:42.330 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:42.330 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 13 tests from LibRGW 2024-03-09T14:30:42.330 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:42.338 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:42.338 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:42.709 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (380 ms) 2024-03-09T14:30:42.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:42.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:42.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:30:42.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:30:42.710 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:30:42.715 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-03-09T14:30:42.716 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:30:42.719 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-03-09T14:30:42.719 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LARGE1 2024-03-09T14:30:42.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LARGE1 (86 ms) 2024-03-09T14:30:42.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LARGE2 2024-03-09T14:30:42.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-03-09T14:30:42.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:30:42.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:30:42.805 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:30:42.810 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-03-09T14:30:42.810 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:42.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:42.828+0000 7f3ecf7dc8c0 -1 shutting down 2024-03-09T14:30:42.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:42.830+0000 7f3dab4b6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67971, si_uid : 1000, si_addr0x3e800010983, si_status0 2024-03-09T14:30:42.870 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (41 ms) 2024-03-09T14:30:42.870 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 13 tests from LibRGW (540 ms total) 2024-03-09T14:30:42.870 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:42.870 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:42.870 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 13 tests from 1 test suite ran. (540 ms total) 2024-03-09T14:30:42.870 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 13 tests. 2024-03-09T14:30:42.876 INFO:tasks.workunit.client.0.smithi046.stdout:phase 4.1 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 11 tests from LibRGW 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.TVAR 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:read i1: 64001 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:read s1: blunderbuss 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-09T14:30:42.897 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:42.908 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:42.908 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:43.082 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-03-09T14:30:43.082 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:43.082 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:43.082 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:30:43.098 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (16 ms) 2024-03-09T14:30:43.098 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_0 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_1 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_2 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_3 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_4 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_5 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_6 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_7 2024-03-09T14:30:43.517 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_8 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_9 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_10 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_11 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_12 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_13 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_14 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_15 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_16 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_17 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_18 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_19 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_20 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_21 2024-03-09T14:30:43.518 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_22 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_23 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_24 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_25 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_26 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_27 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_28 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_29 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_30 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_31 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_32 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_33 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_34 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_35 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_36 2024-03-09T14:30:43.519 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_37 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_38 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_39 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_40 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_41 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_42 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_43 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_44 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_45 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_46 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_47 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_48 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_49 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_50 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_51 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_52 2024-03-09T14:30:43.520 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_53 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_54 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_55 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_56 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_57 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_58 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_59 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_60 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_61 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_62 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_63 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_64 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_65 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_66 2024-03-09T14:30:43.521 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_67 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_68 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_69 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_70 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_71 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_72 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_73 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_74 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_75 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_76 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_77 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_78 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_79 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_80 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_81 2024-03-09T14:30:43.522 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_82 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_83 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_84 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_85 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_86 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_87 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_88 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_89 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_90 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_91 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_92 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_93 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_94 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_95 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_96 2024-03-09T14:30:43.523 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_97 2024-03-09T14:30:43.524 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_98 2024-03-09T14:30:43.524 INFO:tasks.workunit.client.0.smithi046.stdout:created: dmarker:f_99 2024-03-09T14:30:43.524 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (418 ms) 2024-03-09T14:30:43.524 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:30:43.525 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:30:43.526 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:30:43.527 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:30:43.528 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:30:43.529 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:30:43.530 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:30:43.531 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:30:43.532 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:30:43.533 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:30:43.534 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:30:43.535 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:30:43.536 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:30:43.537 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:30:43.538 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:43.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:43.522+0000 7fe37df3d8c0 -1 shutting down 2024-03-09T14:30:43.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:43.524+0000 7fe257e7a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68588, si_uid : 1000, si_addr0x3e800010bec, si_status0 2024-03-09T14:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (115 ms) 2024-03-09T14:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 11 tests from LibRGW (740 ms total) 2024-03-09T14:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 1 test suite ran. (740 ms total) 2024-03-09T14:30:43.638 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 11 tests. 2024-03-09T14:30:43.644 INFO:tasks.workunit.client.0.smithi046.stdout:phase 4.2 2024-03-09T14:30:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:30:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 11 tests from LibRGW 2024-03-09T14:30:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.TVAR 2024-03-09T14:30:43.664 INFO:tasks.workunit.client.0.smithi046.stdout:read i1: 64001 2024-03-09T14:30:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:read s1: blunderbuss 2024-03-09T14:30:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-09T14:30:43.665 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:43.672 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:43.672 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:43.835 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (171 ms) 2024-03-09T14:30:43.835 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:43.836 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:43.836 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:30:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-03-09T14:30:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:30:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:30:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:30:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:30:43.846 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:30:43.849 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:30:43.850 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:30:43.851 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:30:43.852 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:30:43.853 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:30:43.854 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:30:43.855 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:43.856 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:43.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:43.849+0000 7f6c386398c0 -1 shutting down 2024-03-09T14:30:43.857 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:43.850+0000 7f6b11b25640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69205, si_uid : 1000, si_addr0x3e800010e55, si_status0 2024-03-09T14:30:43.910 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (62 ms) 2024-03-09T14:30:43.910 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 11 tests from LibRGW (246 ms total) 2024-03-09T14:30:43.910 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:43.910 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:43.911 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 11 tests from 1 test suite ran. (246 ms total) 2024-03-09T14:30:43.911 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 11 tests. 2024-03-09T14:30:43.916 INFO:tasks.workunit.client.0.smithi046.stdout:phase 5.1 2024-03-09T14:30:43.945 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-09T14:30:43.945 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:43.945 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 19 tests from LibRGW 2024-03-09T14:30:43.945 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:43.955 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:43.955 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:44.129 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (185 ms) 2024-03-09T14:30:44.129 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:44.130 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:44.130 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:30:44.139 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-03-09T14:30:44.139 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:30:44.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-03-09T14:30:44.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-09T14:30:44.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-09T14:30:44.143 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:30:44.144 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-03-09T14:30:44.144 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-09T14:30:44.144 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-09T14:30:44.145 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-09T14:30:44.148 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-03-09T14:30:44.148 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITEV 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READV 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:30:44.151 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.150+0000 7ff9621218c0 -1 shutting down 2024-03-09T14:30:44.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.151+0000 7ff83bf80640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69822, si_uid : 1000, si_addr0x3e8000110be, si_status0 2024-03-09T14:30:44.203 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (53 ms) 2024-03-09T14:30:44.204 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 19 tests from LibRGW (259 ms total) 2024-03-09T14:30:44.204 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:44.204 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:44.204 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 19 tests from 1 test suite ran. (259 ms total) 2024-03-09T14:30:44.204 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 19 tests. 2024-03-09T14:30:44.209 INFO:tasks.workunit.client.0.smithi046.stdout:phase 5.2 2024-03-09T14:30:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-09T14:30:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment set-up. 2024-03-09T14:30:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 19 tests from LibRGW 2024-03-09T14:30:44.238 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:30:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:44.411 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.INIT (172 ms) 2024-03-09T14:30:44.411 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:30:44.411 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:30:44.411 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:30:44.411 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:30:44.411 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:30:44.417 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.WRITEV 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READV 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-09T14:30:44.418 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:30:44.420 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-03-09T14:30:44.420 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:30:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.DELETE_BUCKET (17 ms) 2024-03-09T14:30:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:30:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:30:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:30:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:30:44.438 INFO:tasks.workunit.client.0.smithi046.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:30:44.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.438+0000 7f4ba4ec18c0 -1 shutting down 2024-03-09T14:30:44.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.439+0000 7f4a7e200640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70439, si_uid : 1000, si_addr0x3e800011327, si_status0 2024-03-09T14:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout:[ OK ] LibRGW.SHUTDOWN (137 ms) 2024-03-09T14:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] 19 tests from LibRGW (336 ms total) 2024-03-09T14:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout:[----------] Global test environment tear-down 2024-03-09T14:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout:[==========] 19 tests from 1 test suite ran. (336 ms total) 2024-03-09T14:30:44.575 INFO:tasks.workunit.client.0.smithi046.stdout:[ PASSED ] 19 tests. 2024-03-09T14:30:44.581 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:30:44.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:44.620 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-03-09T14:30:44.621 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-03-09T14:30:44.621 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-03-09T14:30:44.690 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -z ']' 2024-03-09T14:30:44.690 INFO:tasks.workunit.client.0.smithi046.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:30:44.690 INFO:tasks.workunit.client.0.smithi046.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:30:44.691 INFO:tasks.workunit.client.0.smithi046.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:30:44.691 INFO:tasks.workunit.client.0.smithi046.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:30:44.691 INFO:tasks.workunit.client.0.smithi046.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-03-09T14:30:44.725 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:30:44.725 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:30:44.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.759+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.760+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.760+0000 7f5f1ad33800 20 realm 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.760+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.760+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.760+0000 7f5f1ad33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.761+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.761+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.761+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.762+0000 7f5f1ad33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:30:44.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.762+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.762+0000 7f5f1ad33800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:30:44.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.762+0000 7f5f1ad33800 20 searching for the correct realm 2024-03-09T14:30:44.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.765+0000 7f5f17265640 0 -- 172.21.15.46:0/3882163123 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55f9a62fc740 msgr2=0x55f9a62fec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:30:44.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.769+0000 7f5f16a64640 0 -- 172.21.15.46:0/3882163123 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f5f0c086710 msgr2=0x7f5f0c04b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:30:44.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:30:44.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:30:44.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:30:44.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.774+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:30:44.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 zone default found 2024-03-09T14:30:44.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 4 Realm: () 2024-03-09T14:30:44.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:30:44.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 zonegroup default 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.775+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.776+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.776+0000 7f5f1ad33800 20 started sync module instance, tier type = 2024-03-09T14:30:44.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.776+0000 7f5f1ad33800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:30:44.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=0 2024-03-09T14:30:44.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=1 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=2 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=3 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=4 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=5 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.784+0000 7f5f1ad33800 20 add_watcher() i=6 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.785+0000 7f5f1ad33800 20 add_watcher() i=7 2024-03-09T14:30:44.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.785+0000 7f5f1ad33800 2 all 8 watchers are set, enabling cache 2024-03-09T14:30:44.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.787+0000 7f5dcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:30:44.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.787+0000 7f5f1ad33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:30:44.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.787+0000 7f5f1ad33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.787+0000 7f5f1ad33800 5 note: GC not initialized 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.787+0000 7f5d47fff640 20 reqs_thread_entry: start 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.787+0000 7f5f1ad33800 20 init_complete bucket index max shards: 1 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 Filter name: none 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5d45ffb640 20 reqs_thread_entry: start 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-03-09T14:30:44.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 rados->read ofs=0 len=0 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-09T14:30:44.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.788+0000 7f5f1ad33800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-09T14:30:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.789+0000 7f5f1ad33800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-09T14:30:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.789+0000 7f5f1ad33800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:30:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.789+0000 7f5f1ad33800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-03-09T14:30:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.790+0000 7f5dfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954816 cookie 94530723388160 notifier 5486 bl.length()=677 2024-03-09T14:30:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.790+0000 7f5dfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-09T14:30:44.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.790+0000 7f5dfa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:30:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.792+0000 7f5f1ad33800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-09T14:30:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.792+0000 7f5f1ad33800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:30:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.792+0000 7f5f1ad33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-03-09T14:30:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.793+0000 7f5dfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954826 cookie 94530723381616 notifier 5486 bl.length()=187 2024-03-09T14:30:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.793+0000 7f5dfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-09T14:30:44.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.793+0000 7f5dfa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:30:44.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.795+0000 7f5f1ad33800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-09T14:30:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.795+0000 7f5f1ad33800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:30:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.795+0000 7f5f1ad33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-03-09T14:30:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.795+0000 7f5df9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1056561954827 cookie 94530723381616 notifier 5486 bl.length()=197 2024-03-09T14:30:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.795+0000 7f5df9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-09T14:30:44.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.795+0000 7f5df9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:30:44.796 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "user_id": "ceph-test-maven", 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "display_name": "maven test user", 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "email": "sigv4@example.com", 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "suspended": 0, 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "subusers": [], 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "keys": [ 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: { 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "user": "ceph-test-maven", 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "active": true, 2024-03-09T14:30:44.797 INFO:tasks.workunit.client.0.smithi046.stdout: "create_date": "2024-03-09T14:30:44.789756Z" 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: ], 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "swift_keys": [], 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "caps": [], 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "default_placement": "", 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "placement_tags": [], 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_quota": { 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "enabled": false, 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size": -1, 2024-03-09T14:30:44.798 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "max_objects": -1 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "user_quota": { 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "enabled": false, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size": -1, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "max_objects": -1 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "type": "rgw", 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "account_id": "", 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "path": "/", 2024-03-09T14:30:44.799 INFO:tasks.workunit.client.0.smithi046.stdout: "create_date": "2024-03-09T14:30:44.789739Z", 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stdout: "tags": [], 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stdout: "group_ids": [] 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.797+0000 7f5dcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.799+0000 7f5f1ad33800 20 remove_watcher() i=0 2024-03-09T14:30:44.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.799+0000 7f5f1ad33800 2 removed watcher, disabling cache 2024-03-09T14:30:44.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.800+0000 7f5f1ad33800 20 remove_watcher() i=1 2024-03-09T14:30:44.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.801+0000 7f5f1ad33800 20 remove_watcher() i=2 2024-03-09T14:30:44.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.802+0000 7f5f1ad33800 20 remove_watcher() i=3 2024-03-09T14:30:44.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.803+0000 7f5f1ad33800 20 remove_watcher() i=4 2024-03-09T14:30:44.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.804+0000 7f5f1ad33800 20 remove_watcher() i=5 2024-03-09T14:30:44.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.805+0000 7f5f1ad33800 20 remove_watcher() i=6 2024-03-09T14:30:44.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:30:44.806+0000 7f5f1ad33800 20 remove_watcher() i=7 2024-03-09T14:30:44.816 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -z ']' 2024-03-09T14:30:44.816 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-03-09T14:30:44.816 INFO:tasks.workunit.client.0.smithi046.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-03-09T14:30:44.817 INFO:tasks.workunit.client.0.smithi046.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi046.front.sepia.ceph.com:443 2024-03-09T14:30:44.817 INFO:tasks.workunit.client.0.smithi046.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi046.front.sepia.ceph.com:443 2024-03-09T14:30:44.817 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-03-09T14:30:44.817 INFO:tasks.workunit.client.0.smithi046.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-03-09T14:30:44.817 INFO:tasks.workunit.client.0.smithi046.stderr:+ ./mvnw clean package 2024-03-09T14:30:44.826 INFO:tasks.workunit.client.0.smithi046.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-09T14:30:46.335 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Scanning for projects... 2024-03-09T14:30:46.455 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-03-09T14:30:46.547 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 59 kB/s) 2024-03-09T14:30:46.558 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-03-09T14:30:46.608 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.7 MB/s) 2024-03-09T14:30:46.616 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-03-09T14:30:46.663 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 1.6 MB/s) 2024-03-09T14:30:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-09T14:30:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Building jcksum 1.0 2024-03-09T14:30:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] from pom.xml 2024-03-09T14:30:46.685 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-09T14:30:46.688 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-03-09T14:30:46.706 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-03-09T14:30:46.712 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-03-09T14:30:46.730 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 521 kB/s) 2024-03-09T14:30:46.733 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-03-09T14:30:46.752 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.4 MB/s) 2024-03-09T14:30:46.759 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-03-09T14:30:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-03-09T14:30:46.789 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-03-09T14:30:46.809 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.7 MB/s) 2024-03-09T14:30:46.815 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-03-09T14:30:46.833 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-03-09T14:30:46.836 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-03-09T14:30:46.854 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-03-09T14:30:46.856 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-03-09T14:30:46.876 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.4 MB/s) 2024-03-09T14:30:46.880 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-03-09T14:30:46.898 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.1 MB/s) 2024-03-09T14:30:46.903 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-03-09T14:30:46.922 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.7 MB/s) 2024-03-09T14:30:46.928 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-03-09T14:30:46.947 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 517 kB/s) 2024-03-09T14:30:46.953 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-03-09T14:30:46.974 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.1 MB/s) 2024-03-09T14:30:46.981 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-03-09T14:30:46.999 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 280 kB/s) 2024-03-09T14:30:47.002 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-03-09T14:30:47.020 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-03-09T14:30:47.024 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-03-09T14:30:47.044 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.5 MB/s) 2024-03-09T14:30:47.048 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-03-09T14:30:47.067 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.2 MB/s) 2024-03-09T14:30:47.073 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-03-09T14:30:47.091 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 331 kB/s) 2024-03-09T14:30:47.094 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-03-09T14:30:47.114 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-03-09T14:30:47.121 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-03-09T14:30:47.139 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 376 kB/s) 2024-03-09T14:30:47.142 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-03-09T14:30:47.160 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 550 kB/s) 2024-03-09T14:30:47.164 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-03-09T14:30:47.183 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.3 MB/s) 2024-03-09T14:30:47.188 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-03-09T14:30:47.206 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-03-09T14:30:47.213 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-03-09T14:30:47.231 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-03-09T14:30:47.246 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-03-09T14:30:47.264 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 320 kB/s) 2024-03-09T14:30:47.266 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-03-09T14:30:47.286 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-03-09T14:30:47.292 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-03-09T14:30:47.311 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.0 MB/s) 2024-03-09T14:30:47.322 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-03-09T14:30:47.341 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-03-09T14:30:47.343 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-03-09T14:30:47.362 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 86 kB/s) 2024-03-09T14:30:47.364 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-03-09T14:30:47.381 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 124 kB/s) 2024-03-09T14:30:47.387 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-03-09T14:30:47.406 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 191 kB/s) 2024-03-09T14:30:47.413 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-03-09T14:30:47.433 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 161 kB/s) 2024-03-09T14:30:47.439 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-03-09T14:30:47.459 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 522 kB/s) 2024-03-09T14:30:47.465 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-03-09T14:30:47.483 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-03-09T14:30:47.487 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-03-09T14:30:47.504 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-03-09T14:30:47.508 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-03-09T14:30:47.526 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 273 kB/s) 2024-03-09T14:30:47.529 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-03-09T14:30:47.546 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-03-09T14:30:47.549 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-03-09T14:30:47.566 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 213 kB/s) 2024-03-09T14:30:47.568 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-03-09T14:30:47.585 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-03-09T14:30:47.588 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-03-09T14:30:47.606 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 204 kB/s) 2024-03-09T14:30:47.609 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-03-09T14:30:47.627 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-03-09T14:30:47.631 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-03-09T14:30:47.648 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-03-09T14:30:47.652 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-03-09T14:30:47.670 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-03-09T14:30:47.674 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-03-09T14:30:47.692 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 303 kB/s) 2024-03-09T14:30:47.696 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-03-09T14:30:47.713 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 205 kB/s) 2024-03-09T14:30:47.718 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-03-09T14:30:47.736 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-03-09T14:30:47.738 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-03-09T14:30:47.756 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-03-09T14:30:47.759 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-03-09T14:30:47.777 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-03-09T14:30:47.781 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-03-09T14:30:47.798 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-03-09T14:30:47.802 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-03-09T14:30:47.819 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-03-09T14:30:47.822 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-03-09T14:30:47.840 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-03-09T14:30:47.844 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-03-09T14:30:47.862 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-03-09T14:30:47.863 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-03-09T14:30:47.880 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-03-09T14:30:47.884 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-03-09T14:30:47.902 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 367 kB/s) 2024-03-09T14:30:47.904 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-03-09T14:30:47.922 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-03-09T14:30:47.924 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-03-09T14:30:47.943 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-03-09T14:30:47.946 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-03-09T14:30:47.998 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 323 kB/s) 2024-03-09T14:30:48.002 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-03-09T14:30:48.020 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 276 kB/s) 2024-03-09T14:30:48.022 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-03-09T14:30:48.039 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 732 kB/s) 2024-03-09T14:30:48.043 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-03-09T14:30:48.061 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-03-09T14:30:48.063 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-03-09T14:30:48.083 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-03-09T14:30:48.089 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-03-09T14:30:48.106 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-03-09T14:30:48.110 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-03-09T14:30:48.128 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-03-09T14:30:48.130 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-03-09T14:30:48.150 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-03-09T14:30:48.153 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-03-09T14:30:48.171 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-03-09T14:30:48.174 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-03-09T14:30:48.191 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-03-09T14:30:48.194 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-03-09T14:30:48.214 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-03-09T14:30:48.220 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-03-09T14:30:48.237 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-03-09T14:30:48.239 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-03-09T14:30:48.257 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-03-09T14:30:48.259 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-03-09T14:30:48.277 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 178 kB/s) 2024-03-09T14:30:48.279 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-03-09T14:30:48.296 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 187 kB/s) 2024-03-09T14:30:48.298 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-03-09T14:30:48.315 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-03-09T14:30:48.317 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-03-09T14:30:48.334 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 157 kB/s) 2024-03-09T14:30:48.336 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-03-09T14:30:48.353 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-03-09T14:30:48.355 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-03-09T14:30:48.372 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-03-09T14:30:48.375 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-03-09T14:30:48.400 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 128 kB/s) 2024-03-09T14:30:48.402 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-03-09T14:30:48.419 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-03-09T14:30:48.422 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-03-09T14:30:48.439 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-03-09T14:30:48.443 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-03-09T14:30:48.483 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 24 kB/s) 2024-03-09T14:30:48.485 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-03-09T14:30:48.503 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-03-09T14:30:48.506 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-03-09T14:30:48.523 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 168 kB/s) 2024-03-09T14:30:48.525 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-03-09T14:30:48.543 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-03-09T14:30:48.545 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-03-09T14:30:48.562 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-03-09T14:30:48.564 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-03-09T14:30:48.581 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-03-09T14:30:48.599 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-03-09T14:30:48.695 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 34 MB/s) 2024-03-09T14:30:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-03-09T14:30:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-03-09T14:30:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-03-09T14:30:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-03-09T14:30:48.697 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-03-09T14:30:48.717 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.8 MB/s) 2024-03-09T14:30:48.717 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-03-09T14:30:48.737 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 411 kB/s) 2024-03-09T14:30:48.737 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-03-09T14:30:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (2): 8.3/16 kB | 1.4/49 kB Progress (2): 9.7/16 kB | 1.4/49 kB Progress (2): 9.7/16 kB | 2.8/49 kB Progress (2): 11/16 kB | 2.8/49 kB Progress (2): 11/16 kB | 4.1/49 kB Progress (2): 12/16 kB | 4.1/49 kB Progress (2): 12/16 kB | 5.5/49 kB Progress (2): 14/16 kB | 5.5/49 kB Progress (2): 14/16 kB | 6.9/49 kB Progress (3): 14/16 kB | 6.9/49 kB | 16/71 kB Progress (3): 14/16 kB | 8.3/49 kB | 16/71 kB Progress (3): 15/16 kB | 8.3/49 kB | 16/71 kB Progress (3): 15/16 kB | 9.7/49 kB | 16/71 kB Progress (3): 16 kB | 9.7/49 kB | 16/71 kB Progress (3): 16 kB | 11/49 kB | 16/71 kB Progress (3): 16 kB | 12/49 kB | 16/71 kB Progress (3): 16 kB | 14/49 kB | 16/71 kB Progress (4): 16 kB | 14/49 kB | 16/71 kB | 16/98 kB Progress (4): 16 kB | 15/49 kB | 16/71 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 277 kB/s) 2024-03-09T14:30:48.755 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (4): 15/49 kB | 16/71 kB | 16/98 kB | 16/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-03-09T14:30:48.771 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (4): 15/49 kB | 16/71 kB | 16/98 kB | 33/782 kB Progress (4): 15/49 kB | 16/71 kB | 16/98 kB | 49/782 kB Progress (4): 17/49 kB | 16/71 kB | 16/98 kB | 49/782 kB Progress (4): 18/49 kB | 16/71 kB | 16/98 kB | 49/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 49/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 63/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 79/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 96/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 112/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 128/782 kB Progress (4): 19/49 kB | 16/71 kB | 16/98 kB | 145/782 kB Progress (4): 21/49 kB | 16/71 kB | 16/98 kB | 145/782 kB Progress (4): 22/49 kB | 16/71 kB | 16/98 kB | 145/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 145/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 161/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 178/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 194/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 210/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 227/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 243/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 259/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 276/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 292/782 kB Progress (4): 23/49 kB | 16/71 kB | 16/98 kB | 309/782 kB Progress (4): 25/49 kB | 16/71 kB | 16/98 kB | 309/782 kB Progress (4): 25/49 kB | 16/71 kB | 16/98 kB | 325/782 kB Progress (4): 26/49 kB | 16/71 kB | 16/98 kB | 325/782 kB Progress (4): 28/49 kB | 16/71 kB | 16/98 kB | 325/782 kB Progress (4): 29/49 kB | 16/71 kB | 16/98 kB | 325/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 325/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 341/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 358/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 374/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 391/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 407/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 423/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 440/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 456/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 472/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 489/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 505/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 522/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 538/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 554/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 571/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 587/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 604/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 620/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 636/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 653/782 kB Progress (4): 30/49 kB | 33/71 kB | 16/98 kB | 653/782 kB Progress (4): 30/49 kB | 33/71 kB | 16/98 kB | 669/782 kB Progress (4): 32/49 kB | 33/71 kB | 16/98 kB | 669/782 kB Progress (4): 33/49 kB | 33/71 kB | 16/98 kB | 669/782 kB Progress (4): 34/49 kB | 33/71 kB | 16/98 kB | 669/782 kB Progress (4): 34/49 kB | 33/71 kB | 16/98 kB | 685/782 kB Progress (4): 36/49 kB | 33/71 kB | 16/98 kB | 685/782 kB Progress (4): 36/49 kB | 33/71 kB | 33/98 kB | 685/782 kB Progress (4): 36/49 kB | 33/71 kB | 33/98 kB | 702/782 kB Progress (4): 37/49 kB | 33/71 kB | 33/98 kB | 702/782 kB Progress (4): 39/49 kB | 33/71 kB | 33/98 kB | 702/782 kB Progress (4): 39/49 kB | 33/71 kB | 33/98 kB | 718/782 kB Progress (4): 40/49 kB | 33/71 kB | 33/98 kB | 718/782 kB Progress (4): 41/49 kB | 33/71 kB | 33/98 kB | 718/782 kB Progress (4): 41/49 kB | 33/71 kB | 33/98 kB | 735/782 kB Progress (4): 43/49 kB | 33/71 kB | 33/98 kB | 735/782 kB Progress (4): 44/49 kB | 33/71 kB | 33/98 kB | 735/782 kB Progress (4): 44/49 kB | 33/71 kB | 33/98 kB | 751/782 kB Progress (4): 46/49 kB | 33/71 kB | 33/98 kB | 751/782 kB Progress (4): 46/49 kB | 33/71 kB | 33/98 kB | 767/782 kB Progress (4): 46/49 kB | 33/71 kB | 33/98 kB | 782 kB Progress (5): 46/49 kB | 33/71 kB | 33/98 kB | 782 kB | 1.4/11 kB Progress (5): 46/49 kB | 33/71 kB | 33/98 kB | 782 kB | 2.8/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-03-09T14:30:48.771 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-03-09T14:30:48.773 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (4): 46/49 kB | 33/71 kB | 33/98 kB | 4.1/11 kB Progress (4): 46/49 kB | 33/71 kB | 33/98 kB | 5.5/11 kB Progress (4): 46/49 kB | 49/71 kB | 33/98 kB | 5.5/11 kB Progress (4): 46/49 kB | 49/71 kB | 33/98 kB | 6.9/11 kB Progress (4): 46/49 kB | 49/71 kB | 33/98 kB | 8.3/11 kB Progress (4): 46/49 kB | 49/71 kB | 33/98 kB | 9.7/11 kB Progress (4): 46/49 kB | 49/71 kB | 33/98 kB | 11/11 kB Progress (4): 46/49 kB | 49/71 kB | 33/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 152 kB/s) 2024-03-09T14:30:48.773 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-03-09T14:30:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (3): 47/49 kB | 49/71 kB | 33/98 kB Progress (3): 48/49 kB | 49/71 kB | 33/98 kB Progress (3): 49 kB | 49/71 kB | 33/98 kB Progress (3): 49 kB | 49/71 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 639 kB/s) 2024-03-09T14:30:48.774 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-03-09T14:30:48.782 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 66/71 kB | 49/98 kB Progress (2): 71 kB | 49/98 kB Progress (2): 71 kB | 66/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 820 kB/s) 2024-03-09T14:30:48.782 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-03-09T14:30:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.1 MB/s) 2024-03-09T14:30:48.786 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-03-09T14:30:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (1): 65/205 kB Progress (2): 65/205 kB | 1.4/30 kB Progress (2): 65/205 kB | 2.8/30 kB Progress (2): 65/205 kB | 4.1/30 kB Progress (2): 65/205 kB | 5.5/30 kB Progress (2): 81/205 kB | 5.5/30 kB Progress (2): 81/205 kB | 6.9/30 kB Progress (2): 98/205 kB | 6.9/30 kB Progress (2): 98/205 kB | 8.3/30 kB Progress (2): 98/205 kB | 9.7/30 kB Progress (2): 98/205 kB | 11/30 kB Progress (2): 114/205 kB | 11/30 kB Progress (2): 130/205 kB | 11/30 kB Progress (2): 130/205 kB | 12/30 kB Progress (2): 130/205 kB | 14/30 kB Progress (2): 147/205 kB | 14/30 kB Progress (2): 147/205 kB | 15/30 kB Progress (2): 163/205 kB | 15/30 kB Progress (2): 163/205 kB | 17/30 kB Progress (2): 180/205 kB | 17/30 kB Progress (2): 180/205 kB | 18/30 kB Progress (2): 180/205 kB | 19/30 kB Progress (2): 196/205 kB | 19/30 kB Progress (2): 205 kB | 19/30 kB Progress (2): 205 kB | 21/30 kB Progress (2): 205 kB | 22/30 kB Progress (2): 205 kB | 23/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-03-09T14:30:48.794 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-03-09T14:30:48.795 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 25/30 kB Progress (1): 26/30 kB Progress (2): 26/30 kB | 16/81 kB Progress (2): 28/30 kB | 16/81 kB Progress (2): 29/30 kB | 16/81 kB Progress (2): 30 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 311 kB/s) 2024-03-09T14:30:48.795 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-03-09T14:30:48.803 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 33/81 kB Progress (1): 49/81 kB Progress (1): 66/81 kB Progress (2): 66/81 kB | 16/798 kB Progress (3): 66/81 kB | 16/798 kB | 13 kB Progress (3): 66/81 kB | 33/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 126 kB/s) 2024-03-09T14:30:48.803 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-03-09T14:30:48.809 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 66/81 kB | 49/798 kB Progress (2): 66/81 kB | 66/798 kB Progress (2): 81 kB | 66/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 732 kB/s) 2024-03-09T14:30:48.809 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-03-09T14:30:48.813 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 66/798 kB | 16/182 kB Progress (2): 66/798 kB | 33/182 kB Progress (2): 66/798 kB | 49/182 kB Progress (2): 66/798 kB | 66/182 kB Progress (2): 66/798 kB | 82/182 kB Progress (2): 66/798 kB | 98/182 kB Progress (2): 66/798 kB | 115/182 kB Progress (2): 66/798 kB | 131/182 kB Progress (3): 66/798 kB | 131/182 kB | 16/151 kB Progress (3): 66/798 kB | 147/182 kB | 16/151 kB Progress (3): 66/798 kB | 164/182 kB | 16/151 kB Progress (3): 66/798 kB | 180/182 kB | 16/151 kB Progress (3): 66/798 kB | 182 kB | 16/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-03-09T14:30:48.814 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-03-09T14:30:48.822 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 66/798 kB | 33/151 kB Progress (2): 82/798 kB | 33/151 kB Progress (2): 98/798 kB | 33/151 kB Progress (2): 98/798 kB | 49/151 kB Progress (2): 115/798 kB | 49/151 kB Progress (2): 115/798 kB | 66/151 kB Progress (2): 131/798 kB | 66/151 kB Progress (2): 147/798 kB | 66/151 kB Progress (3): 147/798 kB | 66/151 kB | 16/27 kB Progress (3): 164/798 kB | 66/151 kB | 16/27 kB Progress (3): 164/798 kB | 66/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 220 kB/s) 2024-03-09T14:30:48.822 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 180/798 kB | 66/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-03-09T14:30:48.827 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 197/798 kB | 66/151 kB Progress (2): 213/798 kB | 66/151 kB Progress (3): 213/798 kB | 66/151 kB | 16/30 kB Progress (3): 213/798 kB | 66/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 235 kB/s) 2024-03-09T14:30:48.827 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-03-09T14:30:48.837 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 213/798 kB | 82/151 kB Progress (2): 213/798 kB | 98/151 kB Progress (2): 229/798 kB | 98/151 kB Progress (2): 229/798 kB | 115/151 kB Progress (2): 246/798 kB | 115/151 kB Progress (2): 256/798 kB | 115/151 kB Progress (2): 272/798 kB | 115/151 kB Progress (2): 272/798 kB | 131/151 kB Progress (3): 272/798 kB | 131/151 kB | 16/385 kB Progress (3): 272/798 kB | 131/151 kB | 33/385 kB Progress (3): 272/798 kB | 131/151 kB | 49/385 kB Progress (3): 272/798 kB | 131/151 kB | 66/385 kB Progress (3): 272/798 kB | 131/151 kB | 82/385 kB Progress (3): 272/798 kB | 131/151 kB | 98/385 kB Progress (3): 272/798 kB | 131/151 kB | 115/385 kB Progress (3): 272/798 kB | 131/151 kB | 131/385 kB Progress (3): 272/798 kB | 131/151 kB | 147/385 kB Progress (3): 272/798 kB | 131/151 kB | 164/385 kB Progress (3): 272/798 kB | 131/151 kB | 180/385 kB Progress (3): 272/798 kB | 131/151 kB | 197/385 kB Progress (3): 289/798 kB | 131/151 kB | 197/385 kB Progress (3): 289/798 kB | 131/151 kB | 213/385 kB Progress (3): 289/798 kB | 147/151 kB | 213/385 kB Progress (3): 305/798 kB | 147/151 kB | 213/385 kB Progress (3): 305/798 kB | 147/151 kB | 229/385 kB Progress (3): 305/798 kB | 151 kB | 229/385 kB Progress (3): 321/798 kB | 151 kB | 229/385 kB Progress (3): 321/798 kB | 151 kB | 246/385 kB Progress (3): 321/798 kB | 151 kB | 256/385 kB Progress (3): 338/798 kB | 151 kB | 256/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-03-09T14:30:48.838 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 338/798 kB | 272/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-03-09T14:30:48.839 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 354/798 kB | 272/385 kB Progress (2): 354/798 kB | 289/385 kB Progress (2): 370/798 kB | 289/385 kB Progress (2): 370/798 kB | 305/385 kB Progress (2): 387/798 kB | 305/385 kB Progress (2): 387/798 kB | 321/385 kB Progress (2): 403/798 kB | 321/385 kB Progress (2): 403/798 kB | 338/385 kB Progress (2): 420/798 kB | 338/385 kB Progress (2): 420/798 kB | 354/385 kB Progress (2): 436/798 kB | 354/385 kB Progress (2): 436/798 kB | 370/385 kB Progress (2): 452/798 kB | 370/385 kB Progress (2): 452/798 kB | 385 kB Progress (2): 469/798 kB | 385 kB Progress (2): 485/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.7 MB/s) 2024-03-09T14:30:48.839 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-03-09T14:30:48.840 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 485/798 kB | 13 kB Progress (2): 502/798 kB | 13 kB Progress (2): 518/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 93 kB/s) 2024-03-09T14:30:48.840 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-03-09T14:30:48.848 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 518/798 kB | 16/75 kB Progress (2): 518/798 kB | 32/75 kB Progress (2): 534/798 kB | 32/75 kB Progress (2): 551/798 kB | 32/75 kB Progress (2): 567/798 kB | 32/75 kB Progress (2): 567/798 kB | 49/75 kB Progress (2): 583/798 kB | 49/75 kB Progress (2): 583/798 kB | 65/75 kB Progress (2): 600/798 kB | 65/75 kB Progress (2): 600/798 kB | 75 kB Progress (2): 616/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 500 kB/s) 2024-03-09T14:30:48.848 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-03-09T14:30:48.854 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 633/798 kB Progress (1): 649/798 kB Progress (1): 665/798 kB Progress (1): 682/798 kB Progress (1): 698/798 kB Progress (1): 715/798 kB Progress (1): 731/798 kB Progress (1): 747/798 kB Progress (1): 764/798 kB Progress (1): 780/798 kB Progress (1): 796/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 5.1 MB/s) 2024-03-09T14:30:48.854 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-03-09T14:30:48.863 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/780 kB Progress (2): 16/780 kB | 16/329 kB Progress (2): 16/780 kB | 32/329 kB Progress (2): 16/780 kB | 49/329 kB Progress (2): 16/780 kB | 65/329 kB Progress (2): 16/780 kB | 81/329 kB Progress (2): 16/780 kB | 98/329 kB Progress (2): 16/780 kB | 114/329 kB Progress (2): 16/780 kB | 130/329 kB Progress (2): 16/780 kB | 147/329 kB Progress (2): 16/780 kB | 163/329 kB Progress (2): 33/780 kB | 163/329 kB Progress (2): 33/780 kB | 180/329 kB Progress (3): 33/780 kB | 180/329 kB | 16/501 kB Progress (3): 49/780 kB | 180/329 kB | 16/501 kB Progress (3): 49/780 kB | 196/329 kB | 16/501 kB Progress (3): 66/780 kB | 196/329 kB | 16/501 kB Progress (3): 66/780 kB | 196/329 kB | 33/501 kB Progress (3): 66/780 kB | 212/329 kB | 33/501 kB Progress (3): 82/780 kB | 212/329 kB | 33/501 kB Progress (3): 82/780 kB | 212/329 kB | 49/501 kB Progress (3): 82/780 kB | 229/329 kB | 49/501 kB Progress (3): 98/780 kB | 229/329 kB | 49/501 kB Progress (3): 98/780 kB | 245/329 kB | 49/501 kB Progress (3): 98/780 kB | 245/329 kB | 65/501 kB Progress (3): 115/780 kB | 245/329 kB | 65/501 kB Progress (3): 115/780 kB | 262/329 kB | 65/501 kB Progress (3): 131/780 kB | 262/329 kB | 65/501 kB Progress (3): 131/780 kB | 278/329 kB | 65/501 kB Progress (3): 147/780 kB | 278/329 kB | 65/501 kB Progress (3): 147/780 kB | 294/329 kB | 65/501 kB Progress (3): 147/780 kB | 294/329 kB | 82/501 kB Progress (3): 164/780 kB | 294/329 kB | 82/501 kB Progress (3): 164/780 kB | 311/329 kB | 82/501 kB Progress (3): 164/780 kB | 327/329 kB | 82/501 kB Progress (3): 164/780 kB | 329 kB | 82/501 kB Progress (3): 180/780 kB | 329 kB | 82/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-03-09T14:30:48.863 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-03-09T14:30:48.872 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 197/780 kB | 82/501 kB Progress (2): 197/780 kB | 98/501 kB Progress (2): 213/780 kB | 98/501 kB Progress (2): 229/780 kB | 98/501 kB Progress (2): 246/780 kB | 98/501 kB Progress (3): 246/780 kB | 98/501 kB | 16/41 kB Progress (3): 246/780 kB | 98/501 kB | 33/41 kB Progress (3): 246/780 kB | 98/501 kB | 41 kB Progress (4): 246/780 kB | 98/501 kB | 41 kB | 16/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 238 kB/s) 2024-03-09T14:30:48.873 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-03-09T14:30:48.880 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (3): 246/780 kB | 98/501 kB | 33/354 kB Progress (3): 246/780 kB | 98/501 kB | 49/354 kB Progress (3): 246/780 kB | 115/501 kB | 49/354 kB Progress (3): 256/780 kB | 115/501 kB | 49/354 kB Progress (3): 272/780 kB | 115/501 kB | 49/354 kB Progress (3): 272/780 kB | 131/501 kB | 49/354 kB Progress (3): 289/780 kB | 131/501 kB | 49/354 kB Progress (3): 305/780 kB | 131/501 kB | 49/354 kB Progress (3): 305/780 kB | 131/501 kB | 66/354 kB Progress (3): 305/780 kB | 147/501 kB | 66/354 kB Progress (3): 305/780 kB | 147/501 kB | 82/354 kB Progress (3): 321/780 kB | 147/501 kB | 82/354 kB Progress (3): 338/780 kB | 147/501 kB | 82/354 kB Progress (3): 338/780 kB | 164/501 kB | 82/354 kB Progress (3): 354/780 kB | 164/501 kB | 82/354 kB Progress (3): 354/780 kB | 164/501 kB | 98/354 kB Progress (3): 370/780 kB | 164/501 kB | 98/354 kB Progress (3): 370/780 kB | 164/501 kB | 115/354 kB Progress (3): 370/780 kB | 180/501 kB | 115/354 kB Progress (3): 387/780 kB | 180/501 kB | 115/354 kB Progress (3): 403/780 kB | 180/501 kB | 115/354 kB Progress (3): 403/780 kB | 180/501 kB | 131/354 kB Progress (3): 403/780 kB | 196/501 kB | 131/354 kB Progress (3): 420/780 kB | 196/501 kB | 131/354 kB Progress (3): 420/780 kB | 196/501 kB | 147/354 kB Progress (3): 436/780 kB | 196/501 kB | 147/354 kB Progress (3): 452/780 kB | 196/501 kB | 147/354 kB Progress (3): 452/780 kB | 213/501 kB | 147/354 kB Progress (3): 469/780 kB | 213/501 kB | 147/354 kB Progress (3): 485/780 kB | 213/501 kB | 147/354 kB Progress (4): 485/780 kB | 213/501 kB | 147/354 kB | 6.4 kB Progress (4): 485/780 kB | 229/501 kB | 147/354 kB | 6.4 kB Progress (4): 502/780 kB | 229/501 kB | 147/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 35 kB/s) 2024-03-09T14:30:48.880 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-03-09T14:30:48.891 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (3): 502/780 kB | 246/501 kB | 147/354 kB Progress (3): 518/780 kB | 246/501 kB | 147/354 kB Progress (3): 534/780 kB | 246/501 kB | 147/354 kB Progress (3): 534/780 kB | 262/501 kB | 147/354 kB Progress (3): 551/780 kB | 262/501 kB | 147/354 kB Progress (3): 567/780 kB | 262/501 kB | 147/354 kB Progress (3): 583/780 kB | 262/501 kB | 147/354 kB Progress (3): 600/780 kB | 262/501 kB | 147/354 kB Progress (3): 600/780 kB | 278/501 kB | 147/354 kB Progress (3): 616/780 kB | 278/501 kB | 147/354 kB Progress (3): 616/780 kB | 295/501 kB | 147/354 kB Progress (3): 633/780 kB | 295/501 kB | 147/354 kB Progress (3): 633/780 kB | 311/501 kB | 147/354 kB Progress (3): 649/780 kB | 311/501 kB | 147/354 kB Progress (3): 665/780 kB | 311/501 kB | 147/354 kB Progress (3): 682/780 kB | 311/501 kB | 147/354 kB Progress (3): 698/780 kB | 311/501 kB | 147/354 kB Progress (3): 698/780 kB | 311/501 kB | 164/354 kB Progress (3): 698/780 kB | 311/501 kB | 180/354 kB Progress (3): 698/780 kB | 311/501 kB | 197/354 kB Progress (3): 698/780 kB | 327/501 kB | 197/354 kB Progress (3): 698/780 kB | 327/501 kB | 213/354 kB Progress (3): 715/780 kB | 327/501 kB | 213/354 kB Progress (3): 731/780 kB | 327/501 kB | 213/354 kB Progress (3): 747/780 kB | 327/501 kB | 213/354 kB Progress (3): 747/780 kB | 344/501 kB | 213/354 kB Progress (3): 747/780 kB | 344/501 kB | 229/354 kB Progress (3): 747/780 kB | 360/501 kB | 229/354 kB Progress (3): 764/780 kB | 360/501 kB | 229/354 kB Progress (3): 764/780 kB | 360/501 kB | 246/354 kB Progress (3): 780/780 kB | 360/501 kB | 246/354 kB Progress (3): 780/780 kB | 377/501 kB | 246/354 kB Progress (3): 780 kB | 377/501 kB | 246/354 kB Progress (3): 780 kB | 393/501 kB | 246/354 kB Progress (3): 780 kB | 393/501 kB | 262/354 kB Progress (3): 780 kB | 409/501 kB | 262/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.1 MB/s) 2024-03-09T14:30:48.891 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-03-09T14:30:48.896 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (3): 409/501 kB | 262/354 kB | 16/586 kB Progress (3): 409/501 kB | 279/354 kB | 16/586 kB Progress (3): 409/501 kB | 279/354 kB | 33/586 kB Progress (3): 426/501 kB | 279/354 kB | 33/586 kB Progress (3): 426/501 kB | 279/354 kB | 49/586 kB Progress (3): 442/501 kB | 279/354 kB | 49/586 kB Progress (3): 442/501 kB | 279/354 kB | 66/586 kB Progress (3): 442/501 kB | 279/354 kB | 82/586 kB Progress (3): 442/501 kB | 279/354 kB | 98/586 kB Progress (3): 442/501 kB | 279/354 kB | 115/586 kB Progress (3): 442/501 kB | 279/354 kB | 131/586 kB Progress (3): 442/501 kB | 295/354 kB | 131/586 kB Progress (3): 442/501 kB | 295/354 kB | 147/586 kB Progress (3): 442/501 kB | 311/354 kB | 147/586 kB Progress (3): 442/501 kB | 311/354 kB | 164/586 kB Progress (3): 442/501 kB | 311/354 kB | 180/586 kB Progress (3): 459/501 kB | 311/354 kB | 180/586 kB Progress (3): 459/501 kB | 311/354 kB | 197/586 kB Progress (3): 475/501 kB | 311/354 kB | 197/586 kB Progress (3): 475/501 kB | 311/354 kB | 213/586 kB Progress (3): 475/501 kB | 311/354 kB | 229/586 kB Progress (3): 475/501 kB | 328/354 kB | 229/586 kB Progress (3): 475/501 kB | 328/354 kB | 246/586 kB Progress (3): 475/501 kB | 328/354 kB | 256/586 kB Progress (3): 475/501 kB | 328/354 kB | 272/586 kB Progress (3): 491/501 kB | 328/354 kB | 272/586 kB Progress (3): 491/501 kB | 328/354 kB | 289/586 kB Progress (3): 501 kB | 328/354 kB | 289/586 kB Progress (3): 501 kB | 328/354 kB | 305/586 kB Progress (3): 501 kB | 328/354 kB | 321/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.5 MB/s) 2024-03-09T14:30:48.896 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 344/354 kB | 321/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-03-09T14:30:48.897 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 344/354 kB | 338/586 kB Progress (2): 354 kB | 338/586 kB Progress (2): 354 kB | 354/586 kB Progress (2): 354 kB | 370/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.8 MB/s) 2024-03-09T14:30:48.897 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-03-09T14:30:48.901 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 387/586 kB Progress (1): 403/586 kB Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.9 MB/s) 2024-03-09T14:30:48.901 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-03-09T14:30:48.905 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (1): 115/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 164/211 kB Progress (1): 180/211 kB Progress (1): 197/211 kB Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.0 MB/s) 2024-03-09T14:30:48.905 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-03-09T14:30:48.908 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 68 kB/s) 2024-03-09T14:30:48.908 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-03-09T14:30:48.915 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.8 kB Progress (2): 6.8 kB | 16/106 kB Progress (2): 6.8 kB | 33/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 32 kB/s) 2024-03-09T14:30:48.915 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-03-09T14:30:48.916 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 490 kB/s) 2024-03-09T14:30:48.916 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-03-09T14:30:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/245 kB Progress (1): 32/245 kB Progress (1): 49/245 kB Progress (1): 65/245 kB Progress (1): 81/245 kB Progress (1): 98/245 kB Progress (1): 114/245 kB Progress (2): 114/245 kB | 16/205 kB Progress (2): 130/245 kB | 16/205 kB Progress (2): 130/245 kB | 33/205 kB Progress (2): 147/245 kB | 33/205 kB Progress (2): 147/245 kB | 49/205 kB Progress (2): 147/245 kB | 66/205 kB Progress (2): 163/245 kB | 66/205 kB Progress (2): 163/245 kB | 82/205 kB Progress (2): 180/245 kB | 82/205 kB Progress (2): 180/245 kB | 98/205 kB Progress (2): 180/245 kB | 115/205 kB Progress (2): 196/245 kB | 115/205 kB Progress (2): 196/245 kB | 131/205 kB Progress (2): 212/245 kB | 131/205 kB Progress (2): 212/245 kB | 147/205 kB Progress (2): 229/245 kB | 147/205 kB Progress (2): 229/245 kB | 164/205 kB Progress (2): 229/245 kB | 180/205 kB Progress (2): 245 kB | 180/205 kB Progress (2): 245 kB | 197/205 kB Progress (2): 245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-03-09T14:30:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 906 kB/s) 2024-03-09T14:30:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-03-09T14:30:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-03-09T14:30:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 67 kB/s) 2024-03-09T14:30:48.926 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-03-09T14:30:48.931 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 71 kB/s) 2024-03-09T14:30:48.932 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-03-09T14:30:48.934 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-03-09T14:30:48.957 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/17 kB Progress (2): 16/17 kB | 16/23 kB Progress (2): 17 kB | 16/23 kB Progress (3): 17 kB | 16/23 kB | 16/24 kB Progress (3): 17 kB | 23 kB | 16/24 kB Progress (4): 17 kB | 23 kB | 16/24 kB | 16/184 kB Progress (4): 17 kB | 23 kB | 24 kB | 16/184 kB Progress (4): 17 kB | 23 kB | 24 kB | 33/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 88 kB/s) 2024-03-09T14:30:48.957 INFO:tasks.workunit.client.0.smithi046.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 93 kB/s) 2024-03-09T14:30:48.957 INFO:tasks.workunit.client.0.smithi046.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 67 kB/s) 2024-03-09T14:30:48.960 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 49/184 kB Progress (1): 64/184 kB Progress (1): 81/184 kB Progress (1): 97/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 146/184 kB Progress (1): 163/184 kB Progress (1): 179/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 707 kB/s) 2024-03-09T14:30:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:48.978 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-03-09T14:30:48.985 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-03-09T14:30:49.002 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-03-09T14:30:49.004 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-03-09T14:30:49.022 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-03-09T14:30:49.023 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-03-09T14:30:49.041 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-03-09T14:30:49.045 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-03-09T14:30:49.063 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-03-09T14:30:49.067 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-03-09T14:30:49.087 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 97/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.1 MB/s) 2024-03-09T14:30:49.087 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-03-09T14:30:49.107 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-03-09T14:30:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:49.143 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-09T14:30:49.146 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-03-09T14:30:49.163 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-03-09T14:30:49.165 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-03-09T14:30:49.182 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-03-09T14:30:49.184 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-03-09T14:30:49.202 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 487 kB/s) 2024-03-09T14:30:49.204 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-03-09T14:30:49.221 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-03-09T14:30:49.224 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-03-09T14:30:49.241 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-03-09T14:30:49.242 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-03-09T14:30:49.259 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 201 kB/s) 2024-03-09T14:30:49.262 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-03-09T14:30:49.278 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 36 kB/s) 2024-03-09T14:30:49.280 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-03-09T14:30:49.296 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 161 kB/s) 2024-03-09T14:30:49.297 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-03-09T14:30:49.314 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-03-09T14:30:49.316 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-03-09T14:30:49.333 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-03-09T14:30:49.335 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-03-09T14:30:49.351 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-03-09T14:30:49.353 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-03-09T14:30:49.370 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 492 kB/s) 2024-03-09T14:30:49.372 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-03-09T14:30:49.389 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-03-09T14:30:49.391 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-03-09T14:30:49.408 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-03-09T14:30:49.412 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-03-09T14:30:49.430 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 283 kB/s) 2024-03-09T14:30:49.432 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-03-09T14:30:49.449 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.8 MB/s) 2024-03-09T14:30:49.454 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-03-09T14:30:49.472 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 268 kB/s) 2024-03-09T14:30:49.476 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-03-09T14:30:49.495 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 62/85 kB Progress (1): 79/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.7 MB/s) 2024-03-09T14:30:49.495 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-03-09T14:30:49.495 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-03-09T14:30:49.495 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-03-09T14:30:49.495 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-03-09T14:30:49.496 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-03-09T14:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (2): 2.5 kB | 33/41 kB Progress (3): 2.5 kB | 33/41 kB | 16/55 kB Progress (3): 2.5 kB | 41 kB | 16/55 kB Progress (3): 2.5 kB | 41 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 147 kB/s) 2024-03-09T14:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 41 kB | 49/55 kB Progress (3): 41 kB | 49/55 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-03-09T14:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (3): 41 kB | 55 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.4 MB/s) 2024-03-09T14:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-03-09T14:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (3): 55 kB | 8.5 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-03-09T14:30:49.513 INFO:tasks.workunit.client.0.smithi046.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-03-09T14:30:49.516 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-03-09T14:30:49.538 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 64/587 kB Progress (1): 80/587 kB Progress (1): 97/587 kB Progress (1): 113/587 kB Progress (2): 113/587 kB | 16/327 kB Progress (2): 130/587 kB | 16/327 kB Progress (2): 130/587 kB | 33/327 kB Progress (2): 146/587 kB | 33/327 kB Progress (2): 162/587 kB | 33/327 kB Progress (2): 162/587 kB | 49/327 kB Progress (2): 179/587 kB | 49/327 kB Progress (2): 179/587 kB | 66/327 kB Progress (2): 195/587 kB | 66/327 kB Progress (2): 211/587 kB | 66/327 kB Progress (2): 211/587 kB | 82/327 kB Progress (2): 228/587 kB | 82/327 kB Progress (2): 244/587 kB | 82/327 kB Progress (2): 244/587 kB | 98/327 kB Progress (2): 261/587 kB | 98/327 kB Progress (2): 261/587 kB | 115/327 kB Progress (2): 277/587 kB | 115/327 kB Progress (2): 293/587 kB | 115/327 kB Progress (2): 293/587 kB | 131/327 kB Progress (2): 310/587 kB | 131/327 kB Progress (2): 310/587 kB | 147/327 kB Progress (2): 326/587 kB | 147/327 kB Progress (2): 326/587 kB | 164/327 kB Progress (2): 343/587 kB | 164/327 kB Progress (2): 359/587 kB | 164/327 kB Progress (2): 359/587 kB | 180/327 kB Progress (2): 375/587 kB | 180/327 kB Progress (2): 375/587 kB | 197/327 kB Progress (2): 392/587 kB | 197/327 kB Progress (2): 392/587 kB | 213/327 kB Progress (2): 408/587 kB | 213/327 kB Progress (2): 424/587 kB | 213/327 kB Progress (2): 424/587 kB | 229/327 kB Progress (2): 441/587 kB | 229/327 kB Progress (2): 457/587 kB | 229/327 kB Progress (2): 457/587 kB | 246/327 kB Progress (2): 474/587 kB | 246/327 kB Progress (2): 474/587 kB | 262/327 kB Progress (2): 490/587 kB | 262/327 kB Progress (2): 506/587 kB | 262/327 kB Progress (2): 506/587 kB | 279/327 kB Progress (2): 523/587 kB | 279/327 kB Progress (2): 539/587 kB | 279/327 kB Progress (2): 539/587 kB | 295/327 kB Progress (2): 556/587 kB | 295/327 kB Progress (2): 556/587 kB | 311/327 kB Progress (2): 572/587 kB | 311/327 kB Progress (2): 587 kB | 311/327 kB Progress (2): 587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-03-09T14:30:49.539 INFO:tasks.workunit.client.0.smithi046.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.6 MB/s) 2024-03-09T14:30:49.570 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-09T14:30:49.570 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:49.570 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-09T14:30:49.574 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-03-09T14:30:49.591 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 279 kB/s) 2024-03-09T14:30:49.593 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-03-09T14:30:49.610 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-03-09T14:30:49.611 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-03-09T14:30:49.628 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.9 MB/s) 2024-03-09T14:30:49.630 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-03-09T14:30:49.646 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 873 kB/s) 2024-03-09T14:30:49.649 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-03-09T14:30:49.667 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 45 kB/s) 2024-03-09T14:30:49.669 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-03-09T14:30:49.689 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 223 kB/s) 2024-03-09T14:30:49.691 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-03-09T14:30:49.708 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-03-09T14:30:49.712 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-03-09T14:30:49.730 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-03-09T14:30:49.732 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-03-09T14:30:49.750 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 230 kB/s) 2024-03-09T14:30:49.754 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-03-09T14:30:49.771 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 132 kB/s) 2024-03-09T14:30:49.773 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-03-09T14:30:49.791 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 664 kB/s) 2024-03-09T14:30:49.794 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-03-09T14:30:49.812 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-03-09T14:30:49.815 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-03-09T14:30:49.833 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-03-09T14:30:49.836 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-03-09T14:30:49.854 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-03-09T14:30:49.856 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-03-09T14:30:49.873 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 466 kB/s) 2024-03-09T14:30:49.876 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-03-09T14:30:49.893 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 149 kB/s) 2024-03-09T14:30:49.896 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-03-09T14:30:49.914 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 331 kB/s) 2024-03-09T14:30:49.917 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-03-09T14:30:49.934 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-03-09T14:30:49.937 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-03-09T14:30:49.954 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-03-09T14:30:49.955 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-03-09T14:30:49.971 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-03-09T14:30:49.973 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-03-09T14:30:49.989 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-03-09T14:30:49.993 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-03-09T14:30:50.010 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 71 kB/s) 2024-03-09T14:30:50.011 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-03-09T14:30:50.028 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-03-09T14:30:50.036 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-03-09T14:30:50.054 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 713 kB/s) 2024-03-09T14:30:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-03-09T14:30:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-03-09T14:30:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-03-09T14:30:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-03-09T14:30:50.055 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-03-09T14:30:50.074 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (2): 4.2 kB | 33/55 kB Progress (2): 4.2 kB | 49/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-03-09T14:30:50.074 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 49/55 kB | 16/122 kB Progress (2): 55 kB | 16/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-03-09T14:30:50.074 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 55 kB | 33/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-03-09T14:30:50.075 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-03-09T14:30:50.075 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 49/122 kB Progress (1): 66/122 kB Progress (1): 82/122 kB Progress (2): 82/122 kB | 16/27 kB Progress (2): 82/122 kB | 27 kB Progress (2): 98/122 kB | 27 kB Progress (3): 98/122 kB | 27 kB | 16/334 kB Progress (3): 115/122 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.4 MB/s) 2024-03-09T14:30:50.075 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 122 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-03-09T14:30:50.075 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 122 kB | 33/334 kB Progress (2): 122 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-03-09T14:30:50.078 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 66/334 kB Progress (1): 82/334 kB Progress (1): 98/334 kB Progress (1): 115/334 kB Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 14 MB/s) 2024-03-09T14:30:50.088 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 141 kB/s) 2024-03-09T14:30:50.092 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 63/267 kB Progress (1): 79/267 kB Progress (1): 95/267 kB Progress (1): 112/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (2): 144/267 kB | 16/23 kB Progress (2): 144/267 kB | 23 kB Progress (2): 161/267 kB | 23 kB Progress (2): 177/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 633 kB/s) 2024-03-09T14:30:50.093 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 226/267 kB Progress (1): 243/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.0 MB/s) 2024-03-09T14:30:50.152 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Changes detected - recompiling the module! :source 2024-03-09T14:30:50.153 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-03-09T14:30:50.776 INFO:tasks.workunit.client.0.smithi046.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-09T14:30:50.776 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:50.776 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-09T14:30:50.779 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-09T14:30:50.779 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:50.779 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-09T14:30:50.784 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-03-09T14:30:50.784 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-03-09T14:30:50.938 INFO:tasks.workunit.client.0.smithi046.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-09T14:30:50.939 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:50.939 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-09T14:30:50.942 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-03-09T14:30:50.968 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 240 kB/s) 2024-03-09T14:30:50.972 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-03-09T14:30:50.989 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 208 kB/s) 2024-03-09T14:30:50.992 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-03-09T14:30:51.009 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 192 kB/s) 2024-03-09T14:30:51.012 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-03-09T14:30:51.030 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 226 kB/s) 2024-03-09T14:30:51.033 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-03-09T14:30:51.050 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-03-09T14:30:51.053 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-03-09T14:30:51.070 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-03-09T14:30:51.074 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-03-09T14:30:51.090 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 104 kB/s) 2024-03-09T14:30:51.093 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-03-09T14:30:51.111 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 129 kB/s) 2024-03-09T14:30:51.112 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-03-09T14:30:51.129 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.8 MB/s) 2024-03-09T14:30:51.131 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-03-09T14:30:51.148 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 112 kB/s) 2024-03-09T14:30:51.151 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-03-09T14:30:51.168 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 362 kB/s) 2024-03-09T14:30:51.170 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-03-09T14:30:51.188 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-03-09T14:30:51.189 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-03-09T14:30:51.206 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.3 MB/s) 2024-03-09T14:30:51.210 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-03-09T14:30:51.226 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.1 MB/s) 2024-03-09T14:30:51.228 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-03-09T14:30:51.244 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 952 kB/s) 2024-03-09T14:30:51.247 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-03-09T14:30:51.264 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-03-09T14:30:51.265 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-03-09T14:30:51.282 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-03-09T14:30:51.285 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-03-09T14:30:51.302 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-03-09T14:30:51.305 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-03-09T14:30:51.322 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 128 kB/s) 2024-03-09T14:30:51.325 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-03-09T14:30:51.341 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-03-09T14:30:51.344 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-03-09T14:30:51.361 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 96 kB/s) 2024-03-09T14:30:51.361 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-03-09T14:30:51.378 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 180 kB/s) 2024-03-09T14:30:51.379 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-03-09T14:30:51.396 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.2 MB/s) 2024-03-09T14:30:51.398 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-03-09T14:30:51.414 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 398 kB/s) 2024-03-09T14:30:51.416 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-03-09T14:30:51.433 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 848 kB/s) 2024-03-09T14:30:51.435 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-03-09T14:30:51.452 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-03-09T14:30:51.453 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-03-09T14:30:51.472 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 358 kB/s) 2024-03-09T14:30:51.473 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-03-09T14:30:51.489 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 525 kB/s) 2024-03-09T14:30:51.492 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-03-09T14:30:51.512 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 103 kB/s) 2024-03-09T14:30:51.513 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-03-09T14:30:51.530 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-03-09T14:30:51.533 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-03-09T14:30:51.550 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-03-09T14:30:51.553 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-03-09T14:30:51.570 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-03-09T14:30:51.572 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-03-09T14:30:51.589 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-03-09T14:30:51.591 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-03-09T14:30:51.608 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 790 kB/s) 2024-03-09T14:30:51.610 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-03-09T14:30:51.626 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-03-09T14:30:51.628 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-03-09T14:30:51.645 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 369 kB/s) 2024-03-09T14:30:51.646 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-03-09T14:30:51.666 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.7 MB/s) 2024-03-09T14:30:51.668 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-03-09T14:30:51.685 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.0 MB/s) 2024-03-09T14:30:51.687 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-03-09T14:30:51.703 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-03-09T14:30:51.706 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-03-09T14:30:51.722 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-03-09T14:30:51.724 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-03-09T14:30:51.741 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 300 kB/s) 2024-03-09T14:30:51.742 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-03-09T14:30:51.759 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-03-09T14:30:51.762 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-03-09T14:30:51.779 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-03-09T14:30:51.781 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-03-09T14:30:51.798 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-03-09T14:30:51.800 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-03-09T14:30:51.817 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-03-09T14:30:51.819 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-03-09T14:30:51.836 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-03-09T14:30:51.838 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-03-09T14:30:51.855 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-03-09T14:30:51.856 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-03-09T14:30:51.878 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 612 kB/s) 2024-03-09T14:30:51.880 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-03-09T14:30:51.897 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.1 MB/s) 2024-03-09T14:30:51.899 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-03-09T14:30:51.916 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-03-09T14:30:51.917 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-03-09T14:30:51.934 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-03-09T14:30:51.935 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-03-09T14:30:51.952 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-03-09T14:30:51.953 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-03-09T14:30:51.970 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 284 kB/s) 2024-03-09T14:30:51.973 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-03-09T14:30:51.989 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-03-09T14:30:51.992 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-03-09T14:30:52.009 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-03-09T14:30:52.010 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-03-09T14:30:52.028 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 63/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-03-09T14:30:52.031 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-03-09T14:30:52.048 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-03-09T14:30:52.051 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-03-09T14:30:52.067 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-03-09T14:30:52.069 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-03-09T14:30:52.085 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-03-09T14:30:52.087 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-03-09T14:30:52.103 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-03-09T14:30:52.105 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-03-09T14:30:52.122 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-03-09T14:30:52.125 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-03-09T14:30:52.141 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 139 kB/s) 2024-03-09T14:30:52.146 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-03-09T14:30:52.167 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 62/308 kB Progress (1): 79/308 kB Progress (1): 95/308 kB Progress (1): 111/308 kB Progress (1): 128/308 kB Progress (1): 144/308 kB Progress (1): 161/308 kB Progress (1): 177/308 kB Progress (1): 193/308 kB Progress (1): 210/308 kB Progress (1): 226/308 kB Progress (1): 242/308 kB Progress (1): 259/308 kB Progress (1): 275/308 kB Progress (1): 292/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-03-09T14:30:52.168 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-03-09T14:30:52.168 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-03-09T14:30:52.168 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-03-09T14:30:52.168 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-03-09T14:30:52.168 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-03-09T14:30:52.186 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-03-09T14:30:52.186 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-03-09T14:30:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 32/118 kB Progress (2): 32/118 kB | 8.2 kB Progress (3): 32/118 kB | 8.2 kB | 16/26 kB Progress (3): 49/118 kB | 8.2 kB | 16/26 kB Progress (3): 49/118 kB | 8.2 kB | 26 kB Progress (3): 65/118 kB | 8.2 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 454 kB/s) 2024-03-09T14:30:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-03-09T14:30:52.188 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 81/118 kB | 26 kB Progress (2): 98/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-03-09T14:30:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-03-09T14:30:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 114/118 kB Progress (1): 118 kB Progress (2): 118 kB | 16/171 kB Progress (2): 118 kB | 32/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.9 MB/s) 2024-03-09T14:30:52.189 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-03-09T14:30:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (1): 81/171 kB Progress (1): 98/171 kB Progress (1): 114/171 kB Progress (1): 130/171 kB Progress (1): 147/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.4 MB/s) 2024-03-09T14:30:52.190 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-03-09T14:30:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 63/146 kB Progress (1): 80/146 kB Progress (1): 96/146 kB Progress (2): 96/146 kB | 16/136 kB Progress (2): 112/146 kB | 16/136 kB Progress (2): 129/146 kB | 16/136 kB Progress (2): 129/146 kB | 33/136 kB Progress (2): 129/146 kB | 37/136 kB Progress (2): 145/146 kB | 37/136 kB Progress (2): 146 kB | 37/136 kB Progress (2): 146 kB | 53/136 kB Progress (3): 146 kB | 53/136 kB | 16/501 kB Progress (3): 146 kB | 69/136 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.9 MB/s) 2024-03-09T14:30:52.206 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-03-09T14:30:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 69/136 kB | 33/501 kB Progress (3): 69/136 kB | 33/501 kB | 16/61 kB Progress (3): 86/136 kB | 33/501 kB | 16/61 kB Progress (3): 86/136 kB | 49/501 kB | 16/61 kB Progress (3): 86/136 kB | 49/501 kB | 33/61 kB Progress (3): 86/136 kB | 64/501 kB | 33/61 kB Progress (3): 86/136 kB | 64/501 kB | 49/61 kB Progress (3): 86/136 kB | 64/501 kB | 61 kB Progress (3): 86/136 kB | 80/501 kB | 61 kB Progress (3): 86/136 kB | 97/501 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-03-09T14:30:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-03-09T14:30:52.208 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 86/136 kB | 113/501 kB Progress (2): 86/136 kB | 130/501 kB Progress (2): 102/136 kB | 130/501 kB Progress (2): 102/136 kB | 146/501 kB Progress (2): 118/136 kB | 146/501 kB Progress (2): 118/136 kB | 162/501 kB Progress (2): 135/136 kB | 162/501 kB Progress (2): 136 kB | 162/501 kB Progress (2): 136 kB | 179/501 kB Progress (2): 136 kB | 195/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.5 MB/s) 2024-03-09T14:30:52.211 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 212/501 kB Progress (1): 228/501 kB Progress (1): 236/501 kB Progress (1): 252/501 kB Progress (1): 261/501 kB Progress (1): 277/501 kB Progress (1): 293/501 kB Progress (1): 310/501 kB Progress (1): 326/501 kB Progress (1): 343/501 kB Progress (2): 343/501 kB | 16/58 kB Progress (2): 359/501 kB | 16/58 kB Progress (2): 359/501 kB | 32/58 kB Progress (2): 375/501 kB | 32/58 kB Progress (2): 375/501 kB | 49/58 kB Progress (2): 392/501 kB | 49/58 kB Progress (2): 392/501 kB | 58 kB Progress (2): 408/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.3 MB/s) 2024-03-09T14:30:52.212 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 424/501 kB Progress (1): 441/501 kB Progress (1): 457/501 kB Progress (1): 474/501 kB Progress (1): 490/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-03-09T14:30:52.223 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 56/124 kB Progress (1): 73/124 kB Progress (1): 89/124 kB Progress (1): 105/124 kB Progress (1): 122/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.2 MB/s) 2024-03-09T14:30:52.260 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-03-09T14:30:52.331 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:52.331 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-03-09T14:30:52.333 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-03-09T14:30:52.351 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 264 kB/s) 2024-03-09T14:30:52.352 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-03-09T14:30:52.371 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 258 kB/s) 2024-03-09T14:30:52.372 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-03-09T14:30:52.391 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.4 MB/s) 2024-03-09T14:30:52.393 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-03-09T14:30:52.412 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.1 MB/s) 2024-03-09T14:30:52.414 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-03-09T14:30:52.434 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 259 kB/s) 2024-03-09T14:30:52.436 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-03-09T14:30:52.453 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 231 kB/s) 2024-03-09T14:30:52.456 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-03-09T14:30:52.474 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 334 kB/s) 2024-03-09T14:30:52.476 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-03-09T14:30:52.494 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 348 kB/s) 2024-03-09T14:30:52.496 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-03-09T14:30:52.514 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.0 MB/s) 2024-03-09T14:30:52.518 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-03-09T14:30:52.535 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-03-09T14:30:52.537 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-03-09T14:30:52.554 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-03-09T14:30:52.556 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-03-09T14:30:52.574 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 456 kB/s) 2024-03-09T14:30:52.576 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-03-09T14:30:52.597 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.2 MB/s) 2024-03-09T14:30:52.602 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-03-09T14:30:52.620 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.0 MB/s) 2024-03-09T14:30:52.621 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-03-09T14:30:52.622 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-03-09T14:30:52.622 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-03-09T14:30:52.622 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-03-09T14:30:52.622 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/79 kB Progress (2): 26 kB | 16/79 kB Progress (2): 26 kB | 33/79 kB Progress (2): 26 kB | 49/79 kB Progress (3): 26 kB | 49/79 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 63/79 kB | 16/211 kB Progress (2): 63/79 kB | 33/211 kB Progress (2): 79/79 kB | 33/211 kB Progress (2): 79 kB | 33/211 kB Progress (2): 79 kB | 49/211 kB Progress (2): 79 kB | 66/211 kB Progress (2): 79 kB | 82/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 98/211 kB Progress (2): 98/211 kB | 16/58 kB Progress (2): 115/211 kB | 16/58 kB Progress (2): 115/211 kB | 32/58 kB Progress (2): 131/211 kB | 32/58 kB Progress (2): 131/211 kB | 49/58 kB Progress (2): 147/211 kB | 49/58 kB Progress (2): 147/211 kB | 58 kB Progress (2): 164/211 kB | 58 kB Progress (3): 164/211 kB | 58 kB | 0/1.0 MB Progress (3): 180/211 kB | 58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.9 MB/s) 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 197/211 kB | 0/1.0 MB Progress (2): 197/211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-03-09T14:30:52.659 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/267 kB Progress (2): 1.0/1.0 MB | 33/267 kB Progress (2): 1.0/1.0 MB | 49/267 kB Progress (2): 1.0/1.0 MB | 49/267 kB Progress (2): 1.0 MB | 49/267 kB Progress (2): 1.0 MB | 64/267 kB Progress (3): 1.0 MB | 64/267 kB | 16/116 kB Progress (3): 1.0 MB | 64/267 kB | 33/116 kB Progress (3): 1.0 MB | 81/267 kB | 33/116 kB Progress (3): 1.0 MB | 81/267 kB | 49/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 28 MB/s) 2024-03-09T14:30:52.660 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 97/267 kB | 49/116 kB Progress (2): 97/267 kB | 66/116 kB Progress (2): 97/267 kB | 82/116 kB Progress (2): 114/267 kB | 82/116 kB Progress (2): 114/267 kB | 98/116 kB Progress (2): 130/267 kB | 98/116 kB Progress (2): 130/267 kB | 115/116 kB Progress (2): 130/267 kB | 116 kB Progress (2): 146/267 kB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.1 MB/s) 2024-03-09T14:30:52.662 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 163/267 kB Progress (1): 179/267 kB Progress (1): 195/267 kB Progress (1): 212/267 kB Progress (1): 228/267 kB Progress (1): 245/267 kB Progress (1): 261/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.5 MB/s) 2024-03-09T14:30:52.786 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-03-09T14:30:52.811 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:30:52.811 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] BUILD SUCCESS 2024-03-09T14:30:52.811 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:30:52.812 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Total time: 6.508 s 2024-03-09T14:30:52.812 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Finished at: 2024-03-09T14:30:52Z 2024-03-09T14:30:52.812 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:30:52.836 INFO:tasks.workunit.client.0.smithi046.stderr:+ ./mvnw test -Dtest=PutObjects 2024-03-09T14:30:52.844 INFO:tasks.workunit.client.0.smithi046.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-09T14:30:53.970 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Scanning for projects... 2024-03-09T14:30:54.048 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:54.048 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-09T14:30:54.048 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Building jcksum 1.0 2024-03-09T14:30:54.048 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] from pom.xml 2024-03-09T14:30:54.048 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-09T14:30:54.301 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:54.301 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-09T14:30:54.395 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-09T14:30:54.396 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:54.396 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-09T14:30:54.495 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-09T14:30:54.495 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:54.495 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-09T14:30:54.495 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-09T14:30:54.495 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:54.495 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-09T14:30:54.499 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-09T14:30:54.499 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:54.499 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-09T14:30:54.725 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-03-09T14:30:54.938 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-03-09T14:30:55.140 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-03-09T14:30:55.149 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-03-09T14:30:55.170 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-03-09T14:30:55.175 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-03-09T14:30:55.195 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 141 kB/s) 2024-03-09T14:30:55.200 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-03-09T14:30:55.220 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 151 kB/s) 2024-03-09T14:30:55.223 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-03-09T14:30:55.243 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 160 kB/s) 2024-03-09T14:30:55.247 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-03-09T14:30:55.266 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 89 kB/s) 2024-03-09T14:30:55.269 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-03-09T14:30:55.289 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 142 kB/s) 2024-03-09T14:30:55.297 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-03-09T14:30:55.327 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 876 kB/s) 2024-03-09T14:30:55.329 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-03-09T14:30:55.329 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-03-09T14:30:55.330 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-03-09T14:30:55.330 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-03-09T14:30:55.332 INFO:tasks.workunit.client.0.smithi046.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-03-09T14:30:55.354 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 650 kB/s) 2024-03-09T14:30:55.390 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Progress (2): 7.7 kB | 1.4/189 kB Progress (2): 7.7 kB | 2.8/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 125 kB/s) 2024-03-09T14:30:55.435 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 4.1/189 kB Progress (1): 5.5/189 kB Progress (2): 5.5/189 kB | 16/169 kB Progress (2): 6.9/189 kB | 16/169 kB Progress (2): 8.3/189 kB | 16/169 kB Progress (2): 9.7/189 kB | 16/169 kB Progress (2): 11/189 kB | 16/169 kB Progress (2): 12/189 kB | 16/169 kB Progress (2): 14/189 kB | 16/169 kB Progress (2): 15/189 kB | 16/169 kB Progress (2): 16/189 kB | 16/169 kB Progress (3): 16/189 kB | 16/169 kB | 1.4/103 kB Progress (3): 16/189 kB | 16/169 kB | 2.8/103 kB Progress (3): 16/189 kB | 16/169 kB | 4.1/103 kB Progress (3): 16/189 kB | 16/169 kB | 5.5/103 kB Progress (3): 16/189 kB | 16/169 kB | 6.9/103 kB Progress (3): 16/189 kB | 16/169 kB | 8.3/103 kB Progress (3): 16/189 kB | 16/169 kB | 9.7/103 kB Progress (3): 16/189 kB | 16/169 kB | 11/103 kB Progress (3): 16/189 kB | 16/169 kB | 12/103 kB Progress (3): 16/189 kB | 16/169 kB | 14/103 kB Progress (3): 16/189 kB | 16/169 kB | 15/103 kB Progress (3): 16/189 kB | 16/169 kB | 16/103 kB Progress (3): 16/189 kB | 33/169 kB | 16/103 kB Progress (3): 32/189 kB | 33/169 kB | 16/103 kB Progress (3): 32/189 kB | 49/169 kB | 16/103 kB Progress (3): 49/189 kB | 49/169 kB | 16/103 kB Progress (3): 49/189 kB | 49/169 kB | 32/103 kB Progress (3): 49/189 kB | 49/169 kB | 49/103 kB Progress (3): 49/189 kB | 66/169 kB | 49/103 kB Progress (3): 65/189 kB | 66/169 kB | 49/103 kB Progress (3): 65/189 kB | 82/169 kB | 49/103 kB Progress (3): 81/189 kB | 82/169 kB | 49/103 kB Progress (3): 81/189 kB | 98/169 kB | 49/103 kB Progress (3): 98/189 kB | 98/169 kB | 49/103 kB Progress (3): 98/189 kB | 115/169 kB | 49/103 kB Progress (3): 114/189 kB | 115/169 kB | 49/103 kB Progress (3): 114/189 kB | 131/169 kB | 49/103 kB Progress (3): 114/189 kB | 131/169 kB | 65/103 kB Progress (3): 130/189 kB | 131/169 kB | 65/103 kB Progress (3): 130/189 kB | 147/169 kB | 65/103 kB Progress (3): 130/189 kB | 147/169 kB | 81/103 kB Progress (3): 130/189 kB | 147/169 kB | 98/103 kB Progress (3): 130/189 kB | 147/169 kB | 103 kB Progress (3): 147/189 kB | 147/169 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 990 kB/s) 2024-03-09T14:30:55.436 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (2): 147/189 kB | 164/169 kB Progress (2): 147/189 kB | 169 kB Progress (2): 163/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.6 MB/s) 2024-03-09T14:30:55.438 INFO:tasks.workunit.client.0.smithi046.stdout:Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.7 MB/s) 2024-03-09T14:30:55.452 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:30:55.452 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------- 2024-03-09T14:30:55.452 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] T E S T S 2024-03-09T14:30:55.452 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------- 2024-03-09T14:30:55.901 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-03-09T14:30:55.933 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjects.java: starting test run: 2024-03-09T14:30:56.031 INFO:tasks.workunit.client.0.smithi046.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:30:56.031 INFO:tasks.workunit.client.0.smithi046.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:30:56.031 INFO:tasks.workunit.client.0.smithi046.stdout: EndpointUrl=https://smithi046.front.sepia.ceph.com:443 2024-03-09T14:30:56.032 INFO:tasks.workunit.client.0.smithi046.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-03-09T14:30:56.131 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Environment Variables Read 2024-03-09T14:30:56.432 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: S3 Client Initialized 2024-03-09T14:30:56.433 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generating File 2024-03-09T14:30:56.433 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: File Generated 2024-03-09T14:30:56.433 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generating File 2024-03-09T14:30:56.433 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: File Generated 2024-03-09T14:30:56.433 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generating File 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: File Generated 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generating File 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: File Generated 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generating File 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: File Generated 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generating File 2024-03-09T14:30:56.533 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: File Generated 2024-03-09T14:30:56.534 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Generated Big Files 2024-03-09T14:30:56.892 INFO:tasks.workunit.client.0.smithi046.stdout:HeadBucketResponse() 2024-03-09T14:30:56.892 INFO:tasks.workunit.client.0.smithi046.stdout:sheik is ready 2024-03-09T14:30:56.892 INFO:tasks.workunit.client.0.smithi046.stdout:DEBUG: Test Bucket Created 2024-03-09T14:30:56.932 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-0b 2024-03-09T14:30:57.133 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-8b 2024-03-09T14:30:57.233 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-200b 2024-03-09T14:30:57.423 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-21983b 2024-03-09T14:30:57.433 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-5519b 2024-03-09T14:30:57.633 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-204329b 2024-03-09T14:30:57.834 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-256k 2024-03-09T14:30:58.034 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-1m 2024-03-09T14:30:58.635 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-03-09T14:30:59.136 INFO:tasks.workunit.client.0.smithi046.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-03-09T14:31:03.743 INFO:tasks.workunit.client.0.smithi046.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-03-09T14:31:07.849 INFO:tasks.workunit.client.0.smithi046.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-03-09T14:32:03.682 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-0b 2024-03-09T14:32:03.682 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-8b 2024-03-09T14:32:03.683 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-200b 2024-03-09T14:32:03.683 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-21983b 2024-03-09T14:32:03.684 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-5519b 2024-03-09T14:32:03.686 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-204329b 2024-03-09T14:32:03.687 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-256k 2024-03-09T14:32:03.689 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-1m 2024-03-09T14:32:03.690 INFO:tasks.workunit.client.0.smithi046.stdout:arg: file-1038757b 2024-03-09T14:32:03.707 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-0b 2024-03-09T14:32:03.807 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:03.908 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-8b 2024-03-09T14:32:03.908 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:04.008 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-200b 2024-03-09T14:32:04.082 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:04.108 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-21983b 2024-03-09T14:32:04.208 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:04.308 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-5519b 2024-03-09T14:32:04.308 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:04.408 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-204329b 2024-03-09T14:32:04.508 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:04.608 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-256k 2024-03-09T14:32:04.802 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:04.808 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-1m 2024-03-09T14:32:05.209 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:05.409 INFO:tasks.workunit.client.0.smithi046.stdout:putObjectFromFileCksum called with file-1038757b 2024-03-09T14:32:05.709 INFO:tasks.workunit.client.0.smithi046.stdout:PutObjectResponse 2024-03-09T14:32:05.910 INFO:tasks.workunit.client.0.smithi046.stdout:mpuObjectFromFileCksum called with file-5m 2024-03-09T14:32:08.312 INFO:tasks.workunit.client.0.smithi046.stdout:mpuObjectFromFileCksum called with file-10m 2024-03-09T14:32:13.416 INFO:tasks.workunit.client.0.smithi046.stdout:mpuObjectFromFileCksum called with file-100m 2024-03-09T14:33:16.333 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 140.4 s -- in io.ceph.jcksum.PutObjects 2024-03-09T14:33:16.346 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:33:16.346 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Results: 2024-03-09T14:33:16.346 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:33:16.346 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-03-09T14:33:16.346 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] 2024-03-09T14:33:16.348 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:33:16.348 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] BUILD SUCCESS 2024-03-09T14:33:16.348 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:33:16.349 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Total time: 02:22 min 2024-03-09T14:33:16.349 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] Finished at: 2024-03-09T14:33:16Z 2024-03-09T14:33:16.349 INFO:tasks.workunit.client.0.smithi046.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:33:16.372 INFO:tasks.workunit.client.0.smithi046.stderr:+ exit 2024-03-09T14:33:16.372 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:33:16.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:33:16.451 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-03-09T14:33:16.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:33:16.804 DEBUG:teuthology.parallel:result is None 2024-03-09T14:33:16.804 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:33:16.843 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:33:16.843 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:33:16.909 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:33:16.909 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:33:16.919 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:33:16.919 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:33:16.919 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:33:16.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:33:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:33:16.977 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:33:17.044 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:33:17.044 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:33:17.111 INFO:tasks.workunit:timeout=3h 2024-03-09T14:33:17.111 INFO:tasks.workunit:cleanup=True 2024-03-09T14:33:17.112 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:33:17.178 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:34:33.021 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 94% (11606/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.191 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-03-09T14:34:33.192 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.193 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:34:33.193 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:34:33.193 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:34:33.195 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:34:33.262 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:34:33.264 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:34:33.264 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:34:33.312 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:34:33.361 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:34:33.400 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:34:33.401 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:34:33.401 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:34:33.439 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:34:33.442 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:34:33.443 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:34:33.510 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-03-09T14:34:33.511 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-03-09T14:34:33.512 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-03-09T14:34:33.583 INFO:tasks.workunit.client.0.smithi046.stdout:INFO: fully qualified domain name: smithi046.front.sepia.ceph.com 2024-03-09T14:34:33.583 INFO:tasks.workunit.client.0.smithi046.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-03-09T14:34:33.583 INFO:tasks.workunit.client.0.smithi046.stdout:== TESTING VERSIONED BUCKET == 2024-03-09T14:34:36.247 INFO:tasks.workunit.client.0.smithi046.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-09T14:34:36.470 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting pip 2024-03-09T14:34:36.475 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:34:36.524 INFO:tasks.workunit.client.0.smithi046.stdout:Installing collected packages: pip 2024-03-09T14:34:36.524 INFO:tasks.workunit.client.0.smithi046.stdout: Attempting uninstall: pip 2024-03-09T14:34:36.524 INFO:tasks.workunit.client.0.smithi046.stdout: Found existing installation: pip 21.2.3 2024-03-09T14:34:36.680 INFO:tasks.workunit.client.0.smithi046.stdout: Uninstalling pip-21.2.3: 2024-03-09T14:34:36.686 INFO:tasks.workunit.client.0.smithi046.stdout: Successfully uninstalled pip-21.2.3 2024-03-09T14:34:37.703 INFO:tasks.workunit.client.0.smithi046.stdout:Successfully installed pip-24.0 2024-03-09T14:34:38.599 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting boto3 2024-03-09T14:34:38.601 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:34:39.148 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:34:39.150 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:34:39.203 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:34:39.204 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:34:39.258 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:34:39.259 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:34:39.317 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:34:39.318 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:34:39.393 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:34:39.394 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-09T14:34:39.556 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:34:39.557 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:34:39.580 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:34:39.581 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:34:39.604 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:34:39.605 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:34:39.607 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:34:39.608 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-09T14:34:39.610 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:34:39.716 INFO:tasks.workunit.client.0.smithi046.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:34:40.788 INFO:tasks.workunit.client.0.smithi046.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-09T14:34:41.242 INFO:tasks.workunit.client.0.smithi046.stdout:INFO: creating user 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout:{ 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "user_id": "testid", 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "display_name": "M. Tester", 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "email": "tester@ceph.com", 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "suspended": 0, 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "subusers": [], 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "keys": [ 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: { 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "user": "testid", 2024-03-09T14:34:41.351 INFO:tasks.workunit.client.0.smithi046.stdout: "access_key": "0555b35654ad1656d804", 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "active": true, 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "create_date": "2024-03-09T14:34:41.342969Z" 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: } 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: ], 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "swift_keys": [], 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "caps": [], 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "default_placement": "", 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "placement_tags": [], 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "bucket_quota": { 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "enabled": false, 2024-03-09T14:34:41.352 INFO:tasks.workunit.client.0.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size": -1, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "max_objects": -1 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "user_quota": { 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "enabled": false, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size": -1, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "max_objects": -1 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: }, 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "type": "rgw", 2024-03-09T14:34:41.353 INFO:tasks.workunit.client.0.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout: "account_id": "", 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout: "path": "/", 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout: "create_date": "2024-03-09T14:34:41.342955Z", 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout: "tags": [], 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout: "group_ids": [] 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout:} 2024-03-09T14:34:41.354 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-03-09T14:34:49.668 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:49.668 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:49.718 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:49.718 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:49.764 INFO:tasks.workunit.client.0.smithi046.stderr:5+0 records in 2024-03-09T14:34:49.764 INFO:tasks.workunit.client.0.smithi046.stderr:5+0 records out 2024-03-09T14:34:49.764 INFO:tasks.workunit.client.0.smithi046.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.014135 s, 371 MB/s 2024-03-09T14:34:49.767 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:49.767 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:49.847 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:49.847 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:50.960 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:50.960 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:52.057 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:52.058 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:53.166 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:53.166 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:54.258 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:54.258 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:55.352 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:55.353 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:56.467 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:56.467 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:57.563 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:57.563 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:58.664 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:58.664 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:34:59.769 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:34:59.769 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:35:00.872 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:35:00.873 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:35:01.971 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:35:01.971 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:35:03.065 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:35:03.065 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:35:04.165 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:35:04.165 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:35:04.241 INFO:tasks.workunit.client.0.smithi046.stdout:bucket nams is reupload-bkt-115727 2024-03-09T14:35:04.241 INFO:tasks.workunit.client.0.smithi046.stdout:endpoint is https://smithi046.front.sepia.ceph.com:443 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:start UploadId=2~VsjXbj-Kn6TjSGH40M4NwIvxPxgyHP8 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 1 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 1 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 2} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:phase 2 uploaded part {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1} 2024-03-09T14:35:04.243 INFO:tasks.workunit.client.0.smithi046.stdout:aborting multipart upload, parts=[{'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 1}, {'ETag': '"70a3ea2e214762c6eaac9ccf25938080"', 'PartNumber': 2}] 2024-03-09T14:35:05.204 INFO:tasks.workunit.client.0.smithi046.stdout:radosgw-admin bucket radoslist: 2024-03-09T14:35:05.262 INFO:tasks.workunit.client.0.smithi046.stdout:rados ls: 2024-03-09T14:35:05.277 INFO:tasks.workunit.client.0.smithi046.stdout:== PASSED == 2024-03-09T14:35:05.278 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:35:05.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:35:05.358 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-03-09T14:35:05.358 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:35:05.718 DEBUG:teuthology.parallel:result is None 2024-03-09T14:35:05.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:35:05.757 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:35:05.757 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:35:05.824 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:35:05.824 INFO:teuthology.run_tasks:Running task ragweed... 2024-03-09T14:35:05.839 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-03-09T14:35:05.839 INFO:tasks.ragweed:Downloading ragweed... 2024-03-09T14:35:05.839 INFO:tasks.ragweed:Using branch 'wip-rgw-account-v3' for ragweed 2024-03-09T14:35:05.840 DEBUG:teuthology.orchestra.run.smithi046:> git clone -b wip-rgw-account-v3 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:35:05.892 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-09T14:35:05.935 INFO:teuthology.orchestra.run.smithi046.stderr:fatal: Remote branch wip-rgw-account-v3 not found in upstream origin 2024-03-09T14:35:05.936 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-09T14:35:05.937 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-03-09T14:35:05.937 DEBUG:teuthology.orchestra.run.smithi046:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:35:06.004 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-09T14:35:06.233 INFO:tasks.ragweed:Creating rgw users... 2024-03-09T14:35:06.234 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-03-09T14:35:06.234 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key KRRUUGZVBWOGYWDMWJDU --secret Q22H5+KWKHVRy/jb9IDSQASA7fqW5S5HwKrJ5sToiaA+H1yaiiqyaA== --email ragweed.client.0+test@test.test --system false 2024-03-09T14:35:06.336 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:06.336 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:06.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.366+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.367+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.367+0000 7f0b41a24800 20 realm 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.367+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.367+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.367+0000 7f0b41a24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.367+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.368+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.368+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.369+0000 7f0b41a24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:06.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.369+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.370+0000 7f0b41a24800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:35:06.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.370+0000 7f0b41a24800 20 searching for the correct realm 2024-03-09T14:35:06.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.373+0000 7f0b3f527640 0 -- 172.21.15.46:0/3832482684 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f0b3802a040 msgr2=0x7f0b3802a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:06.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.377+0000 7f0b3f527640 0 -- 172.21.15.46:0/3832482684 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f0b280b2b00 msgr2=0x7f0b280ae630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:06.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:35:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:35:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:35:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:35:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:35:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:35:06.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.583+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 zone default found 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 4 Realm: () 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:35:06.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 zonegroup default 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.584+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.585+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.585+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.585+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.585+0000 7f0b41a24800 20 started sync module instance, tier type = 2024-03-09T14:35:06.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.585+0000 7f0b41a24800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:35:06.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=0 2024-03-09T14:35:06.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=1 2024-03-09T14:35:06.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=2 2024-03-09T14:35:06.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=3 2024-03-09T14:35:06.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=4 2024-03-09T14:35:06.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=5 2024-03-09T14:35:06.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.594+0000 7f0b41a24800 20 add_watcher() i=6 2024-03-09T14:35:06.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.595+0000 7f0b41a24800 20 add_watcher() i=7 2024-03-09T14:35:06.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.595+0000 7f0b41a24800 2 all 8 watchers are set, enabling cache 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.597+0000 7f09f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.597+0000 7f0b41a24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.597+0000 7f0b41a24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.597+0000 7f0b41a24800 5 note: GC not initialized 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.597+0000 7f09f4fe1640 20 reqs_thread_entry: start 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.597+0000 7f0b41a24800 20 init_complete bucket index max shards: 1 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 20 Filter name: none 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f096e7fc640 20 reqs_thread_entry: start 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-09T14:35:06.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-03-09T14:35:06.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:35:06.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-03-09T14:35:06.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.598+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 cache get: name=default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU : miss 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 cache put: name=default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU info.flags=0x0 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 adding default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU to cache LRU end 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 cache get: name=default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU : hit (negative entry) 2024-03-09T14:35:06.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.599+0000 7f0b41a24800 10 cache get: name=default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU : hit (negative entry) 2024-03-09T14:35:06.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.601+0000 7f0b41a24800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-09T14:35:06.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.601+0000 7f0b41a24800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:35:06.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.601+0000 7f0b41a24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-09T14:35:06.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.601+0000 7f0a22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856724 cookie 94344485692656 notifier 5838 bl.length()=675 2024-03-09T14:35:06.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.601+0000 7f0a22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-09T14:35:06.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.601+0000 7f0a22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:35:06.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.604+0000 7f0b41a24800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-09T14:35:06.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.604+0000 7f0b41a24800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:35:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.604+0000 7f0b41a24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-09T14:35:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.605+0000 7f0a22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856717 cookie 94344485685408 notifier 5838 bl.length()=202 2024-03-09T14:35:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.605+0000 7f0a22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-09T14:35:06.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.605+0000 7f0a22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:35:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.608+0000 7f0b41a24800 10 cache put: name=default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU info.flags=0x7 2024-03-09T14:35:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.608+0000 7f0b41a24800 10 moving default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU to cache LRU end 2024-03-09T14:35:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.608+0000 7f0b41a24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:KRRUUGZVBWOGYWDMWJDU, ofs0, ns] 2024-03-09T14:35:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.608+0000 7f0a22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856725 cookie 94344485692656 notifier 5838 bl.length()=190 2024-03-09T14:35:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.608+0000 7f0a22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU info.flags=0x7 2024-03-09T14:35:06.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.608+0000 7f0a22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KRRUUGZVBWOGYWDMWJDU to cache LRU end 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "ragweed.client.0", 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr. ragweed.client.0", 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "ragweed.client.0+test@test.test", 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "ragweed.client.0", 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "KRRUUGZVBWOGYWDMWJDU", 2024-03-09T14:35:06.610 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "Q22H5+KWKHVRy/jb9IDSQASA7fqW5S5HwKrJ5sToiaA+H1yaiiqyaA==", 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:35:06.600276Z" 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:35:06.611 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:35:06.612 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:35:06.600258Z", 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:35:06.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.610+0000 7f09f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:06.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.613+0000 7f0b41a24800 20 remove_watcher() i=0 2024-03-09T14:35:06.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.613+0000 7f0b41a24800 2 removed watcher, disabling cache 2024-03-09T14:35:06.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.615+0000 7f0b41a24800 20 remove_watcher() i=1 2024-03-09T14:35:06.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.616+0000 7f0b41a24800 20 remove_watcher() i=2 2024-03-09T14:35:06.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.617+0000 7f0b41a24800 20 remove_watcher() i=3 2024-03-09T14:35:06.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.618+0000 7f0b41a24800 20 remove_watcher() i=4 2024-03-09T14:35:06.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.619+0000 7f0b41a24800 20 remove_watcher() i=5 2024-03-09T14:35:06.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.620+0000 7f0b41a24800 20 remove_watcher() i=6 2024-03-09T14:35:06.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.621+0000 7f0b41a24800 20 remove_watcher() i=7 2024-03-09T14:35:06.631 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-03-09T14:35:06.632 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key NAQSCEQCNNESRQXJHXHB --secret GGt1AlVLdhZEnhe/6n03AUaxY7JmsbqqaZORJN+fjXEYAYM1tvCFBg== --email sysuser.client.0+test@test.test --system true 2024-03-09T14:35:06.694 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:35:06.695 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:35:06.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.725+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 realm 2024-03-09T14:35:06.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:35:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.726+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.727+0000 7f5b9bb3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:06.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.727+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.728+0000 7f5b9bb3c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:35:06.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.728+0000 7f5b9bb3c800 20 searching for the correct realm 2024-03-09T14:35:06.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.732+0000 7f5b97100640 0 -- 172.21.15.46:0/1185749673 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55f76af737e0 msgr2=0x55f76af75bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.736+0000 7f5b98102640 0 -- 172.21.15.46:0/1185749673 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f5b8c02c070 msgr2=0x7f5b8c02c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.739+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:35:06.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 zone default found 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 4 Realm: () 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 zonegroup default 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.740+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 started sync module instance, tier type = 2024-03-09T14:35:06.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.741+0000 7f5b9bb3c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:35:06.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=0 2024-03-09T14:35:06.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=1 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=2 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=3 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=4 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=5 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.750+0000 7f5b9bb3c800 20 add_watcher() i=6 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.751+0000 7f5b9bb3c800 20 add_watcher() i=7 2024-03-09T14:35:06.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.751+0000 7f5b9bb3c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:35:06.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5a4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 5 note: GC not initialized 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5a4cfe1640 20 reqs_thread_entry: start 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 20 init_complete bucket index max shards: 1 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 20 Filter name: none 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f59c67fc640 20 reqs_thread_entry: start 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-09T14:35:06.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.753+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-03-09T14:35:06.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:35:06.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-03-09T14:35:06.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache get: name=default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB : miss 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 20 rados->read ofs=0 len=0 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache put: name=default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB info.flags=0x0 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 adding default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB to cache LRU end 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache get: name=default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB : hit (negative entry) 2024-03-09T14:35:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.754+0000 7f5b9bb3c800 10 cache get: name=default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB : hit (negative entry) 2024-03-09T14:35:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.756+0000 7f5b9bb3c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-09T14:35:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.756+0000 7f5b9bb3c800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:35:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.756+0000 7f5b9bb3c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-09T14:35:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.756+0000 7f5a76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856718 cookie 94521139905024 notifier 5859 bl.length()=675 2024-03-09T14:35:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.756+0000 7f5a76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-09T14:35:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.756+0000 7f5a76ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:35:06.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.760+0000 7f5b9bb3c800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-09T14:35:06.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.760+0000 7f5b9bb3c800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:35:06.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.760+0000 7f5b9bb3c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-09T14:35:06.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.760+0000 7f5a76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856726 cookie 94521139912832 notifier 5859 bl.length()=202 2024-03-09T14:35:06.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.760+0000 7f5a76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-09T14:35:06.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.760+0000 7f5a76ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:35:06.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.763+0000 7f5b9bb3c800 10 cache put: name=default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB info.flags=0x7 2024-03-09T14:35:06.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.763+0000 7f5b9bb3c800 10 moving default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB to cache LRU end 2024-03-09T14:35:06.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.763+0000 7f5b9bb3c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NAQSCEQCNNESRQXJHXHB, ofs0, ns] 2024-03-09T14:35:06.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.763+0000 7f5a76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856715 cookie 94521139917024 notifier 5859 bl.length()=190 2024-03-09T14:35:06.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.763+0000 7f5a76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB info.flags=0x7 2024-03-09T14:35:06.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.763+0000 7f5a76ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NAQSCEQCNNESRQXJHXHB to cache LRU end 2024-03-09T14:35:06.764 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "sysuser.client.0", 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr. sysuser.client.0", 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "sysuser.client.0+test@test.test", 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "sysuser.client.0", 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "NAQSCEQCNNESRQXJHXHB", 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "GGt1AlVLdhZEnhe/6n03AUaxY7JmsbqqaZORJN+fjXEYAYM1tvCFBg==", 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:35:06.755814Z" 2024-03-09T14:35:06.765 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "system": true, 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:35:06.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:35:06.755804Z", 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:35:06.767 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:35:06.768 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:35:06.768 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:35:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.765+0000 7f5a4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:35:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.767+0000 7f5b9bb3c800 20 remove_watcher() i=0 2024-03-09T14:35:06.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.767+0000 7f5b9bb3c800 2 removed watcher, disabling cache 2024-03-09T14:35:06.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.769+0000 7f5b9bb3c800 20 remove_watcher() i=1 2024-03-09T14:35:06.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.770+0000 7f5b9bb3c800 20 remove_watcher() i=2 2024-03-09T14:35:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.771+0000 7f5b9bb3c800 20 remove_watcher() i=3 2024-03-09T14:35:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.772+0000 7f5b9bb3c800 20 remove_watcher() i=4 2024-03-09T14:35:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.773+0000 7f5b9bb3c800 20 remove_watcher() i=5 2024-03-09T14:35:06.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.774+0000 7f5b9bb3c800 20 remove_watcher() i=6 2024-03-09T14:35:06.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:35:06.775+0000 7f5b9bb3c800 20 remove_watcher() i=7 2024-03-09T14:35:06.785 INFO:tasks.ragweed:Configuring ragweed... 2024-03-09T14:35:06.786 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:35:06.786 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-03-09T14:35:06.812 INFO:tasks.ragweed:Configuring boto... 2024-03-09T14:35:06.812 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:35:06.813 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-03-09T14:35:06.879 DEBUG:teuthology.orchestra.run.smithi046:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-03-09T14:35:07.070 INFO:teuthology.orchestra.run.smithi046.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-03-09T14:35:07.242 INFO:teuthology.orchestra.run.smithi046.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-03-09T14:35:07.740 INFO:teuthology.orchestra.run.smithi046.stdout:py installdeps: -rrequirements.txt 2024-03-09T14:35:15.263 INFO:teuthology.orchestra.run.smithi046.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-03-09T14:35:17.395 INFO:teuthology.orchestra.run.smithi046.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==24.2.1,google-auth==2.28.0,gpg==1.15.1,greenlet==3.0.3,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.4.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.1.1,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=c151d341ec2a0d6c2d2d8c0fdb2c0994d27ffd9109e6b1b7a5b37ac28234303c,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.2 2024-03-09T14:35:17.395 INFO:teuthology.orchestra.run.smithi046.stdout:py run-test-pre: PYTHONHASHSEED='3074108602' 2024-03-09T14:35:17.395 INFO:teuthology.orchestra.run.smithi046.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-03-09T14:35:17.627 INFO:teuthology.orchestra.run.smithi046.stdout:============================= test session starts ============================== 2024-03-09T14:35:17.627 INFO:teuthology.orchestra.run.smithi046.stdout:platform linux -- Python 3.9.17, pytest-8.1.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-03-09T14:35:17.627 INFO:teuthology.orchestra.run.smithi046.stdout:cachedir: .tox/py/.pytest_cache 2024-03-09T14:35:17.627 INFO:teuthology.orchestra.run.smithi046.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:35:17.627 INFO:teuthology.orchestra.run.smithi046.stdout:configfile: pytest.ini 2024-03-09T14:35:17.729 INFO:teuthology.orchestra.run.smithi046.stdout:collecting ... collected 9 items 2024-03-09T14:35:17.729 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:35:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-03-09T14:35:30.768 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-03-09T14:35:35.361 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-03-09T14:35:41.991 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-03-09T14:35:48.829 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-03-09T14:36:05.726 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-03-09T14:36:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-03-09T14:36:32.858 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-03-09T14:37:01.306 INFO:teuthology.orchestra.run.smithi046.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout:=============================== warnings summary =============================== 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout: import imp 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-09T14:37:01.307 INFO:teuthology.orchestra.run.smithi046.stdout:=================== 9 passed, 1 warning in 103.68s (0:01:43) =================== 2024-03-09T14:37:01.340 INFO:teuthology.orchestra.run.smithi046.stdout:___________________________________ summary ____________________________________ 2024-03-09T14:37:01.340 INFO:teuthology.orchestra.run.smithi046.stdout: py: commands succeeded 2024-03-09T14:37:01.340 INFO:teuthology.orchestra.run.smithi046.stdout: congratulations :) 2024-03-09T14:37:01.353 INFO:tasks.ragweed:Cleaning up boto... 2024-03-09T14:37:01.354 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-03-09T14:37:01.381 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-03-09T14:37:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:37:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:37:01.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.504+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.505+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.505+0000 7f496be9d800 20 realm 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.505+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.506+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.506+0000 7f496be9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.506+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.506+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.506+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.507+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:37:01.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.507+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.508+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:37:01.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.508+0000 7f496be9d800 20 searching for the correct realm 2024-03-09T14:37:01.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.511+0000 7f4969198640 0 -- 172.21.15.46:0/2487930047 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x562f0b5840a0 msgr2=0x562f0b5864b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:37:01.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.515+0000 7f4969999640 0 -- 172.21.15.46:0/2487930047 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f4960057440 msgr2=0x7f49600578c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:37:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.721+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 zone default found 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 4 Realm: () 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:37:01.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 zonegroup default 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.722+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 started sync module instance, tier type = 2024-03-09T14:37:01.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.723+0000 7f496be9d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:37:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=0 2024-03-09T14:37:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=1 2024-03-09T14:37:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=2 2024-03-09T14:37:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=3 2024-03-09T14:37:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=4 2024-03-09T14:37:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=5 2024-03-09T14:37:01.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.733+0000 7f496be9d800 20 add_watcher() i=6 2024-03-09T14:37:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.734+0000 7f496be9d800 20 add_watcher() i=7 2024-03-09T14:37:01.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.734+0000 7f496be9d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:37:01.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.736+0000 7f481b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:37:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.736+0000 7f496be9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:37:01.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.736+0000 7f496be9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:37:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.775+0000 7f481a7fc640 20 reqs_thread_entry: start 2024-03-09T14:37:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.775+0000 7f496be9d800 20 init_complete bucket index max shards: 1 2024-03-09T14:37:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.775+0000 7f496be9d800 20 Filter name: none 2024-03-09T14:37:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.775+0000 7f478bfff640 20 reqs_thread_entry: start 2024-03-09T14:37:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.775+0000 7f496be9d800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-09T14:37:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.776+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.776+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:37:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.776+0000 7f496be9d800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-03-09T14:37:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.776+0000 7f496be9d800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:37:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.776+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.777+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 : miss 2024-03-09T14:37:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.777+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=418 2024-03-09T14:37:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 info.flags=0x17 2024-03-09T14:37:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 to cache LRU end 2024-03-09T14:37:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 2024-03-09T14:37:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-03-09T14:37:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-03-09T14:37:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-03-09T14:37:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-03-09T14:37:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.778+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.779+0000 7f496be9d800 10 manifest: total_size = 4961 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.779+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9437379914601463948 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.779+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.779+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.779+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.782+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.782+0000 7f496be9d800 10 manifest: total_size = 7644 2024-03-09T14:37:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.782+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5605237460463444473 2024-03-09T14:37:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.782+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.782+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.782+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.783+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-03-09T14:37:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.785+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.785+0000 7f496be9d800 10 manifest: total_size = 7485 2024-03-09T14:37:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.785+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10736571352128765977 2024-03-09T14:37:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.785+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.785+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.785+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.786+0000 7f484cff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-03-09T14:37:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.788+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.788+0000 7f496be9d800 10 manifest: total_size = 12784 2024-03-09T14:37:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.788+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2041630967880135891 2024-03-09T14:37:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.788+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.788+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.788+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.789+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-03-09T14:37:01.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.791+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.791+0000 7f496be9d800 10 manifest: total_size = 7641 2024-03-09T14:37:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.791+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5415324980186123027 2024-03-09T14:37:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.791+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.791+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.791+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.792+0000 7f484cff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-03-09T14:37:01.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.794+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409d9b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.794+0000 7f496be9d800 10 manifest: total_size = 15880 2024-03-09T14:37:01.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.794+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7211070534938415576 2024-03-09T14:37:01.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.794+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409d9b0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.794+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.794+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.796+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-03-09T14:37:01.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.797+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c076cb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.798+0000 7f496be9d800 10 manifest: total_size = 7883 2024-03-09T14:37:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.798+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12537581624501932708 2024-03-09T14:37:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.798+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c076cb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.798+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.798+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.799+0000 7f484cff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-03-09T14:37:01.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.800+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c076ee0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.801+0000 7f496be9d800 10 manifest: total_size = 5252 2024-03-09T14:37:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.801+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16961751998645313209 2024-03-09T14:37:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.801+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c076ee0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.801+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.801+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.802+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-03-09T14:37:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.804+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c076cb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.804+0000 7f496be9d800 10 manifest: total_size = 38404 2024-03-09T14:37:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.804+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18433025501510144637 2024-03-09T14:37:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.804+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c076cb0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x562f0b5d01b8 s->prefetch_data=0 2024-03-09T14:37:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.804+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d01b8 2024-03-09T14:37:01.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.804+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4.0 2024-03-09T14:37:01.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.805+0000 7f484cff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-03-09T14:37:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.807+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:01.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.807+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.808+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-03-09T14:37:01.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.808+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.808+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.808+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.808+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:01.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.808+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.810+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-03-09T14:37:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.810+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.810+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=204 2024-03-09T14:37:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.810+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-03-09T14:37:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.810+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-03-09T14:37:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.812+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-03-09T14:37:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.812+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-03-09T14:37:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.812+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595102 cookie 94760053792368 notifier 5889 bl.length()=162 2024-03-09T14:37:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.815+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 from cache 2024-03-09T14:37:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.815+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4, ofs0, ns] 2024-03-09T14:37:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.815+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595103 cookie 94760053792368 notifier 5889 bl.length()=219 2024-03-09T14:37:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.817+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 : miss 2024-03-09T14:37:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.817+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.818+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.818+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 info.flags=0x0 2024-03-09T14:37:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.818+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4 to cache LRU end 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.820+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 : miss 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.820+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=449 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 info.flags=0x17 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 to cache LRU end 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d7ba0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562f0b5cfc88 s->prefetch_data=0 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.821+0000 7f496be9d800 10 manifest: total_size = 1667 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.822+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2071830931742452883 2024-03-09T14:37:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.822+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d7ba0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x562f0b5cfc88 s->prefetch_data=0 2024-03-09T14:37:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.822+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cfc88 2024-03-09T14:37:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.822+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11.0 2024-03-09T14:37:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:37:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-03-09T14:37:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:37:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2071830931742452883 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.1 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.2 2024-03-09T14:37:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-03-09T14:37:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.3 2024-03-09T14:37:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-03-09T14:37:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.4 2024-03-09T14:37:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-03-09T14:37:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.824+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2071830931742452883 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.825+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.826+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.827+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-03-09T14:37:01.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.827+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.828+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=235 2024-03-09T14:37:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.828+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-03-09T14:37:01.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.828+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-03-09T14:37:01.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.829+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-03-09T14:37:01.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.829+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-03-09T14:37:01.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.829+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595170 cookie 94760053821312 notifier 5889 bl.length()=191 2024-03-09T14:37:01.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.832+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 from cache 2024-03-09T14:37:01.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.832+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11, ofs0, ns] 2024-03-09T14:37:01.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.832+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 94760053824864 notifier 5889 bl.length()=249 2024-03-09T14:37:01.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.835+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 : miss 2024-03-09T14:37:01.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.835+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.835+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.835+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 info.flags=0x0 2024-03-09T14:37:01.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.835+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11 to cache LRU end 2024-03-09T14:37:01.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 : miss 2024-03-09T14:37:01.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=456 2024-03-09T14:37:01.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 info.flags=0x17 2024-03-09T14:37:01.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 to cache LRU end 2024-03-09T14:37:01.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.837+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d7c20 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 10 manifest: total_size = 886297 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13880238533478140029 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d7c20 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.838+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12.0 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-09T14:37:01.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13880238533478140029 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.1 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.2 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.3 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.4 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.841+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13880238533478140029 2024-03-09T14:37:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.842+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:37:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.843+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.844+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.844+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.845+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=242 2024-03-09T14:37:01.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.845+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-03-09T14:37:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.845+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-03-09T14:37:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.846+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-03-09T14:37:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.846+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-03-09T14:37:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.846+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94760053824864 notifier 5889 bl.length()=198 2024-03-09T14:37:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.849+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 from cache 2024-03-09T14:37:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.849+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12, ofs0, ns] 2024-03-09T14:37:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.849+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595076 cookie 94760053838752 notifier 5889 bl.length()=256 2024-03-09T14:37:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.851+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 : miss 2024-03-09T14:37:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.851+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.852+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.852+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 info.flags=0x0 2024-03-09T14:37:01.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.852+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12 to cache LRU end 2024-03-09T14:37:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 : miss 2024-03-09T14:37:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=451 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 info.flags=0x17 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 to cache LRU end 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.854+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.855+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo[sDrNNgqTo8yH9iWX-9uFnvCNvxcp4BO] 2024-03-09T14:37:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.855+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10.0 2024-03-09T14:37:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.855+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562f0b5d1868 s->prefetch_data=0 2024-03-09T14:37:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.856+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 873f4tajjtq6xg0jrgmwtmggnhj06pup 2024-03-09T14:37:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.856+0000 7f496be9d800 20 get_obj_state_impl: setting s->olh_tag to 1111iny3jkb4it9e2zs6e9f72xs4dg38 2024-03-09T14:37:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.856+0000 7f496be9d800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1111iny3jkb4it9e2zs6e9f72xs4dg38 2024-03-09T14:37:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.857+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10.0 2024-03-09T14:37:01.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.858+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10.0 2024-03-09T14:37:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-03-09T14:37:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 olh_log_entry: epoch=3 op=3 key=foo[sDrNNgqTo8yH9iWX-9uFnvCNvxcp4BO] 2024-03-09T14:37:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-multipart-index-versioning.1:_:sDrNNgqTo8yH9iWX-9uFnvCNvxcp4BO_foo state=0x562f0b5e3928 s->prefetch_data=0 2024-03-09T14:37:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 10 manifest: total_size = 74198 2024-03-09T14:37:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14422522094439722390 2024-03-09T14:37:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-multipart-index-versioning.1:_:sDrNNgqTo8yH9iWX-9uFnvCNvxcp4BO_foo state=0x562f0b5e3928 s->prefetch_data=0 2024-03-09T14:37:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5e3928 2024-03-09T14:37:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.859+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10.0 2024-03-09T14:37:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:37:01.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14422522094439722390 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.1 2024-03-09T14:37:01.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.2 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.3 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.4 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.862+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14422522094439722390 2024-03-09T14:37:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.863+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo[sDrNNgqTo8yH9iWX-9uFnvCNvxcp4BO] 2024-03-09T14:37:01.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.864+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x562f0b5d1868 s->prefetch_data=0 2024-03-09T14:37:01.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.866+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10.0 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10.0 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.868+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.869+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-03-09T14:37:01.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.869+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.870+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=237 2024-03-09T14:37:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.870+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-03-09T14:37:01.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.870+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-03-09T14:37:01.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.871+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-03-09T14:37:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.871+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-03-09T14:37:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.871+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595094 cookie 94760053824864 notifier 5889 bl.length()=193 2024-03-09T14:37:01.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.874+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 from cache 2024-03-09T14:37:01.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.874+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10, ofs0, ns] 2024-03-09T14:37:01.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.874+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 94760053834672 notifier 5889 bl.length()=251 2024-03-09T14:37:01.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.876+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 : miss 2024-03-09T14:37:01.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.876+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.877+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.877+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 info.flags=0x0 2024-03-09T14:37:01.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.877+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10 to cache LRU end 2024-03-09T14:37:01.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 : miss 2024-03-09T14:37:01.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=439 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 info.flags=0x17 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 to cache LRU end 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.879+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 2024-03-09T14:37:01.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo 2024-03-09T14:37:01.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b58ee70 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 10 manifest: total_size = 886297 2024-03-09T14:37:01.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7967981293449726364 2024-03-09T14:37:01.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b58ee70 obj=test-client.0-r-test-multipart-simple.1:foo state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.880+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9.0 2024-03-09T14:37:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:37:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-03-09T14:37:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-03-09T14:37:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:37:01.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7967981293449726364 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.1 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-03-09T14:37:01.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.2 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.3 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.4 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.883+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7967981293449726364 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.884+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.886+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.886+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.886+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=225 2024-03-09T14:37:01.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.886+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-03-09T14:37:01.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.886+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-03-09T14:37:01.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.887+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-03-09T14:37:01.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.887+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-03-09T14:37:01.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.888+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595104 cookie 94760053829760 notifier 5889 bl.length()=183 2024-03-09T14:37:01.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.890+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 from cache 2024-03-09T14:37:01.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.890+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9, ofs0, ns] 2024-03-09T14:37:01.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.890+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595090 cookie 94760053822368 notifier 5889 bl.length()=240 2024-03-09T14:37:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.892+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 : miss 2024-03-09T14:37:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.892+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.893+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.893+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 info.flags=0x0 2024-03-09T14:37:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.893+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9 to cache LRU end 2024-03-09T14:37:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.895+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 : miss 2024-03-09T14:37:01.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.895+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.896+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=447 2024-03-09T14:37:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.896+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 info.flags=0x17 2024-03-09T14:37:01.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.896+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 to cache LRU end 2024-03-09T14:37:01.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.896+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.896+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.896+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-09T14:37:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8531512067127068524 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.897+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8531512067127068524 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_0 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.899+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8531512067127068524 2024-03-09T14:37:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.900+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:37:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 10 generate_fake_tag new tag=9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_1_b126cc325d6c1e6de4304956701536cf 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_1_b126cc325d6c1e6de4304956701536cf 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.901+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_1_b126cc325d6c1e6de4304956701536cf 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_0 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.904+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_1_b126cc325d6c1e6de4304956701536cf 2024-03-09T14:37:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-09T14:37:01.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _4uROoVhZ5hI42qq7hILCP7u-4ZU2HnL 2024-03-09T14:37:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.905+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _4uROoVhZ5hI42qq7hILCP7u-4ZU2HnL 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.XTuuZZptYFBfxPczLpSfkx2i6od2pE7_0 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.908+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _4uROoVhZ5hI42qq7hILCP7u-4ZU2HnL 2024-03-09T14:37:01.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.909+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-09T14:37:01.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.909+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.910+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.910+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _3eUJYErNflZVMlSfiju3NCrqY07KSHi 2024-03-09T14:37:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.910+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5560 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.910+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.910+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _3eUJYErNflZVMlSfiju3NCrqY07KSHi 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.OqLDZfrxkeJZ3HfuHw4CqZD8QMMDQv2_1 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:37:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.912+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _3eUJYErNflZVMlSfiju3NCrqY07KSHi 2024-03-09T14:37:01.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.913+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-09T14:37:01.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.913+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.914+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.914+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2240626206833955503 2024-03-09T14:37:01.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.914+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.914+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.914+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2240626206833955503 2024-03-09T14:37:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_0 2024-03-09T14:37:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-09T14:37:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.916+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2240626206833955503 2024-03-09T14:37:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.917+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:37:01.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.917+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.918+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.918+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _fBA8xusIiillT_a8FprC0A7qBIN0Z3t 2024-03-09T14:37:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.918+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.918+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.918+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _fBA8xusIiillT_a8FprC0A7qBIN0Z3t 2024-03-09T14:37:01.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.pxVoHGVUkJqvpkOgqIvNOeebeaa0l7L_0 2024-03-09T14:37:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:37:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.920+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _fBA8xusIiillT_a8FprC0A7qBIN0Z3t 2024-03-09T14:37:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.921+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-09T14:37:01.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.921+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 10 generate_fake_tag new tag=9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_1_1043c18b72eee020a807a6e20f43fe5e 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_1_1043c18b72eee020a807a6e20f43fe5e 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.922+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_1_1043c18b72eee020a807a6e20f43fe5e 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_0 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-03-09T14:37:01.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.924+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_1_1043c18b72eee020a807a6e20f43fe5e 2024-03-09T14:37:01.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.925+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-09T14:37:01.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.925+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.926+0000 7f496be9d800 10 manifest: total_size = 5242880 2024-03-09T14:37:01.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.926+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _WPXP2ZODWuTFTzsrp5uwEpn-02O3OeL 2024-03-09T14:37:01.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.926+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.926+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.926+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _WPXP2ZODWuTFTzsrp5uwEpn-02O3OeL 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.ntqDCQ6NNoSG304DNO8ueqvl4AuNeqK_1 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.928+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _WPXP2ZODWuTFTzsrp5uwEpn-02O3OeL 2024-03-09T14:37:01.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.929+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-09T14:37:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.929+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.930+0000 7f496be9d800 10 manifest: total_size = 27191 2024-03-09T14:37:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.930+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4379338209783596996 2024-03-09T14:37:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.930+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.930+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.930+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.932+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.932+0000 7f496be9d800 10 manifest: total_size = 27191 2024-03-09T14:37:01.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.932+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _9jZ9D-yyN5i95vEPmv_c0wII8akVaLZ 2024-03-09T14:37:01.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.932+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.932+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.932+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.933+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:37:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=27191 stripe_ofs=27191 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _9jZ9D-yyN5i95vEPmv_c0wII8akVaLZ 2024-03-09T14:37:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.03L_UkcKKmpx2AS95kiwR1xmp_S2RNl_0 2024-03-09T14:37:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:37:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.935+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _9jZ9D-yyN5i95vEPmv_c0wII8akVaLZ 2024-03-09T14:37:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-09T14:37:01.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f496be9d800 10 manifest: total_size = 27191 2024-03-09T14:37:01.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _ojbNS3eFzUGlenmNQ8N6ho7dUwevhNg 2024-03-09T14:37:01.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039830 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.936+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=27191 stripe_ofs=27191 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _ojbNS3eFzUGlenmNQ8N6ho7dUwevhNg 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.qnlifbXYQxU73oVThrfqQGu76OXD2Tc_0 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:37:01.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.939+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _ojbNS3eFzUGlenmNQ8N6ho7dUwevhNg 2024-03-09T14:37:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.940+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-09T14:37:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.940+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.940+0000 7f496be9d800 10 manifest: total_size = 27191 2024-03-09T14:37:01.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.941+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _VoryiWB4wU6RR1fU9e68UH4P1CrcLzj 2024-03-09T14:37:01.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.941+0000 7f496be9d800 20 get_obj_state: octx=0x7f496002dd30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x562f0b5cf698 s->prefetch_data=0 2024-03-09T14:37:01.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.941+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cf698 2024-03-09T14:37:01.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.941+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15.0 2024-03-09T14:37:01.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.943+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:01.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.943+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:01.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.944+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-09T14:37:01.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.944+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:01.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.944+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:01.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.944+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:01.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.944+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:01.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.944+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:01.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.945+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-03-09T14:37:01.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.945+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.946+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=233 2024-03-09T14:37:01.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.946+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-03-09T14:37:01.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.946+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-03-09T14:37:01.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.947+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-03-09T14:37:01.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.947+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-03-09T14:37:01.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.948+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595095 cookie 94760053824864 notifier 5889 bl.length()=189 2024-03-09T14:37:01.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.950+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 from cache 2024-03-09T14:37:01.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.950+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15, ofs0, ns] 2024-03-09T14:37:01.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.950+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94760053834672 notifier 5889 bl.length()=247 2024-03-09T14:37:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.953+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 : miss 2024-03-09T14:37:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.953+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.953+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.953+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 info.flags=0x0 2024-03-09T14:37:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.953+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15 to cache LRU end 2024-03-09T14:37:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 : miss 2024-03-09T14:37:01.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=457 2024-03-09T14:37:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 info.flags=0x17 2024-03-09T14:37:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 to cache LRU end 2024-03-09T14:37:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:01.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.955+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-09T14:37:01.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.956+0000 7f496be9d800 20 get_obj_state: octx=0x7f49600393f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.957+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.957+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11764159216046581226 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.957+0000 7f496be9d800 20 get_obj_state: octx=0x7f49600393f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.957+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.957+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:01.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11764159216046581226 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.1 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-03-09T14:37:01.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.3 2024-03-09T14:37:01.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-03-09T14:37:01.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.959+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11764159216046581226 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.960+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.960+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5da2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.960+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.960+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.960+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.960+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.961+0000 7f496be9d800 10 generate_fake_tag new tag=9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2_f7d7bebb733afbfd0a9fd5da9408cbb4 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.961+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2_f7d7bebb733afbfd0a9fd5da9408cbb4 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.961+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5da2b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.961+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.961+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:01.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2_f7d7bebb733afbfd0a9fd5da9408cbb4 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.1 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 441 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 708 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.3 2024-03-09T14:37:01.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 975 2024-03-09T14:37:01.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.963+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2_f7d7bebb733afbfd0a9fd5da9408cbb4 2024-03-09T14:37:01.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-09T14:37:01.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f496be9d800 20 get_obj_state: octx=0x7f49640a6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to __lM0mPjPsL6Ft_nE3TNmVizFa5cWTv3 2024-03-09T14:37:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f496be9d800 20 get_obj_state: octx=0x7f49640a6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.964+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: __lM0mPjPsL6Ft_nE3TNmVizFa5cWTv3 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.V8eayp0e9hNbQV0-YOwAVhbfgdYbvfj_0 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.V8eayp0e9hNbQV0-YOwAVhbfgdYbvfj_1 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.967+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: __lM0mPjPsL6Ft_nE3TNmVizFa5cWTv3 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.968+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.968+0000 7f496be9d800 20 get_obj_state: octx=0x7f49640a6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.969+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.969+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _ANtXgmvymw3TdDaJcD_1uMa3-P5Ur40 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.969+0000 7f496be9d800 20 get_obj_state: octx=0x7f49640a6f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.969+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.969+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _ANtXgmvymw3TdDaJcD_1uMa3-P5Ur40 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.Zrx91goMtuNXTz7KmbXFv0XEPgWrChD_1 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.Zrx91goMtuNXTz7KmbXFv0XEPgWrChD_2 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.971+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _ANtXgmvymw3TdDaJcD_1uMa3-P5Ur40 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.972+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.972+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbff0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.973+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.973+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1347850688214617553 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.973+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbff0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.973+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.973+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1347850688214617553 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.1 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.3 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.975+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1347850688214617553 2024-03-09T14:37:01.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.976+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:37:01.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.978+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.978+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.978+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _L4IG0INldZT6D1YoRMZOXe27Hz8H0t1 2024-03-09T14:37:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.978+0000 7f496be9d800 20 get_obj_state: octx=0x7f4960039f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.978+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.978+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _L4IG0INldZT6D1YoRMZOXe27Hz8H0t1 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.zAD7FIHpJhxKEqWvblP7tBCTTDsf9tY_0 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.zAD7FIHpJhxKEqWvblP7tBCTTDsf9tY_1 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.981+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _L4IG0INldZT6D1YoRMZOXe27Hz8H0t1 2024-03-09T14:37:01.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.982+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-09T14:37:01.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.982+0000 7f496be9d800 20 get_obj_state: octx=0x7f49600393f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 10 generate_fake_tag new tag=9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2_9f4849f4bd213398ca3563665a03dd3d 2024-03-09T14:37:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2_9f4849f4bd213398ca3563665a03dd3d 2024-03-09T14:37:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 get_obj_state: octx=0x7f49600393f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.983+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2_9f4849f4bd213398ca3563665a03dd3d 2024-03-09T14:37:01.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.1 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 449 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 722 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.3 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 995 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.985+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2_9f4849f4bd213398ca3563665a03dd3d 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.986+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.987+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5e8d90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.987+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.987+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _vPxTV6msMuWHQoTgAFQ4_-CefcVs5qF 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.987+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5e8d90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.987+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.987+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _vPxTV6msMuWHQoTgAFQ4_-CefcVs5qF 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.IH1VY9Kx61xzGS2AFtPUq8VGbvJvvTE_1 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.IH1VY9Kx61xzGS2AFtPUq8VGbvJvvTE_2 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.989+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _vPxTV6msMuWHQoTgAFQ4_-CefcVs5qF 2024-03-09T14:37:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.991+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-09T14:37:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.992+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d0320 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.993+0000 7f496be9d800 10 manifest: total_size = 16378 2024-03-09T14:37:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.993+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12625374677161632846 2024-03-09T14:37:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.993+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d0320 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.993+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.993+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7672 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-03-09T14:37:01.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12625374677161632846 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.1 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.3 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-03-09T14:37:01.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:01.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.995+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12625374677161632846 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.996+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.997+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b59aab0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.997+0000 7f496be9d800 10 manifest: total_size = 16378 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.997+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _8whfGe3oUscNMLFn93rDBE6tpvTP9Pc 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.997+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b59aab0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.997+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.997+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:01.999+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _8whfGe3oUscNMLFn93rDBE6tpvTP9Pc 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.ExXn83I_37o9LPdSR4525vp55Lkzsps_0 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.000+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _8whfGe3oUscNMLFn93rDBE6tpvTP9Pc 2024-03-09T14:37:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-09T14:37:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f496be9d800 20 get_obj_state: octx=0x7f49600393f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f496be9d800 10 manifest: total_size = 16378 2024-03-09T14:37:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to _g9CzRiPcz200j-G19CNaO6KVZPOwb6r 2024-03-09T14:37:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f496be9d800 20 get_obj_state: octx=0x7f49600393f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.001+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:02.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=0 rule->part_size=0 2024-03-09T14:37:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: _g9CzRiPcz200j-G19CNaO6KVZPOwb6r 2024-03-09T14:37:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.BLyWxAvhJpQKfk5EVpske7SmgaJWM2Q_0 2024-03-09T14:37:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:37:02.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.003+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _g9CzRiPcz200j-G19CNaO6KVZPOwb6r 2024-03-09T14:37:02.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5660 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 10 manifest: total_size = 16378 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 10 generate_fake_tag new tag=9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2_6c7eb5076b3768172a7c1ae1b7ccd78a 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2_6c7eb5076b3768172a7c1ae1b7ccd78a 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5d5660 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x562f0b5cb978 s->prefetch_data=0 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5cb978 2024-03-09T14:37:02.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.005+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16.0 2024-03-09T14:37:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-03-09T14:37:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-03-09T14:37:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-03-09T14:37:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-03-09T14:37:02.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7672 2024-03-09T14:37:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2024-03-09T14:37:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-03-09T14:37:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2024-03-09T14:37:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2024-03-09T14:37:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2_6c7eb5076b3768172a7c1ae1b7ccd78a 2024-03-09T14:37:02.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.1 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.3 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.008+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2_6c7eb5076b3768172a7c1ae1b7ccd78a 2024-03-09T14:37:02.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.009+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-09T14:37:02.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.009+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:02.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.009+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:02.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.010+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:02.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.010+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.010+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.010+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.010+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.011+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.011+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.011+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=243 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.011+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-03-09T14:37:02.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.011+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-03-09T14:37:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.012+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-03-09T14:37:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.012+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-03-09T14:37:02.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.013+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94760053816912 notifier 5889 bl.length()=199 2024-03-09T14:37:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.015+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 from cache 2024-03-09T14:37:02.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.015+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16, ofs0, ns] 2024-03-09T14:37:02.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.016+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94760053792368 notifier 5889 bl.length()=257 2024-03-09T14:37:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.018+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 : miss 2024-03-09T14:37:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.018+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.018+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.018+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 info.flags=0x0 2024-03-09T14:37:02.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.018+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16 to cache LRU end 2024-03-09T14:37:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.020+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 : miss 2024-03-09T14:37:02.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.020+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=452 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 info.flags=0x17 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 to cache LRU end 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 2024-03-09T14:37:02.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:37:02.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:37:02.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:37:02.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5e1dd0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562f0b5d2e08 s->prefetch_data=0 2024-03-09T14:37:02.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:02.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11953286866513314774 2024-03-09T14:37:02.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5e1dd0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x562f0b5d2e08 s->prefetch_data=0 2024-03-09T14:37:02.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d2e08 2024-03-09T14:37:02.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.021+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14.0 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11953286866513314774 2024-03-09T14:37:02.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-FROZEN.2~m4Ch-24qrRZmR9xhifPVW0imHB1hCd5.1 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-FROZEN.2~m4Ch-24qrRZmR9xhifPVW0imHB1hCd5.2 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-FROZEN.2~m4Ch-24qrRZmR9xhifPVW0imHB1hCd5.3 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.023+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.024+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11953286866513314774 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562f0b5d2e08 s->prefetch_data=0 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f496be9d800 10 manifest: total_size = 11534336 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15081334800321944512 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x562f0b5d2e08 s->prefetch_data=0 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5d2e08 2024-03-09T14:37:02.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.025+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14.0 2024-03-09T14:37:02.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:02.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:37:02.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:02.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15081334800321944512 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-LUKEWARM.2~3FySnrFosJ3i55NoKgvIxJ046PJI7uT.1 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-LUKEWARM.2~3FySnrFosJ3i55NoKgvIxJ046PJI7uT.2 2024-03-09T14:37:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-03-09T14:37:02.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-LUKEWARM.2~3FySnrFosJ3i55NoKgvIxJ046PJI7uT.3 2024-03-09T14:37:02.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-03-09T14:37:02.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.027+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15081334800321944512 2024-03-09T14:37:02.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.028+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:37:02.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.029+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5cc390 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.029+0000 7f496be9d800 10 manifest: total_size = 45360 2024-03-09T14:37:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.029+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17984277259094888824 2024-03-09T14:37:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.029+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5cc390 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.029+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b59b1f8 2024-03-09T14:37:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.029+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14.0 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-03-09T14:37:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17984277259094888824 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-STANDARD.2~uXH1YiThU4fk9fjK2lnzE3L_4_h8gJI.1 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-STANDARD.2~uXH1YiThU4fk9fjK2lnzE3L_4_h8gJI.2 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-STANDARD.2~uXH1YiThU4fk9fjK2lnzE3L_4_h8gJI.3 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.032+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17984277259094888824 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:37:02.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:02.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.033+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.035+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.035+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.035+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=238 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.035+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-03-09T14:37:02.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.035+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-03-09T14:37:02.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.036+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-03-09T14:37:02.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.036+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-03-09T14:37:02.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.037+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 94760053834672 notifier 5889 bl.length()=194 2024-03-09T14:37:02.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.039+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 from cache 2024-03-09T14:37:02.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.039+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14, ofs0, ns] 2024-03-09T14:37:02.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.039+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 94760053792368 notifier 5889 bl.length()=252 2024-03-09T14:37:02.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.041+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 : miss 2024-03-09T14:37:02.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.041+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.042+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.042+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 info.flags=0x0 2024-03-09T14:37:02.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.042+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14 to cache LRU end 2024-03-09T14:37:02.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 : miss 2024-03-09T14:37:02.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=442 2024-03-09T14:37:02.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 info.flags=0x17 2024-03-09T14:37:02.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 to cache LRU end 2024-03-09T14:37:02.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:02.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:02.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.044+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 2024-03-09T14:37:02.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:37:02.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5cc390 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562f0b5e0b18 s->prefetch_data=0 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 10 manifest: total_size = 10485760 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14090868796742008213 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5cc390 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x562f0b5e0b18 s->prefetch_data=0 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5e0b18 2024-03-09T14:37:02.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.045+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13.0 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14090868796742008213 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.2giuQYj79aP_WGXWx1NRx4wcVXvOdcl_0 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.2giuQYj79aP_WGXWx1NRx4wcVXvOdcl_1 2024-03-09T14:37:02.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-03-09T14:37:02.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.048+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14090868796742008213 2024-03-09T14:37:02.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:37:02.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c080df0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562f0b5e0b18 s->prefetch_data=0 2024-03-09T14:37:02.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f496be9d800 10 manifest: total_size = 10485760 2024-03-09T14:37:02.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3157115245801954621 2024-03-09T14:37:02.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c080df0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x562f0b5e0b18 s->prefetch_data=0 2024-03-09T14:37:02.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5e0b18 2024-03-09T14:37:02.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.049+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13.0 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3157115245801954621 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.pGCxIyf3TJiCf8_JgcdqER_131uZWdG_0 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-09T14:37:02.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.pGCxIyf3TJiCf8_JgcdqER_131uZWdG_1 2024-03-09T14:37:02.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-03-09T14:37:02.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:37:02.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.052+0000 7f496be9d800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3157115245801954621 2024-03-09T14:37:02.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:37:02.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562f0b5e0b18 s->prefetch_data=0 2024-03-09T14:37:02.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f496be9d800 10 manifest: total_size = 53508 2024-03-09T14:37:02.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17653173167458042579 2024-03-09T14:37:02.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x562f0b5e0b18 s->prefetch_data=0 2024-03-09T14:37:02.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5e0b18 2024-03-09T14:37:02.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.053+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13.0 2024-03-09T14:37:02.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.055+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:02.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.055+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:02.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.056+0000 7f484cff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:37:02.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.057+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:02.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.057+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:02.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.057+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:02.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.057+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:02.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.057+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:02.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.058+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-03-09T14:37:02.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.058+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.059+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=228 2024-03-09T14:37:02.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.059+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-03-09T14:37:02.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.059+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-03-09T14:37:02.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.060+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-03-09T14:37:02.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.060+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-03-09T14:37:02.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.060+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595096 cookie 94760053824864 notifier 5889 bl.length()=184 2024-03-09T14:37:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.063+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 from cache 2024-03-09T14:37:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.063+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13, ofs0, ns] 2024-03-09T14:37:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.063+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595077 cookie 94760053838752 notifier 5889 bl.length()=242 2024-03-09T14:37:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.066+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 : miss 2024-03-09T14:37:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.066+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.066+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.066+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 info.flags=0x0 2024-03-09T14:37:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.066+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13 to cache LRU end 2024-03-09T14:37:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 : miss 2024-03-09T14:37:02.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 info.flags=0x17 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 to cache LRU end 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.068+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 10 cls_bucket_list_unordered: got __ 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 10 cls_bucket_list_unordered: got obj 2024-03-09T14:37:02.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5de880 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562f0b59b708 s->prefetch_data=0 2024-03-09T14:37:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 10 manifest: total_size = 0 2024-03-09T14:37:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14911467832309308642 2024-03-09T14:37:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5de880 obj=test-client.0-r-test-small-obj-data.1:__ state=0x562f0b59b708 s->prefetch_data=0 2024-03-09T14:37:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b59b708 2024-03-09T14:37:02.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.069+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6.0 2024-03-09T14:37:02.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.072+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5de880 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.072+0000 7f496be9d800 10 manifest: total_size = 0 2024-03-09T14:37:02.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.072+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7229338271165474255 2024-03-09T14:37:02.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.072+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5de880 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.072+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b59b1f8 2024-03-09T14:37:02.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.072+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6.0 2024-03-09T14:37:02.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.073+0000 7f484cff9640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:37:02.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.074+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbb30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.075+0000 7f496be9d800 10 manifest: total_size = 0 2024-03-09T14:37:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.075+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6772334839438357392 2024-03-09T14:37:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.075+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbb30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.075+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b59b1f8 2024-03-09T14:37:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.075+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6.0 2024-03-09T14:37:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.075+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:37:02.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.077+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.077+0000 7f496be9d800 10 manifest: total_size = 0 2024-03-09T14:37:02.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.077+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1540174873778322390 2024-03-09T14:37:02.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.077+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409e170 obj=test-client.0-r-test-small-obj-data.1:obj state=0x562f0b59b1f8 s->prefetch_data=0 2024-03-09T14:37:02.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.077+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b59b1f8 2024-03-09T14:37:02.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.077+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6.0 2024-03-09T14:37:02.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.078+0000 7f484cff9640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:37:02.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.080+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:02.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.080+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:02.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.081+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:37:02.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.081+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:02.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.081+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:02.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.081+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:02.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.081+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:02.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.081+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:02.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.082+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-03-09T14:37:02.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.082+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.083+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:37:02.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.083+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-03-09T14:37:02.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.083+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-03-09T14:37:02.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.083+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-03-09T14:37:02.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.084+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-03-09T14:37:02.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.084+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595171 cookie 94760053821312 notifier 5889 bl.length()=181 2024-03-09T14:37:02.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.086+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 from cache 2024-03-09T14:37:02.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.086+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6, ofs0, ns] 2024-03-09T14:37:02.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.087+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 94760053816912 notifier 5889 bl.length()=238 2024-03-09T14:37:02.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.089+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 : miss 2024-03-09T14:37:02.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.089+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.089+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.089+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 info.flags=0x0 2024-03-09T14:37:02.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.089+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6 to cache LRU end 2024-03-09T14:37:02.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.091+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 : miss 2024-03-09T14:37:02.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.091+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 info.flags=0x17 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 to cache LRU end 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 2024-03-09T14:37:02.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 cls_bucket_list_unordered: got __ 2024-03-09T14:37:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:37:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:37:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 cls_bucket_list_unordered: got obj 2024-03-09T14:37:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 10 manifest: total_size = 24595 2024-03-09T14:37:02.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9288525233492515136 2024-03-09T14:37:02.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:__ state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc488 2024-03-09T14:37:02.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.092+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7.0 2024-03-09T14:37:02.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.095+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.096+0000 7f496be9d800 10 manifest: total_size = 24595 2024-03-09T14:37:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.096+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15129812765463502329 2024-03-09T14:37:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.096+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.096+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc488 2024-03-09T14:37:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.096+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7.0 2024-03-09T14:37:02.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.096+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:37:02.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.098+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.098+0000 7f496be9d800 10 manifest: total_size = 2078 2024-03-09T14:37:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.098+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15528167663460547000 2024-03-09T14:37:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.098+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:___ state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.098+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc488 2024-03-09T14:37:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.098+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7.0 2024-03-09T14:37:02.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.099+0000 7f484cff9640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:37:02.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.101+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.101+0000 7f496be9d800 10 manifest: total_size = 38 2024-03-09T14:37:02.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.101+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5725103415210662289 2024-03-09T14:37:02.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.101+0000 7f496be9d800 20 get_obj_state: octx=0x7f495c0b3480 obj=test-client.0-r-test-small-obj-data.2:obj state=0x562f0b5dc488 s->prefetch_data=0 2024-03-09T14:37:02.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.101+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc488 2024-03-09T14:37:02.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.101+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7.0 2024-03-09T14:37:02.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.102+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:37:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.103+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.103+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:02.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.104+0000 7f484cff9640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:37:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.105+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.105+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.105+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.105+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:02.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.105+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.106+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-03-09T14:37:02.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.106+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.107+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:37:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.107+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-03-09T14:37:02.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.107+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-03-09T14:37:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.108+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-03-09T14:37:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.108+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-03-09T14:37:02.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.108+0000 7f484d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595172 cookie 94760053821312 notifier 5889 bl.length()=181 2024-03-09T14:37:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.111+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 from cache 2024-03-09T14:37:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.111+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7, ofs0, ns] 2024-03-09T14:37:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.111+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94760053816912 notifier 5889 bl.length()=238 2024-03-09T14:37:02.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.113+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 : miss 2024-03-09T14:37:02.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.113+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.114+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.114+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 info.flags=0x0 2024-03-09T14:37:02.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.114+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7 to cache LRU end 2024-03-09T14:37:02.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 : miss 2024-03-09T14:37:02.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:37:02.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 info.flags=0x17 2024-03-09T14:37:02.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 to cache LRU end 2024-03-09T14:37:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:37:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 2024-03-09T14:37:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 cls_bucket_list_unordered: got __ 2024-03-09T14:37:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:37:02.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:37:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 10 cls_bucket_list_unordered: got obj 2024-03-09T14:37:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.116+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbeb0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.117+0000 7f496be9d800 10 manifest: total_size = 4134 2024-03-09T14:37:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.117+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8323310826593236723 2024-03-09T14:37:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.117+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbeb0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.117+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc408 2024-03-09T14:37:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.117+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8.0 2024-03-09T14:37:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.119+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbeb0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.120+0000 7f496be9d800 10 manifest: total_size = 55 2024-03-09T14:37:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.120+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11378565929687297963 2024-03-09T14:37:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.120+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbeb0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.120+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc408 2024-03-09T14:37:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.120+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8.0 2024-03-09T14:37:02.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.121+0000 7f484cff9640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:37:02.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.122+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbeb0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.123+0000 7f496be9d800 10 manifest: total_size = 4134 2024-03-09T14:37:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.123+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9971906467701289911 2024-03-09T14:37:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.123+0000 7f496be9d800 20 get_obj_state: octx=0x562f0b5dbeb0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.123+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc408 2024-03-09T14:37:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.123+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8.0 2024-03-09T14:37:02.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.123+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:37:02.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.125+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409dea0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.126+0000 7f496be9d800 10 manifest: total_size = 1035 2024-03-09T14:37:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.126+0000 7f496be9d800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7449213085789986431 2024-03-09T14:37:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.126+0000 7f496be9d800 20 get_obj_state: octx=0x7f496409dea0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x562f0b5dc408 s->prefetch_data=0 2024-03-09T14:37:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.126+0000 7f496be9d800 20 prepare_atomic_modification: state is not atomic. state=0x562f0b5dc408 2024-03-09T14:37:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.126+0000 7f496be9d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8.0 2024-03-09T14:37:02.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.126+0000 7f484cff9640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:37:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.128+0000 7f496be9d800 20 list_objects_ordered: starting attempt 1 2024-03-09T14:37:02.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.128+0000 7f496be9d800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-03-09T14:37:02.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.129+0000 7f484d7fa640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:37:02.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.129+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:37:02.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.129+0000 7f496be9d800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:37:02.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.129+0000 7f496be9d800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:37:02.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.129+0000 7f496be9d800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:37:02.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.129+0000 7f496be9d800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8])"; uploads.size()=0; is_truncated=0 2024-03-09T14:37:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.131+0000 7f496be9d800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-03-09T14:37:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.131+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.131+0000 7f496be9d800 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:37:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.131+0000 7f496be9d800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-03-09T14:37:02.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.131+0000 7f496be9d800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-03-09T14:37:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.132+0000 7f496be9d800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-03-09T14:37:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.132+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-03-09T14:37:02.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.132+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595173 cookie 94760053821312 notifier 5889 bl.length()=181 2024-03-09T14:37:02.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.135+0000 7f496be9d800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 from cache 2024-03-09T14:37:02.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.135+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8, ofs0, ns] 2024-03-09T14:37:02.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.135+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595094 cookie 94760053816912 notifier 5889 bl.length()=238 2024-03-09T14:37:02.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.141+0000 7f496be9d800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 : miss 2024-03-09T14:37:02.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.141+0000 7f496be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.141+0000 7f496be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.141+0000 7f496be9d800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 info.flags=0x0 2024-03-09T14:37:02.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.141+0000 7f496be9d800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8 to cache LRU end 2024-03-09T14:37:02.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.143+0000 7f496be9d800 10 removing key index: KRRUUGZVBWOGYWDMWJDU 2024-03-09T14:37:02.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.145+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:KRRUUGZVBWOGYWDMWJDU, ofs0, ns] 2024-03-09T14:37:02.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.145+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 94760053829760 notifier 5889 bl.length()=170 2024-03-09T14:37:02.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.146+0000 7f496be9d800 10 removing email index: ragweed.client.0+test@test.test 2024-03-09T14:37:02.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.147+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-09T14:37:02.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.148+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595097 cookie 94760053824864 notifier 5889 bl.length()=182 2024-03-09T14:37:02.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.149+0000 7f496be9d800 10 removing user buckets index 2024-03-09T14:37:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.151+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-03-09T14:37:02.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.151+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94760053834672 notifier 5889 bl.length()=173 2024-03-09T14:37:02.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.152+0000 7f496be9d800 10 removing user index: ragweed.client.0 2024-03-09T14:37:02.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.154+0000 7f496be9d800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-03-09T14:37:02.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.154+0000 7f496be9d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-09T14:37:02.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.154+0000 7f484cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595108 cookie 94760053829760 notifier 5889 bl.length()=165 2024-03-09T14:37:02.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.157+0000 7f481b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:37:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.160+0000 7f496be9d800 20 remove_watcher() i=0 2024-03-09T14:37:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.160+0000 7f496be9d800 2 removed watcher, disabling cache 2024-03-09T14:37:02.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.161+0000 7f496be9d800 20 remove_watcher() i=1 2024-03-09T14:37:02.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.162+0000 7f496be9d800 20 remove_watcher() i=2 2024-03-09T14:37:02.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.163+0000 7f496be9d800 20 remove_watcher() i=3 2024-03-09T14:37:02.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.164+0000 7f496be9d800 20 remove_watcher() i=4 2024-03-09T14:37:02.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.165+0000 7f496be9d800 20 remove_watcher() i=5 2024-03-09T14:37:02.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.166+0000 7f496be9d800 20 remove_watcher() i=6 2024-03-09T14:37:02.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.167+0000 7f496be9d800 20 remove_watcher() i=7 2024-03-09T14:37:02.177 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-03-09T14:37:02.230 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:37:02.231 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:37:02.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.261+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 realm 2024-03-09T14:37:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:37:02.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.263+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.264+0000 7f055dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:37:02.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.264+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.265+0000 7f055dc13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:37:02.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.265+0000 7f055dc13800 20 searching for the correct realm 2024-03-09T14:37:02.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.267+0000 7f0558bcb640 0 -- 172.21.15.46:0/1235827040 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5654ded55e00 msgr2=0x5654ded58210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:37:02.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.270+0000 7f05593cc640 0 -- 172.21.15.46:0/1235827040 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f055002b070 msgr2=0x7f05500888c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:37:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:37:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:37:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:37:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:37:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:37:02.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:37:02.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.476+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:37:02.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:37:02.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 zone default found 2024-03-09T14:37:02.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 4 Realm: () 2024-03-09T14:37:02.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 zonegroup default 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.477+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.478+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.478+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.478+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.478+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.479+0000 7f055dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.479+0000 7f055dc13800 20 started sync module instance, tier type = 2024-03-09T14:37:02.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.479+0000 7f055dc13800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:37:02.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=0 2024-03-09T14:37:02.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=1 2024-03-09T14:37:02.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=2 2024-03-09T14:37:02.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=3 2024-03-09T14:37:02.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=4 2024-03-09T14:37:02.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=5 2024-03-09T14:37:02.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.488+0000 7f055dc13800 20 add_watcher() i=6 2024-03-09T14:37:02.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.489+0000 7f055dc13800 20 add_watcher() i=7 2024-03-09T14:37:02.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.489+0000 7f055dc13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:37:02.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.490+0000 7f040f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:37:02.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.490+0000 7f055dc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:37:02.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.490+0000 7f055dc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:37:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.525+0000 7f040e7e4640 20 reqs_thread_entry: start 2024-03-09T14:37:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.525+0000 7f055dc13800 20 init_complete bucket index max shards: 1 2024-03-09T14:37:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.525+0000 7f055dc13800 20 Filter name: none 2024-03-09T14:37:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.525+0000 7f037ffff640 20 reqs_thread_entry: start 2024-03-09T14:37:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.525+0000 7f055dc13800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-09T14:37:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.525+0000 7f055dc13800 20 rados->read ofs=0 len=0 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.526+0000 7f055dc13800 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.526+0000 7f055dc13800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.526+0000 7f055dc13800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.526+0000 7f055dc13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.526+0000 7f055dc13800 10 removing key index: NAQSCEQCNNESRQXJHXHB 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.527+0000 7f055dc13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NAQSCEQCNNESRQXJHXHB, ofs0, ns] 2024-03-09T14:37:02.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.527+0000 7f043cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595094 cookie 94922515819584 notifier 5907 bl.length()=170 2024-03-09T14:37:02.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.529+0000 7f055dc13800 10 removing email index: sysuser.client.0+test@test.test 2024-03-09T14:37:02.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.530+0000 7f055dc13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-09T14:37:02.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.530+0000 7f042bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595109 cookie 94922515813680 notifier 5907 bl.length()=182 2024-03-09T14:37:02.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.531+0000 7f055dc13800 10 removing user buckets index 2024-03-09T14:37:02.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.532+0000 7f055dc13800 10 removing user index: sysuser.client.0 2024-03-09T14:37:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.533+0000 7f055dc13800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-03-09T14:37:02.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.533+0000 7f055dc13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-09T14:37:02.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.533+0000 7f042bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595098 cookie 94922515805952 notifier 5907 bl.length()=165 2024-03-09T14:37:02.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.536+0000 7f040f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:37:02.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.539+0000 7f055dc13800 20 remove_watcher() i=0 2024-03-09T14:37:02.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.539+0000 7f055dc13800 2 removed watcher, disabling cache 2024-03-09T14:37:02.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.541+0000 7f055dc13800 20 remove_watcher() i=1 2024-03-09T14:37:02.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.542+0000 7f055dc13800 20 remove_watcher() i=2 2024-03-09T14:37:02.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.543+0000 7f055dc13800 20 remove_watcher() i=3 2024-03-09T14:37:02.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.545+0000 7f055dc13800 20 remove_watcher() i=4 2024-03-09T14:37:02.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.546+0000 7f055dc13800 20 remove_watcher() i=5 2024-03-09T14:37:02.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.547+0000 7f055dc13800 20 remove_watcher() i=6 2024-03-09T14:37:02.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:37:02.548+0000 7f055dc13800 20 remove_watcher() i=7 2024-03-09T14:37:02.559 INFO:tasks.ragweed:Removing ragweed... 2024-03-09T14:37:02.559 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:37:02.642 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:37:02.662 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:37:02.663 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:37:02.663 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:37:02.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:37:02.692 INFO:teuthology.orchestra.run.smithi046.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:37:02.693 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:37:02.761 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:37:02.762 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:37:02.828 INFO:tasks.workunit:timeout=3h 2024-03-09T14:37:02.828 INFO:tasks.workunit:cleanup=True 2024-03-09T14:37:02.829 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:37:02.895 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:38:19.555 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 97% (11921/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-03-09T14:38:20.154 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:20.155 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:38:20.158 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:38:20.225 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:38:20.227 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:38:20.227 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:38:20.275 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:38:20.323 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:38:20.362 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:38:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:38:20.364 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:38:20.402 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:38:20.405 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:38:20.405 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:38:20.474 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-03-09T14:38:20.476 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-03-09T14:38:20.476 DEBUG:teuthology.orchestra.run.smithi046:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-09T14:38:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:+ ulimit -c 0 2024-03-09T14:38:20.545 INFO:tasks.workunit.client.0.smithi046.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-09T14:38:20.546 INFO:tasks.workunit.client.0.smithi046.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:38:20.546 INFO:tasks.workunit.client.0.smithi046.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ deactivate nondestructive 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ hash -r 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:38:22.897 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ export VIRTUAL_ENV 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ export PATH 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n '' ']' 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -z '' ']' 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ PS1='(rgw) ' 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ export PS1 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:++ hash -r 2024-03-09T14:38:22.898 INFO:tasks.workunit.client.0.smithi046.stderr:+ pip install pip --upgrade 2024-03-09T14:38:23.133 INFO:tasks.workunit.client.0.smithi046.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2024-03-09T14:38:23.344 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting pip 2024-03-09T14:38:23.351 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:38:23.399 INFO:tasks.workunit.client.0.smithi046.stdout:Installing collected packages: pip 2024-03-09T14:38:23.400 INFO:tasks.workunit.client.0.smithi046.stdout: Attempting uninstall: pip 2024-03-09T14:38:23.400 INFO:tasks.workunit.client.0.smithi046.stdout: Found existing installation: pip 21.2.3 2024-03-09T14:38:23.553 INFO:tasks.workunit.client.0.smithi046.stdout: Uninstalling pip-21.2.3: 2024-03-09T14:38:23.558 INFO:tasks.workunit.client.0.smithi046.stdout: Successfully uninstalled pip-21.2.3 2024-03-09T14:38:24.572 INFO:tasks.workunit.client.0.smithi046.stdout:Successfully installed pip-24.0 2024-03-09T14:38:24.620 INFO:tasks.workunit.client.0.smithi046.stderr:+ pip install boto3 2024-03-09T14:38:25.485 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting boto3 2024-03-09T14:38:25.486 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:38:26.049 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:38:26.050 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:38:26.105 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:38:26.106 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:38:26.160 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:38:26.161 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:38:26.229 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:38:26.230 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:38:26.313 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:38:26.314 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2024-03-09T14:38:26.483 INFO:tasks.workunit.client.0.smithi046.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:38:26.485 INFO:tasks.workunit.client.0.smithi046.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:38:26.509 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:38:26.510 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:38:26.530 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:38:26.532 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:38:26.533 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:38:26.535 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2024-03-09T14:38:26.536 INFO:tasks.workunit.client.0.smithi046.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:38:26.641 INFO:tasks.workunit.client.0.smithi046.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:38:27.765 INFO:tasks.workunit.client.0.smithi046.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-1.26.18 2024-03-09T14:38:27.906 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-03-09T14:38:28.036 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-03-09T14:38:28.070 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:28.070 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:28.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.103+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 realm 2024-03-09T14:38:28.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:28.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.105+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.106+0000 7fae74b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:28.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.106+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.107+0000 7fae74b1f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:28.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.107+0000 7fae74b1f800 20 searching for the correct realm 2024-03-09T14:38:28.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.110+0000 7fae71082640 0 -- 172.21.15.46:0/4102766057 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55555d81a060 msgr2=0x55555d81c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:28.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.114+0000 7fae6bfff640 0 -- 172.21.15.46:0/4102766057 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55555d821ba0 msgr2=0x55555d823fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.119+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:28.120 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 zone default found 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 4 Realm: () 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 zonegroup default 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.120+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.121+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.121+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.121+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.121+0000 7fae74b1f800 20 started sync module instance, tier type = 2024-03-09T14:38:28.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.121+0000 7fae74b1f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=0 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=1 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=2 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=3 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=4 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=5 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.130+0000 7fae74b1f800 20 add_watcher() i=6 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.131+0000 7fae74b1f800 20 add_watcher() i=7 2024-03-09T14:38:28.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.131+0000 7fae74b1f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:28.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.133+0000 7fad26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.133+0000 7fae74b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.133+0000 7fae74b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 5 note: GC not initialized 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fad25fe3640 20 reqs_thread_entry: start 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 20 Filter name: none 2024-03-09T14:38:28.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fac977fe640 20 reqs_thread_entry: start 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.134+0000 7fae74b1f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.135+0000 7fae74b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.135+0000 7fae74b1f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.135+0000 7fae74b1f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.135+0000 7fae74b1f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-09T14:38:28.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.135+0000 7fae74b1f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-09T14:38:28.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.136+0000 7fae74b1f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-03-09T14:38:28.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.136+0000 7fae74b1f800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:38:28.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.136+0000 7fae74b1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-03-09T14:38:28.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.136+0000 7fad47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595095 cookie 93825129426528 notifier 5925 bl.length()=569 2024-03-09T14:38:28.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.136+0000 7fad47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-03-09T14:38:28.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.136+0000 7fad47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:38:28.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.139+0000 7fae74b1f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-09T14:38:28.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.139+0000 7fae74b1f800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:38:28.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.139+0000 7fae74b1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-09T14:38:28.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.139+0000 7fad477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595096 cookie 93825129423824 notifier 5925 bl.length()=180 2024-03-09T14:38:28.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.139+0000 7fad477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-09T14:38:28.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.139+0000 7fad477fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:38:28.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.141+0000 7fad26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:28.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.144+0000 7fae74b1f800 20 remove_watcher() i=0 2024-03-09T14:38:28.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.144+0000 7fae74b1f800 2 removed watcher, disabling cache 2024-03-09T14:38:28.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.145+0000 7fae74b1f800 20 remove_watcher() i=1 2024-03-09T14:38:28.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.146+0000 7fae74b1f800 20 remove_watcher() i=2 2024-03-09T14:38:28.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.147+0000 7fae74b1f800 20 remove_watcher() i=3 2024-03-09T14:38:28.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.148+0000 7fae74b1f800 20 remove_watcher() i=4 2024-03-09T14:38:28.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.149+0000 7fae74b1f800 20 remove_watcher() i=5 2024-03-09T14:38:28.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.150+0000 7fae74b1f800 20 remove_watcher() i=6 2024-03-09T14:38:28.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:28.151+0000 7fae74b1f800 20 remove_watcher() i=7 2024-03-09T14:38:42.694 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:42.694 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:42.744 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:42.744 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:42.785 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:42.785 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:42.826 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:42.826 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:42.855 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:42.856 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:42.917 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:42.917 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:42.974 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard add 2024-03-09T14:38:42.974 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:42.974 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:38:43.001 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:43.001 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:43.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.035+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.036+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.036+0000 7f34eea15800 20 realm 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.036+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.036+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.036+0000 7f34eea15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.036+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.037+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.037+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.037+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.037+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.038 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.038+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:43.039 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.038+0000 7f34eea15800 20 searching for the correct realm 2024-03-09T14:38:43.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.041+0000 7f34ea7df640 0 -- 172.21.15.46:0/1613910721 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55b483bf1a60 msgr2=0x55b483bf3ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:43.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.045+0000 7f34e9fde640 0 -- 172.21.15.46:0/1613910721 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f34e0032930 msgr2=0x7f34e005e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:43.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:43.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:43.050 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.051 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.050+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 zone default found 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 4 Realm: () 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:43.052 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 zonegroup default 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.051+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.052+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.052+0000 7f34eea15800 20 started sync module instance, tier type = 2024-03-09T14:38:43.053 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.052+0000 7f34eea15800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=0 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=1 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=2 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=3 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=4 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=5 2024-03-09T14:38:43.061 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.061+0000 7f34eea15800 20 add_watcher() i=6 2024-03-09T14:38:43.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.062+0000 7f34eea15800 20 add_watcher() i=7 2024-03-09T14:38:43.062 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.062+0000 7f34eea15800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:43.063 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.063+0000 7f33937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f34eea15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:43.064 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f34eea15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:43.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f34eea15800 5 note: GC not initialized 2024-03-09T14:38:43.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f33927fc640 20 reqs_thread_entry: start 2024-03-09T14:38:43.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f34eea15800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:43.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f34eea15800 20 Filter name: none 2024-03-09T14:38:43.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f330bfff640 20 reqs_thread_entry: start 2024-03-09T14:38:43.065 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.064+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.065+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.065+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.065+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.065+0000 7f34eea15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.065+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.066+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:43.066 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.066+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.066+0000 7f34eea15800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:43.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.066+0000 7f34eea15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:43.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.066+0000 7f34eea15800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.067+0000 7f34eea15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.067 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.067+0000 7f33937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.070+0000 7f34eea15800 20 remove_watcher() i=0 2024-03-09T14:38:43.070 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.070+0000 7f34eea15800 2 removed watcher, disabling cache 2024-03-09T14:38:43.071 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.071+0000 7f34eea15800 20 remove_watcher() i=1 2024-03-09T14:38:43.072 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.072+0000 7f34eea15800 20 remove_watcher() i=2 2024-03-09T14:38:43.073 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.073+0000 7f34eea15800 20 remove_watcher() i=3 2024-03-09T14:38:43.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.074+0000 7f34eea15800 20 remove_watcher() i=4 2024-03-09T14:38:43.074 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.074+0000 7f34eea15800 20 remove_watcher() i=5 2024-03-09T14:38:43.075 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.075+0000 7f34eea15800 20 remove_watcher() i=6 2024-03-09T14:38:43.076 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.076+0000 7f34eea15800 20 remove_watcher() i=7 2024-03-09T14:38:43.086 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:43.087 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:43.087 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: a-bucket id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-03-09T14:38:43.087 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:43.088 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-03-09T14:38:43.118 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:43.118 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:43.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.151+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 realm 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.152+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.153+0000 7fb9d0ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.153+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.154+0000 7fb9d0ac0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:43.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.154+0000 7fb9d0ac0800 20 searching for the correct realm 2024-03-09T14:38:43.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.157+0000 7fb9cedc4640 0 -- 172.21.15.46:0/235398607 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55dfa68b0ec0 msgr2=0x55dfa68b3380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.161+0000 7fb9ce5c3640 0 -- 172.21.15.46:0/235398607 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fb9b8061430 msgr2=0x7fb9b8003360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.165+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.168 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:43.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 zone default found 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 4 Realm: () 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 zonegroup default 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.166+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 started sync module instance, tier type = 2024-03-09T14:38:43.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.167+0000 7fb9d0ac0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=0 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=1 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=2 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=3 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=4 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=5 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.176+0000 7fb9d0ac0800 20 add_watcher() i=6 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.177+0000 7fb9d0ac0800 20 add_watcher() i=7 2024-03-09T14:38:43.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.177+0000 7fb9d0ac0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.178+0000 7fb884fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 5 note: GC not initialized 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb7ff7fe640 20 reqs_thread_entry: start 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:43.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 20 Filter name: none 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb7fd7fa640 20 reqs_thread_entry: start 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.179+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : miss 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:43.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:43.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:43.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:43.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:43.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.180+0000 7fb9d0ac0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:38:43.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.182+0000 7fb884fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.184+0000 7fb9d0ac0800 20 remove_watcher() i=0 2024-03-09T14:38:43.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.184+0000 7fb9d0ac0800 2 removed watcher, disabling cache 2024-03-09T14:38:43.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.185+0000 7fb9d0ac0800 20 remove_watcher() i=1 2024-03-09T14:38:43.186 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.186+0000 7fb9d0ac0800 20 remove_watcher() i=2 2024-03-09T14:38:43.187 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.187+0000 7fb9d0ac0800 20 remove_watcher() i=3 2024-03-09T14:38:43.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.188+0000 7fb9d0ac0800 20 remove_watcher() i=4 2024-03-09T14:38:43.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.189+0000 7fb9d0ac0800 20 remove_watcher() i=5 2024-03-09T14:38:43.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.190+0000 7fb9d0ac0800 20 remove_watcher() i=6 2024-03-09T14:38:43.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.191+0000 7fb9d0ac0800 20 remove_watcher() i=7 2024-03-09T14:38:43.202 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin reshard list 2024-03-09T14:38:43.227 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:43.227 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:43.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.260+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 realm 2024-03-09T14:38:43.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.262+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.263+0000 7f930681e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.263+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.264+0000 7f930681e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:43.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.264+0000 7f930681e800 20 searching for the correct realm 2024-03-09T14:38:43.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.267+0000 7f9304b1b640 0 -- 172.21.15.46:0/973084971 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x555c89f16730 msgr2=0x555c89f18ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.270+0000 7f930431a640 0 -- 172.21.15.46:0/973084971 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f92ec07f040 msgr2=0x7f92ec09c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 zone default found 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 4 Realm: () 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 zonegroup default 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.275+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 started sync module instance, tier type = 2024-03-09T14:38:43.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.276+0000 7f930681e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:43.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=0 2024-03-09T14:38:43.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=1 2024-03-09T14:38:43.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=2 2024-03-09T14:38:43.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=3 2024-03-09T14:38:43.285 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=4 2024-03-09T14:38:43.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=5 2024-03-09T14:38:43.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=6 2024-03-09T14:38:43.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 20 add_watcher() i=7 2024-03-09T14:38:43.286 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.285+0000 7f930681e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:43.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.287+0000 7f91ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f930681e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:43.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f930681e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:43.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f930681e800 5 note: GC not initialized 2024-03-09T14:38:43.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f91b97e2640 20 reqs_thread_entry: start 2024-03-09T14:38:43.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f930681e800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:43.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f930681e800 20 Filter name: none 2024-03-09T14:38:43.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.288+0000 7f912affd640 20 reqs_thread_entry: start 2024-03-09T14:38:43.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.294+0000 7f91ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.296+0000 7f930681e800 20 remove_watcher() i=0 2024-03-09T14:38:43.296 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.296+0000 7f930681e800 2 removed watcher, disabling cache 2024-03-09T14:38:43.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.297+0000 7f930681e800 20 remove_watcher() i=1 2024-03-09T14:38:43.298 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.298+0000 7f930681e800 20 remove_watcher() i=2 2024-03-09T14:38:43.299 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.299+0000 7f930681e800 20 remove_watcher() i=3 2024-03-09T14:38:43.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.300+0000 7f930681e800 20 remove_watcher() i=4 2024-03-09T14:38:43.301 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.301+0000 7f930681e800 20 remove_watcher() i=5 2024-03-09T14:38:43.302 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.302+0000 7f930681e800 20 remove_watcher() i=6 2024-03-09T14:38:43.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.303+0000 7f930681e800 20 remove_watcher() i=7 2024-03-09T14:38:43.313 INFO:tasks.workunit.client.0.smithi046.stderr:bucket name a-bucket 2024-03-09T14:38:43.313 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard process 2024-03-09T14:38:43.313 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:43.314 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin reshard process 2024-03-09T14:38:43.339 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:43.340 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:43.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.372+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.373+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.373+0000 7f92fe614800 20 realm 2024-03-09T14:38:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.373+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.374+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.374+0000 7f92fe614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:43.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.374+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.374+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.374+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.375+0000 7f92fe614800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.375+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.376+0000 7f92fe614800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:43.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.376+0000 7f92fe614800 20 searching for the correct realm 2024-03-09T14:38:43.378 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.378+0000 7f92f9492640 0 -- 172.21.15.46:0/2237558921 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f92ec04c070 msgr2=0x7f92ec074af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.382+0000 7f92f9c93640 0 -- 172.21.15.46:0/2237558921 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f92f009fa60 msgr2=0x7f92f00bf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:43.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:43.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:43.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:43.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.588+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.589+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.589+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.589+0000 7f92fe614800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.589+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 zone default found 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 4 Realm: () 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:43.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 zonegroup default 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.590+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.591+0000 7f92fe614800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.591+0000 7f92fe614800 20 started sync module instance, tier type = 2024-03-09T14:38:43.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.591+0000 7f92fe614800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:43.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=0 2024-03-09T14:38:43.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=1 2024-03-09T14:38:43.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=2 2024-03-09T14:38:43.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=3 2024-03-09T14:38:43.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=4 2024-03-09T14:38:43.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=5 2024-03-09T14:38:43.601 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.599+0000 7f92fe614800 20 add_watcher() i=6 2024-03-09T14:38:43.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.600+0000 7f92fe614800 20 add_watcher() i=7 2024-03-09T14:38:43.602 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.600+0000 7f92fe614800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:43.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.602+0000 7f91ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.602+0000 7f92fe614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:43.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.602+0000 7f92fe614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:43.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.602+0000 7f92fe614800 5 note: GC not initialized 2024-03-09T14:38:43.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.603+0000 7f91aa7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:43.604 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.603+0000 7f92fe614800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:43.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.603+0000 7f92fe614800 20 Filter name: none 2024-03-09T14:38:43.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.603+0000 7f911bfff640 20 reqs_thread_entry: start 2024-03-09T14:38:43.605 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.603+0000 7f92fe614800 20 processing logshard = reshard.0000000000 2024-03-09T14:38:43.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.606+0000 7f92fe614800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-09T14:38:43.606 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.606+0000 7f92fe614800 20 processing logshard = reshard.0000000001 2024-03-09T14:38:43.608 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.608+0000 7f92fe614800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-09T14:38:43.608 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.608+0000 7f92fe614800 20 processing logshard = reshard.0000000002 2024-03-09T14:38:43.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.611+0000 7f92fe614800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-09T14:38:43.611 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.611+0000 7f92fe614800 20 processing logshard = reshard.0000000003 2024-03-09T14:38:43.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.613+0000 7f92fe614800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-09T14:38:43.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.613+0000 7f92fe614800 20 processing logshard = reshard.0000000004 2024-03-09T14:38:43.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.617+0000 7f92fe614800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-09T14:38:43.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.617+0000 7f92fe614800 20 processing logshard = reshard.0000000005 2024-03-09T14:38:43.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.618+0000 7f92fe614800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-09T14:38:43.619 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.618+0000 7f92fe614800 20 processing logshard = reshard.0000000006 2024-03-09T14:38:43.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 20 process_entry resharding a-bucket 2024-03-09T14:38:43.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:38:43.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : miss 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 20 rados->read ofs=0 len=0 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:43.621 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:43.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:43.622 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.620+0000 7f92fe614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.625+0000 7f92fe614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.625+0000 7f92fe614800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.625+0000 7f92fe614800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.625+0000 7f92fe614800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17, ofs0, ns] 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.625+0000 7f91dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595100 cookie 94888445456528 notifier 6000 bl.length()=819 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.626+0000 7f91dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.626+0000 7f91dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:43.626 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.626+0000 7f91dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:43.627 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.627+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_sources= new_sources= 2024-03-09T14:38:43.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.627+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential sources added=[] removed=[] 2024-03-09T14:38:43.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.627+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_dests= new_dests= 2024-03-09T14:38:43.628 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.627+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential dests added=[] removed=[] 2024-03-09T14:38:43.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.628+0000 7f92fe614800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.0 2024-03-09T14:38:43.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.628+0000 7f92fe614800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.0 2024-03-09T14:38:43.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.628+0000 7f92fe614800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.1 2024-03-09T14:38:43.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.628+0000 7f92fe614800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.1 2024-03-09T14:38:43.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.628+0000 7f92fe614800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.0 2024-03-09T14:38:43.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.629+0000 7f92fe614800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : hit (requested=0x17, cached=0x17) 2024-03-09T14:38:43.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.629+0000 7f92fe614800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:38:43.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.630+0000 7f92fe614800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:43.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.630+0000 7f92fe614800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:43.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.630+0000 7f92fe614800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:43.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.630+0000 7f92fe614800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17, ofs0, ns] 2024-03-09T14:38:43.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.631+0000 7f91dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595101 cookie 94888445456528 notifier 6000 bl.length()=787 2024-03-09T14:38:43.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.631+0000 7f91dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:43.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.631+0000 7f91dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:43.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.631+0000 7f91dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:43.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.632+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_sources= new_sources= 2024-03-09T14:38:43.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.632+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential sources added=[] removed=[] 2024-03-09T14:38:43.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.632+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_dests= new_dests= 2024-03-09T14:38:43.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.632+0000 7f92fe614800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential dests added=[] removed=[] 2024-03-09T14:38:43.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.633+0000 7f92fe614800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:38:43.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.634+0000 7f92fe614800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-09T14:38:43.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.636+0000 7f92fe614800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-09T14:38:43.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.636+0000 7f92fe614800 20 processing logshard = reshard.0000000007 2024-03-09T14:38:43.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.639+0000 7f92fe614800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-09T14:38:43.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.639+0000 7f92fe614800 20 processing logshard = reshard.0000000008 2024-03-09T14:38:43.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.641+0000 7f92fe614800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-09T14:38:43.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.641+0000 7f92fe614800 20 processing logshard = reshard.0000000009 2024-03-09T14:38:43.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.643+0000 7f92fe614800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-09T14:38:43.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.643+0000 7f92fe614800 20 processing logshard = reshard.0000000010 2024-03-09T14:38:43.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.645+0000 7f92fe614800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-09T14:38:43.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.645+0000 7f92fe614800 20 processing logshard = reshard.0000000011 2024-03-09T14:38:43.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.648+0000 7f92fe614800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-09T14:38:43.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.648+0000 7f92fe614800 20 processing logshard = reshard.0000000012 2024-03-09T14:38:43.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.651+0000 7f92fe614800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-09T14:38:43.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.651+0000 7f92fe614800 20 processing logshard = reshard.0000000013 2024-03-09T14:38:43.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.653+0000 7f92fe614800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-09T14:38:43.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.653+0000 7f92fe614800 20 processing logshard = reshard.0000000014 2024-03-09T14:38:43.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.655+0000 7f92fe614800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-09T14:38:43.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.655+0000 7f92fe614800 20 processing logshard = reshard.0000000015 2024-03-09T14:38:43.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.658+0000 7f92fe614800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-09T14:38:43.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.658+0000 7f91ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:43.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.661+0000 7f92fe614800 20 remove_watcher() i=0 2024-03-09T14:38:43.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.661+0000 7f92fe614800 2 removed watcher, disabling cache 2024-03-09T14:38:43.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.662+0000 7f92fe614800 20 remove_watcher() i=1 2024-03-09T14:38:43.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.662+0000 7f92fe614800 20 remove_watcher() i=2 2024-03-09T14:38:43.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.664+0000 7f92fe614800 20 remove_watcher() i=3 2024-03-09T14:38:43.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.664+0000 7f92fe614800 20 remove_watcher() i=4 2024-03-09T14:38:43.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.665+0000 7f92fe614800 20 remove_watcher() i=5 2024-03-09T14:38:43.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.666+0000 7f92fe614800 20 remove_watcher() i=6 2024-03-09T14:38:43.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:43.667+0000 7f92fe614800 20 remove_watcher() i=7 2024-03-09T14:38:48.685 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:38:48.717 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:48.717 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:48.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.756+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.758+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.758+0000 7f89e9ac0800 20 realm 2024-03-09T14:38:48.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.758+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.759+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.759+0000 7f89e9ac0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:48.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.759+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.759+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.759+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.760+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:48.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.760+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.761+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:48.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.761+0000 7f89e9ac0800 20 searching for the correct realm 2024-03-09T14:38:48.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.764+0000 7f89e75c3640 0 -- 172.21.15.46:0/2766499995 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f89e008f050 msgr2=0x7f89e005b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:48.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.768+0000 7f89e75c3640 0 -- 172.21.15.46:0/2766499995 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f89dc05e070 msgr2=0x7f89dc003530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:48.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:48.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:48.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.975+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 20 zone default found 2024-03-09T14:38:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 4 Realm: () 2024-03-09T14:38:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:48.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:48.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 20 zonegroup default 2024-03-09T14:38:48.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.976+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.977+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.977+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.977+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.977+0000 7f89e9ac0800 20 started sync module instance, tier type = 2024-03-09T14:38:48.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.977+0000 7f89e9ac0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=0 2024-03-09T14:38:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=1 2024-03-09T14:38:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=2 2024-03-09T14:38:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=3 2024-03-09T14:38:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=4 2024-03-09T14:38:48.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=5 2024-03-09T14:38:48.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.988+0000 7f89e9ac0800 20 add_watcher() i=6 2024-03-09T14:38:48.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.989+0000 7f89e9ac0800 20 add_watcher() i=7 2024-03-09T14:38:48.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.989+0000 7f89e9ac0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:48.994 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f889dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:48.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f89e9ac0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:48.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f89e9ac0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:48.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f89e9ac0800 5 note: GC not initialized 2024-03-09T14:38:48.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f889cfe1640 20 reqs_thread_entry: start 2024-03-09T14:38:48.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f89e9ac0800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f89e9ac0800 20 Filter name: none 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.992+0000 7f88167fc640 20 reqs_thread_entry: start 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.993+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.993+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.993+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.994+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:48.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.994+0000 7f89e9ac0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:48.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.994+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.994+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:48.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.994+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.995+0000 7f89e9ac0800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:48.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.995+0000 7f89e9ac0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:48.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.995+0000 7f89e9ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:48.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.996+0000 7f89e9ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:48.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.997+0000 7f889dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:48.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.999+0000 7f89e9ac0800 20 remove_watcher() i=0 2024-03-09T14:38:48.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:48.999+0000 7f89e9ac0800 2 removed watcher, disabling cache 2024-03-09T14:38:49.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.000+0000 7f89e9ac0800 20 remove_watcher() i=1 2024-03-09T14:38:49.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.001+0000 7f89e9ac0800 20 remove_watcher() i=2 2024-03-09T14:38:49.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.003+0000 7f89e9ac0800 20 remove_watcher() i=3 2024-03-09T14:38:49.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.004+0000 7f89e9ac0800 20 remove_watcher() i=4 2024-03-09T14:38:49.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.005+0000 7f89e9ac0800 20 remove_watcher() i=5 2024-03-09T14:38:49.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.006+0000 7f89e9ac0800 20 remove_watcher() i=6 2024-03-09T14:38:49.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.007+0000 7f89e9ac0800 20 remove_watcher() i=7 2024-03-09T14:38:49.019 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:49.019 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:49.019 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: a-bucket id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-03-09T14:38:49.019 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:49.019 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard add non empty bucket 2024-03-09T14:38:49.019 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:49.024 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.024 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.060 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.060 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.094 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.094 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.126 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.126 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.159 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.159 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.190 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.191 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.222 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.222 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.255 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:49.255 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:49.287 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:38:49.314 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:49.314 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:49.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.347+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 realm 2024-03-09T14:38:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.349+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.350+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:49.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.350+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.351+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:49.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.351+0000 7f2b8c333800 20 searching for the correct realm 2024-03-09T14:38:49.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.355+0000 7f2b8886c640 0 -- 172.21.15.46:0/3906690512 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f2b7c06b7f0 msgr2=0x7f2b7c0827d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:49.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.562+0000 7f2b8806b640 0 -- 172.21.15.46:0/3906690512 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x56370055f060 msgr2=0x563700561500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:49.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:49.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:49.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:49.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:49.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:49.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:49.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.564+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 zone default found 2024-03-09T14:38:49.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 4 Realm: () 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 zonegroup default 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.565+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 started sync module instance, tier type = 2024-03-09T14:38:49.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.566+0000 7f2b8c333800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=0 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=1 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=2 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=3 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=4 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=5 2024-03-09T14:38:49.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.576+0000 7f2b8c333800 20 add_watcher() i=6 2024-03-09T14:38:49.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.577+0000 7f2b8c333800 20 add_watcher() i=7 2024-03-09T14:38:49.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.577+0000 7f2b8c333800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:49.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2a3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2b8c333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2b8c333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2b8c333800 5 note: GC not initialized 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2a3dfdb640 20 reqs_thread_entry: start 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2b8c333800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2b8c333800 20 Filter name: none 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f29af7fe640 20 reqs_thread_entry: start 2024-03-09T14:38:49.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.580+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.581+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:49.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.581+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.581+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:49.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.581+0000 7f2b8c333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:49.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.581+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.582+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:49.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.582+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.582+0000 7f2b8c333800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:49.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.582+0000 7f2b8c333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:49.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.583+0000 7f2b8c333800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.583+0000 7f2b8c333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.584+0000 7f2a3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:49.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.587+0000 7f2b8c333800 20 remove_watcher() i=0 2024-03-09T14:38:49.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.587+0000 7f2b8c333800 2 removed watcher, disabling cache 2024-03-09T14:38:49.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.588+0000 7f2b8c333800 20 remove_watcher() i=1 2024-03-09T14:38:49.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.589+0000 7f2b8c333800 20 remove_watcher() i=2 2024-03-09T14:38:49.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.590+0000 7f2b8c333800 20 remove_watcher() i=3 2024-03-09T14:38:49.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.591+0000 7f2b8c333800 20 remove_watcher() i=4 2024-03-09T14:38:49.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.592+0000 7f2b8c333800 20 remove_watcher() i=5 2024-03-09T14:38:49.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.593+0000 7f2b8c333800 20 remove_watcher() i=6 2024-03-09T14:38:49.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.594+0000 7f2b8c333800 20 remove_watcher() i=7 2024-03-09T14:38:49.604 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:49.604 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:49.604 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: a-bucket id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-03-09T14:38:49.605 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:49.606 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-03-09T14:38:49.635 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:49.635 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:49.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.668+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 realm 2024-03-09T14:38:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.669+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.670+0000 7f10d9212800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:49.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.670+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.671+0000 7f10d9212800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:49.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.671+0000 7f10d9212800 20 searching for the correct realm 2024-03-09T14:38:49.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.675+0000 7f10d515f640 0 -- 172.21.15.46:0/4062450850 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f10c8090070 msgr2=0x7f10c805dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:49.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.881+0000 7f10d495e640 0 -- 172.21.15.46:0/4062450850 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55de79316750 msgr2=0x55de79318b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:49.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:49.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:49.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:49.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:49.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:49.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:49.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.884+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.885+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.885+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.885+0000 7f10d9212800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.885+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 zone default found 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 4 Realm: () 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:49.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:49.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:49.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 zonegroup default 2024-03-09T14:38:49.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.886+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.887+0000 7f10d9212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.887+0000 7f10d9212800 20 started sync module instance, tier type = 2024-03-09T14:38:49.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.887+0000 7f10d9212800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:49.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=0 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=1 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=2 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=3 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=4 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=5 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.896+0000 7f10d9212800 20 add_watcher() i=6 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.897+0000 7f10d9212800 20 add_watcher() i=7 2024-03-09T14:38:49.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.897+0000 7f10d9212800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:49.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f0f8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 5 note: GC not initialized 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f0f89fe3640 20 reqs_thread_entry: start 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 20 Filter name: none 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f0efb7fe640 20 reqs_thread_entry: start 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:38:49.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.899+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : miss 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:49.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:49.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:49.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:49.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.900+0000 7f10d9212800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:38:49.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.902+0000 7f0f8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:49.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.905+0000 7f10d9212800 20 remove_watcher() i=0 2024-03-09T14:38:49.906 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.905+0000 7f10d9212800 2 removed watcher, disabling cache 2024-03-09T14:38:49.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.906+0000 7f10d9212800 20 remove_watcher() i=1 2024-03-09T14:38:49.908 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.907+0000 7f10d9212800 20 remove_watcher() i=2 2024-03-09T14:38:49.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.909+0000 7f10d9212800 20 remove_watcher() i=3 2024-03-09T14:38:49.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.910+0000 7f10d9212800 20 remove_watcher() i=4 2024-03-09T14:38:49.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.911+0000 7f10d9212800 20 remove_watcher() i=5 2024-03-09T14:38:49.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.911+0000 7f10d9212800 20 remove_watcher() i=6 2024-03-09T14:38:49.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.912+0000 7f10d9212800 20 remove_watcher() i=7 2024-03-09T14:38:49.926 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin reshard list 2024-03-09T14:38:49.950 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:49.951 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:49.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.983+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.984+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.984+0000 7f679ac13800 20 realm 2024-03-09T14:38:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.984+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.985+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.985+0000 7f679ac13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:49.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.985+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.985+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:49.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.985+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.986+0000 7f679ac13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:49.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.986+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:49.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.987+0000 7f679ac13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:49.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.987+0000 7f679ac13800 20 searching for the correct realm 2024-03-09T14:38:49.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:49.991+0000 7f6796bcd640 0 -- 172.21.15.46:0/3996972565 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f678c031040 msgr2=0x7f678c03e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:50.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.198+0000 7f67963cc640 0 -- 172.21.15.46:0/3996972565 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x564853e96950 msgr2=0x564853e98d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:50.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:50.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:50.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:50.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:50.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:50.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:50.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.201+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 zone default found 2024-03-09T14:38:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 4 Realm: () 2024-03-09T14:38:50.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 zonegroup default 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.202+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.203+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.203+0000 7f679ac13800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.203+0000 7f679ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.203+0000 7f679ac13800 20 started sync module instance, tier type = 2024-03-09T14:38:50.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.203+0000 7f679ac13800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:50.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=0 2024-03-09T14:38:50.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=1 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=2 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=3 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=4 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=5 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.212+0000 7f679ac13800 20 add_watcher() i=6 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.213+0000 7f679ac13800 20 add_watcher() i=7 2024-03-09T14:38:50.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.213+0000 7f679ac13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:50.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.215+0000 7f664cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:50.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.215+0000 7f679ac13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:50.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.215+0000 7f679ac13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:50.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.215+0000 7f679ac13800 5 note: GC not initialized 2024-03-09T14:38:50.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.215+0000 7f65c77fe640 20 reqs_thread_entry: start 2024-03-09T14:38:50.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.216+0000 7f679ac13800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:50.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.216+0000 7f679ac13800 20 Filter name: none 2024-03-09T14:38:50.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.216+0000 7f65c57fa640 20 reqs_thread_entry: start 2024-03-09T14:38:50.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.222+0000 7f664cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:50.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.224+0000 7f679ac13800 20 remove_watcher() i=0 2024-03-09T14:38:50.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.224+0000 7f679ac13800 2 removed watcher, disabling cache 2024-03-09T14:38:50.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.225+0000 7f679ac13800 20 remove_watcher() i=1 2024-03-09T14:38:50.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.226+0000 7f679ac13800 20 remove_watcher() i=2 2024-03-09T14:38:50.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.228+0000 7f679ac13800 20 remove_watcher() i=3 2024-03-09T14:38:50.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.229+0000 7f679ac13800 20 remove_watcher() i=4 2024-03-09T14:38:50.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.230+0000 7f679ac13800 20 remove_watcher() i=5 2024-03-09T14:38:50.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.230+0000 7f679ac13800 20 remove_watcher() i=6 2024-03-09T14:38:50.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.231+0000 7f679ac13800 20 remove_watcher() i=7 2024-03-09T14:38:50.242 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard process non empty bucket 2024-03-09T14:38:50.242 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:50.244 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin reshard process 2024-03-09T14:38:50.270 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:50.270 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:50.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.306+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.307+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.307+0000 7fc358d2f800 20 realm 2024-03-09T14:38:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.307+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.308+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.308+0000 7fc358d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.308+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.308+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.308+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.309+0000 7fc358d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:50.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.309+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.310+0000 7fc358d2f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:50.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.310+0000 7fc358d2f800 20 searching for the correct realm 2024-03-09T14:38:50.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.311+0000 7fc34ffff640 0 -- 172.21.15.46:0/2220806758 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fc34802c070 msgr2=0x7fc348051920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:50.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.517+0000 7fc3549b0640 0 -- 172.21.15.46:0/2220806758 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fc340013030 msgr2=0x7fc340013920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:50.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.724+0000 7fc358d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:50.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.724+0000 7fc358d2f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:50.726 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.724+0000 7fc358d2f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:50.727 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.725+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:50.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 zone default found 2024-03-09T14:38:50.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 4 Realm: () 2024-03-09T14:38:50.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:50.728 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 zonegroup default 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.726+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.727+0000 7fc358d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.727+0000 7fc358d2f800 20 started sync module instance, tier type = 2024-03-09T14:38:50.729 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.727+0000 7fc358d2f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=0 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=1 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=2 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=3 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=4 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=5 2024-03-09T14:38:50.738 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.737+0000 7fc358d2f800 20 add_watcher() i=6 2024-03-09T14:38:50.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.738+0000 7fc358d2f800 20 add_watcher() i=7 2024-03-09T14:38:50.739 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.738+0000 7fc358d2f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:50.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.740+0000 7fc20afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.740+0000 7fc358d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.740+0000 7fc358d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.740+0000 7fc358d2f800 5 note: GC not initialized 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.740+0000 7fc209fe3640 20 reqs_thread_entry: start 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.740+0000 7fc358d2f800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.741+0000 7fc358d2f800 20 Filter name: none 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.741+0000 7fc17b7fe640 20 reqs_thread_entry: start 2024-03-09T14:38:50.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.741+0000 7fc358d2f800 20 processing logshard = reshard.0000000000 2024-03-09T14:38:50.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.744+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-09T14:38:50.745 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.744+0000 7fc358d2f800 20 processing logshard = reshard.0000000001 2024-03-09T14:38:50.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.746+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-09T14:38:50.747 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.746+0000 7fc358d2f800 20 processing logshard = reshard.0000000002 2024-03-09T14:38:50.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.749+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-09T14:38:50.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.749+0000 7fc358d2f800 20 processing logshard = reshard.0000000003 2024-03-09T14:38:50.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.752+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-09T14:38:50.753 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.752+0000 7fc358d2f800 20 processing logshard = reshard.0000000004 2024-03-09T14:38:50.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.755+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-09T14:38:50.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.755+0000 7fc358d2f800 20 processing logshard = reshard.0000000005 2024-03-09T14:38:50.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.758+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-09T14:38:50.759 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.758+0000 7fc358d2f800 20 processing logshard = reshard.0000000006 2024-03-09T14:38:50.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.759+0000 7fc358d2f800 20 process_entry resharding a-bucket 2024-03-09T14:38:50.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.759+0000 7fc358d2f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:38:50.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.759+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:50.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-09T14:38:50.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : miss 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:50.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.760+0000 7fc358d2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:38:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.765+0000 7fc358d2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.765+0000 7fc358d2f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.765+0000 7fc358d2f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.765+0000 7fc358d2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17, ofs0, ns] 2024-03-09T14:38:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.766+0000 7fc22b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595102 cookie 94203996603488 notifier 6087 bl.length()=819 2024-03-09T14:38:50.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.766+0000 7fc22b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:50.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.766+0000 7fc22b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:50.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.766+0000 7fc22b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:50.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.768+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_sources= new_sources= 2024-03-09T14:38:50.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.768+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential sources added=[] removed=[] 2024-03-09T14:38:50.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.768+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_dests= new_dests= 2024-03-09T14:38:50.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.768+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential dests added=[] removed=[] 2024-03-09T14:38:50.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 2024-03-09T14:38:50.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 2024-03-09T14:38:50.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.1 2024-03-09T14:38:50.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.1 2024-03-09T14:38:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.2 2024-03-09T14:38:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.2 2024-03-09T14:38:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.0 2024-03-09T14:38:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.0 2024-03-09T14:38:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.1 2024-03-09T14:38:50.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.769+0000 7fc358d2f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.1.1 2024-03-09T14:38:50.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.771+0000 7fc358d2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : hit (requested=0x17, cached=0x17) 2024-03-09T14:38:50.772 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.771+0000 7fc358d2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:38:50.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc358d2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:50.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc358d2f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:50.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc358d2f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:50.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc358d2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17, ofs0, ns] 2024-03-09T14:38:50.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc22b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595103 cookie 94203996603488 notifier 6087 bl.length()=787 2024-03-09T14:38:50.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc22b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:38:50.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc22b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:38:50.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.773+0000 7fc22b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:38:50.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.774+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_sources= new_sources= 2024-03-09T14:38:50.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.774+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential sources added=[] removed=[] 2024-03-09T14:38:50.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.774+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_dests= new_dests= 2024-03-09T14:38:50.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.774+0000 7fc358d2f800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential dests added=[] removed=[] 2024-03-09T14:38:50.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.776+0000 7fc358d2f800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:38:50.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.777+0000 7fc358d2f800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-09T14:38:50.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.779+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-09T14:38:50.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.779+0000 7fc358d2f800 20 processing logshard = reshard.0000000007 2024-03-09T14:38:50.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.781+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-09T14:38:50.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.781+0000 7fc358d2f800 20 processing logshard = reshard.0000000008 2024-03-09T14:38:50.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.784+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-09T14:38:50.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.784+0000 7fc358d2f800 20 processing logshard = reshard.0000000009 2024-03-09T14:38:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.787+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-09T14:38:50.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.787+0000 7fc358d2f800 20 processing logshard = reshard.0000000010 2024-03-09T14:38:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.789+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-09T14:38:50.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.789+0000 7fc358d2f800 20 processing logshard = reshard.0000000011 2024-03-09T14:38:50.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.792+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-09T14:38:50.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.792+0000 7fc358d2f800 20 processing logshard = reshard.0000000012 2024-03-09T14:38:50.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.795+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-09T14:38:50.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.795+0000 7fc358d2f800 20 processing logshard = reshard.0000000013 2024-03-09T14:38:50.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.797+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-09T14:38:50.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.797+0000 7fc358d2f800 20 processing logshard = reshard.0000000014 2024-03-09T14:38:50.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.800+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-09T14:38:50.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.800+0000 7fc358d2f800 20 processing logshard = reshard.0000000015 2024-03-09T14:38:50.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.802+0000 7fc358d2f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-09T14:38:50.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.803+0000 7fc20afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:50.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.806+0000 7fc358d2f800 20 remove_watcher() i=0 2024-03-09T14:38:50.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.806+0000 7fc358d2f800 2 removed watcher, disabling cache 2024-03-09T14:38:50.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.807+0000 7fc358d2f800 20 remove_watcher() i=1 2024-03-09T14:38:50.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.808+0000 7fc358d2f800 20 remove_watcher() i=2 2024-03-09T14:38:50.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.809+0000 7fc358d2f800 20 remove_watcher() i=3 2024-03-09T14:38:50.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.810+0000 7fc358d2f800 20 remove_watcher() i=4 2024-03-09T14:38:50.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.811+0000 7fc358d2f800 20 remove_watcher() i=5 2024-03-09T14:38:50.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.812+0000 7fc358d2f800 20 remove_watcher() i=6 2024-03-09T14:38:50.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.813+0000 7fc358d2f800 20 remove_watcher() i=7 2024-03-09T14:38:50.827 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:38:50.854 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:50.854 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:50.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.888+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 realm 2024-03-09T14:38:50.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.891 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:50.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:50.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.890+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.891+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:50.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.891+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:50.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.892+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:50.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.892+0000 7fe6e4533800 20 searching for the correct realm 2024-03-09T14:38:50.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:50.892+0000 7fe6e09f8640 0 -- 172.21.15.46:0/2292780218 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x561b29be7a00 msgr2=0x561b29be9ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:51.099 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.098+0000 7fe6e09f8640 0 -- 172.21.15.46:0/2292780218 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7fe6d403a070 msgr2=0x7fe6d401b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:51.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:51.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.307+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.308+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:51.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.308+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.308+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.308+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 zone default found 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 4 Realm: () 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:51.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 zonegroup default 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.309+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.310+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.310+0000 7fe6e4533800 20 started sync module instance, tier type = 2024-03-09T14:38:51.312 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.310+0000 7fe6e4533800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=0 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=1 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=2 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=3 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=4 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=5 2024-03-09T14:38:51.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.320+0000 7fe6e4533800 20 add_watcher() i=6 2024-03-09T14:38:51.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.321+0000 7fe6e4533800 20 add_watcher() i=7 2024-03-09T14:38:51.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.321+0000 7fe6e4533800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:51.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe6e4533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe6e4533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe6e4533800 5 note: GC not initialized 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe595fdb640 20 reqs_thread_entry: start 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe6e4533800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe6e4533800 20 Filter name: none 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.323+0000 7fe5077fe640 20 reqs_thread_entry: start 2024-03-09T14:38:51.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.324+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.324+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.324+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.324+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.324+0000 7fe6e4533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.324+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.325+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:38:51.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.325+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.325+0000 7fe6e4533800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:38:51.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.325+0000 7fe6e4533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:51.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.326+0000 7fe6e4533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:51.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.326+0000 7fe6e4533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:51.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.327+0000 7fe596fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:51.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.330+0000 7fe6e4533800 20 remove_watcher() i=0 2024-03-09T14:38:51.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.330+0000 7fe6e4533800 2 removed watcher, disabling cache 2024-03-09T14:38:51.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.331+0000 7fe6e4533800 20 remove_watcher() i=1 2024-03-09T14:38:51.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.332+0000 7fe6e4533800 20 remove_watcher() i=2 2024-03-09T14:38:51.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.333+0000 7fe6e4533800 20 remove_watcher() i=3 2024-03-09T14:38:51.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.334+0000 7fe6e4533800 20 remove_watcher() i=4 2024-03-09T14:38:51.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.335+0000 7fe6e4533800 20 remove_watcher() i=5 2024-03-09T14:38:51.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.337+0000 7fe6e4533800 20 remove_watcher() i=6 2024-03-09T14:38:51.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:51.338+0000 7fe6e4533800 20 remove_watcher() i=7 2024-03-09T14:38:51.350 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:51.350 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:51.350 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: a-bucket id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-03-09T14:38:51.353 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:51.354 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-03-09T14:38:51.354 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:51.354 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.355 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.400 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.400 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.462 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.462 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.496 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.496 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.528 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.529 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.561 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.562 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.593 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.593 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.626 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.626 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.660 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.660 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.693 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.693 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.725 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.726 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.758 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.759 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.791 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.791 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.824 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.824 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.856 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.856 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.888 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.888 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.922 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.923 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.954 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.955 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:51.987 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:51.987 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:52.020 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:52.020 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:52.053 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:52.054 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:52.086 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:52.086 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:52.120 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:38:52.147 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:52.147 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:52.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.180+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 realm 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.181+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.182+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.182+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.183+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:52.185 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.183+0000 7f3500212800 20 searching for the correct realm 2024-03-09T14:38:52.188 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.187+0000 7f34fb15d640 0 -- 172.21.15.46:0/1973740048 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x56112bae2b40 msgr2=0x56112bae4f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:52.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.191+0000 7f34fb15d640 0 -- 172.21.15.46:0/1973740048 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x7f33c407ad10 msgr2=0x7f33c407d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:52.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:52.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.196+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:52.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 zone default found 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 4 Realm: () 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 zonegroup default 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.197+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.198+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.198+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.198+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.198+0000 7f3500212800 20 started sync module instance, tier type = 2024-03-09T14:38:52.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.198+0000 7f3500212800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:52.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=0 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=1 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=2 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=3 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=4 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=5 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.207+0000 7f3500212800 20 add_watcher() i=6 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.208+0000 7f3500212800 20 add_watcher() i=7 2024-03-09T14:38:52.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.208+0000 7f3500212800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:52.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.211+0000 7f33b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:52.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.211+0000 7f3500212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:52.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.211+0000 7f3500212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:52.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.211+0000 7f3500212800 5 note: GC not initialized 2024-03-09T14:38:52.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.211+0000 7f33b0fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:52.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.211+0000 7f3500212800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:52.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.212+0000 7f3500212800 20 Filter name: none 2024-03-09T14:38:52.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.212+0000 7f332a7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:52.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.212+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.212+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:52.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.212+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:52.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.213+0000 7f3500212800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.214+0000 7f3500212800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.214+0000 7f3500212800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.215+0000 7f33b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:52.218 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.217+0000 7f3500212800 20 remove_watcher() i=0 2024-03-09T14:38:52.219 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.217+0000 7f3500212800 2 removed watcher, disabling cache 2024-03-09T14:38:52.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.219+0000 7f3500212800 20 remove_watcher() i=1 2024-03-09T14:38:52.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.220+0000 7f3500212800 20 remove_watcher() i=2 2024-03-09T14:38:52.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.221+0000 7f3500212800 20 remove_watcher() i=3 2024-03-09T14:38:52.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.222+0000 7f3500212800 20 remove_watcher() i=4 2024-03-09T14:38:52.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.223+0000 7f3500212800 20 remove_watcher() i=5 2024-03-09T14:38:52.225 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.224+0000 7f3500212800 20 remove_watcher() i=6 2024-03-09T14:38:52.226 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.225+0000 7f3500212800 20 remove_watcher() i=7 2024-03-09T14:38:52.235 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:52.235 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:52.236 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:38:52.236 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:52.237 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-03-09T14:38:52.270 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:52.270 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:52.303 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.302+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.304 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 realm 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.303+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.304+0000 7f8e3d531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.304+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.305+0000 7f8e3d531800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:52.307 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.305+0000 7f8e3d531800 20 searching for the correct realm 2024-03-09T14:38:52.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.308+0000 7f8e39a65640 0 -- 172.21.15.46:0/1581667130 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x5571c6546790 msgr2=0x5571c6548c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:52.313 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.312+0000 7f8e39264640 0 -- 172.21.15.46:0/1581667130 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f8e240651d0 msgr2=0x7f8e24067a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:52.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:52.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:52.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:52.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:52.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:52.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:52.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.317+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 zone default found 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 4 Realm: () 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 zonegroup default 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.318+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.319+0000 7f8e3d531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.319+0000 7f8e3d531800 20 started sync module instance, tier type = 2024-03-09T14:38:52.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.319+0000 7f8e3d531800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:52.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=0 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=1 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=2 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=3 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=4 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=5 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.327+0000 7f8e3d531800 20 add_watcher() i=6 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.328+0000 7f8e3d531800 20 add_watcher() i=7 2024-03-09T14:38:52.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.328+0000 7f8e3d531800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:52.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.330+0000 7f8cef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:52.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.330+0000 7f8e3d531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:52.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.330+0000 7f8e3d531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.330+0000 7f8e3d531800 5 note: GC not initialized 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.330+0000 7f8cee7e4640 20 reqs_thread_entry: start 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 20 Filter name: none 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8c5ffff640 20 reqs_thread_entry: start 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 : miss 2024-03-09T14:38:52.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.331+0000 7f8e3d531800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.332+0000 7f8e3d531800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:52.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.332+0000 7f8e3d531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 info.flags=0x17 2024-03-09T14:38:52.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.332+0000 7f8e3d531800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 to cache LRU end 2024-03-09T14:38:52.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.332+0000 7f8e3d531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:52.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.332+0000 7f8e3d531800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:52.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.332+0000 7f8e3d531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 2024-03-09T14:38:52.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.334+0000 7f8e3d531800 -1 Injecting error=-5 at location=set_target_layout 2024-03-09T14:38:52.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.334+0000 7f8e3d531800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-03-09T14:38:52.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.337+0000 7f8cef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:52.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.340+0000 7f8e3d531800 20 remove_watcher() i=0 2024-03-09T14:38:52.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.340+0000 7f8e3d531800 2 removed watcher, disabling cache 2024-03-09T14:38:52.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.341+0000 7f8e3d531800 20 remove_watcher() i=1 2024-03-09T14:38:52.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.342+0000 7f8e3d531800 20 remove_watcher() i=2 2024-03-09T14:38:52.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.343+0000 7f8e3d531800 20 remove_watcher() i=3 2024-03-09T14:38:52.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.344+0000 7f8e3d531800 20 remove_watcher() i=4 2024-03-09T14:38:52.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.345+0000 7f8e3d531800 20 remove_watcher() i=5 2024-03-09T14:38:52.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.346+0000 7f8e3d531800 20 remove_watcher() i=6 2024-03-09T14:38:52.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.347+0000 7f8e3d531800 20 remove_watcher() i=7 2024-03-09T14:38:52.359 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:38:52.386 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:52.387 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:52.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.420+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 realm 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.422+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.423+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.423+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.424+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:52.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.424+0000 7fecb4844800 20 searching for the correct realm 2024-03-09T14:38:52.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.426+0000 7fecb2347640 0 -- 172.21.15.46:0/3994068358 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7feca0003ab0 msgr2=0x7fecac08d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:52.430 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.429+0000 7fecb2347640 0 -- 172.21.15.46:0/3994068358 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7feb7c07ace0 msgr2=0x7feb7c07d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.435+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 zone default found 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 4 Realm: () 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 zonegroup default 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.436+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.437+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.437+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.437+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.437+0000 7fecb4844800 20 started sync module instance, tier type = 2024-03-09T14:38:52.440 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.437+0000 7fecb4844800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=0 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=1 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=2 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=3 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=4 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=5 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=6 2024-03-09T14:38:52.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 20 add_watcher() i=7 2024-03-09T14:38:52.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.446+0000 7fecb4844800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:52.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.448+0000 7feb68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:52.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.448+0000 7fecb4844800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:52.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.448+0000 7fecb4844800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:52.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.448+0000 7fecb4844800 5 note: GC not initialized 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7feae37fe640 20 reqs_thread_entry: start 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7fecb4844800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7fecb4844800 20 Filter name: none 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7feae17fa640 20 reqs_thread_entry: start 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:52.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.449+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:52.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:52.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:52.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:52.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.450+0000 7fecb4844800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:52.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.451+0000 7fecb4844800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.451+0000 7fecb4844800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.452+0000 7feb68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:52.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.454+0000 7fecb4844800 20 remove_watcher() i=0 2024-03-09T14:38:52.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.454+0000 7fecb4844800 2 removed watcher, disabling cache 2024-03-09T14:38:52.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.455+0000 7fecb4844800 20 remove_watcher() i=1 2024-03-09T14:38:52.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.456+0000 7fecb4844800 20 remove_watcher() i=2 2024-03-09T14:38:52.458 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.457+0000 7fecb4844800 20 remove_watcher() i=3 2024-03-09T14:38:52.459 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.458+0000 7fecb4844800 20 remove_watcher() i=4 2024-03-09T14:38:52.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.459+0000 7fecb4844800 20 remove_watcher() i=5 2024-03-09T14:38:52.461 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.460+0000 7fecb4844800 20 remove_watcher() i=6 2024-03-09T14:38:52.462 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.461+0000 7fecb4844800 20 remove_watcher() i=7 2024-03-09T14:38:52.472 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:52.472 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:52.472 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:38:52.472 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:52.474 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:52.474 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:52.504 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:52.504 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:52.563 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:38:52.593 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:52.593 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:52.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.825+0000 7f3b186ba640 0 --2- 172.21.15.46:0/2241421211 >> [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] conn(0x55cfc4558d60 0x55cfc4555ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:38:52.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.827+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.828+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.828+0000 7f3b1d128800 20 realm 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.828+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.828+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.828+0000 7f3b1d128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.828+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.829+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:52.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.829+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.830+0000 7f3b1d128800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:52.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.830+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:52.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.831+0000 7f3b1d128800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:52.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.831+0000 7f3b1d128800 20 searching for the correct realm 2024-03-09T14:38:52.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:52.833+0000 7f3b186ba640 0 -- 172.21.15.46:0/2241421211 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f3b0808e040 msgr2=0x7f3b08067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:53.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.039+0000 7f3b18ebb640 0 -- 172.21.15.46:0/2241421211 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f3b0c0422a0 msgr2=0x7f3b0c0378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:53.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:53.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.246+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:53.249 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 zone default found 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 4 Realm: () 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 zonegroup default 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.247+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.248+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.248+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.248+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.248+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.249+0000 7f3b1d128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.249+0000 7f3b1d128800 20 started sync module instance, tier type = 2024-03-09T14:38:53.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.249+0000 7f3b1d128800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:53.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=0 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=1 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=2 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=3 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=4 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=5 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.260+0000 7f3b1d128800 20 add_watcher() i=6 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.261+0000 7f3b1d128800 20 add_watcher() i=7 2024-03-09T14:38:53.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.261+0000 7f3b1d128800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:53.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.263+0000 7f39cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.263+0000 7f3b1d128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.263+0000 7f3b1d128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f3b1d128800 5 note: GC not initialized 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f39cdfe3640 20 reqs_thread_entry: start 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f3b1d128800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f3b1d128800 20 Filter name: none 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f393f7fe640 20 reqs_thread_entry: start 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f3b1d128800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:38:53.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.264+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:38:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:38:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 : miss 2024-03-09T14:38:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 info.flags=0x17 2024-03-09T14:38:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 to cache LRU end 2024-03-09T14:38:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:53.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.265+0000 7f3b1d128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 2024-03-09T14:38:53.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.269+0000 7f3b1d128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 info.flags=0x17 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.269+0000 7f3b1d128800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 to cache LRU end 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.269+0000 7f3b1d128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.269+0000 7f3b1d128800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19, ofs0, ns] 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.270+0000 7f39effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94350840708240 notifier 5900 bl.length()=917 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.270+0000 7f39effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 info.flags=0x17 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.270+0000 7f39effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 to cache LRU end 2024-03-09T14:38:53.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.270+0000 7f39effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:53.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.272+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): orig_sources= new_sources= 2024-03-09T14:38:53.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.272+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): potential sources added=[] removed=[] 2024-03-09T14:38:53.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.272+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): orig_dests= new_dests= 2024-03-09T14:38:53.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.272+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): potential dests added=[] removed=[] 2024-03-09T14:38:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.274+0000 7f3b1d128800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19.1.0 2024-03-09T14:38:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.274+0000 7f3b1d128800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19.1.0 2024-03-09T14:38:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.274+0000 7f3b1d128800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19.1.1 2024-03-09T14:38:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.274+0000 7f3b1d128800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19.1.1 2024-03-09T14:38:53.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.274+0000 7f3b1d128800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19.0 2024-03-09T14:38:53.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.276+0000 7f3b1d128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 : hit (requested=0x17, cached=0x17) 2024-03-09T14:38:53.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.276+0000 7f3b1d128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 2024-03-09T14:38:53.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f3b1d128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 info.flags=0x17 2024-03-09T14:38:53.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f3b1d128800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 to cache LRU end 2024-03-09T14:38:53.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f3b1d128800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:53.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f3b1d128800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19, ofs0, ns] 2024-03-09T14:38:53.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f39ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 94350840708240 notifier 5900 bl.length()=885 2024-03-09T14:38:53.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f39ef7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 info.flags=0x17 2024-03-09T14:38:53.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f39ef7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 to cache LRU end 2024-03-09T14:38:53.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.278+0000 7f39ef7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:53.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.280+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): orig_sources= new_sources= 2024-03-09T14:38:53.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.280+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): potential sources added=[] removed=[] 2024-03-09T14:38:53.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.280+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): orig_dests= new_dests= 2024-03-09T14:38:53.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.280+0000 7f3b1d128800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19]): potential dests added=[] removed=[] 2024-03-09T14:38:53.282 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.281+0000 7f3b1d128800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-09T14:38:53.284 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.283+0000 7f39cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:53.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.286+0000 7f3b1d128800 20 remove_watcher() i=0 2024-03-09T14:38:53.287 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.286+0000 7f3b1d128800 2 removed watcher, disabling cache 2024-03-09T14:38:53.288 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.287+0000 7f3b1d128800 20 remove_watcher() i=1 2024-03-09T14:38:53.289 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.288+0000 7f3b1d128800 20 remove_watcher() i=2 2024-03-09T14:38:53.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.289+0000 7f3b1d128800 20 remove_watcher() i=3 2024-03-09T14:38:53.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.291+0000 7f3b1d128800 20 remove_watcher() i=4 2024-03-09T14:38:53.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.292+0000 7f3b1d128800 20 remove_watcher() i=5 2024-03-09T14:38:53.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.293+0000 7f3b1d128800 20 remove_watcher() i=6 2024-03-09T14:38:53.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.294+0000 7f3b1d128800 20 remove_watcher() i=7 2024-03-09T14:38:53.308 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:38:53.336 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:53.337 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:53.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.371+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.372+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.372+0000 7f4055b33800 20 realm 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.372+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.372+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.372+0000 7f4055b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.372+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.373+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.373+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.374+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:53.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.374+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.375+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:53.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.375+0000 7f4055b33800 20 searching for the correct realm 2024-03-09T14:38:53.379 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.378+0000 7f405186b640 0 -- 172.21.15.46:0/469500571 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f404c05b410 msgr2=0x7f404c05b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:53.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.381+0000 7f405186b640 0 -- 172.21.15.46:0/469500571 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f4048056600 msgr2=0x7f40480589d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 zone default found 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 4 Realm: () 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.387+0000 7f4055b33800 20 zonegroup default 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 started sync module instance, tier type = 2024-03-09T14:38:53.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.388+0000 7f4055b33800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:53.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=0 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=1 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=2 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=3 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=4 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=5 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.397+0000 7f4055b33800 20 add_watcher() i=6 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.398+0000 7f4055b33800 20 add_watcher() i=7 2024-03-09T14:38:53.399 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.398+0000 7f4055b33800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:53.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.400+0000 7f3f037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.400+0000 7f4055b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.400+0000 7f4055b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.400+0000 7f4055b33800 5 note: GC not initialized 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.400+0000 7f3f027fc640 20 reqs_thread_entry: start 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.401+0000 7f4055b33800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.401+0000 7f4055b33800 20 Filter name: none 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.401+0000 7f3e73fff640 20 reqs_thread_entry: start 2024-03-09T14:38:53.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.401+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.401+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:53.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.401+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:53.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.402+0000 7f4055b33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.403+0000 7f4055b33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:53.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.403+0000 7f4055b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:53.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.404+0000 7f3f037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:53.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.406+0000 7f4055b33800 20 remove_watcher() i=0 2024-03-09T14:38:53.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.406+0000 7f4055b33800 2 removed watcher, disabling cache 2024-03-09T14:38:53.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.407+0000 7f4055b33800 20 remove_watcher() i=1 2024-03-09T14:38:53.409 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.408+0000 7f4055b33800 20 remove_watcher() i=2 2024-03-09T14:38:53.410 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.409+0000 7f4055b33800 20 remove_watcher() i=3 2024-03-09T14:38:53.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.410+0000 7f4055b33800 20 remove_watcher() i=4 2024-03-09T14:38:53.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.411+0000 7f4055b33800 20 remove_watcher() i=5 2024-03-09T14:38:53.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.412+0000 7f4055b33800 20 remove_watcher() i=6 2024-03-09T14:38:53.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:53.413+0000 7f4055b33800 20 remove_watcher() i=7 2024-03-09T14:38:53.425 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:53.425 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:53.425 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:38:53.425 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:53.426 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.427 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.450 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.450 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.637 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.637 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.706 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-03-09T14:38:53.706 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:53.707 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.707 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.748 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.748 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.806 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.806 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.840 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.841 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.873 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.873 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.905 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.905 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.938 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.938 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:53.972 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:53.972 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.004 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.005 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.038 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.038 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.071 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.071 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.105 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.105 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.137 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.137 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.170 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.170 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.203 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.203 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.236 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.236 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.268 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.268 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.302 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.302 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.335 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.335 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.367 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.368 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.400 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.400 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.434 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:54.434 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:54.469 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:38:54.496 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:54.496 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:54.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.528+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 realm 2024-03-09T14:38:54.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:54.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.530+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.532+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:54.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.532+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.532+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:54.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.532+0000 7f7b99533800 20 searching for the correct realm 2024-03-09T14:38:54.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.536+0000 7f7b95a65640 0 -- 172.21.15.46:0/74555541 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55ddc24ccac0 msgr2=0x55ddc24cef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:54.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.540+0000 7f7b95264640 0 -- 172.21.15.46:0/74555541 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f7b8c009040 msgr2=0x7f7b8c074740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:54.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.544+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 zone default found 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 4 Realm: () 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 zonegroup default 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.545+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.546+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.546+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.546+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.546+0000 7f7b99533800 20 started sync module instance, tier type = 2024-03-09T14:38:54.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.546+0000 7f7b99533800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=0 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=1 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=2 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=3 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=4 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=5 2024-03-09T14:38:54.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=6 2024-03-09T14:38:54.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 20 add_watcher() i=7 2024-03-09T14:38:54.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.556+0000 7f7b99533800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:54.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.558+0000 7f7a4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7b99533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7b99533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7b99533800 5 note: GC not initialized 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7a4a7e4640 20 reqs_thread_entry: start 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7b99533800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7b99533800 20 Filter name: none 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f79bbfff640 20 reqs_thread_entry: start 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.559+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.560+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:54.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.560+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.561+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:54.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.561+0000 7f7b99533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:54.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.561+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.561+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:54.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.561+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.562+0000 7f7b99533800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:54.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.562+0000 7f7b99533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:54.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.562+0000 7f7b99533800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.563+0000 7f7b99533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.563+0000 7f7a4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:54.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.566+0000 7f7b99533800 20 remove_watcher() i=0 2024-03-09T14:38:54.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.566+0000 7f7b99533800 2 removed watcher, disabling cache 2024-03-09T14:38:54.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.567+0000 7f7b99533800 20 remove_watcher() i=1 2024-03-09T14:38:54.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.568+0000 7f7b99533800 20 remove_watcher() i=2 2024-03-09T14:38:54.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.569+0000 7f7b99533800 20 remove_watcher() i=3 2024-03-09T14:38:54.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.570+0000 7f7b99533800 20 remove_watcher() i=4 2024-03-09T14:38:54.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.571+0000 7f7b99533800 20 remove_watcher() i=5 2024-03-09T14:38:54.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.572+0000 7f7b99533800 20 remove_watcher() i=6 2024-03-09T14:38:54.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.573+0000 7f7b99533800 20 remove_watcher() i=7 2024-03-09T14:38:54.584 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:54.584 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:54.584 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:38:54.584 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:54.586 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-03-09T14:38:54.621 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:54.621 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:54.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.653+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 realm 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.654+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.655+0000 7f0b7b71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:54.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.655+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.656+0000 7f0b7b71f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:54.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.656+0000 7f0b7b71f800 20 searching for the correct realm 2024-03-09T14:38:54.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.659+0000 7f0b76be8640 0 -- 172.21.15.46:0/3855371072 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x558bc21eaef0 msgr2=0x558bc21ed300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:54.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.663+0000 7f0b773e9640 0 -- 172.21.15.46:0/3855371072 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f0b60037910 msgr2=0x7f0b6004f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.667+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 zone default found 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 4 Realm: () 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 zonegroup default 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.668+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.669+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.669+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.669+0000 7f0b7b71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.669+0000 7f0b7b71f800 20 started sync module instance, tier type = 2024-03-09T14:38:54.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.669+0000 7f0b7b71f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=0 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=1 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=2 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=3 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=4 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=5 2024-03-09T14:38:54.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.678+0000 7f0b7b71f800 20 add_watcher() i=6 2024-03-09T14:38:54.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.679+0000 7f0b7b71f800 20 add_watcher() i=7 2024-03-09T14:38:54.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.679+0000 7f0b7b71f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:54.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0a2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 5 note: GC not initialized 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0a2cfe1640 20 reqs_thread_entry: start 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 20 Filter name: none 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f09a67fc640 20 reqs_thread_entry: start 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.681+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:54.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 : miss 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 info.flags=0x17 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 to cache LRU end 2024-03-09T14:38:54.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:54.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:54.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.682+0000 7f0b7b71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 2024-03-09T14:38:54.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.685+0000 7f0b7b71f800 -1 Injecting error=-125 at location=set_target_layout 2024-03-09T14:38:54.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0b7b71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 info.flags=0x17 2024-03-09T14:38:54.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0b7b71f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 to cache LRU end 2024-03-09T14:38:54.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0b7b71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:54.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0b7b71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20, ofs0, ns] 2024-03-09T14:38:54.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0a5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595109 cookie 94058745674608 notifier 6231 bl.length()=917 2024-03-09T14:38:54.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0a5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 info.flags=0x17 2024-03-09T14:38:54.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0a5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 to cache LRU end 2024-03-09T14:38:54.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.686+0000 7f0a5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:54.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.688+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): orig_sources= new_sources= 2024-03-09T14:38:54.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.688+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): potential sources added=[] removed=[] 2024-03-09T14:38:54.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.688+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): orig_dests= new_dests= 2024-03-09T14:38:54.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.688+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): potential dests added=[] removed=[] 2024-03-09T14:38:54.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.689+0000 7f0b7b71f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20.1.0 2024-03-09T14:38:54.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.689+0000 7f0b7b71f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20.1.0 2024-03-09T14:38:54.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.689+0000 7f0b7b71f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20.1.1 2024-03-09T14:38:54.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.689+0000 7f0b7b71f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20.1.1 2024-03-09T14:38:54.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.689+0000 7f0b7b71f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20.0 2024-03-09T14:38:54.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.692+0000 7f0b7b71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 : hit (requested=0x17, cached=0x17) 2024-03-09T14:38:54.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.692+0000 7f0b7b71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 2024-03-09T14:38:54.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0b7b71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 info.flags=0x17 2024-03-09T14:38:54.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0b7b71f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 to cache LRU end 2024-03-09T14:38:54.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0b7b71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:54.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0b7b71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20, ofs0, ns] 2024-03-09T14:38:54.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0a5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94058745674608 notifier 6231 bl.length()=885 2024-03-09T14:38:54.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0a5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 info.flags=0x17 2024-03-09T14:38:54.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0a5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 to cache LRU end 2024-03-09T14:38:54.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.693+0000 7f0a5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:54.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.695+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): orig_sources= new_sources= 2024-03-09T14:38:54.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.695+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): potential sources added=[] removed=[] 2024-03-09T14:38:54.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.695+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): orig_dests= new_dests= 2024-03-09T14:38:54.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.695+0000 7f0b7b71f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20]): potential dests added=[] removed=[] 2024-03-09T14:38:54.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.696+0000 7f0b7b71f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-09T14:38:54.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.698+0000 7f0a2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:54.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.700+0000 7f0b7b71f800 20 remove_watcher() i=0 2024-03-09T14:38:54.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.700+0000 7f0b7b71f800 2 removed watcher, disabling cache 2024-03-09T14:38:54.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.702+0000 7f0b7b71f800 20 remove_watcher() i=1 2024-03-09T14:38:54.704 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.703+0000 7f0b7b71f800 20 remove_watcher() i=2 2024-03-09T14:38:54.705 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.704+0000 7f0b7b71f800 20 remove_watcher() i=3 2024-03-09T14:38:54.706 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.705+0000 7f0b7b71f800 20 remove_watcher() i=4 2024-03-09T14:38:54.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.706+0000 7f0b7b71f800 20 remove_watcher() i=5 2024-03-09T14:38:54.708 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.707+0000 7f0b7b71f800 20 remove_watcher() i=6 2024-03-09T14:38:54.709 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.708+0000 7f0b7b71f800 20 remove_watcher() i=7 2024-03-09T14:38:54.721 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:38:54.748 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:54.749 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:54.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.780+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 realm 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.782+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.783+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:54.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.783+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.784+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:54.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.784+0000 7f86b1ba2800 20 searching for the correct realm 2024-03-09T14:38:54.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.786+0000 7f86af69e640 0 -- 172.21.15.46:0/2677129547 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f86a801a070 msgr2=0x7f86a801b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:54.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.790+0000 7f86af69e640 0 -- 172.21.15.46:0/2677129547 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f8698003090 msgr2=0x7f86980989f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.996+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:54.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:54.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 zone default found 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 4 Realm: () 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:55.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 zonegroup default 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.997+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 started sync module instance, tier type = 2024-03-09T14:38:55.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:54.998+0000 7f86b1ba2800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=0 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=1 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=2 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=3 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=4 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=5 2024-03-09T14:38:55.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=6 2024-03-09T14:38:55.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 20 add_watcher() i=7 2024-03-09T14:38:55.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.009+0000 7f86b1ba2800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:55.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.011+0000 7f8565fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:55.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:55.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:55.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 5 note: GC not initialized 2024-03-09T14:38:55.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f8564fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:55.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:55.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 Filter name: none 2024-03-09T14:38:55.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f84de7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:55.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:55.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.012+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.013+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:55.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.013+0000 7f86b1ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:55.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.013+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.014+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:55.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.014+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.014+0000 7f86b1ba2800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:55.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.014+0000 7f86b1ba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:55.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.015+0000 7f86b1ba2800 20 rados->read ofs=0 len=0 2024-03-09T14:38:55.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.015+0000 7f86b1ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:55.017 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.016+0000 7f8565fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:55.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.018+0000 7f86b1ba2800 20 remove_watcher() i=0 2024-03-09T14:38:55.019 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.018+0000 7f86b1ba2800 2 removed watcher, disabling cache 2024-03-09T14:38:55.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.019+0000 7f86b1ba2800 20 remove_watcher() i=1 2024-03-09T14:38:55.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.020+0000 7f86b1ba2800 20 remove_watcher() i=2 2024-03-09T14:38:55.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.021+0000 7f86b1ba2800 20 remove_watcher() i=3 2024-03-09T14:38:55.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.022+0000 7f86b1ba2800 20 remove_watcher() i=4 2024-03-09T14:38:55.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.023+0000 7f86b1ba2800 20 remove_watcher() i=5 2024-03-09T14:38:55.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.024+0000 7f86b1ba2800 20 remove_watcher() i=6 2024-03-09T14:38:55.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:55.025+0000 7f86b1ba2800 20 remove_watcher() i=7 2024-03-09T14:38:55.037 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:55.037 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:55.038 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-03-09T14:38:55.038 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:55.038 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.038 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.059 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.059 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.258 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.259 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.325 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with abort at set_target_layout 2024-03-09T14:38:55.325 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:55.326 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.326 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.369 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.369 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.426 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.426 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.460 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.461 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.492 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.492 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.525 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.525 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.559 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.559 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.593 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.593 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.625 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.626 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.659 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.659 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.691 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.691 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.724 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.724 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.756 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.756 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.790 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.790 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.822 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.823 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.855 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.855 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.889 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.889 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.921 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.921 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.953 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.953 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:55.985 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:55.985 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:56.018 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:56.018 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:56.050 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:56.051 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:56.083 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:38:56.110 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:56.110 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:56.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.142+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.143+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.143+0000 7f9be4f33800 20 realm 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.143+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.144+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.144+0000 7f9be4f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.144+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.144+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.144+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.145+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.145+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.146+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:56.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.146+0000 7f9be4f33800 20 searching for the correct realm 2024-03-09T14:38:56.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.148+0000 7f9be0c64640 0 -- 172.21.15.46:0/1682439040 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f9bd8081a80 msgr2=0x7f9bd80565a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.152+0000 7f9be0c64640 0 -- 172.21.15.46:0/1682439040 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9bd4056070 msgr2=0x7f9bd4089930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.358+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:56.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 zone default found 2024-03-09T14:38:56.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 4 Realm: () 2024-03-09T14:38:56.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 zonegroup default 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.359+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.360+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.360+0000 7f9be4f33800 20 started sync module instance, tier type = 2024-03-09T14:38:56.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.360+0000 7f9be4f33800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:56.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=0 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=1 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=2 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=3 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=4 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=5 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.369+0000 7f9be4f33800 20 add_watcher() i=6 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.370+0000 7f9be4f33800 20 add_watcher() i=7 2024-03-09T14:38:56.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.370+0000 7f9be4f33800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9a96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9be4f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9be4f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9be4f33800 5 note: GC not initialized 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9a95fe3640 20 reqs_thread_entry: start 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9be4f33800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.372+0000 7f9be4f33800 20 Filter name: none 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.373+0000 7f9a077fe640 20 reqs_thread_entry: start 2024-03-09T14:38:56.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.373+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.373+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.373+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.374+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.374+0000 7f9be4f33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:56.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.374+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.374+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.374+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.375+0000 7f9be4f33800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.375+0000 7f9be4f33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:56.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.375+0000 7f9be4f33800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.375+0000 7f9be4f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.376+0000 7f9a96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.379+0000 7f9be4f33800 20 remove_watcher() i=0 2024-03-09T14:38:56.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.379+0000 7f9be4f33800 2 removed watcher, disabling cache 2024-03-09T14:38:56.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.380+0000 7f9be4f33800 20 remove_watcher() i=1 2024-03-09T14:38:56.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.381+0000 7f9be4f33800 20 remove_watcher() i=2 2024-03-09T14:38:56.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.382+0000 7f9be4f33800 20 remove_watcher() i=3 2024-03-09T14:38:56.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.384+0000 7f9be4f33800 20 remove_watcher() i=4 2024-03-09T14:38:56.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.385+0000 7f9be4f33800 20 remove_watcher() i=5 2024-03-09T14:38:56.387 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.386+0000 7f9be4f33800 20 remove_watcher() i=6 2024-03-09T14:38:56.388 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.387+0000 7f9be4f33800 20 remove_watcher() i=7 2024-03-09T14:38:56.399 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.399 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:56.399 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:38:56.399 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.400 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-03-09T14:38:56.432 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:56.433 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:56.466 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.465+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 realm 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.468 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.467+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.467+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.468+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:56.469 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.468+0000 7f1ebe4c0800 20 searching for the correct realm 2024-03-09T14:38:56.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.471+0000 7f1ebc7c4640 0 -- 172.21.15.46:0/2864304931 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55cbe824b5e0 msgr2=0x55cbe824daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.475 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.474+0000 7f1ebbfc3640 0 -- 172.21.15.46:0/2864304931 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f1eb0019be0 msgr2=0x7f1eb0039030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:56.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 zone default found 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 Realm: () 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:56.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 zonegroup default 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 started sync module instance, tier type = 2024-03-09T14:38:56.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=0 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=1 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=2 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=3 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=4 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=5 2024-03-09T14:38:56.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=6 2024-03-09T14:38:56.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=7 2024-03-09T14:38:56.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.492+0000 7f1ebe4c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:56.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.494+0000 7f1d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.494+0000 7f1ebe4c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.494+0000 7f1ebe4c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 note: GC not initialized 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.494+0000 7f1d70fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 Filter name: none 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1cea7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 : miss 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.496+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:56.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 2024-03-09T14:38:56.499 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebe4c0800 time 2024-03-09T14:38:56.500612+0000 2024-03-09T14:38:56.499 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:38:56.500 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.500 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ec1980e86] 2024-03-09T14:38:56.500 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.500 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 4: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 6: main() 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 8: __libc_start_main() 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 9: _start() 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebe4c0800 thread_name:radosgw-admin 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.499+0000 7f1ebe4c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebe4c0800 time 2024-03-09T14:38:56.500612+0000 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ec1980e86] 2024-03-09T14:38:56.501 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 4: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 6: main() 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 8: __libc_start_main() 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 9: _start() 2024-03-09T14:38:56.502 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.515 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.515 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ec0654db0] 2024-03-09T14:38:56.515 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ec06a154c] 2024-03-09T14:38:56.515 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ec1980ee0] 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 8: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 10: main() 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 12: __libc_start_main() 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 13: _start() 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.500+0000 7f1ebe4c0800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebe4c0800 thread_name:radosgw-admin 2024-03-09T14:38:56.516 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ec0654db0] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ec06a154c] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ec1980ee0] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 8: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 10: main() 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 12: __libc_start_main() 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: 13: _start() 2024-03-09T14:38:56.517 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:38:56.448+0000 7f1ebb7c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: dump: 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.518 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: dump: 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.519 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 5984 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 4 set_mon_vals no callback set 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: shutdown 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) unregister_commands rotate-key 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.520 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding auth protocol: cephx 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding auth protocol: cephx 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding auth protocol: cephx 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.521 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: starting msgr at 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: starting objecter 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command objecter_requests hook 0x55cbe800a110 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: setting wanted keys 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: calling monclient init 2024-03-09T14:38:56.522 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding auth protocol: cephx 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding auth protocol: cephx 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding auth protocol: cephx 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.523 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key hook 0x55cbe8152e38 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe7fdad70 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe80087e0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe809ae60 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.524 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.823995s 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe7fdad70 auth_method 0 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe80087e0 auth_method 0 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe809ae60 auth_method 0 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.525 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:38:56.451+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:38:56.451+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:38:56.451+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:38:56.451+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_done global_id 5987 payload 824 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 1 monclient: found mon.noname-c 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: dump: 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.526 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 5987 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.527 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: dump: 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:38:56.451+0000 7f1da9e0b640 4 set_mon_vals no callback set 2024-03-09T14:38:56.528 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 1 librados: init done 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:38:56.453+0000 7f1da3fff640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:38:56.453+0000 7f1da3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:38:56.453+0000 7f1da3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:38:56.453+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x7f1da406a5b0 auth_method 0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:38:56.453+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x55cbe8178ff0 auth_method 0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:38:56.454+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x55cbe819eb90 auth_method 0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:38:56.455+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x55cbe81a2ef0 auth_method 0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.529 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding auth protocol: cephx 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding auth protocol: cephx 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding auth protocol: cephx 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.530 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command objecter_requests cmddesc objecter_requests hook 0x55cbe81ad210 EEXIST 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding auth protocol: cephx 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding auth protocol: cephx 2024-03-09T14:38:56.531 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding auth protocol: cephx 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.532 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key cmddesc rotate-key hook 0x55cbe81a6230 EEXIST 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe81d1f70 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe81d2350 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe81cd410 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.830877s 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe81d1f70 auth_method 0 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.533 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe81d2350 auth_method 0 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe81cd410 auth_method 0 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.534 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_done global_id 5990 payload 824 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:38:56.458+0000 7f1ebbfc3640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:38:56.458+0000 7f1ebbfc3640 1 monclient: found mon.noname-c 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:38:56.458+0000 7f1ebbfc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: dump: 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.535 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: dump: 2024-03-09T14:38:56.536 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 5990 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:38:56.458+0000 7f1ebcfc5640 4 set_mon_vals no callback set 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.537 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:38:56.459+0000 7f1da17fa640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:38:56.459+0000 7f1da17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:38:56.459+0000 7f1da17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:38:56.459+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x7f1d9406a4c0 auth_method 0 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: get_monmap_and_config 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.538 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.539 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding auth protocol: cephx 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding auth protocol: cephx 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding auth protocol: cephx 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.540 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key cmddesc rotate-key hook 0x7fffe4555fa8 EEXIST 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe8224330 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe8224710 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.541 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe821ebe0 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.834182s 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe8224710 auth_method 0 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe821ebe0 auth_method 0 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.542 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe8224330 auth_method 0 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_done global_id 6285 payload 274 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 1 monclient: found mon.noname-a 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.543 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.544 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:38:56.461+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 6285 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:38:56.461+0000 7f1ebe4c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:38:56.461+0000 7f1ebe4c0800 4 set_mon_vals no callback set 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.545 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: shutdown 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.546 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.547 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: starting msgr at 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: starting objecter 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command objecter_requests cmddesc objecter_requests hook 0x55cbe81e8300 EEXIST 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: setting wanted keys 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: calling monclient init 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding auth protocol: cephx 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding auth protocol: cephx 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding auth protocol: cephx 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.548 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key cmddesc rotate-key hook 0x55cbe81eedd8 EEXIST 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.549 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe821ebe0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe8224330 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe8212130 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.836400s 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe8224330 auth_method 0 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe8212130 auth_method 0 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.550 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe821ebe0 auth_method 0 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_done global_id 6288 payload 824 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.551 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 1 monclient: found mon.noname-a 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.552 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.553 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 6288 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:38:56.463+0000 7f1d9affd640 4 set_mon_vals no callback set 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 1 librados: init done 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cr dump hook 0x55cbe822e748 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:38:56.465+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:38:56.465+0000 7f1d997fa640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:38:56.465+0000 7f1d997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:38:56.465+0000 7f1d997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:38:56.465+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1d8406a5b0 auth_method 0 2024-03-09T14:38:56.554 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:38:56.466+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x55cbe823ed60 auth_method 0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 realm 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:38:56.467+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x55cbe8243010 auth_method 0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:38:56.467+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:38:56.467+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:38:56.468+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x55cbe8246870 auth_method 0 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:38:56.468+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:56.555 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:38:56.468+0000 7f1ebe4c0800 20 searching for the correct realm 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:38:56.468+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x55cbe824b5e0 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:38:56.469+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1eb401f040 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:38:56.470+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x7f1eac0c4820 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:38:56.471+0000 7f1ebc7c4640 0 -- 172.21.15.46:0/2864304931 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55cbe824b5e0 msgr2=0x55cbe824daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:38:56.471+0000 7f1d997fa640 1 client.6288.objecter ms_handle_reset 0x55cbe824b5e0 session 0x55cbe824af60 osd.3 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:38:56.471+0000 7f1d997fa640 10 monclient: _renew_subs 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:38:56.471+0000 7f1d997fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:38:56.471+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x7f1d8407ac60 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:38:56.472+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x7f1eb0028040 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:38:56.474+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1eb0019be0 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:38:56.474+0000 7f1ebbfc3640 0 -- 172.21.15.46:0/2864304931 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f1eb0019be0 msgr2=0x7f1eb0039030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:38:56.474+0000 7f1d997fa640 1 client.6288.objecter ms_handle_reset 0x7f1eb0019be0 session 0x7f1eb0095040 osd.0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:38:56.475+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1d8407d9e0 auth_method 0 2024-03-09T14:38:56.556 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 zone default found 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 Realm: () 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:56.557 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 zonegroup default 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 started sync module instance, tier type = 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=0 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=1 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=2 2024-03-09T14:38:56.558 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=3 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=4 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=5 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=6 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=7 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding auth protocol: cephx 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding auth protocol: cephx 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding auth protocol: cephx 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.559 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:38:56.494+0000 7f1d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache list hook 0x55cbe8212550 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache inspect hook 0x55cbe8212550 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache erase hook 0x55cbe8212550 2024-03-09T14:38:56.560 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache zap hook 0x55cbe8212550 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 note: GC not initialized 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:38:56.494+0000 7f1d70fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace show hook 0x7f1eb001f070 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace history hook 0x7f1eb001f070 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace active hook 0x7f1eb001f070 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace active_short hook 0x7f1eb001f070 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 Filter name: none 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:38:56.495+0000 7f1cea7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:38:56.561 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 : miss 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:38:56.499+0000 7f1ebe4c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebe4c0800 time 2024-03-09T14:38:56.500612+0000 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ec1980e86] 2024-03-09T14:38:56.562 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 4: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 6: main() 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 8: __libc_start_main() 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 9: _start() 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:38:56.500+0000 7f1ebe4c0800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebe4c0800 thread_name:radosgw-admin 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ec0654db0] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ec06a154c] 2024-03-09T14:38:56.563 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ec1980ee0] 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 8: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 10: main() 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 12: __libc_start_main() 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 13: _start() 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:38:56.564 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:38:56.565 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:38:56.566 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:38:56.567 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:38:56.568 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:38:56.569 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:38:56.570 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1cea7fc640 / http_manager 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d70fe1640 / http_manager 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d71fe3640 / rgw_dt_lg_renew 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d997fa640 / ms_dispatch 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d9affd640 / io_context_pool 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da17fa640 / ms_dispatch 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da3fff640 / ms_dispatch 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da9e0b640 / io_context_pool 2024-03-09T14:38:56.571 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebb7c2640 / msgr-worker-2 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebbfc3640 / msgr-worker-1 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebc7c4640 / msgr-worker-0 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebcfc5640 / io_context_pool 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebe4c0800 / radosgw-admin 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/log/ceph/ceph-client.admin.89947.log 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:38:56.448+0000 7f1ebb7c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: dump: 2024-03-09T14:38:56.572 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:38:56.448+0000 7f1da9e0b640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:38:56.573 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:38:56.449+0000 7f1da9e0b640 10 monclient: dump: 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 5984 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 4 set_mon_vals no callback set 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: shutdown 2024-03-09T14:38:56.574 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) unregister_commands rotate-key 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.575 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding auth protocol: cephx 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding auth protocol: cephx 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding auth protocol: cephx 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: crc 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:38:56.449+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8154fc0) adding con mode: secure 2024-03-09T14:38:56.576 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: starting msgr at 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: starting objecter 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command objecter_requests hook 0x55cbe800a110 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: setting wanted keys 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 1 librados: calling monclient init 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding auth protocol: cephx 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding auth protocol: cephx 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding auth protocol: cephx 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.577 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: crc 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe8152cf0) adding con mode: secure 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key hook 0x55cbe8152e38 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe7fdad70 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.578 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe80087e0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe809ae60 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:38:56.450+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.823995s 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe7fdad70 auth_method 0 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe80087e0 auth_method 0 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.579 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:38:56.450+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe809ae60 auth_method 0 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:38:56.450+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:38:56.450+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:38:56.451+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:38:56.451+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:38:56.451+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:38:56.451+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.580 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_done global_id 5987 payload 824 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 1 monclient: found mon.noname-c 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:38:56.451+0000 7f1ebbfc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: dump: 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.581 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 5987 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:38:56.451+0000 7f1da3fff640 10 monclient: dump: 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.582 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:38:56.451+0000 7f1da9e0b640 4 set_mon_vals no callback set 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:38:56.451+0000 7f1ebe4c0800 1 librados: init done 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:38:56.453+0000 7f1da3fff640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:38:56.453+0000 7f1da3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:38:56.453+0000 7f1da3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:38:56.453+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x7f1da406a5b0 auth_method 0 2024-03-09T14:38:56.583 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:38:56.453+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x55cbe8178ff0 auth_method 0 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:38:56.454+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x55cbe819eb90 auth_method 0 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:38:56.455+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x55cbe81a2ef0 auth_method 0 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.584 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding auth protocol: cephx 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding auth protocol: cephx 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding auth protocol: cephx 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.585 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: crc 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a7a80) adding con mode: secure 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:38:56.456+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command objecter_requests cmddesc objecter_requests hook 0x55cbe81ad210 EEXIST 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding auth protocol: cephx 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding auth protocol: cephx 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding auth protocol: cephx 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.586 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: crc 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81a60e8) adding con mode: secure 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key cmddesc rotate-key hook 0x55cbe81a6230 EEXIST 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe81d1f70 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe81d2350 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe81cd410 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.587 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:38:56.457+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.830877s 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe81d1f70 auth_method 0 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe81d2350 auth_method 0 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.588 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:38:56.457+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe81cd410 auth_method 0 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:38:56.457+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:38:56.457+0000 7f1ebbfc3640 10 monclient(hunting): handle_auth_done global_id 5990 payload 824 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:38:56.458+0000 7f1ebbfc3640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:38:56.458+0000 7f1ebbfc3640 1 monclient: found mon.noname-c 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:38:56.458+0000 7f1ebbfc3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.589 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: dump: 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.590 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:38:56.458+0000 7f1da17fa640 10 monclient: dump: 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.591 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 5990 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:38:56.458+0000 7f1ebcfc5640 4 set_mon_vals no callback set 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:38:56.458+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:38:56.459+0000 7f1da17fa640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:38:56.459+0000 7f1da17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:38:56.459+0000 7f1da17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:38:56.459+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x7f1d9406a4c0 auth_method 0 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: get_monmap_and_config 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.592 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.593 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding auth protocol: cephx 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding auth protocol: cephx 2024-03-09T14:38:56.594 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding auth protocol: cephx 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: crc 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe4555e60) adding con mode: secure 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.595 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key cmddesc rotate-key hook 0x7fffe4555fa8 EEXIST 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe8224330 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe8224710 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe821ebe0 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.596 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:38:56.460+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.834182s 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe8224710 auth_method 0 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe821ebe0 auth_method 0 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe8224330 auth_method 0 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.597 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:38:56.461+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:38:56.461+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_done global_id 6285 payload 274 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 1 monclient: found mon.noname-a 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:38:56.461+0000 7f1ebb7c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.598 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:38:56.461+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 6285 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:38:56.461+0000 7f1ebe4c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:38:56.461+0000 7f1ebe4c0800 4 set_mon_vals no callback set 2024-03-09T14:38:56.599 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:38:56.461+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: shutdown 2024-03-09T14:38:56.600 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: build_initial_monmap 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 build_initial for_mkfs: 0 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: monmap: 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.601 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding auth protocol: cephx 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: crc 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81efac0) adding con mode: secure 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.602 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: starting msgr at 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: starting objecter 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command objecter_requests cmddesc objecter_requests hook 0x55cbe81e8300 EEXIST 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: setting wanted keys 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 1 librados: calling monclient init 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 10 monclient: init 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding auth protocol: cephx 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding auth protocol: cephx 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding auth protocol: cephx 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.603 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: crc 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 5 AuthRegistry(0x55cbe81eec90) adding con mode: secure 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:38:56.462+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command rotate-key cmddesc rotate-key hook 0x55cbe81eedd8 EEXIST 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-b con 0x55cbe821ebe0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-a con 0x55cbe8224330 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): picked mon.noname-c con 0x55cbe8212130 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:38:56.604 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient(hunting): authenticate will time out at 1813.836400s 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request con 0x55cbe8224330 auth_method 0 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request con 0x55cbe8212130 auth_method 0 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.605 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:38:56.463+0000 7f1ebc7c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request con 0x55cbe821ebe0 auth_method 0 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:38:56.463+0000 7f1ebbfc3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient(hunting): handle_auth_done global_id 6288 payload 824 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient: _finish_hunting 0 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 1 monclient: found mon.noname-a 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:38:56.463+0000 7f1ebb7c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.606 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: _finish_auth 0 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: _check_auth_tickets 2024-03-09T14:38:56.607 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:38:56.463+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.608 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 5 monclient: authenticate success, global_id 6288 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:38:56.463+0000 7f1d9affd640 4 set_mon_vals no callback set 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _renew_subs 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 1 librados: init done 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:38:56.463+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cr dump hook 0x55cbe822e748 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:38:56.465+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:38:56.465+0000 7f1d997fa640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:38:56.465+0000 7f1d997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:38:56.465+0000 7f1d997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:38:56.465+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1d8406a5b0 auth_method 0 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:38:56.466+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x55cbe823ed60 auth_method 0 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.609 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 realm 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:38:56.466+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:38:56.467+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x55cbe8243010 auth_method 0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:38:56.467+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:38:56.467+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:38:56.468+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x55cbe8246870 auth_method 0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:38:56.468+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:38:56.468+0000 7f1ebe4c0800 20 searching for the correct realm 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:38:56.468+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x55cbe824b5e0 auth_method 0 2024-03-09T14:38:56.610 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:38:56.469+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1eb401f040 auth_method 0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:38:56.470+0000 7f1ebb7c2640 10 monclient: get_auth_request con 0x7f1eac0c4820 auth_method 0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:38:56.471+0000 7f1ebc7c4640 0 -- 172.21.15.46:0/2864304931 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55cbe824b5e0 msgr2=0x55cbe824daa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:38:56.471+0000 7f1d997fa640 1 client.6288.objecter ms_handle_reset 0x55cbe824b5e0 session 0x55cbe824af60 osd.3 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:38:56.471+0000 7f1d997fa640 10 monclient: _renew_subs 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:38:56.471+0000 7f1d997fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:38:56.471+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x7f1d8407ac60 auth_method 0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:38:56.472+0000 7f1ebc7c4640 10 monclient: get_auth_request con 0x7f1eb0028040 auth_method 0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:38:56.474+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1eb0019be0 auth_method 0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:38:56.474+0000 7f1ebbfc3640 0 -- 172.21.15.46:0/2864304931 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f1eb0019be0 msgr2=0x7f1eb0039030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:38:56.474+0000 7f1d997fa640 1 client.6288.objecter ms_handle_reset 0x7f1eb0019be0 session 0x7f1eb0095040 osd.0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:38:56.475+0000 7f1ebbfc3640 10 monclient: get_auth_request con 0x7f1d8407d9e0 auth_method 0 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:56.611 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:38:56.479+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 zone default found 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 Realm: () 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:56.612 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 zonegroup default 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:38:56.480+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:38:56.481+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 started sync module instance, tier type = 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:38:56.482+0000 7f1ebe4c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=0 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=1 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=2 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=3 2024-03-09T14:38:56.613 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=4 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=5 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=6 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 20 add_watcher() i=7 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:38:56.492+0000 7f1ebe4c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding auth protocol: cephx 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding auth protocol: cephx 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding auth protocol: cephx 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.614 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:38:56.494+0000 7f1d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: crc 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 AuthRegistry(0x7fffe45562f0) adding con mode: secure 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache list hook 0x55cbe8212550 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache inspect hook 0x55cbe8212550 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache erase hook 0x55cbe8212550 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command cache zap hook 0x55cbe8212550 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:38:56.494+0000 7f1ebe4c0800 5 note: GC not initialized 2024-03-09T14:38:56.615 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:38:56.494+0000 7f1d70fe1640 20 reqs_thread_entry: start 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace show hook 0x7f1eb001f070 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace history hook 0x7f1eb001f070 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace active hook 0x7f1eb001f070 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 5 asok(0x55cbe7f34780) register_command sync trace active_short hook 0x7f1eb001f070 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 Filter name: none 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:38:56.495+0000 7f1cea7fc640 20 reqs_thread_entry: start 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 : miss 2024-03-09T14:38:56.616 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:38:56.495+0000 7f1ebe4c0800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:38:56.496+0000 7f1ebe4c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:38:56.499+0000 7f1ebe4c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebe4c0800 time 2024-03-09T14:38:56.500612+0000 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ec1980e86] 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.617 INFO:tasks.workunit.client.0.smithi046.stderr: 4: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 6: main() 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 8: __libc_start_main() 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 9: _start() 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:38:56.500+0000 7f1ebe4c0800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebe4c0800 thread_name:radosgw-admin 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ec0654db0] 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ec06a154c] 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:38:56.618 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ec1980ee0] 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ec1981044] 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cbe6889f91] 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 8: radosgw-admin(+0x802a32) [0x55cbe6899a32] 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55cbe68a4e0b] 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 10: main() 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f1ec063feb0] 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 12: __libc_start_main() 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 13: _start() 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:38:56.619 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:38:56.620 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:38:56.621 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:38:56.622 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:38:56.623 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:38:56.624 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:38:56.625 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1cea7fc640 / http_manager 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d70fe1640 / http_manager 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d71fe3640 / rgw_dt_lg_renew 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d997fa640 / ms_dispatch 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d9affd640 / io_context_pool 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da17fa640 / ms_dispatch 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da3fff640 / ms_dispatch 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da9e0b640 / io_context_pool 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebb7c2640 / msgr-worker-2 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebbfc3640 / msgr-worker-1 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebc7c4640 / msgr-worker-0 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebcfc5640 / io_context_pool 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebe4c0800 / radosgw-admin 2024-03-09T14:38:56.626 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:38:56.627 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:38:56.627 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:38:56.502238Z_00223a1c-119b-41d4-984d-0172326233d1/log 2024-03-09T14:38:56.627 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:38:56.627 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:38:56.628 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:56.628 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.570+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 realm 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.572+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.573+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.573+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.574+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:56.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.574+0000 7f686b613800 20 searching for the correct realm 2024-03-09T14:38:56.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.576+0000 7f68665cb640 0 -- 172.21.15.46:0/2600723295 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x556a6d1e28b0 msgr2=0x556a6d1e4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.580+0000 7f6866dcc640 0 -- 172.21.15.46:0/2600723295 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f685c05f410 msgr2=0x7f685c05f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:38:56.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.786+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:56.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 zone default found 2024-03-09T14:38:56.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 4 Realm: () 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 zonegroup default 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.787+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.788+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.788+0000 7f686b613800 20 started sync module instance, tier type = 2024-03-09T14:38:56.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.788+0000 7f686b613800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:56.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=0 2024-03-09T14:38:56.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=1 2024-03-09T14:38:56.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=2 2024-03-09T14:38:56.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=3 2024-03-09T14:38:56.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=4 2024-03-09T14:38:56.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=5 2024-03-09T14:38:56.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.797+0000 7f686b613800 20 add_watcher() i=6 2024-03-09T14:38:56.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.798+0000 7f686b613800 20 add_watcher() i=7 2024-03-09T14:38:56.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.798+0000 7f686b613800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:56.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.799+0000 7f671d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f686b613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:56.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f686b613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:56.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f686b613800 5 note: GC not initialized 2024-03-09T14:38:56.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f6697fff640 20 reqs_thread_entry: start 2024-03-09T14:38:56.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f686b613800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:56.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f686b613800 20 Filter name: none 2024-03-09T14:38:56.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f6695ffb640 20 reqs_thread_entry: start 2024-03-09T14:38:56.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.800+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:56.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.801+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.802+0000 7f686b613800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.802+0000 7f686b613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.802+0000 7f686b613800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.802+0000 7f686b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.803+0000 7f671d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:56.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.805+0000 7f686b613800 20 remove_watcher() i=0 2024-03-09T14:38:56.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.805+0000 7f686b613800 2 removed watcher, disabling cache 2024-03-09T14:38:56.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.806+0000 7f686b613800 20 remove_watcher() i=1 2024-03-09T14:38:56.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.807+0000 7f686b613800 20 remove_watcher() i=2 2024-03-09T14:38:56.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.808+0000 7f686b613800 20 remove_watcher() i=3 2024-03-09T14:38:56.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.809+0000 7f686b613800 20 remove_watcher() i=4 2024-03-09T14:38:56.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.810+0000 7f686b613800 20 remove_watcher() i=5 2024-03-09T14:38:56.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.811+0000 7f686b613800 20 remove_watcher() i=6 2024-03-09T14:38:56.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.812+0000 7f686b613800 20 remove_watcher() i=7 2024-03-09T14:38:56.823 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.823 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:38:56.823 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:38:56.824 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:38:56.825 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:56.825 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:56.854 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:38:56.854 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:38:56.913 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:38:56.943 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:38:56.943 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:38:56.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.975+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 realm 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:56.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.977+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.978+0000 7f7933c44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:56.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.978+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:56.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.979+0000 7f7933c44800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:38:56.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.979+0000 7f7933c44800 20 searching for the correct realm 2024-03-09T14:38:56.982 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.981+0000 7f7930f3f640 0 -- 172.21.15.46:0/1113373516 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55d61ee3fd90 msgr2=0x55d61ee42180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:56.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:56.985+0000 7f7931740640 0 -- 172.21.15.46:0/1113373516 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f7928029960 msgr2=0x7f7928051400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:38:57.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.191+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:38:57.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 zone default found 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 4 Realm: () 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 zonegroup default 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.192+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.193+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.193+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.193+0000 7f7933c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:38:57.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.193+0000 7f7933c44800 20 started sync module instance, tier type = 2024-03-09T14:38:57.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.193+0000 7f7933c44800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=0 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=1 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=2 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=3 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=4 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=5 2024-03-09T14:38:57.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=6 2024-03-09T14:38:57.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 20 add_watcher() i=7 2024-03-09T14:38:57.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.202+0000 7f7933c44800 2 all 8 watchers are set, enabling cache 2024-03-09T14:38:57.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.204+0000 7f77e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:57.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.204+0000 7f7933c44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:38:57.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.204+0000 7f7933c44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:38:57.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 5 note: GC not initialized 2024-03-09T14:38:57.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f77e67e4640 20 reqs_thread_entry: start 2024-03-09T14:38:57.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 20 init_complete bucket index max shards: 1 2024-03-09T14:38:57.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 20 Filter name: none 2024-03-09T14:38:57.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7757fff640 20 reqs_thread_entry: start 2024-03-09T14:38:57.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:38:57.207 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 : miss 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.205+0000 7f7933c44800 20 rados->read ofs=0 len=0 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.206+0000 7f7933c44800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.206+0000 7f7933c44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.206+0000 7f7933c44800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.206+0000 7f7933c44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.206+0000 7f7933c44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:38:57.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.206+0000 7f7933c44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 2024-03-09T14:38:57.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.207+0000 7f7933c44800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to be held by another RGW process; skipping for now 2024-03-09T14:38:57.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.208+0000 7f77e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:38:57.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.210+0000 7f7933c44800 20 remove_watcher() i=0 2024-03-09T14:38:57.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.210+0000 7f7933c44800 2 removed watcher, disabling cache 2024-03-09T14:38:57.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.211+0000 7f7933c44800 20 remove_watcher() i=1 2024-03-09T14:38:57.213 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.212+0000 7f7933c44800 20 remove_watcher() i=2 2024-03-09T14:38:57.214 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.213+0000 7f7933c44800 20 remove_watcher() i=3 2024-03-09T14:38:57.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.214+0000 7f7933c44800 20 remove_watcher() i=4 2024-03-09T14:38:57.215 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.214+0000 7f7933c44800 20 remove_watcher() i=5 2024-03-09T14:38:57.216 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.215+0000 7f7933c44800 20 remove_watcher() i=6 2024-03-09T14:38:57.217 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:38:57.216+0000 7f7933c44800 20 remove_watcher() i=7 2024-03-09T14:38:57.227 INFO:tasks.workunit.client.0.smithi046.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-09T14:39:27.247 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:39:27.282 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:27.282 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:27.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.321+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 realm 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.322+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.324+0000 7fe344e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:27.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.324+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.325+0000 7fe344e24800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:27.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.325+0000 7fe344e24800 20 searching for the correct realm 2024-03-09T14:39:27.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.327+0000 7fe342920640 0 -- 172.21.15.46:0/2175412298 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fe33c02d020 msgr2=0x7fe33c05b590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:27.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.332+0000 7fe342920640 0 -- 172.21.15.46:0/2175412298 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fe338042960 msgr2=0x7fe33801e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.540 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.539+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:27.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 zone default found 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 4 Realm: () 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 zonegroup default 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.540+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.541+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.541+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.541+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.541+0000 7fe344e24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.541+0000 7fe344e24800 20 started sync module instance, tier type = 2024-03-09T14:39:27.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.541+0000 7fe344e24800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=0 2024-03-09T14:39:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=1 2024-03-09T14:39:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=2 2024-03-09T14:39:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=3 2024-03-09T14:39:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=4 2024-03-09T14:39:27.552 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=5 2024-03-09T14:39:27.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.552+0000 7fe344e24800 20 add_watcher() i=6 2024-03-09T14:39:27.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.553+0000 7fe344e24800 20 add_watcher() i=7 2024-03-09T14:39:27.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.553+0000 7fe344e24800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:27.555 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.555+0000 7fe1f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.555+0000 7fe344e24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.555+0000 7fe344e24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.555+0000 7fe344e24800 5 note: GC not initialized 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.555+0000 7fe173fff640 20 reqs_thread_entry: start 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 20 Filter name: none 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe171ffb640 20 reqs_thread_entry: start 2024-03-09T14:39:27.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:39:27.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:39:27.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:39:27.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:39:27.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 : miss 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.556+0000 7fe344e24800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.557+0000 7fe344e24800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.557+0000 7fe344e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.557+0000 7fe344e24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.557+0000 7fe344e24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.557+0000 7fe344e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:27.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.557+0000 7fe344e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 2024-03-09T14:39:27.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe344e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:39:27.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe344e24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:39:27.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe344e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:27.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe344e24800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21, ofs0, ns] 2024-03-09T14:39:27.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe2267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595079 cookie 94013139280192 notifier 6047 bl.length()=917 2024-03-09T14:39:27.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe2267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:39:27.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe2267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:39:27.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.561+0000 7fe2267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:27.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.563+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): orig_sources= new_sources= 2024-03-09T14:39:27.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.563+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): potential sources added=[] removed=[] 2024-03-09T14:39:27.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.563+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): orig_dests= new_dests= 2024-03-09T14:39:27.563 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.563+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): potential dests added=[] removed=[] 2024-03-09T14:39:27.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.565+0000 7fe344e24800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21.1.0 2024-03-09T14:39:27.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.565+0000 7fe344e24800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21.1.0 2024-03-09T14:39:27.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.565+0000 7fe344e24800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21.1.1 2024-03-09T14:39:27.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.565+0000 7fe344e24800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21.1.1 2024-03-09T14:39:27.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.565+0000 7fe344e24800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21.0 2024-03-09T14:39:27.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.567+0000 7fe344e24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 : hit (requested=0x17, cached=0x17) 2024-03-09T14:39:27.568 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.568+0000 7fe344e24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 2024-03-09T14:39:27.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe344e24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:39:27.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe344e24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:39:27.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe344e24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:27.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe344e24800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21, ofs0, ns] 2024-03-09T14:39:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe225ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595080 cookie 94013139280192 notifier 6047 bl.length()=885 2024-03-09T14:39:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe225ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 info.flags=0x17 2024-03-09T14:39:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe225ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 to cache LRU end 2024-03-09T14:39:27.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.569+0000 7fe225ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.571+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): orig_sources= new_sources= 2024-03-09T14:39:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.571+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): potential sources added=[] removed=[] 2024-03-09T14:39:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.571+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): orig_dests= new_dests= 2024-03-09T14:39:27.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.571+0000 7fe344e24800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21]): potential dests added=[] removed=[] 2024-03-09T14:39:27.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.572+0000 7fe344e24800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-03-09T14:39:27.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.575+0000 7fe1f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.577+0000 7fe344e24800 20 remove_watcher() i=0 2024-03-09T14:39:27.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.577+0000 7fe344e24800 2 removed watcher, disabling cache 2024-03-09T14:39:27.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.578+0000 7fe344e24800 20 remove_watcher() i=1 2024-03-09T14:39:27.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.580+0000 7fe344e24800 20 remove_watcher() i=2 2024-03-09T14:39:27.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.581+0000 7fe344e24800 20 remove_watcher() i=3 2024-03-09T14:39:27.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.582+0000 7fe344e24800 20 remove_watcher() i=4 2024-03-09T14:39:27.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.583+0000 7fe344e24800 20 remove_watcher() i=5 2024-03-09T14:39:27.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.584+0000 7fe344e24800 20 remove_watcher() i=6 2024-03-09T14:39:27.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.585+0000 7fe344e24800 20 remove_watcher() i=7 2024-03-09T14:39:27.598 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:39:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:27.626 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:27.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.660+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.662+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.662+0000 7fc99971f800 20 realm 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.662+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.662+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.662+0000 7fc99971f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.662+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.663+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.663+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.664+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:27.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.664+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.664+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:27.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.664+0000 7fc99971f800 20 searching for the correct realm 2024-03-09T14:39:27.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.668+0000 7fc994ce7640 0 -- 172.21.15.46:0/3358868935 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55b0449be630 msgr2=0x55b0449c0a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:27.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.672+0000 7fc995ce9640 0 -- 172.21.15.46:0/3358868935 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7fc980026070 msgr2=0x7fc98003ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.676+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 zone default found 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 4 Realm: () 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 zonegroup default 2024-03-09T14:39:27.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.677+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.678+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.678+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.678+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.678+0000 7fc99971f800 20 started sync module instance, tier type = 2024-03-09T14:39:27.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.678+0000 7fc99971f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=0 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=1 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=2 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=3 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=4 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=5 2024-03-09T14:39:27.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.687+0000 7fc99971f800 20 add_watcher() i=6 2024-03-09T14:39:27.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.688+0000 7fc99971f800 20 add_watcher() i=7 2024-03-09T14:39:27.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.688+0000 7fc99971f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:27.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.689+0000 7fc84b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:27.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:27.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:27.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 5 note: GC not initialized 2024-03-09T14:39:27.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc84a7e4640 20 reqs_thread_entry: start 2024-03-09T14:39:27.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:27.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 20 Filter name: none 2024-03-09T14:39:27.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc7bbfff640 20 reqs_thread_entry: start 2024-03-09T14:39:27.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.690+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:39:27.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.691+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.691+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:39:27.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.691+0000 7fc99971f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:27.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.691+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.691+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=194 2024-03-09T14:39:27.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.691+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.692+0000 7fc99971f800 20 rados_obj.operate() r=0 bl.length=408 2024-03-09T14:39:27.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.692+0000 7fc99971f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:27.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.692+0000 7fc99971f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:27.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.692+0000 7fc99971f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:27.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.693+0000 7fc84b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:27.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.696+0000 7fc99971f800 20 remove_watcher() i=0 2024-03-09T14:39:27.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.696+0000 7fc99971f800 2 removed watcher, disabling cache 2024-03-09T14:39:27.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.697+0000 7fc99971f800 20 remove_watcher() i=1 2024-03-09T14:39:27.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.698+0000 7fc99971f800 20 remove_watcher() i=2 2024-03-09T14:39:27.699 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.699+0000 7fc99971f800 20 remove_watcher() i=3 2024-03-09T14:39:27.700 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.700+0000 7fc99971f800 20 remove_watcher() i=4 2024-03-09T14:39:27.701 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.701+0000 7fc99971f800 20 remove_watcher() i=5 2024-03-09T14:39:27.702 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.702+0000 7fc99971f800 20 remove_watcher() i=6 2024-03-09T14:39:27.703 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:27.703+0000 7fc99971f800 20 remove_watcher() i=7 2024-03-09T14:39:27.713 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:27.713 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:39:27.713 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-set-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:39:27.713 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:27.715 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:27.715 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:27.736 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:27.736 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:27.933 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:27.933 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:27.995 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-03-09T14:39:27.995 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:27.996 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:27.997 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.045 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.045 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.103 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.103 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.139 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.139 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.172 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.172 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.206 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.206 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.240 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.240 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.272 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.272 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.305 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.305 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.338 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.338 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.371 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.371 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.405 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.405 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.436 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.437 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.469 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.469 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.501 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.501 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.534 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.534 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.567 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.567 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.600 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.600 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.632 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.633 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.664 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.665 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.697 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.697 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.729 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:28.729 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:28.762 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:39:28.789 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:28.789 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:28.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.822+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:28.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 realm 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.824+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.825+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:28.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.825+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:28.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.826+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:28.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.826+0000 7f5739c13800 20 searching for the correct realm 2024-03-09T14:39:28.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:28.828+0000 7f5734bcb640 0 -- 172.21.15.46:0/3987016052 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f5728095020 msgr2=0x7f572805e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:29.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.034+0000 7f57353cc640 0 -- 172.21.15.46:0/3987016052 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f572c062050 msgr2=0x7f572c0770c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:29.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.241+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.242+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.242+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.242+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:29.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.242+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 20 zone default found 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 4 Realm: () 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:29.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 20 zonegroup default 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.243+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.244+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.244+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.244+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.244+0000 7f5739c13800 20 started sync module instance, tier type = 2024-03-09T14:39:29.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.244+0000 7f5739c13800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=0 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=1 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=2 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=3 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=4 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=5 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.254+0000 7f5739c13800 20 add_watcher() i=6 2024-03-09T14:39:29.255 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.255+0000 7f5739c13800 20 add_watcher() i=7 2024-03-09T14:39:29.256 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.255+0000 7f5739c13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:29.257 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.257+0000 7f55eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:29.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f5739c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:29.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f5739c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:29.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f5739c13800 5 note: GC not initialized 2024-03-09T14:39:29.258 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f55ea7e4640 20 reqs_thread_entry: start 2024-03-09T14:39:29.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f5739c13800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:29.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f5739c13800 20 Filter name: none 2024-03-09T14:39:29.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f555bfff640 20 reqs_thread_entry: start 2024-03-09T14:39:29.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.258+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.259+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:29.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.259+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.260+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:29.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.260+0000 7f5739c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:29.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.260+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.260+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:29.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.260+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.261+0000 7f5739c13800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:29.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.261+0000 7f5739c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:29.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.261+0000 7f5739c13800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.262+0000 7f5739c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.263+0000 7f55eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:29.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.265+0000 7f5739c13800 20 remove_watcher() i=0 2024-03-09T14:39:29.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.265+0000 7f5739c13800 2 removed watcher, disabling cache 2024-03-09T14:39:29.266 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.266+0000 7f5739c13800 20 remove_watcher() i=1 2024-03-09T14:39:29.267 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.267+0000 7f5739c13800 20 remove_watcher() i=2 2024-03-09T14:39:29.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.268+0000 7f5739c13800 20 remove_watcher() i=3 2024-03-09T14:39:29.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.269+0000 7f5739c13800 20 remove_watcher() i=4 2024-03-09T14:39:29.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.270+0000 7f5739c13800 20 remove_watcher() i=5 2024-03-09T14:39:29.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.271+0000 7f5739c13800 20 remove_watcher() i=6 2024-03-09T14:39:29.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.273+0000 7f5739c13800 20 remove_watcher() i=7 2024-03-09T14:39:29.284 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:29.284 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:39:29.284 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-block-writes id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:39:29.284 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:29.285 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-03-09T14:39:29.319 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:29.319 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:29.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.355+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.356+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.356+0000 7f69c6a15800 20 realm 2024-03-09T14:39:29.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.356+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.356+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.356+0000 7f69c6a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:29.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.356+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.357+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.357+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.358+0000 7f69c6a15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:29.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.358+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.359+0000 7f69c6a15800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:29.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.359+0000 7f69c6a15800 20 searching for the correct realm 2024-03-09T14:39:29.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.362+0000 7f69c27df640 0 -- 172.21.15.46:0/2585504040 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x5611905637f0 msgr2=0x561190565cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:29.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.365+0000 7f69c1fde640 0 -- 172.21.15.46:0/2585504040 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f69b8068070 msgr2=0x7f69b80ae020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:29.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:29.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:29.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:29.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:29.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:29.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:29.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.370+0000 7f69c6a15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 zone default found 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 4 Realm: () 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 zonegroup default 2024-03-09T14:39:29.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 started sync module instance, tier type = 2024-03-09T14:39:29.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.371+0000 7f69c6a15800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:29.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=0 2024-03-09T14:39:29.380 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=1 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=2 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=3 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=4 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=5 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.380+0000 7f69c6a15800 20 add_watcher() i=6 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.381+0000 7f69c6a15800 20 add_watcher() i=7 2024-03-09T14:39:29.381 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.381+0000 7f69c6a15800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:29.382 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.382+0000 7f68737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:29.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:29.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:29.383 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 5 note: GC not initialized 2024-03-09T14:39:29.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f68727fc640 20 reqs_thread_entry: start 2024-03-09T14:39:29.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:29.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 20 Filter name: none 2024-03-09T14:39:29.384 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f67e7fff640 20 reqs_thread_entry: start 2024-03-09T14:39:29.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-09T14:39:29.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.383+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:29.385 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 : miss 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:29.386 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.384+0000 7f69c6a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.388+0000 7f69c6a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f69c6a15800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f69c6a15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f69c6a15800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22, ofs0, ns] 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f68a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94633436006000 notifier 6393 bl.length()=907 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f68a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:29.389 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f68a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:29.390 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.389+0000 7f68a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:29.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.391+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_sources= new_sources= 2024-03-09T14:39:29.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.391+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential sources added=[] removed=[] 2024-03-09T14:39:29.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.391+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_dests= new_dests= 2024-03-09T14:39:29.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.391+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential dests added=[] removed=[] 2024-03-09T14:39:29.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.391+0000 7f69c6a15800 -1 Injecting error=-5 at location=block_writes 2024-03-09T14:39:29.391 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.391+0000 7f69c6a15800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-03-09T14:39:29.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.392+0000 7f69c6a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 : hit (requested=0x17, cached=0x17) 2024-03-09T14:39:29.392 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.392+0000 7f69c6a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 2024-03-09T14:39:29.393 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.393+0000 7f69c6a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.393+0000 7f69c6a15800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.393+0000 7f69c6a15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.393+0000 7f69c6a15800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22, ofs0, ns] 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.394+0000 7f68a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94633436006000 notifier 6393 bl.length()=875 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.394+0000 7f68a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.394+0000 7f68a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:29.394 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.394+0000 7f68a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:29.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.396+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_sources= new_sources= 2024-03-09T14:39:29.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.396+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential sources added=[] removed=[] 2024-03-09T14:39:29.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.396+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_dests= new_dests= 2024-03-09T14:39:29.396 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.396+0000 7f69c6a15800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential dests added=[] removed=[] 2024-03-09T14:39:29.398 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.398+0000 7f68737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:29.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.400+0000 7f69c6a15800 20 remove_watcher() i=0 2024-03-09T14:39:29.400 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.400+0000 7f69c6a15800 2 removed watcher, disabling cache 2024-03-09T14:39:29.401 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.401+0000 7f69c6a15800 20 remove_watcher() i=1 2024-03-09T14:39:29.402 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.402+0000 7f69c6a15800 20 remove_watcher() i=2 2024-03-09T14:39:29.403 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.403+0000 7f69c6a15800 20 remove_watcher() i=3 2024-03-09T14:39:29.404 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.404+0000 7f69c6a15800 20 remove_watcher() i=4 2024-03-09T14:39:29.405 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.405+0000 7f69c6a15800 20 remove_watcher() i=5 2024-03-09T14:39:29.406 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.406+0000 7f69c6a15800 20 remove_watcher() i=6 2024-03-09T14:39:29.407 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.407+0000 7f69c6a15800 20 remove_watcher() i=7 2024-03-09T14:39:29.421 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:39:29.446 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:29.446 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:29.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.682+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.683+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.683+0000 7f74df330800 20 realm 2024-03-09T14:39:29.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.683+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.683+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.683+0000 7f74df330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:29.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.683+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.684+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.684+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.685+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:29.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.685+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.686+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:29.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.686+0000 7f74df330800 20 searching for the correct realm 2024-03-09T14:39:29.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.688+0000 7f74da8ee640 0 -- 172.21.15.46:0/2741892619 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55956f3f8380 msgr2=0x55956f3fa770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:29.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.692+0000 7f74db0ef640 0 -- 172.21.15.46:0/2741892619 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f74d002bc60 msgr2=0x7f74d0090850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:29.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:29.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:29.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.899+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 zone default found 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 4 Realm: () 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 zonegroup default 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.900+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.901+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.901+0000 7f74df330800 20 started sync module instance, tier type = 2024-03-09T14:39:29.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.901+0000 7f74df330800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=0 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=1 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=2 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=3 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=4 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=5 2024-03-09T14:39:29.910 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=6 2024-03-09T14:39:29.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 20 add_watcher() i=7 2024-03-09T14:39:29.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.910+0000 7f74df330800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:29.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.912+0000 7f7391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:29.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f74df330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:29.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f74df330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:29.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f74df330800 5 note: GC not initialized 2024-03-09T14:39:29.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f7390fe1640 20 reqs_thread_entry: start 2024-03-09T14:39:29.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f74df330800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:29.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f74df330800 20 Filter name: none 2024-03-09T14:39:29.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f730a7fc640 20 reqs_thread_entry: start 2024-03-09T14:39:29.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.913+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.914+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.914+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.914+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.914+0000 7f74df330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.914+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.915+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:29.915 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.915+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.915+0000 7f74df330800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:29.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.915+0000 7f74df330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:29.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.916+0000 7f74df330800 20 rados->read ofs=0 len=0 2024-03-09T14:39:29.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.916+0000 7f74df330800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:29.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.917+0000 7f7391fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:29.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.919+0000 7f74df330800 20 remove_watcher() i=0 2024-03-09T14:39:29.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.919+0000 7f74df330800 2 removed watcher, disabling cache 2024-03-09T14:39:29.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.920+0000 7f74df330800 20 remove_watcher() i=1 2024-03-09T14:39:29.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.921+0000 7f74df330800 20 remove_watcher() i=2 2024-03-09T14:39:29.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.922+0000 7f74df330800 20 remove_watcher() i=3 2024-03-09T14:39:29.923 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.923+0000 7f74df330800 20 remove_watcher() i=4 2024-03-09T14:39:29.924 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.924+0000 7f74df330800 20 remove_watcher() i=5 2024-03-09T14:39:29.925 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.925+0000 7f74df330800 20 remove_watcher() i=6 2024-03-09T14:39:29.926 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:29.926+0000 7f74df330800 20 remove_watcher() i=7 2024-03-09T14:39:29.937 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:29.937 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:39:29.937 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-block-writes id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:39:29.937 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:29.938 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:29.938 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:29.969 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:29.969 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:30.027 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:39:30.057 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:30.057 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:30.091 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.090+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 realm 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.092+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.093+0000 7f30af624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:30.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.093+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.094+0000 7f30af624800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:30.094 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.094+0000 7f30af624800 20 searching for the correct realm 2024-03-09T14:39:30.097 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.097+0000 7f30ad120640 0 -- 172.21.15.46:0/1983567702 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f30a805e070 msgr2=0x7f30a8055b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:30.101 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.101+0000 7f30ad120640 0 -- 172.21.15.46:0/1983567702 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f30a4024bb0 msgr2=0x7f30a405ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.307+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 zone default found 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 4 Realm: () 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 zonegroup default 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.310 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.308+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.309+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.309+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.309+0000 7f30af624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.309+0000 7f30af624800 20 started sync module instance, tier type = 2024-03-09T14:39:30.311 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.309+0000 7f30af624800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:30.318 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=0 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=1 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=2 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=3 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=4 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=5 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.318+0000 7f30af624800 20 add_watcher() i=6 2024-03-09T14:39:30.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.319+0000 7f30af624800 20 add_watcher() i=7 2024-03-09T14:39:30.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.319+0000 7f30af624800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f2f637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 5 note: GC not initialized 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f2f627e4640 20 reqs_thread_entry: start 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 20 Filter name: none 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f2ed3fff640 20 reqs_thread_entry: start 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-09T14:39:30.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.321+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:30.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-09T14:39:30.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-09T14:39:30.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 : miss 2024-03-09T14:39:30.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:30.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:30.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:30.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:30.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:30.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.322+0000 7f30af624800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.326+0000 7f30af624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f30af624800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f30af624800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f30af624800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22, ofs0, ns] 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f2f7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94564613269104 notifier 6134 bl.length()=907 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f2f7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f2f7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:30.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.327+0000 7f2f7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:30.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.328+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_sources= new_sources= 2024-03-09T14:39:30.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.329+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential sources added=[] removed=[] 2024-03-09T14:39:30.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.329+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_dests= new_dests= 2024-03-09T14:39:30.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.329+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential dests added=[] removed=[] 2024-03-09T14:39:30.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.330+0000 7f30af624800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22.1.0 2024-03-09T14:39:30.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.330+0000 7f30af624800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22.1.0 2024-03-09T14:39:30.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.330+0000 7f30af624800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22.1.1 2024-03-09T14:39:30.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.330+0000 7f30af624800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22.1.1 2024-03-09T14:39:30.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.330+0000 7f30af624800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22.0 2024-03-09T14:39:30.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.332+0000 7f30af624800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 : hit (requested=0x17, cached=0x17) 2024-03-09T14:39:30.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.332+0000 7f30af624800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 2024-03-09T14:39:30.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.333+0000 7f30af624800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:30.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.333+0000 7f30af624800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:30.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.333+0000 7f30af624800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:30.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.333+0000 7f30af624800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22, ofs0, ns] 2024-03-09T14:39:30.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.334+0000 7f2f90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595116 cookie 94564613269104 notifier 6134 bl.length()=875 2024-03-09T14:39:30.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.334+0000 7f2f90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 info.flags=0x17 2024-03-09T14:39:30.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.334+0000 7f2f90ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 to cache LRU end 2024-03-09T14:39:30.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.334+0000 7f2f90ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:30.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.335+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_sources= new_sources= 2024-03-09T14:39:30.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.335+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential sources added=[] removed=[] 2024-03-09T14:39:30.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.335+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): orig_dests= new_dests= 2024-03-09T14:39:30.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.335+0000 7f30af624800 20 handle_bi_update(): bucket=:error-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22]): potential dests added=[] removed=[] 2024-03-09T14:39:30.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.336+0000 7f30af624800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-03-09T14:39:30.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.338+0000 7f2f637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:30.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.340+0000 7f30af624800 20 remove_watcher() i=0 2024-03-09T14:39:30.340 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.340+0000 7f30af624800 2 removed watcher, disabling cache 2024-03-09T14:39:30.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.341+0000 7f30af624800 20 remove_watcher() i=1 2024-03-09T14:39:30.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.342+0000 7f30af624800 20 remove_watcher() i=2 2024-03-09T14:39:30.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.343+0000 7f30af624800 20 remove_watcher() i=3 2024-03-09T14:39:30.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.344+0000 7f30af624800 20 remove_watcher() i=4 2024-03-09T14:39:30.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.345+0000 7f30af624800 20 remove_watcher() i=5 2024-03-09T14:39:30.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.346+0000 7f30af624800 20 remove_watcher() i=6 2024-03-09T14:39:30.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.346+0000 7f30af624800 20 remove_watcher() i=7 2024-03-09T14:39:30.358 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:39:30.387 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:30.387 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:30.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.421+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.422+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.422+0000 7f5075a3c800 20 realm 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.422+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.423+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.423+0000 7f5075a3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.423+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.423+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.423+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.424+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:30.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.424+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.424+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:30.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.424+0000 7f5075a3c800 20 searching for the correct realm 2024-03-09T14:39:30.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.426+0000 7f506bfff640 0 -- 172.21.15.46:0/1989658017 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f506404a040 msgr2=0x7f506404b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:30.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.430+0000 7f5070ce7640 0 -- 172.21.15.46:0/1989658017 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f505c08a390 msgr2=0x7f505c05b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:30.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:30.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.638+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 zone default found 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 4 Realm: () 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 zonegroup default 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.639+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.640+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.640+0000 7f5075a3c800 20 started sync module instance, tier type = 2024-03-09T14:39:30.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.640+0000 7f5075a3c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:30.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=0 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=1 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=2 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=3 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=4 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=5 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.648+0000 7f5075a3c800 20 add_watcher() i=6 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.649+0000 7f5075a3c800 20 add_watcher() i=7 2024-03-09T14:39:30.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.649+0000 7f5075a3c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:30.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f4f26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f5075a3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f5075a3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f5075a3c800 5 note: GC not initialized 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f4f25fe3640 20 reqs_thread_entry: start 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f5075a3c800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.651+0000 7f5075a3c800 20 Filter name: none 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.652+0000 7f4e977fe640 20 reqs_thread_entry: start 2024-03-09T14:39:30.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.652+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.652+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:30.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.652+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:30.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:30.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:30.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:30.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.653+0000 7f5075a3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:30.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.654+0000 7f5075a3c800 20 rados->read ofs=0 len=0 2024-03-09T14:39:30.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.654+0000 7f5075a3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:30.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.655+0000 7f4f26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:30.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.657+0000 7f5075a3c800 20 remove_watcher() i=0 2024-03-09T14:39:30.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.657+0000 7f5075a3c800 2 removed watcher, disabling cache 2024-03-09T14:39:30.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.658+0000 7f5075a3c800 20 remove_watcher() i=1 2024-03-09T14:39:30.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.659+0000 7f5075a3c800 20 remove_watcher() i=2 2024-03-09T14:39:30.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.660+0000 7f5075a3c800 20 remove_watcher() i=3 2024-03-09T14:39:30.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.661+0000 7f5075a3c800 20 remove_watcher() i=4 2024-03-09T14:39:30.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.662+0000 7f5075a3c800 20 remove_watcher() i=5 2024-03-09T14:39:30.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.663+0000 7f5075a3c800 20 remove_watcher() i=6 2024-03-09T14:39:30.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:30.664+0000 7f5075a3c800 20 remove_watcher() i=7 2024-03-09T14:39:30.674 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:30.675 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:39:30.675 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-block-writes id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:39:30.675 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:30.676 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:30.676 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:30.698 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:30.698 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:30.884 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:30.884 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:30.951 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with abort at block_writes 2024-03-09T14:39:30.951 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:30.952 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:30.952 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:30.993 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:30.993 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.050 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.050 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.085 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.085 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.118 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.118 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.153 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.153 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.185 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.185 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.221 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.221 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.254 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.254 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.286 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.286 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.318 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.319 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.351 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.351 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.384 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.384 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.417 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.417 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.450 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.450 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.482 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.483 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.515 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.515 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.548 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.548 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.581 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.581 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.614 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.614 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.645 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.646 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.679 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:31.679 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:31.712 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:39:31.739 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:31.740 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:31.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.773+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.774+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.774+0000 7f8c0082e800 20 realm 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.774+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.775+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.775+0000 7f8c0082e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.775+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.775+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.775+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.776+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:31.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.776+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.777+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:31.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.777+0000 7f8c0082e800 20 searching for the correct realm 2024-03-09T14:39:31.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.780+0000 7f8bfb305640 0 -- 172.21.15.46:0/1402593071 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55c119ec8010 msgr2=0x55c119eca400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:31.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.784+0000 7f8bfbb06640 0 -- 172.21.15.46:0/1402593071 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f8bf0092170 msgr2=0x7f8bf00895c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:31.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:31.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:31.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:31.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:31.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:31.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:31.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.789+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:31.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:31.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 zone default found 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 4 Realm: () 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 zonegroup default 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.790+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.791+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.791+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.791+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.791+0000 7f8c0082e800 20 started sync module instance, tier type = 2024-03-09T14:39:31.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.791+0000 7f8c0082e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:31.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=0 2024-03-09T14:39:31.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=1 2024-03-09T14:39:31.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=2 2024-03-09T14:39:31.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=3 2024-03-09T14:39:31.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=4 2024-03-09T14:39:31.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=5 2024-03-09T14:39:31.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.800+0000 7f8c0082e800 20 add_watcher() i=6 2024-03-09T14:39:31.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.801+0000 7f8c0082e800 20 add_watcher() i=7 2024-03-09T14:39:31.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.801+0000 7f8c0082e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:31.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8ab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:31.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8c0082e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:31.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8c0082e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:31.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8c0082e800 5 note: GC not initialized 2024-03-09T14:39:31.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8ab0fe1640 20 reqs_thread_entry: start 2024-03-09T14:39:31.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8c0082e800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:31.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.803+0000 7f8c0082e800 20 Filter name: none 2024-03-09T14:39:31.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8a2a7fc640 20 reqs_thread_entry: start 2024-03-09T14:39:31.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:31.805 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:31.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8c0082e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:31.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.804+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.805+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.805+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.805+0000 7f8c0082e800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.805+0000 7f8c0082e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.805+0000 7f8c0082e800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.806+0000 7f8c0082e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.807+0000 7f8ab1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:31.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.809+0000 7f8c0082e800 20 remove_watcher() i=0 2024-03-09T14:39:31.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.809+0000 7f8c0082e800 2 removed watcher, disabling cache 2024-03-09T14:39:31.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.810+0000 7f8c0082e800 20 remove_watcher() i=1 2024-03-09T14:39:31.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.811+0000 7f8c0082e800 20 remove_watcher() i=2 2024-03-09T14:39:31.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.812+0000 7f8c0082e800 20 remove_watcher() i=3 2024-03-09T14:39:31.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.813+0000 7f8c0082e800 20 remove_watcher() i=4 2024-03-09T14:39:31.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.814+0000 7f8c0082e800 20 remove_watcher() i=5 2024-03-09T14:39:31.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.815+0000 7f8c0082e800 20 remove_watcher() i=6 2024-03-09T14:39:31.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.816+0000 7f8c0082e800 20 remove_watcher() i=7 2024-03-09T14:39:31.826 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:31.826 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:39:31.826 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-block-writes id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:39:31.826 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:31.827 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-03-09T14:39:31.860 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:31.860 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:31.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.893+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 realm 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.895+0000 7f1ebb71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:31.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.896+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:31.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.896+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:31.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.897+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:31.897 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.897+0000 7f1ebb71f800 20 searching for the correct realm 2024-03-09T14:39:31.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:31.901+0000 7f1eb7c82640 0 -- 172.21.15.46:0/3824574836 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f1eac03c040 msgr2=0x7f1eac02e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:32.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.108+0000 7f1eb7481640 0 -- 172.21.15.46:0/3824574836 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55e69b0bb720 msgr2=0x55e69b0bdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 zone default found 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 Realm: () 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 zonegroup default 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 started sync module instance, tier type = 2024-03-09T14:39:32.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:32.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=0 2024-03-09T14:39:32.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=1 2024-03-09T14:39:32.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=2 2024-03-09T14:39:32.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=3 2024-03-09T14:39:32.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=4 2024-03-09T14:39:32.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=5 2024-03-09T14:39:32.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=6 2024-03-09T14:39:32.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.123+0000 7f1ebb71f800 20 add_watcher() i=7 2024-03-09T14:39:32.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.123+0000 7f1ebb71f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:32.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 note: GC not initialized 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1d6cfe1640 20 reqs_thread_entry: start 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 Filter name: none 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ce67fc640 20 reqs_thread_entry: start 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:32.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 : miss 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:32.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 2024-03-09T14:39:32.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23, ofs0, ns] 2024-03-09T14:39:32.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595083 cookie 94448932132144 notifier 6486 bl.length()=907 2024-03-09T14:39:32.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_sources= new_sources= 2024-03-09T14:39:32.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential sources added=[] removed=[] 2024-03-09T14:39:32.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_dests= new_dests= 2024-03-09T14:39:32.133 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential dests added=[] removed=[] 2024-03-09T14:39:32.133 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebb71f800 time 2024-03-09T14:39:32.134118+0000 2024-03-09T14:39:32.133 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ebcd80e86] 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.133+0000 7f1ebb71f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebb71f800 time 2024-03-09T14:39:32.134118+0000 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.134 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ebcd80e86] 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:39:32.135 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebb71f800 thread_name:radosgw-admin 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ebbc54db0] 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ebbca154c] 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ebcd80ee0] 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.148 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.134+0000 7f1ebb71f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebb71f800 thread_name:radosgw-admin 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ebbc54db0] 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ebbca154c] 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ebcd80ee0] 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.149 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:39:31.876+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6170 payload 274 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:39:31.876+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:39:31.876+0000 7f1eb7481640 1 monclient: found mon.noname-c 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:39:31.876+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.150 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: dump: 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.151 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: dump: 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6170 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: get_monmap_and_config success 2024-03-09T14:39:32.152 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 4 set_mon_vals no callback set 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: shutdown 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 asok(0x55e69adab780) unregister_commands rotate-key 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.153 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding auth protocol: cephx 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding auth protocol: cephx 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding auth protocol: cephx 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.154 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: starting msgr at 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: starting objecter 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command objecter_requests hook 0x55e69affe7d0 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: setting wanted keys 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: calling monclient init 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding auth protocol: cephx 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding auth protocol: cephx 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding auth protocol: cephx 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.155 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key hook 0x55e69afc9528 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:39:32.156 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69ae7afa0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69af07140 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69af0dd60 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.251073s 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69ae7afa0 auth_method 0 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:39:31.878+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69af0dd60 auth_method 0 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.157 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request con 0x55e69af07140 auth_method 0 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6477 payload 824 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:39:31.879+0000 7f1eb7481640 1 monclient: found mon.noname-a 2024-03-09T14:39:32.158 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: dump: 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.159 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: dump: 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.160 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6477 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:39:31.879+0000 7f1da560a640 4 set_mon_vals no callback set 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 1 librados: init done 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:39:31.881+0000 7f1da3e07640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:39:31.881+0000 7f1da3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:39:31.881+0000 7f1da3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:39:31.881+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1d9c06a5b0 auth_method 0 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:39:31.881+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x55e69aff5830 auth_method 0 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:39:31.882+0000 7f1eb7481640 10 monclient: get_auth_request con 0x55e69b018160 auth_method 0 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:39:31.883+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x55e69b01c350 auth_method 0 2024-03-09T14:39:32.161 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding auth protocol: cephx 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding auth protocol: cephx 2024-03-09T14:39:32.162 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding auth protocol: cephx 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command objecter_requests cmddesc objecter_requests hook 0x55e69b0268b0 EEXIST 2024-03-09T14:39:32.163 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding auth protocol: cephx 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding auth protocol: cephx 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding auth protocol: cephx 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.164 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key cmddesc rotate-key hook 0x55e69b01f910 EEXIST 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69b04b610 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69b04b9f0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69b046ab0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.258110s 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:39:31.885+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69b04b610 auth_method 0 2024-03-09T14:39:32.165 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69b046ab0 auth_method 0 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request con 0x55e69b04b9f0 auth_method 0 2024-03-09T14:39:32.166 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6176 payload 824 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:39:31.886+0000 7f1eb7481640 1 monclient: found mon.noname-c 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: dump: 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.167 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: dump: 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.168 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6176 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:39:31.886+0000 7f1eb8483640 4 set_mon_vals no callback set 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:39:31.888+0000 7f1da1602640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:39:31.888+0000 7f1da1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.169 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:39:31.888+0000 7f1da1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:39:31.888+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1d9006a4c0 auth_method 0 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: get_monmap_and_config 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.170 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.171 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding auth protocol: cephx 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding auth protocol: cephx 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding auth protocol: cephx 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.172 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key cmddesc rotate-key hook 0x7ffc14328468 EEXIST 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69b09d6f0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69b09dad0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69b08f850 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.173 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.261440s 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69b09d6f0 auth_method 0 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69b08f850 auth_method 0 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.174 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6483 payload 274 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:39:31.889+0000 7f1eb7481640 1 monclient: found mon.noname-a 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.175 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6483 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient: get_monmap_and_config success 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 4 set_mon_vals no callback set 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.176 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: shutdown 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.177 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.178 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.179 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: starting msgr at 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: starting objecter 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command objecter_requests cmddesc objecter_requests hook 0x55e69b099800 EEXIST 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: setting wanted keys 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: calling monclient init 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding auth protocol: cephx 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding auth protocol: cephx 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding auth protocol: cephx 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.180 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key cmddesc rotate-key hook 0x55e69b068478 EEXIST 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:39:32.181 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69b08f850 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69b09d6f0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69b095640 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.263622s 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69b08f850 auth_method 0 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69b095640 auth_method 0 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.182 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6486 payload 824 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:39:31.891+0000 7f1eb7481640 1 monclient: found mon.noname-a 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:39:32.183 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:39:32.184 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:39:31.892+0000 7f1d9affd640 4 set_mon_vals no callback set 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6486 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.185 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 1 librados: init done 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cr dump hook 0x55e69b090c68 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:39:31.893+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:39:31.893+0000 7f1d997fa640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:39:31.893+0000 7f1d997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:39:31.893+0000 7f1d997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:39:31.894+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1d8006a670 auth_method 0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:39:31.894+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x55e69b0b7500 auth_method 0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 realm 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.186 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:39:31.895+0000 7f1eb7481640 10 monclient: get_auth_request con 0x55e69b0bb720 auth_method 0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:39:31.896+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:39:31.896+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:39:31.896+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x55e69b0bef60 auth_method 0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:39:31.897+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:39:31.897+0000 7f1ebb71f800 20 searching for the correct realm 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:39:31.897+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x55e69b0c3cf0 auth_method 0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:39:31.898+0000 7f1eb7481640 10 monclient: get_auth_request con 0x7f1eb0074040 auth_method 0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:39:31.898+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1ea8023030 auth_method 0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:39:31.900+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x7f1eac03c040 auth_method 0 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:39:31.901+0000 7f1eb7c82640 0 -- 172.21.15.46:0/3824574836 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f1eac03c040 msgr2=0x7f1eac02e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:32.187 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:39:32.102+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x7f1eac03c040 auth_method 0 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:39:32.105+0000 7f1eb7481640 10 monclient: get_auth_request con 0x7f1eac00b040 auth_method 0 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:39:32.108+0000 7f1eb7481640 0 -- 172.21.15.46:0/3824574836 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55e69b0bb720 msgr2=0x55e69b0bdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:39:32.108+0000 7f1d997fa640 1 client.6486.objecter ms_handle_reset 0x55e69b0bb720 session 0x55e69b0bb0a0 osd.5 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:39:32.108+0000 7f1d997fa640 10 monclient: _renew_subs 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:39:32.108+0000 7f1d997fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:39:32.108+0000 7f1eb7481640 10 monclient: get_auth_request con 0x7f1d8007ada0 auth_method 0 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.188 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 zone default found 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 Realm: () 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 zonegroup default 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.189 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 started sync module instance, tier type = 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=0 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=1 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=2 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=3 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=4 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=5 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=6 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:39:32.123+0000 7f1ebb71f800 20 add_watcher() i=7 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:39:32.123+0000 7f1ebb71f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding auth protocol: cephx 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding auth protocol: cephx 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding auth protocol: cephx 2024-03-09T14:39:32.190 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:39:32.125+0000 7f1d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:32.191 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache list hook 0x55e69b095a80 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache inspect hook 0x55e69b095a80 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache erase hook 0x55e69b095a80 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache zap hook 0x55e69b095a80 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 note: GC not initialized 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:39:32.125+0000 7f1d6cfe1640 20 reqs_thread_entry: start 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace show hook 0x7f1ea8070030 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace history hook 0x7f1ea8070030 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace active hook 0x7f1ea8070030 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace active_short hook 0x7f1ea8070030 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 Filter name: none 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:39:32.125+0000 7f1ce67fc640 20 reqs_thread_entry: start 2024-03-09T14:39:32.192 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 : miss 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.193 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23, ofs0, ns] 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595083 cookie 94448932132144 notifier 6486 bl.length()=907 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_sources= new_sources= 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential sources added=[] removed=[] 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_dests= new_dests= 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential dests added=[] removed=[] 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebb71f800 time 2024-03-09T14:39:32.134118+0000 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.194 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ebcd80e86] 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:39:32.134+0000 7f1ebb71f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebb71f800 thread_name:radosgw-admin 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ebbc54db0] 2024-03-09T14:39:32.195 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ebbca154c] 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ebcd80ee0] 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:39:32.196 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:39:32.197 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:39:32.198 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:39:32.199 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:39:32.200 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:39:32.201 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:39:32.202 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ce67fc640 / http_manager 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d6cfe1640 / http_manager 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d6dfe3640 / rgw_dt_lg_renew 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d997fa640 / ms_dispatch 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d9affd640 / io_context_pool 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da1602640 / ms_dispatch 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da3e07640 / ms_dispatch 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da560a640 / io_context_pool 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb6c80640 / msgr-worker-2 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb7481640 / msgr-worker-1 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb7c82640 / msgr-worker-0 2024-03-09T14:39:32.203 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb8483640 / io_context_pool 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebb71f800 / radosgw-admin 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/log/ceph/ceph-client.admin.96427.log 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:39:31.876+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6170 payload 274 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:39:31.876+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:39:31.876+0000 7f1eb7481640 1 monclient: found mon.noname-c 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:39:31.876+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: dump: 2024-03-09T14:39:32.204 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:39:32.205 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:39:31.877+0000 7f1da560a640 10 monclient: dump: 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6170 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: get_monmap_and_config success 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 4 set_mon_vals no callback set 2024-03-09T14:39:32.206 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: shutdown 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 asok(0x55e69adab780) unregister_commands rotate-key 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.207 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding auth protocol: cephx 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding auth protocol: cephx 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding auth protocol: cephx 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: crc 2024-03-09T14:39:32.208 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:39:31.877+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afcb6b0) adding con mode: secure 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: starting msgr at 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: starting objecter 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command objecter_requests hook 0x55e69affe7d0 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: setting wanted keys 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 1 librados: calling monclient init 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding auth protocol: cephx 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding auth protocol: cephx 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding auth protocol: cephx 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.209 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: crc 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 AuthRegistry(0x55e69afc93e0) adding con mode: secure 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key hook 0x55e69afc9528 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.210 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69ae7afa0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69af07140 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69af0dd60 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:39:31.878+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.251073s 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69ae7afa0 auth_method 0 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:39:31.878+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.211 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:39:31.878+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69af0dd60 auth_method 0 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:39:31.879+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request con 0x55e69af07140 auth_method 0 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:39:31.879+0000 7f1eb6c80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.212 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6477 payload 824 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:39:31.879+0000 7f1eb7481640 1 monclient: found mon.noname-a 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:39:31.879+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: dump: 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.213 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:39:31.879+0000 7f1da3e07640 10 monclient: dump: 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.214 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6477 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:39:31.879+0000 7f1da560a640 4 set_mon_vals no callback set 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:39:31.879+0000 7f1ebb71f800 1 librados: init done 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:39:31.881+0000 7f1da3e07640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:39:31.881+0000 7f1da3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:39:31.881+0000 7f1da3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.215 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:39:31.881+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1d9c06a5b0 auth_method 0 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:39:31.881+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x55e69aff5830 auth_method 0 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:39:31.882+0000 7f1eb7481640 10 monclient: get_auth_request con 0x55e69b018160 auth_method 0 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:39:31.883+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x55e69b01c350 auth_method 0 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.216 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding auth protocol: cephx 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding auth protocol: cephx 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding auth protocol: cephx 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.217 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: crc 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:39:31.884+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b021160) adding con mode: secure 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command objecter_requests cmddesc objecter_requests hook 0x55e69b0268b0 EEXIST 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding auth protocol: cephx 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding auth protocol: cephx 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding auth protocol: cephx 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.218 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: crc 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b01f7c8) adding con mode: secure 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key cmddesc rotate-key hook 0x55e69b01f910 EEXIST 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69b04b610 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69b04b9f0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69b046ab0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.219 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:39:31.885+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.258110s 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:39:31.885+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69b04b610 auth_method 0 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69b046ab0 auth_method 0 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.220 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:39:31.886+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request con 0x55e69b04b9f0 auth_method 0 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:39:31.886+0000 7f1eb6c80640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6176 payload 824 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:39:31.886+0000 7f1eb7481640 1 monclient: found mon.noname-c 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:39:31.886+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:39:32.221 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: dump: 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.222 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:39:31.886+0000 7f1da1602640 10 monclient: dump: 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.223 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6176 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:39:31.886+0000 7f1eb8483640 4 set_mon_vals no callback set 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:39:31.886+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:39:31.888+0000 7f1da1602640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:39:31.888+0000 7f1da1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:39:31.888+0000 7f1da1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:39:31.888+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1d9006a4c0 auth_method 0 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: get_monmap_and_config 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.224 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.225 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.226 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding auth protocol: cephx 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding auth protocol: cephx 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding auth protocol: cephx 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.227 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: crc 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc14328320) adding con mode: secure 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:39:31.888+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key cmddesc rotate-key hook 0x7ffc14328468 EEXIST 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69b09d6f0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69b09dad0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69b08f850 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.228 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.261440s 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69b09d6f0 auth_method 0 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69b08f850 auth_method 0 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.229 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:39:31.889+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6483 payload 274 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:39:31.889+0000 7f1eb7481640 1 monclient: found mon.noname-a 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:39:31.889+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.230 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6483 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 10 monclient: get_monmap_and_config success 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:39:31.889+0000 7f1ebb71f800 4 set_mon_vals no callback set 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:39:31.889+0000 7f1d9affd640 10 monclient: dump: 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.231 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: shutdown 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: build_initial_monmap 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 build_initial for_mkfs: 0 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: monmap: 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:39:32.232 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding auth protocol: cephx 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.233 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: crc 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b069160) adding con mode: secure 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: starting msgr at 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: starting objecter 2024-03-09T14:39:32.234 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command objecter_requests cmddesc objecter_requests hook 0x55e69b099800 EEXIST 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: setting wanted keys 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 1 librados: calling monclient init 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 10 monclient: init 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding auth protocol: cephx 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding auth protocol: cephx 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding auth protocol: cephx 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.235 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: crc 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:39:31.890+0000 7f1ebb71f800 5 AuthRegistry(0x55e69b068330) adding con mode: secure 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command rotate-key cmddesc rotate-key hook 0x55e69b068478 EEXIST 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient: _reopen_session rank -1 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-a con 0x55e69b08f850 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-b con 0x55e69b09d6f0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): picked mon.noname-c con 0x55e69b095640 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.236 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): _renew_subs 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:39:31.891+0000 7f1ebb71f800 10 monclient(hunting): authenticate will time out at 1849.263622s 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): get_auth_request con 0x55e69b08f850 auth_method 0 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request con 0x55e69b095640 auth_method 0 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.237 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:39:31.891+0000 7f1eb7c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient(hunting): handle_auth_done global_id 6486 payload 824 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient: _finish_hunting 0 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:39:31.891+0000 7f1eb7481640 1 monclient: found mon.noname-a 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:39:31.891+0000 7f1eb7481640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.238 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: _finish_auth 0 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: _check_auth_tickets 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:39:31.892+0000 7f1d997fa640 10 monclient: dump: 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:39:32.239 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:39:31.892+0000 7f1d9affd640 4 set_mon_vals no callback set 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 5 monclient: authenticate success, global_id 6486 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _renew_subs 2024-03-09T14:39:32.240 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 1 librados: init done 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:39:31.892+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cr dump hook 0x55e69b090c68 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:39:31.893+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:39:31.893+0000 7f1d997fa640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:39:31.893+0000 7f1d997fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:39:31.893+0000 7f1d997fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:39:31.894+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1d8006a670 auth_method 0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:39:31.894+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x55e69b0b7500 auth_method 0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 realm 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:39:31.894+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.241 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:39:31.895+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:39:31.895+0000 7f1eb7481640 10 monclient: get_auth_request con 0x55e69b0bb720 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:39:31.896+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:39:31.896+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:39:31.896+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x55e69b0bef60 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:39:31.897+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:39:31.897+0000 7f1ebb71f800 20 searching for the correct realm 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:39:31.897+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x55e69b0c3cf0 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:39:31.898+0000 7f1eb7481640 10 monclient: get_auth_request con 0x7f1eb0074040 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:39:31.898+0000 7f1eb6c80640 10 monclient: get_auth_request con 0x7f1ea8023030 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:39:31.900+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x7f1eac03c040 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:39:31.901+0000 7f1eb7c82640 0 -- 172.21.15.46:0/3824574836 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f1eac03c040 msgr2=0x7f1eac02e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:39:32.102+0000 7f1eb7c82640 10 monclient: get_auth_request con 0x7f1eac03c040 auth_method 0 2024-03-09T14:39:32.242 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:39:32.105+0000 7f1eb7481640 10 monclient: get_auth_request con 0x7f1eac00b040 auth_method 0 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:39:32.108+0000 7f1eb7481640 0 -- 172.21.15.46:0/3824574836 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55e69b0bb720 msgr2=0x55e69b0bdb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:39:32.108+0000 7f1d997fa640 1 client.6486.objecter ms_handle_reset 0x55e69b0bb720 session 0x55e69b0bb0a0 osd.5 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:39:32.108+0000 7f1d997fa640 10 monclient: _renew_subs 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:39:32.108+0000 7f1d997fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:39:32.108+0000 7f1eb7481640 10 monclient: get_auth_request con 0x7f1d8007ada0 auth_method 0 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.243 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 zone default found 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 Realm: () 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 zonegroup default 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:39:32.111+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.244 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 started sync module instance, tier type = 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:39:32.112+0000 7f1ebb71f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=0 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=1 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=2 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=3 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=4 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=5 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:39:32.122+0000 7f1ebb71f800 20 add_watcher() i=6 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:39:32.123+0000 7f1ebb71f800 20 add_watcher() i=7 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:39:32.123+0000 7f1ebb71f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding auth protocol: cephx 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding auth protocol: cephx 2024-03-09T14:39:32.245 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding auth protocol: cephx 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:39:32.125+0000 7f1d6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: crc 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 AuthRegistry(0x7ffc143287b0) adding con mode: secure 2024-03-09T14:39:32.246 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache list hook 0x55e69b095a80 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache inspect hook 0x55e69b095a80 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache erase hook 0x55e69b095a80 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command cache zap hook 0x55e69b095a80 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 note: GC not initialized 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:39:32.125+0000 7f1d6cfe1640 20 reqs_thread_entry: start 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace show hook 0x7f1ea8070030 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace history hook 0x7f1ea8070030 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace active hook 0x7f1ea8070030 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 5 asok(0x55e69adab780) register_command sync trace active_short hook 0x7f1ea8070030 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 Filter name: none 2024-03-09T14:39:32.247 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:39:32.125+0000 7f1ce67fc640 20 reqs_thread_entry: start 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:39:32.125+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 : miss 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.248 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:39:32.126+0000 7f1ebb71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:39:32.131+0000 7f1ebb71f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23, ofs0, ns] 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595083 cookie 94448932132144 notifier 6486 bl.length()=907 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:39:32.131+0000 7f1d9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_sources= new_sources= 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential sources added=[] removed=[] 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_dests= new_dests= 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential dests added=[] removed=[] 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:39:32.133+0000 7f1ebb71f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1ebb71f800 time 2024-03-09T14:39:32.134118+0000 2024-03-09T14:39:32.249 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1ebcd80e86] 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:39:32.134+0000 7f1ebb71f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f1ebb71f800 thread_name:radosgw-admin 2024-03-09T14:39:32.250 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f1ebbc54db0] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f1ebbca154c] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1ebcd80ee0] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f1ebcd81044] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e698486f91] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55e6984a1e64] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f1ebbc3feb0] 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:39:32.251 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:39:32.252 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:39:32.253 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:39:32.254 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:39:32.255 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:39:32.256 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:39:32.257 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ce67fc640 / http_manager 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d6cfe1640 / http_manager 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d6dfe3640 / rgw_dt_lg_renew 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d997fa640 / ms_dispatch 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1d9affd640 / io_context_pool 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da1602640 / ms_dispatch 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da3e07640 / ms_dispatch 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1da560a640 / io_context_pool 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb6c80640 / msgr-worker-2 2024-03-09T14:39:32.258 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb7481640 / msgr-worker-1 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb7c82640 / msgr-worker-0 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1eb8483640 / io_context_pool 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr: 7f1ebb71f800 / radosgw-admin 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:39:32.135507Z_b4064d72-39b2-4a8e-b8a7-22217e37ea2d/log 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:39:32.259 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:39:32.260 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.204+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 realm 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.206+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.207+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.207+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.208+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.208+0000 7fad7a333800 20 searching for the correct realm 2024-03-09T14:39:32.261 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.211+0000 7fad76865640 0 -- 172.21.15.46:0/1980038577 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x5643dd5b9f40 msgr2=0x5643dd5bc400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:32.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.215+0000 7fad76064640 0 -- 172.21.15.46:0/1980038577 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fad60017040 msgr2=0x7fad6000f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.421+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 zone default found 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 4 Realm: () 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 zonegroup default 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.422+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.423+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.423+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.423+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.424 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.423+0000 7fad7a333800 20 started sync module instance, tier type = 2024-03-09T14:39:32.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.423+0000 7fad7a333800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=0 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=1 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=2 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=3 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=4 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=5 2024-03-09T14:39:32.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=6 2024-03-09T14:39:32.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 20 add_watcher() i=7 2024-03-09T14:39:32.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.433+0000 7fad7a333800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:32.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.435+0000 7fac2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:32.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:32.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 5 note: GC not initialized 2024-03-09T14:39:32.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7faba77fe640 20 reqs_thread_entry: start 2024-03-09T14:39:32.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:32.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 Filter name: none 2024-03-09T14:39:32.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7faba57fa640 20 reqs_thread_entry: start 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.436+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:32.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:39:32.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.437+0000 7fad7a333800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:39:32.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.438+0000 7fad7a333800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.438+0000 7fad7a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.439+0000 7fac2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.441+0000 7fad7a333800 20 remove_watcher() i=0 2024-03-09T14:39:32.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.441+0000 7fad7a333800 2 removed watcher, disabling cache 2024-03-09T14:39:32.443 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.443+0000 7fad7a333800 20 remove_watcher() i=1 2024-03-09T14:39:32.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.444+0000 7fad7a333800 20 remove_watcher() i=2 2024-03-09T14:39:32.445 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.445+0000 7fad7a333800 20 remove_watcher() i=3 2024-03-09T14:39:32.446 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.446+0000 7fad7a333800 20 remove_watcher() i=4 2024-03-09T14:39:32.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.447+0000 7fad7a333800 20 remove_watcher() i=5 2024-03-09T14:39:32.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.448+0000 7fad7a333800 20 remove_watcher() i=6 2024-03-09T14:39:32.449 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.449+0000 7fad7a333800 20 remove_watcher() i=7 2024-03-09T14:39:32.459 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.459 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:39:32.459 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-block-writes id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:39:32.459 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:39:32.460 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:32.460 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:32.491 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:39:32.491 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:39:32.550 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:39:32.580 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:32.580 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:32.614 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.614+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 realm 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.616 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.615+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.616+0000 7f1f3fe15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.616+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.617+0000 7f1f3fe15800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:32.617 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.617+0000 7f1f3fe15800 20 searching for the correct realm 2024-03-09T14:39:32.620 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.620+0000 7f1f3bbdf640 0 -- 172.21.15.46:0/3244241815 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55ff681d3ce0 msgr2=0x55ff681d61a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:32.624 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.624+0000 7f1f3b3de640 0 -- 172.21.15.46:0/3244241815 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f1f300a0900 msgr2=0x7f1f30085450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:39:32.629 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.630 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.629+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:32.631 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 zone default found 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 4 Realm: () 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 zonegroup default 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.630+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.631+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.631+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.631+0000 7f1f3fe15800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:32.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.631+0000 7f1f3fe15800 20 started sync module instance, tier type = 2024-03-09T14:39:32.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.631+0000 7f1f3fe15800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=0 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=1 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=2 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=3 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=4 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=5 2024-03-09T14:39:32.640 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=6 2024-03-09T14:39:32.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 20 add_watcher() i=7 2024-03-09T14:39:32.641 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.640+0000 7f1f3fe15800 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:32.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.642+0000 7f1df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:32.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:32.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 5 note: GC not initialized 2024-03-09T14:39:32.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1df0fe1640 20 reqs_thread_entry: start 2024-03-09T14:39:32.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 20 init_complete bucket index max shards: 1 2024-03-09T14:39:32.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 20 Filter name: none 2024-03-09T14:39:32.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1d6a7fc640 20 reqs_thread_entry: start 2024-03-09T14:39:32.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:39:32.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.643+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 : miss 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 20 rados->read ofs=0 len=0 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:39:32.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.644+0000 7f1f3fe15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 2024-03-09T14:39:32.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.647+0000 7f1f3fe15800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to be held by another RGW process; skipping for now 2024-03-09T14:39:32.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.648+0000 7f1df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:32.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.650+0000 7f1f3fe15800 20 remove_watcher() i=0 2024-03-09T14:39:32.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.650+0000 7f1f3fe15800 2 removed watcher, disabling cache 2024-03-09T14:39:32.651 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.651+0000 7f1f3fe15800 20 remove_watcher() i=1 2024-03-09T14:39:32.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.652+0000 7f1f3fe15800 20 remove_watcher() i=2 2024-03-09T14:39:32.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.653+0000 7f1f3fe15800 20 remove_watcher() i=3 2024-03-09T14:39:32.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.654+0000 7f1f3fe15800 20 remove_watcher() i=4 2024-03-09T14:39:32.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.655+0000 7f1f3fe15800 20 remove_watcher() i=5 2024-03-09T14:39:32.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.656+0000 7f1f3fe15800 20 remove_watcher() i=6 2024-03-09T14:39:32.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:39:32.657+0000 7f1f3fe15800 20 remove_watcher() i=7 2024-03-09T14:39:32.667 INFO:tasks.workunit.client.0.smithi046.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-09T14:40:02.688 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:40:02.725 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:02.725 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:02.764 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.764+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.765+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.765+0000 7f790aa30800 20 realm 2024-03-09T14:40:02.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.765+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.765+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.766+0000 7f790aa30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:02.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.766+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.766+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.766+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.767+0000 7f790aa30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:02.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.767+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.768+0000 7f790aa30800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:02.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.768+0000 7f790aa30800 20 searching for the correct realm 2024-03-09T14:40:02.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.771+0000 7f7905456640 0 -- 172.21.15.46:0/2767996600 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55e8cc4bc790 msgr2=0x55e8cc4beb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:02.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.775+0000 7f7905c57640 0 -- 172.21.15.46:0/2767996600 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f78fc080660 msgr2=0x7f78fc08f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:02.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:02.984 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:02.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:02.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:02.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:02.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:02.985 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.982+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 zone default found 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 4 Realm: () 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:02.986 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 zonegroup default 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.983+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.984+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.984+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.984+0000 7f790aa30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.984+0000 7f790aa30800 20 started sync module instance, tier type = 2024-03-09T14:40:02.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.984+0000 7f790aa30800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=0 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=1 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=2 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=3 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=4 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=5 2024-03-09T14:40:02.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.994+0000 7f790aa30800 20 add_watcher() i=6 2024-03-09T14:40:02.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.995+0000 7f790aa30800 20 add_watcher() i=7 2024-03-09T14:40:02.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.995+0000 7f790aa30800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:02.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.997+0000 7f77bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:02.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 5 note: GC not initialized 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f77bafe5640 20 reqs_thread_entry: start 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 20 Filter name: none 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f77b8fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:40:02.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.998+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:40:03.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:40:03.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 : miss 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:02.999+0000 7f790aa30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 2024-03-09T14:40:03.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.001+0000 7f790aa30800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.005+0000 7f790aa30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.005+0000 7f790aa30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.005+0000 7f790aa30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.005+0000 7f790aa30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23, ofs0, ns] 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.006+0000 7f77e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595084 cookie 94458348340960 notifier 6540 bl.length()=907 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.006+0000 7f77e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.006+0000 7f77e8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:40:03.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.006+0000 7f77e8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:03.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.007+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_sources= new_sources= 2024-03-09T14:40:03.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.007+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential sources added=[] removed=[] 2024-03-09T14:40:03.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.007+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_dests= new_dests= 2024-03-09T14:40:03.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.007+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential dests added=[] removed=[] 2024-03-09T14:40:03.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.009+0000 7f790aa30800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23.2.0 2024-03-09T14:40:03.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.009+0000 7f790aa30800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23.2.0 2024-03-09T14:40:03.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.009+0000 7f790aa30800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23.2.1 2024-03-09T14:40:03.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.009+0000 7f790aa30800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23.2.1 2024-03-09T14:40:03.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.009+0000 7f790aa30800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23.0 2024-03-09T14:40:03.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.011+0000 7f790aa30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:03.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.011+0000 7f790aa30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.012+0000 7f790aa30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.012+0000 7f790aa30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.012+0000 7f790aa30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.012+0000 7f790aa30800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23, ofs0, ns] 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.013+0000 7f77e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595085 cookie 94458348340960 notifier 6540 bl.length()=875 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.013+0000 7f77e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 info.flags=0x17 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.013+0000 7f77e97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 to cache LRU end 2024-03-09T14:40:03.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.013+0000 7f77e97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:03.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.014+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_sources= new_sources= 2024-03-09T14:40:03.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.014+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential sources added=[] removed=[] 2024-03-09T14:40:03.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.014+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): orig_dests= new_dests= 2024-03-09T14:40:03.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.014+0000 7f790aa30800 20 handle_bi_update(): bucket=:abort-at-block-writes[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23]): potential dests added=[] removed=[] 2024-03-09T14:40:03.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.015+0000 7f790aa30800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-03-09T14:40:03.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.018+0000 7f77bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:03.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.020+0000 7f790aa30800 20 remove_watcher() i=0 2024-03-09T14:40:03.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.020+0000 7f790aa30800 2 removed watcher, disabling cache 2024-03-09T14:40:03.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.021+0000 7f790aa30800 20 remove_watcher() i=1 2024-03-09T14:40:03.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.022+0000 7f790aa30800 20 remove_watcher() i=2 2024-03-09T14:40:03.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.024+0000 7f790aa30800 20 remove_watcher() i=3 2024-03-09T14:40:03.025 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.025+0000 7f790aa30800 20 remove_watcher() i=4 2024-03-09T14:40:03.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.026+0000 7f790aa30800 20 remove_watcher() i=5 2024-03-09T14:40:03.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.027+0000 7f790aa30800 20 remove_watcher() i=6 2024-03-09T14:40:03.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.028+0000 7f790aa30800 20 remove_watcher() i=7 2024-03-09T14:40:03.040 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:40:03.069 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:03.069 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:03.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.103+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 realm 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.105+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.106+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:03.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.106+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.107+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:03.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.107+0000 7f7a1622e800 20 searching for the correct realm 2024-03-09T14:40:03.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.109+0000 7f7a10da8640 0 -- 172.21.15.46:0/422547776 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f7a0408bc20 msgr2=0x7f7a0405f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:03.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.114+0000 7f7a115a9640 0 -- 172.21.15.46:0/422547776 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f7a0805c960 msgr2=0x7f7a0804e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:03.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.320+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.321+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.321+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.321+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:03.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.321+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:03.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 zone default found 2024-03-09T14:40:03.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 4 Realm: () 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 zonegroup default 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.322+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.323+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.323+0000 7f7a1622e800 20 started sync module instance, tier type = 2024-03-09T14:40:03.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.323+0000 7f7a1622e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:03.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=0 2024-03-09T14:40:03.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=1 2024-03-09T14:40:03.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=2 2024-03-09T14:40:03.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=3 2024-03-09T14:40:03.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=4 2024-03-09T14:40:03.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=5 2024-03-09T14:40:03.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.332+0000 7f7a1622e800 20 add_watcher() i=6 2024-03-09T14:40:03.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.333+0000 7f7a1622e800 20 add_watcher() i=7 2024-03-09T14:40:03.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.333+0000 7f7a1622e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:03.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f78c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f7a1622e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f7a1622e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f7a1622e800 5 note: GC not initialized 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f78c67e4640 20 reqs_thread_entry: start 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f7a1622e800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f7a1622e800 20 Filter name: none 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.335+0000 7f7837fff640 20 reqs_thread_entry: start 2024-03-09T14:40:03.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.336+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.336+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:40:03.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.336+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.336+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:40:03.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.336+0000 7f7a1622e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:03.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.336+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.337+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=189 2024-03-09T14:40:03.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.337+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.337+0000 7f7a1622e800 20 rados_obj.operate() r=0 bl.length=403 2024-03-09T14:40:03.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.337+0000 7f7a1622e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:03.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.338+0000 7f7a1622e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:03.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.338+0000 7f7a1622e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:03.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.339+0000 7f78c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:03.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.341+0000 7f7a1622e800 20 remove_watcher() i=0 2024-03-09T14:40:03.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.341+0000 7f7a1622e800 2 removed watcher, disabling cache 2024-03-09T14:40:03.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.342+0000 7f7a1622e800 20 remove_watcher() i=1 2024-03-09T14:40:03.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.343+0000 7f7a1622e800 20 remove_watcher() i=2 2024-03-09T14:40:03.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.344+0000 7f7a1622e800 20 remove_watcher() i=3 2024-03-09T14:40:03.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.345+0000 7f7a1622e800 20 remove_watcher() i=4 2024-03-09T14:40:03.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.346+0000 7f7a1622e800 20 remove_watcher() i=5 2024-03-09T14:40:03.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.347+0000 7f7a1622e800 20 remove_watcher() i=6 2024-03-09T14:40:03.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:03.348+0000 7f7a1622e800 20 remove_watcher() i=7 2024-03-09T14:40:03.358 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:03.358 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:03.358 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-block-writes id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:40:03.358 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:03.360 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.360 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.382 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.382 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.566 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.566 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.629 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-03-09T14:40:03.629 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:03.630 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.630 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.671 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.672 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.729 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.729 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.763 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.764 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.796 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.797 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.829 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.830 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.862 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.862 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.895 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.895 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.927 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.927 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.960 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.960 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:03.992 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:03.992 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.025 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.025 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.058 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.059 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.091 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.091 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.126 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.126 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.158 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.158 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.192 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.192 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.226 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.226 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.259 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.260 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.291 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.291 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.324 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.324 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.356 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.356 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.392 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:40:04.419 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:04.419 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:04.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.452+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.454+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.454+0000 7f1d20424800 20 realm 2024-03-09T14:40:04.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.454+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.454+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.454+0000 7f1d20424800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:04.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.454+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.455+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.455+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.456+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:04.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.456+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.456+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:04.457 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.456+0000 7f1d20424800 20 searching for the correct realm 2024-03-09T14:40:04.460 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.460+0000 7f1d1e728640 0 -- 172.21.15.46:0/3725200145 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55b381a875a0 msgr2=0x55b381a899c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:04.463 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.463+0000 7f1d1d726640 0 -- 172.21.15.46:0/3725200145 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55b381a8ef10 msgr2=0x55b381a91300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.468+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 zone default found 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 4 Realm: () 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:04.471 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:04.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 zonegroup default 2024-03-09T14:40:04.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.469+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 started sync module instance, tier type = 2024-03-09T14:40:04.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.470+0000 7f1d20424800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=0 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=1 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=2 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=3 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=4 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=5 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.480+0000 7f1d20424800 20 add_watcher() i=6 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.481+0000 7f1d20424800 20 add_watcher() i=7 2024-03-09T14:40:04.481 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.481+0000 7f1d20424800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:04.482 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.482+0000 7f1bcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:04.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1d20424800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:04.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1d20424800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:04.483 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1d20424800 5 note: GC not initialized 2024-03-09T14:40:04.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1bce7fc640 20 reqs_thread_entry: start 2024-03-09T14:40:04.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1d20424800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:04.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1d20424800 20 Filter name: none 2024-03-09T14:40:04.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1b3ffff640 20 reqs_thread_entry: start 2024-03-09T14:40:04.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.483+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.484+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:04.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.484+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.484+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:04.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.484+0000 7f1d20424800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:04.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.484+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.485+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:04.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.485+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.485+0000 7f1d20424800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:04.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.485+0000 7f1d20424800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:04.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.485+0000 7f1d20424800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.486+0000 7f1d20424800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.486+0000 7f1bcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:04.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.489+0000 7f1d20424800 20 remove_watcher() i=0 2024-03-09T14:40:04.489 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.489+0000 7f1d20424800 2 removed watcher, disabling cache 2024-03-09T14:40:04.490 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.490+0000 7f1d20424800 20 remove_watcher() i=1 2024-03-09T14:40:04.491 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.491+0000 7f1d20424800 20 remove_watcher() i=2 2024-03-09T14:40:04.492 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.492+0000 7f1d20424800 20 remove_watcher() i=3 2024-03-09T14:40:04.493 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.493+0000 7f1d20424800 20 remove_watcher() i=4 2024-03-09T14:40:04.494 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.494+0000 7f1d20424800 20 remove_watcher() i=5 2024-03-09T14:40:04.495 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.495+0000 7f1d20424800 20 remove_watcher() i=6 2024-03-09T14:40:04.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.496+0000 7f1d20424800 20 remove_watcher() i=7 2024-03-09T14:40:04.506 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:04.506 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:04.506 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:04.506 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:04.508 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-03-09T14:40:04.540 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:04.540 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:04.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.573+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.775+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.775+0000 7f7c63111800 20 realm 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.775+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.775+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.775+0000 7f7c63111800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.775+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.776+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.776+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.777+0000 7f7c63111800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:04.777 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.777+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.778+0000 7f7c63111800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:04.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.778+0000 7f7c63111800 20 searching for the correct realm 2024-03-09T14:40:04.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.782+0000 7f7c60413640 0 -- 172.21.15.46:0/627873039 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x562cbed0b8d0 msgr2=0x562cbed0dce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:04.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.785+0000 7f7c61415640 0 -- 172.21.15.46:0/627873039 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f7c48009040 msgr2=0x7f7c48056c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:04.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.790+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:04.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 zone default found 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 4 Realm: () 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 zonegroup default 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.791+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.792+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.792+0000 7f7c63111800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.792+0000 7f7c63111800 20 started sync module instance, tier type = 2024-03-09T14:40:04.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.792+0000 7f7c63111800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=0 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=1 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=2 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=3 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=4 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=5 2024-03-09T14:40:04.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.801+0000 7f7c63111800 20 add_watcher() i=6 2024-03-09T14:40:04.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.802+0000 7f7c63111800 20 add_watcher() i=7 2024-03-09T14:40:04.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.802+0000 7f7c63111800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:04.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.804+0000 7f7b16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.804+0000 7f7c63111800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.804+0000 7f7c63111800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.804+0000 7f7c63111800 5 note: GC not initialized 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7b15fe3640 20 reqs_thread_entry: start 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 20 Filter name: none 2024-03-09T14:40:04.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7a877fe640 20 reqs_thread_entry: start 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 : miss 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.805+0000 7f7c63111800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.806+0000 7f7c63111800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:04.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.806+0000 7f7c63111800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:04.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.806+0000 7f7c63111800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:04.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.806+0000 7f7c63111800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:04.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.806+0000 7f7c63111800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:04.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.806+0000 7f7c63111800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.809+0000 7f7c63111800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.809+0000 7f7c63111800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.809+0000 7f7c63111800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.809+0000 7f7c63111800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24, ofs0, ns] 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.810+0000 7f7b37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94750179934560 notifier 6591 bl.length()=923 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.810+0000 7f7b37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.810+0000 7f7b37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:04.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.810+0000 7f7b37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:04.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.811+0000 7f7c63111800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): orig_sources= new_sources= 2024-03-09T14:40:04.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.811+0000 7f7c63111800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): potential sources added=[] removed=[] 2024-03-09T14:40:04.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.811+0000 7f7c63111800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): orig_dests= new_dests= 2024-03-09T14:40:04.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.811+0000 7f7c63111800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): potential dests added=[] removed=[] 2024-03-09T14:40:04.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.813+0000 7f7c63111800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.1.0 2024-03-09T14:40:04.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.813+0000 7f7c63111800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.1.0 2024-03-09T14:40:04.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.813+0000 7f7c63111800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.1.1 2024-03-09T14:40:04.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.813+0000 7f7c63111800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.1.1 2024-03-09T14:40:04.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.813+0000 7f7c63111800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.0 2024-03-09T14:40:04.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.815+0000 7f7c63111800 -1 Injecting error=-5 at location=commit_target_layout 2024-03-09T14:40:04.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.815+0000 7f7c63111800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-03-09T14:40:04.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.818+0000 7f7b16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:04.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.820+0000 7f7c63111800 20 remove_watcher() i=0 2024-03-09T14:40:04.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.820+0000 7f7c63111800 2 removed watcher, disabling cache 2024-03-09T14:40:04.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.822+0000 7f7c63111800 20 remove_watcher() i=1 2024-03-09T14:40:04.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.823+0000 7f7c63111800 20 remove_watcher() i=2 2024-03-09T14:40:04.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.824+0000 7f7c63111800 20 remove_watcher() i=3 2024-03-09T14:40:04.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.825+0000 7f7c63111800 20 remove_watcher() i=4 2024-03-09T14:40:04.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.826+0000 7f7c63111800 20 remove_watcher() i=5 2024-03-09T14:40:04.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.827+0000 7f7c63111800 20 remove_watcher() i=6 2024-03-09T14:40:04.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.828+0000 7f7c63111800 20 remove_watcher() i=7 2024-03-09T14:40:04.842 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:40:04.867 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:04.867 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:04.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.900+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.901+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.901+0000 7feb01011800 20 realm 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.901+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.902+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.902+0000 7feb01011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.902+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.902+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.902+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.903+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:04.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.903+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.904+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:04.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.904+0000 7feb01011800 20 searching for the correct realm 2024-03-09T14:40:04.907 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.907+0000 7feafcddf640 0 -- 172.21.15.46:0/2455289192 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x557643feba70 msgr2=0x557643fede80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:04.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.911+0000 7feafbddd640 0 -- 172.21.15.46:0/2455289192 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x557643ff34a0 msgr2=0x557643ff5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:04.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:04.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:04.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:04.917 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:04.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 zone default found 2024-03-09T14:40:04.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 4 Realm: () 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 zonegroup default 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.916+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 started sync module instance, tier type = 2024-03-09T14:40:04.920 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.917+0000 7feb01011800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=0 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=1 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=2 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=3 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=4 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=5 2024-03-09T14:40:04.927 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.926+0000 7feb01011800 20 add_watcher() i=6 2024-03-09T14:40:04.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.927+0000 7feb01011800 20 add_watcher() i=7 2024-03-09T14:40:04.928 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.927+0000 7feb01011800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:04.929 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.929+0000 7fe9b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:04.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.929+0000 7feb01011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:04.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.929+0000 7feb01011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:04.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.929+0000 7feb01011800 5 note: GC not initialized 2024-03-09T14:40:04.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7fe9b1fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:04.930 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7feb01011800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:04.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7feb01011800 20 Filter name: none 2024-03-09T14:40:04.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7fe9237fe640 20 reqs_thread_entry: start 2024-03-09T14:40:04.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.931 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:04.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.930+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.931+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:40:04.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.931+0000 7feb01011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:04.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.931+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.931+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:04.932 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.931+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.932+0000 7feb01011800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:40:04.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.932+0000 7feb01011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:04.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.933+0000 7feb01011800 20 rados->read ofs=0 len=0 2024-03-09T14:40:04.933 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.933+0000 7feb01011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:04.934 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.934+0000 7fe9b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:04.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.936+0000 7feb01011800 20 remove_watcher() i=0 2024-03-09T14:40:04.936 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.936+0000 7feb01011800 2 removed watcher, disabling cache 2024-03-09T14:40:04.937 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.937+0000 7feb01011800 20 remove_watcher() i=1 2024-03-09T14:40:04.938 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.938+0000 7feb01011800 20 remove_watcher() i=2 2024-03-09T14:40:04.939 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.939+0000 7feb01011800 20 remove_watcher() i=3 2024-03-09T14:40:04.940 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.940+0000 7feb01011800 20 remove_watcher() i=4 2024-03-09T14:40:04.941 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.941+0000 7feb01011800 20 remove_watcher() i=5 2024-03-09T14:40:04.942 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.942+0000 7feb01011800 20 remove_watcher() i=6 2024-03-09T14:40:04.943 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:04.943+0000 7feb01011800 20 remove_watcher() i=7 2024-03-09T14:40:04.953 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:04.953 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:04.953 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:04.953 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:04.954 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.954 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:04.984 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:04.985 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.042 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:40:05.072 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:05.072 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:05.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.106+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 realm 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.107+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.108+0000 7f7d35420800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:05.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.108+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.109+0000 7f7d35420800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:05.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.109+0000 7f7d35420800 20 searching for the correct realm 2024-03-09T14:40:05.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.113+0000 7f7d3271b640 0 -- 172.21.15.46:0/4105697069 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5584d761a040 msgr2=0x5584d761c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:05.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.117+0000 7f7d3371d640 0 -- 172.21.15.46:0/4105697069 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f7d280b5b50 msgr2=0x7f7d280ce130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:05.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:05.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.120+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 zone default found 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 4 Realm: () 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:05.123 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 zonegroup default 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.121+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 started sync module instance, tier type = 2024-03-09T14:40:05.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.122+0000 7f7d35420800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:05.131 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=0 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=1 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=2 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=3 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=4 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=5 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.131+0000 7f7d35420800 20 add_watcher() i=6 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.132+0000 7f7d35420800 20 add_watcher() i=7 2024-03-09T14:40:05.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.132+0000 7f7d35420800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:05.134 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7be97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 5 note: GC not initialized 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7b63fff640 20 reqs_thread_entry: start 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 20 Filter name: none 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7b61ffb640 20 reqs_thread_entry: start 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:40:05.135 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.134+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 : miss 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:05.136 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:05.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:05.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:05.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.135+0000 7f7d35420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 2024-03-09T14:40:05.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.136+0000 7f7d35420800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-09T14:40:05.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7d35420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7d35420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7d35420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7d35420800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24, ofs0, ns] 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7c167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595106 cookie 94029037582272 notifier 6627 bl.length()=923 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7c167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7c167fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:05.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.140+0000 7f7c167fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:05.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.142+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): orig_sources= new_sources= 2024-03-09T14:40:05.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.142+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): potential sources added=[] removed=[] 2024-03-09T14:40:05.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.142+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): orig_dests= new_dests= 2024-03-09T14:40:05.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.142+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): potential dests added=[] removed=[] 2024-03-09T14:40:05.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.143+0000 7f7d35420800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.2.0 2024-03-09T14:40:05.143 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.143+0000 7f7d35420800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.2.0 2024-03-09T14:40:05.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.143+0000 7f7d35420800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.2.1 2024-03-09T14:40:05.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.143+0000 7f7d35420800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.2.1 2024-03-09T14:40:05.144 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.143+0000 7f7d35420800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24.0 2024-03-09T14:40:05.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.146+0000 7f7d35420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:05.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.146+0000 7f7d35420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 2024-03-09T14:40:05.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7d35420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:05.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7d35420800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:05.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7d35420800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:05.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7d35420800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24, ofs0, ns] 2024-03-09T14:40:05.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7c15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595107 cookie 94029037582272 notifier 6627 bl.length()=891 2024-03-09T14:40:05.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7c15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 info.flags=0x17 2024-03-09T14:40:05.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7c15ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 to cache LRU end 2024-03-09T14:40:05.148 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.147+0000 7f7c15ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:05.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.149+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): orig_sources= new_sources= 2024-03-09T14:40:05.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.149+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): potential sources added=[] removed=[] 2024-03-09T14:40:05.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.149+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): orig_dests= new_dests= 2024-03-09T14:40:05.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.149+0000 7f7d35420800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24]): potential dests added=[] removed=[] 2024-03-09T14:40:05.150 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.150+0000 7f7d35420800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-09T14:40:05.152 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.152+0000 7f7be97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:05.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.154+0000 7f7d35420800 20 remove_watcher() i=0 2024-03-09T14:40:05.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.154+0000 7f7d35420800 2 removed watcher, disabling cache 2024-03-09T14:40:05.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.155+0000 7f7d35420800 20 remove_watcher() i=1 2024-03-09T14:40:05.156 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.156+0000 7f7d35420800 20 remove_watcher() i=2 2024-03-09T14:40:05.157 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.157+0000 7f7d35420800 20 remove_watcher() i=3 2024-03-09T14:40:05.158 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.158+0000 7f7d35420800 20 remove_watcher() i=4 2024-03-09T14:40:05.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.159+0000 7f7d35420800 20 remove_watcher() i=5 2024-03-09T14:40:05.160 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.160+0000 7f7d35420800 20 remove_watcher() i=6 2024-03-09T14:40:05.161 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.161+0000 7f7d35420800 20 remove_watcher() i=7 2024-03-09T14:40:05.173 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:40:05.200 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:05.200 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:05.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.233+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 realm 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.235+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.236+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:05.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.236+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.237+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:05.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.237+0000 7fc97594b800 20 searching for the correct realm 2024-03-09T14:40:05.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.238+0000 7fc97344e640 0 -- 172.21.15.46:0/2686319884 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x55692c19d690 msgr2=0x7fc96c018400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:05.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.242+0000 7fc972c4d640 0 -- 172.21.15.46:0/2686319884 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fc96406d020 msgr2=0x7fc964059110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:05.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:05.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:05.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:05.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:05.250 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 zone default found 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 4 Realm: () 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 zonegroup default 2024-03-09T14:40:05.251 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.249+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.252 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 started sync module instance, tier type = 2024-03-09T14:40:05.253 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.250+0000 7fc97594b800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:05.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=0 2024-03-09T14:40:05.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=1 2024-03-09T14:40:05.259 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=2 2024-03-09T14:40:05.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=3 2024-03-09T14:40:05.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=4 2024-03-09T14:40:05.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=5 2024-03-09T14:40:05.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.259+0000 7fc97594b800 20 add_watcher() i=6 2024-03-09T14:40:05.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.260+0000 7fc97594b800 20 add_watcher() i=7 2024-03-09T14:40:05.260 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.260+0000 7fc97594b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:05.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.261+0000 7fc829fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:05.262 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc97594b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc97594b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc97594b800 5 note: GC not initialized 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc828fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc97594b800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc97594b800 20 Filter name: none 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc7a27fc640 20 reqs_thread_entry: start 2024-03-09T14:40:05.263 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.262+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.263+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.263+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.263+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.263+0000 7fc97594b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.263+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.264+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.264+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.264 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.264+0000 7fc97594b800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:05.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.264+0000 7fc97594b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:05.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.264+0000 7fc97594b800 20 rados->read ofs=0 len=0 2024-03-09T14:40:05.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.264+0000 7fc97594b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:05.265 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.265+0000 7fc829fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:05.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.267+0000 7fc97594b800 20 remove_watcher() i=0 2024-03-09T14:40:05.268 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.267+0000 7fc97594b800 2 removed watcher, disabling cache 2024-03-09T14:40:05.269 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.269+0000 7fc97594b800 20 remove_watcher() i=1 2024-03-09T14:40:05.270 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.270+0000 7fc97594b800 20 remove_watcher() i=2 2024-03-09T14:40:05.271 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.271+0000 7fc97594b800 20 remove_watcher() i=3 2024-03-09T14:40:05.272 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.272+0000 7fc97594b800 20 remove_watcher() i=4 2024-03-09T14:40:05.273 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.273+0000 7fc97594b800 20 remove_watcher() i=5 2024-03-09T14:40:05.274 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.274+0000 7fc97594b800 20 remove_watcher() i=6 2024-03-09T14:40:05.275 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:05.274+0000 7fc97594b800 20 remove_watcher() i=7 2024-03-09T14:40:05.284 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:05.285 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:05.285 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:40:05.285 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:05.286 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.287 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.307 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.308 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.492 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.492 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.555 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-03-09T14:40:05.555 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:05.556 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.556 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.598 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.598 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.656 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.656 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.690 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.690 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.722 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.722 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.754 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.755 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.789 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.789 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.820 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.820 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.853 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.853 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.885 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.886 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.918 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.918 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.952 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.952 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:05.987 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:05.987 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.020 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.020 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.052 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.052 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.087 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.087 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.119 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.119 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.151 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.152 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.183 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.184 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.216 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.216 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.257 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.258 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.291 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.291 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.354 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:40:06.381 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:06.381 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:06.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.415+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 realm 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.417 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.417+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.418+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:06.418 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.418+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.419+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:06.419 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.419+0000 7f71bfc13800 20 searching for the correct realm 2024-03-09T14:40:06.421 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.421+0000 7f71ba9dd640 0 -- 172.21.15.46:0/3398619644 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5567f7b5c6e0 msgr2=0x5567f7b5ead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:06.425 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.425+0000 7f71bb1de640 0 -- 172.21.15.46:0/3398619644 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f71b0020070 msgr2=0x7f71b008e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.631+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.632 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.633 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 zone default found 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 4 Realm: () 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 zonegroup default 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.632+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.634 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 started sync module instance, tier type = 2024-03-09T14:40:06.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.633+0000 7f71bfc13800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:06.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=0 2024-03-09T14:40:06.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=1 2024-03-09T14:40:06.643 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=2 2024-03-09T14:40:06.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=3 2024-03-09T14:40:06.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=4 2024-03-09T14:40:06.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=5 2024-03-09T14:40:06.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.643+0000 7f71bfc13800 20 add_watcher() i=6 2024-03-09T14:40:06.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.644+0000 7f71bfc13800 20 add_watcher() i=7 2024-03-09T14:40:06.644 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.644+0000 7f71bfc13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:06.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.645+0000 7f7071fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:06.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f71bfc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:06.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f71bfc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:06.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f71bfc13800 5 note: GC not initialized 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f7070fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f71bfc13800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f71bfc13800 20 Filter name: none 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f6fea7fc640 20 reqs_thread_entry: start 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.646+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.647+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:06.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.647+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:06.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:06.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:06.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:06.649 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.648+0000 7f71bfc13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:06.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.649+0000 7f71bfc13800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.649+0000 7f71bfc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.650 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.650+0000 7f7071fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.653+0000 7f71bfc13800 20 remove_watcher() i=0 2024-03-09T14:40:06.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.653+0000 7f71bfc13800 2 removed watcher, disabling cache 2024-03-09T14:40:06.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.654+0000 7f71bfc13800 20 remove_watcher() i=1 2024-03-09T14:40:06.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.655+0000 7f71bfc13800 20 remove_watcher() i=2 2024-03-09T14:40:06.656 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.656+0000 7f71bfc13800 20 remove_watcher() i=3 2024-03-09T14:40:06.657 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.657+0000 7f71bfc13800 20 remove_watcher() i=4 2024-03-09T14:40:06.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.658+0000 7f71bfc13800 20 remove_watcher() i=5 2024-03-09T14:40:06.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.659+0000 7f71bfc13800 20 remove_watcher() i=6 2024-03-09T14:40:06.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.660+0000 7f71bfc13800 20 remove_watcher() i=7 2024-03-09T14:40:06.670 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:06.670 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:06.671 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:06.671 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:06.671 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-03-09T14:40:06.706 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:06.706 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:06.740 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.739+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 realm 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.741+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.742 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.742+0000 7fa084667800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:06.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.742+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.743+0000 7fa084667800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:06.743 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.743+0000 7fa084667800 20 searching for the correct realm 2024-03-09T14:40:06.746 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.746+0000 7fa082964640 0 -- 172.21.15.46:0/3543060374 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55c54d20c690 msgr2=0x55c54d20ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:06.750 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.749+0000 7fa081962640 0 -- 172.21.15.46:0/3543060374 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55c54d214070 msgr2=0x55c54d216480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:06.754 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.755 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.754+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:06.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.756 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 zone default found 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 4 Realm: () 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 zonegroup default 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.755+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.756+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.756+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.756+0000 7fa084667800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.756+0000 7fa084667800 20 started sync module instance, tier type = 2024-03-09T14:40:06.757 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.756+0000 7fa084667800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=0 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=1 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=2 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=3 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=4 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=5 2024-03-09T14:40:06.765 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.764+0000 7fa084667800 20 add_watcher() i=6 2024-03-09T14:40:06.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.765+0000 7fa084667800 20 add_watcher() i=7 2024-03-09T14:40:06.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.765+0000 7fa084667800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.767+0000 7f9f38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.767+0000 7fa084667800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.767+0000 7fa084667800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.767+0000 7fa084667800 5 note: GC not initialized 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.767+0000 7f9eb37fe640 20 reqs_thread_entry: start 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 20 Filter name: none 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7f9eb17fa640 20 reqs_thread_entry: start 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:40:06.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:06.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:06.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:40:06.769 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 : miss 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.768+0000 7fa084667800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.769+0000 7fa084667800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.769+0000 7fa084667800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 info.flags=0x17 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.769+0000 7fa084667800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 to cache LRU end 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.769+0000 7fa084667800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.769+0000 7fa084667800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:06.770 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.769+0000 7fa084667800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.772+0000 7fa084667800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 info.flags=0x17 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.772+0000 7fa084667800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 to cache LRU end 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.772+0000 7fa084667800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.772+0000 7fa084667800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25, ofs0, ns] 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.773+0000 7f9f65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595110 cookie 94305890919120 notifier 6681 bl.length()=923 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.773+0000 7f9f65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 info.flags=0x17 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.773+0000 7f9f65ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 to cache LRU end 2024-03-09T14:40:06.773 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.773+0000 7f9f65ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:06.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.774+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): orig_sources= new_sources= 2024-03-09T14:40:06.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.774+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): potential sources added=[] removed=[] 2024-03-09T14:40:06.774 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.774+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): orig_dests= new_dests= 2024-03-09T14:40:06.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.774+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): potential dests added=[] removed=[] 2024-03-09T14:40:06.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.776+0000 7fa084667800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25.1.0 2024-03-09T14:40:06.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.776+0000 7fa084667800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25.1.0 2024-03-09T14:40:06.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.776+0000 7fa084667800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25.1.1 2024-03-09T14:40:06.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.776+0000 7fa084667800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25.1.1 2024-03-09T14:40:06.776 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.776+0000 7fa084667800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25.0 2024-03-09T14:40:06.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.778+0000 7fa084667800 -1 Injecting error=-125 at location=commit_target_layout 2024-03-09T14:40:06.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.778+0000 7fa084667800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:06.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.778+0000 7fa084667800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 2024-03-09T14:40:06.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7fa084667800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 info.flags=0x17 2024-03-09T14:40:06.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7fa084667800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 to cache LRU end 2024-03-09T14:40:06.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7fa084667800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:06.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7fa084667800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25, ofs0, ns] 2024-03-09T14:40:06.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7f9f657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595111 cookie 94305890919120 notifier 6681 bl.length()=891 2024-03-09T14:40:06.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7f9f657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 info.flags=0x17 2024-03-09T14:40:06.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7f9f657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 to cache LRU end 2024-03-09T14:40:06.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.779+0000 7f9f657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:06.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.781+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): orig_sources= new_sources= 2024-03-09T14:40:06.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.781+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): potential sources added=[] removed=[] 2024-03-09T14:40:06.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.781+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): orig_dests= new_dests= 2024-03-09T14:40:06.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.781+0000 7fa084667800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25]): potential dests added=[] removed=[] 2024-03-09T14:40:06.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.782+0000 7fa084667800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-09T14:40:06.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.784+0000 7f9f38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:06.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.786+0000 7fa084667800 20 remove_watcher() i=0 2024-03-09T14:40:06.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.786+0000 7fa084667800 2 removed watcher, disabling cache 2024-03-09T14:40:06.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.787+0000 7fa084667800 20 remove_watcher() i=1 2024-03-09T14:40:06.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.788+0000 7fa084667800 20 remove_watcher() i=2 2024-03-09T14:40:06.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.789+0000 7fa084667800 20 remove_watcher() i=3 2024-03-09T14:40:06.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.789+0000 7fa084667800 20 remove_watcher() i=4 2024-03-09T14:40:06.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.790+0000 7fa084667800 20 remove_watcher() i=5 2024-03-09T14:40:06.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.791+0000 7fa084667800 20 remove_watcher() i=6 2024-03-09T14:40:06.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.792+0000 7fa084667800 20 remove_watcher() i=7 2024-03-09T14:40:06.804 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:40:06.831 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:06.831 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:06.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.864+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.865+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.865+0000 7fd904216800 20 realm 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.865+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.865+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.865+0000 7fd904216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.865+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.866+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.866+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.867+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:06.867 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.867+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.867+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:06.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.867+0000 7fd904216800 20 searching for the correct realm 2024-03-09T14:40:06.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.869+0000 7fd8ff89a640 0 -- 172.21.15.46:0/2917383880 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fd8f8020040 msgr2=0x7fd8f8011420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:06.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.872+0000 7fd8ff89a640 0 -- 172.21.15.46:0/2917383880 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fd7c807ad40 msgr2=0x7fd7c807d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:06.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:06.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:06.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:06.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:06.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:06.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:06.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.878+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:06.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 zone default found 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 4 Realm: () 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 zonegroup default 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.879+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.881 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 started sync module instance, tier type = 2024-03-09T14:40:06.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.880+0000 7fd904216800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:06.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=0 2024-03-09T14:40:06.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=1 2024-03-09T14:40:06.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=2 2024-03-09T14:40:06.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=3 2024-03-09T14:40:06.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=4 2024-03-09T14:40:06.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=5 2024-03-09T14:40:06.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.889+0000 7fd904216800 20 add_watcher() i=6 2024-03-09T14:40:06.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.890+0000 7fd904216800 20 add_watcher() i=7 2024-03-09T14:40:06.890 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.890+0000 7fd904216800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:06.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.891+0000 7fd7b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:06.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd904216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:06.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd904216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:06.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd904216800 5 note: GC not initialized 2024-03-09T14:40:06.892 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd7b4fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:06.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd904216800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:06.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd904216800 20 Filter name: none 2024-03-09T14:40:06.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd72e7fc640 20 reqs_thread_entry: start 2024-03-09T14:40:06.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.892+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.893+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:06.893 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.893+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.893+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:06.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.893+0000 7fd904216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:06.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.893+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.894+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:06.894 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.894+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.894+0000 7fd904216800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:06.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.894+0000 7fd904216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:06.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.895+0000 7fd904216800 20 rados->read ofs=0 len=0 2024-03-09T14:40:06.895 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.895+0000 7fd904216800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:06.896 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.896+0000 7fd7b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:06.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.898+0000 7fd904216800 20 remove_watcher() i=0 2024-03-09T14:40:06.898 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.898+0000 7fd904216800 2 removed watcher, disabling cache 2024-03-09T14:40:06.899 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.899+0000 7fd904216800 20 remove_watcher() i=1 2024-03-09T14:40:06.900 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.900+0000 7fd904216800 20 remove_watcher() i=2 2024-03-09T14:40:06.901 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.901+0000 7fd904216800 20 remove_watcher() i=3 2024-03-09T14:40:06.902 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.902+0000 7fd904216800 20 remove_watcher() i=4 2024-03-09T14:40:06.903 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.903+0000 7fd904216800 20 remove_watcher() i=5 2024-03-09T14:40:06.904 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.904+0000 7fd904216800 20 remove_watcher() i=6 2024-03-09T14:40:06.905 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:06.905+0000 7fd904216800 20 remove_watcher() i=7 2024-03-09T14:40:06.915 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:06.915 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:06.915 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.25 num_objects: 20 size_kb: 1 num_shards: 2 2024-03-09T14:40:06.915 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:06.917 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.917 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:06.938 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:06.939 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.135 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.136 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.199 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-03-09T14:40:07.199 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:07.200 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.200 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.242 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.242 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.299 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.299 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.333 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.333 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.366 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.366 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.398 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.399 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.431 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.431 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.465 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.465 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.498 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.498 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.531 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.531 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.564 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.564 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.596 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.597 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.631 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.631 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.664 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.664 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.697 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.697 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.731 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.731 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.764 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.764 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.796 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.797 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.831 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.831 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.865 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.865 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.898 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.898 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.931 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:07.931 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:07.964 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:40:07.991 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:07.991 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:08.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.024+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.227 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.226+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.226+0000 7fafc7f33800 20 realm 2024-03-09T14:40:08.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.226+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.227+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.227+0000 7fafc7f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:08.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.227+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.228 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.227+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.227+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.229 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.228+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:08.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.228+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.229+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:08.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.229+0000 7fafc7f33800 20 searching for the correct realm 2024-03-09T14:40:08.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.231+0000 7fafc33d2640 0 -- 172.21.15.46:0/2754797643 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fafb40b0000 msgr2=0x7fafb4075830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:08.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.839+0000 7fafc33d2640 0 -- 172.21.15.46:0/2754797643 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5612f5e72310 msgr2=0x5612f5e74700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:08.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:08.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:08.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:08.846 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:08.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:08.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:08.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.847 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:08.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.846+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 zone default found 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 4 Realm: () 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 zonegroup default 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.847+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.848+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.848+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.848+0000 7fafc7f33800 20 started sync module instance, tier type = 2024-03-09T14:40:08.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.848+0000 7fafc7f33800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:08.859 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=0 2024-03-09T14:40:08.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=1 2024-03-09T14:40:08.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=2 2024-03-09T14:40:08.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=3 2024-03-09T14:40:08.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=4 2024-03-09T14:40:08.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=5 2024-03-09T14:40:08.860 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.859+0000 7fafc7f33800 20 add_watcher() i=6 2024-03-09T14:40:08.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.860+0000 7fafc7f33800 20 add_watcher() i=7 2024-03-09T14:40:08.861 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.860+0000 7fafc7f33800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:08.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.862+0000 7fae79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:08.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.862+0000 7fafc7f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:08.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.862+0000 7fafc7f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:08.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.862+0000 7fafc7f33800 5 note: GC not initialized 2024-03-09T14:40:08.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fae78fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:08.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fafc7f33800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:08.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fafc7f33800 20 Filter name: none 2024-03-09T14:40:08.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fadf27fc640 20 reqs_thread_entry: start 2024-03-09T14:40:08.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:08.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.863+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.864+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:08.868 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.864+0000 7fafc7f33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:08.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.864+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.864+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:08.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.864+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.865+0000 7fafc7f33800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:08.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.865+0000 7fafc7f33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:08.869 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.866+0000 7fafc7f33800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.866+0000 7fafc7f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.867+0000 7fae79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:08.870 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.869+0000 7fafc7f33800 20 remove_watcher() i=0 2024-03-09T14:40:08.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.869+0000 7fafc7f33800 2 removed watcher, disabling cache 2024-03-09T14:40:08.871 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.871+0000 7fafc7f33800 20 remove_watcher() i=1 2024-03-09T14:40:08.872 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.872+0000 7fafc7f33800 20 remove_watcher() i=2 2024-03-09T14:40:08.873 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.873+0000 7fafc7f33800 20 remove_watcher() i=3 2024-03-09T14:40:08.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.874+0000 7fafc7f33800 20 remove_watcher() i=4 2024-03-09T14:40:08.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.875+0000 7fafc7f33800 20 remove_watcher() i=5 2024-03-09T14:40:08.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.877+0000 7fafc7f33800 20 remove_watcher() i=6 2024-03-09T14:40:08.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.878+0000 7fafc7f33800 20 remove_watcher() i=7 2024-03-09T14:40:08.889 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:08.889 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:08.889 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:08.889 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:08.891 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-03-09T14:40:08.926 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:08.926 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:08.963 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.962+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 realm 2024-03-09T14:40:08.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:08.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:08.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.965+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:08.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.965+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:08.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.966+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:08.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.966+0000 7f68cc6c0800 20 searching for the correct realm 2024-03-09T14:40:08.967 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:08.967+0000 7f68ca1c3640 0 -- 172.21.15.46:0/3228981688 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f68c4059c20 msgr2=0x7f68c407b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:09.173 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.172+0000 7f68c99c2640 0 -- 172.21.15.46:0/3228981688 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f68bc08f060 msgr2=0x7f68bc055a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 zone default found 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 Realm: () 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 zonegroup default 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 started sync module instance, tier type = 2024-03-09T14:40:09.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:09.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=0 2024-03-09T14:40:09.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=1 2024-03-09T14:40:09.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=2 2024-03-09T14:40:09.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=3 2024-03-09T14:40:09.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=4 2024-03-09T14:40:09.192 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=5 2024-03-09T14:40:09.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=6 2024-03-09T14:40:09.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.192+0000 7f68cc6c0800 20 add_watcher() i=7 2024-03-09T14:40:09.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.192+0000 7f68cc6c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:09.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.194+0000 7f6780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:09.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:09.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 note: GC not initialized 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.194+0000 7f66fb7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 Filter name: none 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f66f97fa640 20 reqs_thread_entry: start 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 : miss 2024-03-09T14:40:09.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.196+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:09.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:09.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26, ofs0, ns] 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.200+0000 7f67adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94784521045152 notifier 6735 bl.length()=923 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.201 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_sources= new_sources= 2024-03-09T14:40:09.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential sources added=[] removed=[] 2024-03-09T14:40:09.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_dests= new_dests= 2024-03-09T14:40:09.203 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential dests added=[] removed=[] 2024-03-09T14:40:09.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.204+0000 7f68cc6c0800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:09.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:09.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.204+0000 7f68cc6c0800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:09.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:09.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.0 2024-03-09T14:40:09.207 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68cc6c0800 time 2024-03-09T14:40:09.207836+0000 2024-03-09T14:40:09.207 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:09.207 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.207 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f68cfb80e86] 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:09.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.207+0000 7f68cc6c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68cc6c0800 time 2024-03-09T14:40:09.207836+0000 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f68cfb80e86] 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:09.209 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.210 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:09.210 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:09.210 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.210 INFO:tasks.workunit.client.0.smithi046.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:40:09.210 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f68cc6c0800 thread_name:radosgw-admin 2024-03-09T14:40:09.230 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.230 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f68ce854db0] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f68ce8a154c] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f68cfb80ee0] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:09.231 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.208+0000 7f68cc6c0800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f68cc6c0800 thread_name:radosgw-admin 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f68ce854db0] 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f68ce8a154c] 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f68cfb80ee0] 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.232 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: dump: 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.233 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:40:08.945+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6410 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:40:08.945+0000 7f68cc6c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:40:08.945+0000 7f68cc6c0800 4 set_mon_vals no callback set 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: shutdown 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 asok(0x5634bd832780) unregister_commands rotate-key 2024-03-09T14:40:09.234 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.235 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding auth protocol: cephx 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding auth protocol: cephx 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding auth protocol: cephx 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.236 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: starting msgr at 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: starting objecter 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command objecter_requests hook 0x5634bda7cc70 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: setting wanted keys 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: calling monclient init 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding auth protocol: cephx 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding auth protocol: cephx 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding auth protocol: cephx 2024-03-09T14:40:09.237 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.238 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key hook 0x5634bda50d48 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bda54120 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bda57600 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x7f68b4002510 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.319577s 2024-03-09T14:40:09.239 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x7f68b4002510 auth_method 0 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bda57600 auth_method 0 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.240 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request con 0x5634bda54120 auth_method 0 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_done global_id 6413 payload 824 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 1 monclient: found mon.noname-c 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.241 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: dump: 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.242 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: dump: 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.243 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6413 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:40:08.948+0000 7f67b8608640 4 set_mon_vals no callback set 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 1 librados: init done 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:40:08.949+0000 7f67b6e05640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:40:08.949+0000 7f67b6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:40:08.949+0000 7f67b6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:40:08.950+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f67b006a5b0 auth_method 0 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:40:08.950+0000 7f68c99c2640 10 monclient: get_auth_request con 0x5634bda935b0 auth_method 0 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:40:08.951+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x5634bda9d000 auth_method 0 2024-03-09T14:40:09.244 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:40:08.952+0000 7f68c99c2640 10 monclient: get_auth_request con 0x5634bdaa1360 auth_method 0 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.245 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding auth protocol: cephx 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding auth protocol: cephx 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding auth protocol: cephx 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.246 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command objecter_requests cmddesc objecter_requests hook 0x5634bdaa7290 EEXIST 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding auth protocol: cephx 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding auth protocol: cephx 2024-03-09T14:40:09.247 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding auth protocol: cephx 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.248 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key cmddesc rotate-key hook 0x5634bdaa4980 EEXIST 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bdad04f0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bdad08d0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x5634bdae3280 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.327024s 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request con 0x5634bdad04f0 auth_method 0 2024-03-09T14:40:09.249 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x5634bdae3280 auth_method 0 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:40:08.955+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:40:08.955+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.250 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bdad08d0 auth_method 0 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_done global_id 6416 payload 824 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 1 monclient: found mon.noname-c 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.251 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: dump: 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.252 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: dump: 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.253 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6416 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:40:08.955+0000 7f68cb1c5640 4 set_mon_vals no callback set 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:40:08.957+0000 7f67affff640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:09.254 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:40:08.957+0000 7f67affff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:40:08.957+0000 7f67affff640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:40:08.957+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f67a406a4f0 auth_method 0 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: get_monmap_and_config 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.255 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding auth protocol: cephx 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding auth protocol: cephx 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding auth protocol: cephx 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.256 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding auth protocol: cephx 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding auth protocol: cephx 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding auth protocol: cephx 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.257 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key cmddesc rotate-key hook 0x7fff39ba01d8 EEXIST 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.258 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bdb226b0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x5634bdb14470 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bdb15180 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.330632s 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bdb14470 auth_method 0 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.259 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x5634bdb15180 auth_method 0 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_done global_id 6419 payload 274 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.260 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:40:08.958+0000 7f68c99c2640 1 monclient: found mon.noname-c 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: dump: 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.261 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: dump: 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.262 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6419 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 4 set_mon_vals no callback set 2024-03-09T14:40:09.263 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: shutdown 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.264 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding auth protocol: cephx 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding auth protocol: cephx 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding auth protocol: cephx 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.265 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: starting msgr at 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: starting objecter 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command objecter_requests cmddesc objecter_requests hook 0x5634bdaf1710 EEXIST 2024-03-09T14:40:09.266 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: setting wanted keys 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: calling monclient init 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding auth protocol: cephx 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding auth protocol: cephx 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding auth protocol: cephx 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.267 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key cmddesc rotate-key hook 0x5634bdae5fd8 EEXIST 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bdb14470 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x5634bdb15180 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bdb226b0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.268 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.332898s 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request con 0x5634bdb14470 auth_method 0 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bdb15180 auth_method 0 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.269 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x5634bdb226b0 auth_method 0 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_done global_id 6735 payload 824 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 1 monclient: found mon.noname-a 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.270 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: dump: 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.271 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: dump: 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.272 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:40:08.961+0000 7f67adffb640 4 set_mon_vals no callback set 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6735 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 1 librados: init done 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cr dump hook 0x5634bdb18688 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:40:08.962+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:40:08.963+0000 7f679bfff640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:40:08.963+0000 7f679bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.273 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:40:08.963+0000 7f679bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:40:08.963+0000 7f68c99c2640 10 monclient: get_auth_request con 0x7f679406a5b0 auth_method 0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:40:08.963+0000 7f68ca9c4640 10 monclient: get_auth_request con 0x5634bdb3d6e0 auth_method 0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 realm 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:40:08.965+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x5634bdb41880 auth_method 0 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:40:08.965+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.274 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:40:08.965+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:40:08.965+0000 7f68c99c2640 10 monclient: get_auth_request con 0x5634bdb45100 auth_method 0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:40:08.966+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:40:08.966+0000 7f68cc6c0800 20 searching for the correct realm 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:40:08.966+0000 7f68ca9c4640 10 monclient: get_auth_request con 0x5634bdb49e50 auth_method 0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:40:08.967+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f68c4059c20 auth_method 0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:40:08.967+0000 7f68ca1c3640 0 -- 172.21.15.46:0/3228981688 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f68c4059c20 msgr2=0x7f68c407b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:40:09.168+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f68c4059c20 auth_method 0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:40:09.169+0000 7f68c99c2640 10 monclient: get_auth_request con 0x7f68bc08f060 auth_method 0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:40:09.171+0000 7f68ca9c4640 10 monclient: get_auth_request con 0x7f68b40030f0 auth_method 0 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:40:09.172+0000 7f68c99c2640 0 -- 172.21.15.46:0/3228981688 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f68bc08f060 msgr2=0x7f68bc055a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:40:09.172+0000 7f679bfff640 1 client.6735.objecter ms_handle_reset 0x7f68bc08f060 session 0x7f68bc0c0040 osd.2 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:40:09.173+0000 7f679bfff640 10 monclient: _renew_subs 2024-03-09T14:40:09.275 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:40:09.173+0000 7f679bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:40:09.173+0000 7f68c99c2640 10 monclient: get_auth_request con 0x7f679407ac60 auth_method 0 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:40:09.174+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f68c005a3f0 auth_method 0 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.276 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 zone default found 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 Realm: () 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 zonegroup default 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.277 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 started sync module instance, tier type = 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=0 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=1 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=2 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=3 2024-03-09T14:40:09.278 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=4 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=5 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=6 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:40:09.192+0000 7f68cc6c0800 20 add_watcher() i=7 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:40:09.192+0000 7f68cc6c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding auth protocol: cephx 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding auth protocol: cephx 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding auth protocol: cephx 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.279 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:40:09.194+0000 7f6780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.280 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache list hook 0x5634bdb22010 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache inspect hook 0x5634bdb22010 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache erase hook 0x5634bdb22010 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache zap hook 0x5634bdb22010 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 note: GC not initialized 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:40:09.194+0000 7f66fb7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace show hook 0x7f68c000cf30 2024-03-09T14:40:09.281 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace history hook 0x7f68c000cf30 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace active hook 0x7f68c000cf30 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace active_short hook 0x7f68c000cf30 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 Filter name: none 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:40:09.195+0000 7f66f97fa640 20 reqs_thread_entry: start 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 : miss 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.282 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26, ofs0, ns] 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:40:09.200+0000 7f67adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94784521045152 notifier 6735 bl.length()=923 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.283 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_sources= new_sources= 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential sources added=[] removed=[] 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_dests= new_dests= 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential dests added=[] removed=[] 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.0 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:40:09.207+0000 7f68cc6c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68cc6c0800 time 2024-03-09T14:40:09.207836+0000 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.284 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f68cfb80e86] 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:40:09.208+0000 7f68cc6c0800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f68cc6c0800 thread_name:radosgw-admin 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.285 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f68ce854db0] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f68ce8a154c] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f68cfb80ee0] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:09.286 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:40:09.287 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:40:09.288 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:40:09.289 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:40:09.290 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:40:09.291 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:40:09.292 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:40:09.293 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f66f97fa640 / http_manager 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f66fb7fe640 / http_manager 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f6780fe1640 / rgw_dt_lg_renew 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f679bfff640 / ms_dispatch 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67adffb640 / io_context_pool 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67affff640 / ms_dispatch 2024-03-09T14:40:09.294 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67b6e05640 / ms_dispatch 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67b8608640 / io_context_pool 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68c99c2640 / msgr-worker-2 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68ca1c3640 / msgr-worker-1 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68ca9c4640 / msgr-worker-0 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68cb1c5640 / io_context_pool 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68cc6c0800 / radosgw-admin 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/log/ceph/ceph-client.admin.104675.log 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:40:09.295 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:40:08.945+0000 7f67b8608640 10 monclient: dump: 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.296 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:40:08.945+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6410 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:40:08.945+0000 7f68cc6c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:40:08.945+0000 7f68cc6c0800 4 set_mon_vals no callback set 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: shutdown 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 asok(0x5634bd832780) unregister_commands rotate-key 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.297 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding auth protocol: cephx 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding auth protocol: cephx 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding auth protocol: cephx 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.298 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: crc 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda57b20) adding con mode: secure 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: starting msgr at 2024-03-09T14:40:09.299 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: starting objecter 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command objecter_requests hook 0x5634bda7cc70 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: setting wanted keys 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 1 librados: calling monclient init 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding auth protocol: cephx 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding auth protocol: cephx 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding auth protocol: cephx 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.300 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: crc 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:40:08.946+0000 7f68cc6c0800 5 AuthRegistry(0x5634bda50c00) adding con mode: secure 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key hook 0x5634bda50d48 2024-03-09T14:40:09.301 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bda54120 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bda57600 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x7f68b4002510 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:40:08.947+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.319577s 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x7f68b4002510 auth_method 0 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.302 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bda57600 auth_method 0 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:40:08.947+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request con 0x5634bda54120 auth_method 0 2024-03-09T14:40:09.303 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:40:08.947+0000 7f68ca1c3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_done global_id 6413 payload 824 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 1 monclient: found mon.noname-c 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:40:08.947+0000 7f68ca9c4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: dump: 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.304 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:40:08.948+0000 7f67b6e05640 10 monclient: dump: 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.305 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6413 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:40:08.948+0000 7f67b8608640 4 set_mon_vals no callback set 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.306 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:40:08.948+0000 7f68cc6c0800 1 librados: init done 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:40:08.949+0000 7f67b6e05640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:40:08.949+0000 7f67b6e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:40:08.949+0000 7f67b6e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:40:08.950+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f67b006a5b0 auth_method 0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:40:08.950+0000 7f68c99c2640 10 monclient: get_auth_request con 0x5634bda935b0 auth_method 0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:40:08.951+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x5634bda9d000 auth_method 0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:40:08.952+0000 7f68c99c2640 10 monclient: get_auth_request con 0x5634bdaa1360 auth_method 0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.307 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding auth protocol: cephx 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding auth protocol: cephx 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding auth protocol: cephx 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.308 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: crc 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:40:08.953+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa6020) adding con mode: secure 2024-03-09T14:40:09.309 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command objecter_requests cmddesc objecter_requests hook 0x5634bdaa7290 EEXIST 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding auth protocol: cephx 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding auth protocol: cephx 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding auth protocol: cephx 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.310 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: crc 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaa4838) adding con mode: secure 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key cmddesc rotate-key hook 0x5634bdaa4980 EEXIST 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bdad04f0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.311 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bdad08d0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x5634bdae3280 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:40:08.954+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.327024s 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request con 0x5634bdad04f0 auth_method 0 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x5634bdae3280 auth_method 0 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.312 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:40:08.954+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:40:08.954+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:40:08.955+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:40:08.955+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bdad08d0 auth_method 0 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:40:08.955+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_done global_id 6416 payload 824 2024-03-09T14:40:09.313 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 1 monclient: found mon.noname-c 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:40:08.955+0000 7f68ca9c4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: dump: 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.314 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:40:08.955+0000 7f67affff640 10 monclient: dump: 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.315 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6416 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:40:08.955+0000 7f68cb1c5640 4 set_mon_vals no callback set 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:40:08.955+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.316 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:40:08.957+0000 7f67affff640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:40:08.957+0000 7f67affff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:40:08.957+0000 7f67affff640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:40:08.957+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f67a406a4f0 auth_method 0 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: get_monmap_and_config 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.317 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding auth protocol: cephx 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding auth protocol: cephx 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding auth protocol: cephx 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.318 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: crc 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedbb0) adding con mode: secure 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding auth protocol: cephx 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding auth protocol: cephx 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding auth protocol: cephx 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.319 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: crc 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:40:08.957+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0090) adding con mode: secure 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key cmddesc rotate-key hook 0x7fff39ba01d8 EEXIST 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.320 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bdb226b0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x5634bdb14470 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bdb15180 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:40:08.958+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.330632s 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bdb14470 auth_method 0 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.321 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x5634bdb15180 auth_method 0 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.322 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:40:08.958+0000 7f68ca9c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient(hunting): handle_auth_done global_id 6419 payload 274 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:40:08.958+0000 7f68c99c2640 1 monclient: found mon.noname-c 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:40:08.958+0000 7f68c99c2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: dump: 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.323 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.324 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:40:08.959+0000 7f67adffb640 10 monclient: dump: 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.325 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6419 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 4 set_mon_vals no callback set 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: shutdown 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: build_initial_monmap 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 1 build_initial for_mkfs: 0 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 10 monclient: monmap: 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:09.326 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding auth protocol: cephx 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding auth protocol: cephx 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding auth protocol: cephx 2024-03-09T14:40:09.327 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.328 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: crc 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdaedb30) adding con mode: secure 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:40:08.959+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: starting msgr at 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: starting objecter 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command objecter_requests cmddesc objecter_requests hook 0x5634bdaf1710 EEXIST 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: setting wanted keys 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 1 librados: calling monclient init 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient: init 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding auth protocol: cephx 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding auth protocol: cephx 2024-03-09T14:40:09.329 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding auth protocol: cephx 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: crc 2024-03-09T14:40:09.330 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 AuthRegistry(0x5634bdae5e90) adding con mode: secure 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command rotate-key cmddesc rotate-key hook 0x5634bdae5fd8 EEXIST 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-a con 0x5634bdb14470 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-c con 0x5634bdb15180 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): picked mon.noname-b con 0x5634bdb226b0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.331 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:40:08.960+0000 7f68cc6c0800 10 monclient(hunting): authenticate will time out at 1886.332898s 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request con 0x5634bdb14470 auth_method 0 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): get_auth_request con 0x5634bdb15180 auth_method 0 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.332 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:40:08.960+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:40:08.960+0000 7f68c99c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request con 0x5634bdb226b0 auth_method 0 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:40:08.960+0000 7f68ca9c4640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 10 monclient(hunting): handle_auth_done global_id 6735 payload 824 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 10 monclient: _finish_hunting 0 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 1 monclient: found mon.noname-a 2024-03-09T14:40:09.333 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:40:08.961+0000 7f68ca1c3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: dump: 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.334 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: _finish_auth 0 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: _check_auth_tickets 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:40:08.961+0000 7f679bfff640 10 monclient: dump: 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:09.335 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:40:08.961+0000 7f67adffb640 4 set_mon_vals no callback set 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 5 monclient: authenticate success, global_id 6735 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _renew_subs 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 1 librados: init done 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:40:08.961+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cr dump hook 0x5634bdb18688 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:40:08.962+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:40:08.963+0000 7f679bfff640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:40:08.963+0000 7f679bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.336 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:40:08.963+0000 7f679bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:40:08.963+0000 7f68c99c2640 10 monclient: get_auth_request con 0x7f679406a5b0 auth_method 0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:40:08.963+0000 7f68ca9c4640 10 monclient: get_auth_request con 0x5634bdb3d6e0 auth_method 0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 realm 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:40:08.964+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:40:08.965+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x5634bdb41880 auth_method 0 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:40:08.965+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.337 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:40:08.965+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:40:08.965+0000 7f68c99c2640 10 monclient: get_auth_request con 0x5634bdb45100 auth_method 0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:40:08.966+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:40:08.966+0000 7f68cc6c0800 20 searching for the correct realm 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:40:08.966+0000 7f68ca9c4640 10 monclient: get_auth_request con 0x5634bdb49e50 auth_method 0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:40:08.967+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f68c4059c20 auth_method 0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:40:08.967+0000 7f68ca1c3640 0 -- 172.21.15.46:0/3228981688 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f68c4059c20 msgr2=0x7f68c407b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:40:09.168+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f68c4059c20 auth_method 0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:40:09.169+0000 7f68c99c2640 10 monclient: get_auth_request con 0x7f68bc08f060 auth_method 0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:40:09.171+0000 7f68ca9c4640 10 monclient: get_auth_request con 0x7f68b40030f0 auth_method 0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:40:09.172+0000 7f68c99c2640 0 -- 172.21.15.46:0/3228981688 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f68bc08f060 msgr2=0x7f68bc055a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:40:09.172+0000 7f679bfff640 1 client.6735.objecter ms_handle_reset 0x7f68bc08f060 session 0x7f68bc0c0040 osd.2 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:40:09.173+0000 7f679bfff640 10 monclient: _renew_subs 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:40:09.173+0000 7f679bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.46:3300/0 2024-03-09T14:40:09.338 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:40:09.173+0000 7f68c99c2640 10 monclient: get_auth_request con 0x7f679407ac60 auth_method 0 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:40:09.174+0000 7f68ca1c3640 10 monclient: get_auth_request con 0x7f68c005a3f0 auth_method 0 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:40:09.179+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.339 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 zone default found 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 Realm: () 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 zonegroup default 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:40:09.180+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.340 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 started sync module instance, tier type = 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:40:09.181+0000 7f68cc6c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=0 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=1 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=2 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=3 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=4 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=5 2024-03-09T14:40:09.341 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:40:09.191+0000 7f68cc6c0800 20 add_watcher() i=6 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:40:09.192+0000 7f68cc6c0800 20 add_watcher() i=7 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:40:09.192+0000 7f68cc6c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding auth protocol: cephx 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding auth protocol: cephx 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding auth protocol: cephx 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:40:09.194+0000 7f6780fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.342 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: crc 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 AuthRegistry(0x7fff39ba0520) adding con mode: secure 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache list hook 0x5634bdb22010 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache inspect hook 0x5634bdb22010 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache erase hook 0x5634bdb22010 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command cache zap hook 0x5634bdb22010 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 note: GC not initialized 2024-03-09T14:40:09.343 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:40:09.194+0000 7f66fb7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace show hook 0x7f68c000cf30 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace history hook 0x7f68c000cf30 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace active hook 0x7f68c000cf30 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 5 asok(0x5634bd832780) register_command sync trace active_short hook 0x7f68c000cf30 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:40:09.194+0000 7f68cc6c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 Filter name: none 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:40:09.195+0000 7f66f97fa640 20 reqs_thread_entry: start 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 : miss 2024-03-09T14:40:09.344 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:40:09.195+0000 7f68cc6c0800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:40:09.196+0000 7f68cc6c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:40:09.200+0000 7f68cc6c0800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26, ofs0, ns] 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:40:09.200+0000 7f67adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94784521045152 notifier 6735 bl.length()=923 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:09.345 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:40:09.201+0000 7f67adffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_sources= new_sources= 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential sources added=[] removed=[] 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_dests= new_dests= 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:40:09.203+0000 7f68cc6c0800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential dests added=[] removed=[] 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:40:09.204+0000 7f68cc6c0800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.0 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:40:09.207+0000 7f68cc6c0800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68cc6c0800 time 2024-03-09T14:40:09.207836+0000 2024-03-09T14:40:09.346 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:09.347 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.347 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.347 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f68cfb80e86] 2024-03-09T14:40:09.347 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.347 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.347 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:40:09.208+0000 7f68cc6c0800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f68cc6c0800 thread_name:radosgw-admin 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:09.349 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f68ce854db0] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f68ce8a154c] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f68cfb80ee0] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f68cfb81044] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5634bbb4ef91] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5634bbb6a178] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f68ce83feb0] 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:09.350 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:40:09.351 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:40:09.352 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:40:09.353 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:40:09.354 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:40:09.355 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:40:09.356 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:40:09.357 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f66f97fa640 / http_manager 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f66fb7fe640 / http_manager 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f6780fe1640 / rgw_dt_lg_renew 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f679bfff640 / ms_dispatch 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67adffb640 / io_context_pool 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67affff640 / ms_dispatch 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67b6e05640 / ms_dispatch 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f67b8608640 / io_context_pool 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68c99c2640 / msgr-worker-2 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68ca1c3640 / msgr-worker-1 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68ca9c4640 / msgr-worker-0 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68cb1c5640 / io_context_pool 2024-03-09T14:40:09.358 INFO:tasks.workunit.client.0.smithi046.stderr: 7f68cc6c0800 / radosgw-admin 2024-03-09T14:40:09.359 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:40:09.359 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:40:09.359 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:40:09.209237Z_07388402-adfa-45a2-b357-5c38239de201/log 2024-03-09T14:40:09.359 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:40:09.359 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.279+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 realm 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.281+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.282+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.282+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.283+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:09.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.283+0000 7f53a3e8c800 20 searching for the correct realm 2024-03-09T14:40:09.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.285+0000 7f53a1187640 0 -- 172.21.15.46:0/2065448677 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x558ed1f64280 msgr2=0x558ed1f66670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:09.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.289+0000 7f53a1988640 0 -- 172.21.15.46:0/2065448677 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f53980a7d10 msgr2=0x7f53980cf1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:09.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.495+0000 7f53a3e8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:09.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.495+0000 7f53a3e8c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:09.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.495+0000 7f53a3e8c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:09.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.495+0000 7f53a3e8c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:09.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.495+0000 7f53a3e8c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:09.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.495+0000 7f53a3e8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:09.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.496+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.496+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.497 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.496+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.496+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.496+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 zone default found 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 4 Realm: () 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:09.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 zonegroup default 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.497+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.498+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.498+0000 7f53a3e8c800 20 started sync module instance, tier type = 2024-03-09T14:40:09.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.498+0000 7f53a3e8c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=0 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=1 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=2 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=3 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=4 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=5 2024-03-09T14:40:09.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.507+0000 7f53a3e8c800 20 add_watcher() i=6 2024-03-09T14:40:09.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.508+0000 7f53a3e8c800 20 add_watcher() i=7 2024-03-09T14:40:09.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.508+0000 7f53a3e8c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:09.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.510+0000 7f52537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:09.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.510+0000 7f53a3e8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:09.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.510+0000 7f53a3e8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:09.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.510+0000 7f53a3e8c800 5 note: GC not initialized 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.510+0000 7f52527fc640 20 reqs_thread_entry: start 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.511+0000 7f53a3e8c800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.511+0000 7f53a3e8c800 20 Filter name: none 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.511+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.511+0000 7f51c3fff640 20 reqs_thread_entry: start 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.511+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.511+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.512 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.512+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.512+0000 7f53a3e8c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.512+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.512+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.512+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.513+0000 7f53a3e8c800 20 rados_obj.operate() r=0 bl.length=443 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.513+0000 7f53a3e8c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:09.513 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.513+0000 7f53a3e8c800 20 rados->read ofs=0 len=0 2024-03-09T14:40:09.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.513+0000 7f53a3e8c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:09.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.514+0000 7f52537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.517+0000 7f53a3e8c800 20 remove_watcher() i=0 2024-03-09T14:40:09.517 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.517+0000 7f53a3e8c800 2 removed watcher, disabling cache 2024-03-09T14:40:09.518 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.518+0000 7f53a3e8c800 20 remove_watcher() i=1 2024-03-09T14:40:09.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.519+0000 7f53a3e8c800 20 remove_watcher() i=2 2024-03-09T14:40:09.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.520+0000 7f53a3e8c800 20 remove_watcher() i=3 2024-03-09T14:40:09.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.521+0000 7f53a3e8c800 20 remove_watcher() i=4 2024-03-09T14:40:09.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.522+0000 7f53a3e8c800 20 remove_watcher() i=5 2024-03-09T14:40:09.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.523+0000 7f53a3e8c800 20 remove_watcher() i=6 2024-03-09T14:40:09.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:09.524+0000 7f53a3e8c800 20 remove_watcher() i=7 2024-03-09T14:40:09.534 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.534 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:09.534 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:09.534 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:09.536 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:09.536 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:39.654 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:39.654 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:39.717 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:40:39.749 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:39.749 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:39.786 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.785+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 realm 2024-03-09T14:40:39.787 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.786+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.787+0000 7f340d083800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:39.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.787+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.788+0000 7f340d083800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:39.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.788+0000 7f340d083800 20 searching for the correct realm 2024-03-09T14:40:39.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.792+0000 7f340b380640 0 -- 172.21.15.46:0/707602215 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x559ce7e43250 msgr2=0x559ce7e45710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:39.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.796+0000 7f340ab7f640 0 -- 172.21.15.46:0/707602215 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f3400061dd0 msgr2=0x7f340008a9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:39.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:39.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.801+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 zone default found 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 4 Realm: () 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:39.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 zonegroup default 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.802+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.803+0000 7f340d083800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.803+0000 7f340d083800 20 started sync module instance, tier type = 2024-03-09T14:40:39.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.803+0000 7f340d083800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:39.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=0 2024-03-09T14:40:39.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=1 2024-03-09T14:40:39.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=2 2024-03-09T14:40:39.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=3 2024-03-09T14:40:39.813 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=4 2024-03-09T14:40:39.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=5 2024-03-09T14:40:39.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.812+0000 7f340d083800 20 add_watcher() i=6 2024-03-09T14:40:39.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.813+0000 7f340d083800 20 add_watcher() i=7 2024-03-09T14:40:39.814 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.813+0000 7f340d083800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:39.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.814+0000 7f32c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:39.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:39.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 5 note: GC not initialized 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f323bfff640 20 reqs_thread_entry: start 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 20 Filter name: none 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f3239ffb640 20 reqs_thread_entry: start 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:40:39.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.815+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 : miss 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.816+0000 7f340d083800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:39.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.817+0000 7f340d083800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 2024-03-09T14:40:39.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.820+0000 7f340d083800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:39.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.820+0000 7f340d083800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:39.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.820+0000 7f340d083800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:39.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.820+0000 7f340d083800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26, ofs0, ns] 2024-03-09T14:40:39.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.820+0000 7f32ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595117 cookie 94132393768880 notifier 6774 bl.length()=923 2024-03-09T14:40:39.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.821+0000 7f32ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:39.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.821+0000 7f32ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:39.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.821+0000 7f32ee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:39.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.822+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_sources= new_sources= 2024-03-09T14:40:39.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.822+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential sources added=[] removed=[] 2024-03-09T14:40:39.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.822+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_dests= new_dests= 2024-03-09T14:40:39.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.822+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential dests added=[] removed=[] 2024-03-09T14:40:39.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.823+0000 7f340d083800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:39.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.823+0000 7f340d083800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.0 2024-03-09T14:40:39.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.823+0000 7f340d083800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:39.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.823+0000 7f340d083800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.1.1 2024-03-09T14:40:39.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.823+0000 7f340d083800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26.0 2024-03-09T14:40:39.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.827+0000 7f340d083800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:39.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.827+0000 7f340d083800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.828+0000 7f340d083800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.828+0000 7f340d083800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.828+0000 7f340d083800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.828+0000 7f340d083800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26, ofs0, ns] 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.829+0000 7f32edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595118 cookie 94132393768880 notifier 6774 bl.length()=891 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.829+0000 7f32edffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 info.flags=0x17 2024-03-09T14:40:39.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.829+0000 7f32edffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 to cache LRU end 2024-03-09T14:40:39.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.829+0000 7f32edffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:39.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.830+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_sources= new_sources= 2024-03-09T14:40:39.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.830+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential sources added=[] removed=[] 2024-03-09T14:40:39.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.830+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): orig_dests= new_dests= 2024-03-09T14:40:39.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.830+0000 7f340d083800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26]): potential dests added=[] removed=[] 2024-03-09T14:40:39.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.831+0000 7f340d083800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-03-09T14:40:39.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.833+0000 7f32c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:39.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.835+0000 7f340d083800 20 remove_watcher() i=0 2024-03-09T14:40:39.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.835+0000 7f340d083800 2 removed watcher, disabling cache 2024-03-09T14:40:39.837 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.836+0000 7f340d083800 20 remove_watcher() i=1 2024-03-09T14:40:39.838 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.837+0000 7f340d083800 20 remove_watcher() i=2 2024-03-09T14:40:39.839 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.838+0000 7f340d083800 20 remove_watcher() i=3 2024-03-09T14:40:39.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.839+0000 7f340d083800 20 remove_watcher() i=4 2024-03-09T14:40:39.841 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.840+0000 7f340d083800 20 remove_watcher() i=5 2024-03-09T14:40:39.842 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.841+0000 7f340d083800 20 remove_watcher() i=6 2024-03-09T14:40:39.843 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.842+0000 7f340d083800 20 remove_watcher() i=7 2024-03-09T14:40:39.855 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:40:39.882 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:39.882 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:39.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.915+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.916+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.916+0000 7fc3277a2800 20 realm 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.916+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.916+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.916+0000 7fc3277a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.916+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.918 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.917+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:39.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.917+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.917+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:39.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.917+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:39.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.918+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:39.919 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.918+0000 7fc3277a2800 20 searching for the correct realm 2024-03-09T14:40:39.922 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:39.920+0000 7fc31caa4640 0 -- 172.21.15.46:0/3057353837 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fc320096920 msgr2=0x7fc32008a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.126+0000 7fc3252a5640 0 -- 172.21.15.46:0/3057353837 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fc3140030f0 msgr2=0x7fc310058970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.332+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:40.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:40.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 zone default found 2024-03-09T14:40:40.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 4 Realm: () 2024-03-09T14:40:40.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:40.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:40.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 zonegroup default 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.333+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.334+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.334+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.334+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.334+0000 7fc3277a2800 20 started sync module instance, tier type = 2024-03-09T14:40:40.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.334+0000 7fc3277a2800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=0 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=1 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=2 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=3 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=4 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=5 2024-03-09T14:40:40.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.344+0000 7fc3277a2800 20 add_watcher() i=6 2024-03-09T14:40:40.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.345+0000 7fc3277a2800 20 add_watcher() i=7 2024-03-09T14:40:40.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.345+0000 7fc3277a2800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:40.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.346+0000 7fc1db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc3277a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:40.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc3277a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:40.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc3277a2800 5 note: GC not initialized 2024-03-09T14:40:40.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc1da7e4640 20 reqs_thread_entry: start 2024-03-09T14:40:40.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc3277a2800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:40.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc3277a2800 20 Filter name: none 2024-03-09T14:40:40.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc14bfff640 20 reqs_thread_entry: start 2024-03-09T14:40:40.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.347+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.348+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.348+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.348+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.348+0000 7fc3277a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.348+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.349+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.349+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.349+0000 7fc3277a2800 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:40:40.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.349+0000 7fc3277a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:40.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.350+0000 7fc3277a2800 20 rados->read ofs=0 len=0 2024-03-09T14:40:40.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.350+0000 7fc3277a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:40.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.351+0000 7fc1db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:40.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.353+0000 7fc3277a2800 20 remove_watcher() i=0 2024-03-09T14:40:40.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.353+0000 7fc3277a2800 2 removed watcher, disabling cache 2024-03-09T14:40:40.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.354+0000 7fc3277a2800 20 remove_watcher() i=1 2024-03-09T14:40:40.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.355+0000 7fc3277a2800 20 remove_watcher() i=2 2024-03-09T14:40:40.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.357+0000 7fc3277a2800 20 remove_watcher() i=3 2024-03-09T14:40:40.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.358+0000 7fc3277a2800 20 remove_watcher() i=4 2024-03-09T14:40:40.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.359+0000 7fc3277a2800 20 remove_watcher() i=5 2024-03-09T14:40:40.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.360+0000 7fc3277a2800 20 remove_watcher() i=6 2024-03-09T14:40:40.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:40.361+0000 7fc3277a2800 20 remove_watcher() i=7 2024-03-09T14:40:40.373 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:40.373 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:40.373 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-commit-target-layout id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:40:40.373 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:40.374 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.374 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.397 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.397 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.576 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-03-09T14:40:40.642 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:40.643 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.644 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.686 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.686 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.743 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.743 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.776 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.776 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.810 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.811 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.843 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.843 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.875 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.876 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.908 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.908 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.941 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.941 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:40.975 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:40.975 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.008 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.008 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.040 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.041 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.073 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.073 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.107 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.107 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.139 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.139 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.172 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.172 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.206 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.206 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.239 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.239 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.278 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.278 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.310 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.310 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.343 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.343 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.376 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:41.377 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:41.409 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:40:41.436 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:41.436 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:41.470 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.468+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 realm 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.470+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.472 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.471+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:41.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.471+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.472+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:41.473 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.472+0000 7f9fc9e2e800 20 searching for the correct realm 2024-03-09T14:40:41.477 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.476+0000 7f9fc492f640 0 -- 172.21.15.46:0/1650742091 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x558d2bcea710 msgr2=0x558d2bcecb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:41.480 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.479+0000 7f9fc5931640 0 -- 172.21.15.46:0/1650742091 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f9fbc01ab50 msgr2=0x7f9fbc025400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:41.484 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.483+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.485 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 zone default found 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 4 Realm: () 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 zonegroup default 2024-03-09T14:40:41.486 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.484+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.485+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.485+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.485+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.485+0000 7f9fc9e2e800 20 started sync module instance, tier type = 2024-03-09T14:40:41.487 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.485+0000 7f9fc9e2e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=0 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=1 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=2 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=3 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=4 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=5 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.494+0000 7f9fc9e2e800 20 add_watcher() i=6 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.495+0000 7f9fc9e2e800 20 add_watcher() i=7 2024-03-09T14:40:41.496 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.495+0000 7f9fc9e2e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:41.498 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.497+0000 7f9e7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:41.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.497+0000 7f9fc9e2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:41.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.497+0000 7f9fc9e2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:41.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.497+0000 7f9fc9e2e800 5 note: GC not initialized 2024-03-09T14:40:41.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.497+0000 7f9e7a7e4640 20 reqs_thread_entry: start 2024-03-09T14:40:41.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.497+0000 7f9fc9e2e800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:41.499 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 Filter name: none 2024-03-09T14:40:41.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9debfff640 20 reqs_thread_entry: start 2024-03-09T14:40:41.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:41.500 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.498+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.499+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.499+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.499+0000 7f9fc9e2e800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.499+0000 7f9fc9e2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.500+0000 7f9fc9e2e800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.500+0000 7f9fc9e2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.502 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.501+0000 7f9e7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:41.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.503+0000 7f9fc9e2e800 20 remove_watcher() i=0 2024-03-09T14:40:41.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.503+0000 7f9fc9e2e800 2 removed watcher, disabling cache 2024-03-09T14:40:41.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.504+0000 7f9fc9e2e800 20 remove_watcher() i=1 2024-03-09T14:40:41.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.505+0000 7f9fc9e2e800 20 remove_watcher() i=2 2024-03-09T14:40:41.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.506+0000 7f9fc9e2e800 20 remove_watcher() i=3 2024-03-09T14:40:41.508 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.507+0000 7f9fc9e2e800 20 remove_watcher() i=4 2024-03-09T14:40:41.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.508+0000 7f9fc9e2e800 20 remove_watcher() i=5 2024-03-09T14:40:41.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.509+0000 7f9fc9e2e800 20 remove_watcher() i=6 2024-03-09T14:40:41.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.510+0000 7f9fc9e2e800 20 remove_watcher() i=7 2024-03-09T14:40:41.521 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:41.521 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:41.521 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-do-reshard id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:41.521 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:41.522 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-03-09T14:40:41.555 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:41.555 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:41.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.587+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 realm 2024-03-09T14:40:41.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.589+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.590+0000 7fd6aea44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:41.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.590+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:41.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.591+0000 7fd6aea44800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:41.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.591+0000 7fd6aea44800 20 searching for the correct realm 2024-03-09T14:40:41.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.592+0000 7fd6abd3f640 0 -- 172.21.15.46:0/3061194506 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fd6a0059810 msgr2=0x7fd6a0056b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:41.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:41.798+0000 7fd6ac540640 0 -- 172.21.15.46:0/3061194506 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fd69c094190 msgr2=0x7fd69c07f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:42.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:42.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:42.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:42.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:42.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:42.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.004+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.005+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.005+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.005+0000 7fd6aea44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.005+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 zone default found 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 4 Realm: () 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:42.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 zonegroup default 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 started sync module instance, tier type = 2024-03-09T14:40:42.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.006+0000 7fd6aea44800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=0 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=1 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=2 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=3 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=4 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=5 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.016+0000 7fd6aea44800 20 add_watcher() i=6 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.017+0000 7fd6aea44800 20 add_watcher() i=7 2024-03-09T14:40:42.018 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.017+0000 7fd6aea44800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:42.020 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.019+0000 7fd5627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.019+0000 7fd6aea44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:42.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.019+0000 7fd6aea44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:42.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.019+0000 7fd6aea44800 5 note: GC not initialized 2024-03-09T14:40:42.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd5617e2640 20 reqs_thread_entry: start 2024-03-09T14:40:42.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:42.021 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 20 Filter name: none 2024-03-09T14:40:42.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd4d2ffd640 20 reqs_thread_entry: start 2024-03-09T14:40:42.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-09T14:40:42.022 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 : miss 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.020+0000 7fd6aea44800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.021+0000 7fd6aea44800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.021+0000 7fd6aea44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.021+0000 7fd6aea44800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.021+0000 7fd6aea44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.021+0000 7fd6aea44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.023 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.021+0000 7fd6aea44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 2024-03-09T14:40:42.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd6aea44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd6aea44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd6aea44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd6aea44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27, ofs0, ns] 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd58b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595088 cookie 93892162428448 notifier 6503 bl.length()=903 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd58b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd58b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.025+0000 7fd58b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.027+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_sources= new_sources= 2024-03-09T14:40:42.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.027+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential sources added=[] removed=[] 2024-03-09T14:40:42.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.027+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_dests= new_dests= 2024-03-09T14:40:42.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.027+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential dests added=[] removed=[] 2024-03-09T14:40:42.030 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.029+0000 7fd6aea44800 -1 Injecting error=-5 at location=do_reshard 2024-03-09T14:40:42.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.031+0000 7fd6aea44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:42.032 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.031+0000 7fd6aea44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 2024-03-09T14:40:42.033 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd6aea44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd6aea44800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd6aea44800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd6aea44800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27, ofs0, ns] 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd58b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595089 cookie 93892162428448 notifier 6503 bl.length()=871 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd58b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd58b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.034 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.032+0000 7fd58b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.034+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_sources= new_sources= 2024-03-09T14:40:42.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.034+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential sources added=[] removed=[] 2024-03-09T14:40:42.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.034+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_dests= new_dests= 2024-03-09T14:40:42.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.034+0000 7fd6aea44800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential dests added=[] removed=[] 2024-03-09T14:40:42.035 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.034+0000 7fd6aea44800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-03-09T14:40:42.037 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.036+0000 7fd5627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.038+0000 7fd6aea44800 20 remove_watcher() i=0 2024-03-09T14:40:42.040 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.038+0000 7fd6aea44800 2 removed watcher, disabling cache 2024-03-09T14:40:42.041 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.040+0000 7fd6aea44800 20 remove_watcher() i=1 2024-03-09T14:40:42.042 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.041+0000 7fd6aea44800 20 remove_watcher() i=2 2024-03-09T14:40:42.043 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.042+0000 7fd6aea44800 20 remove_watcher() i=3 2024-03-09T14:40:42.044 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.043+0000 7fd6aea44800 20 remove_watcher() i=4 2024-03-09T14:40:42.045 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.044+0000 7fd6aea44800 20 remove_watcher() i=5 2024-03-09T14:40:42.047 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.046+0000 7fd6aea44800 20 remove_watcher() i=6 2024-03-09T14:40:42.048 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.047+0000 7fd6aea44800 20 remove_watcher() i=7 2024-03-09T14:40:42.062 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:40:42.088 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:42.088 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:42.122 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.121+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.122+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.122+0000 7fc173531800 20 realm 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.122+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.123+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.123+0000 7fc173531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.123+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.123+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.123+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.124+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.125 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.124+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.125+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:42.126 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.125+0000 7fc173531800 20 searching for the correct realm 2024-03-09T14:40:42.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.127+0000 7fc16f264640 0 -- 172.21.15.46:0/1585382684 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fc168058050 msgr2=0x7fc168087430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.132 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.131+0000 7fc16f264640 0 -- 172.21.15.46:0/1585382684 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fc164041830 msgr2=0x7fc1640457e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.339 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.337+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.341 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 zone default found 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 4 Realm: () 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 zonegroup default 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.338+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.339+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.339+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.339+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.339+0000 7fc173531800 20 started sync module instance, tier type = 2024-03-09T14:40:42.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.339+0000 7fc173531800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=0 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=1 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=2 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=3 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=4 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=5 2024-03-09T14:40:42.350 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.348+0000 7fc173531800 20 add_watcher() i=6 2024-03-09T14:40:42.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.349+0000 7fc173531800 20 add_watcher() i=7 2024-03-09T14:40:42.351 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.349+0000 7fc173531800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:42.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc173531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc173531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc173531800 5 note: GC not initialized 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc024fe1640 20 reqs_thread_entry: start 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc173531800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.351+0000 7fc173531800 20 Filter name: none 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fbf9e7fc640 20 reqs_thread_entry: start 2024-03-09T14:40:42.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:42.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fc173531800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.352+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.353+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.353+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.353+0000 7fc173531800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.353+0000 7fc173531800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.354+0000 7fc173531800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.354+0000 7fc173531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.355+0000 7fc025fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.357+0000 7fc173531800 20 remove_watcher() i=0 2024-03-09T14:40:42.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.357+0000 7fc173531800 2 removed watcher, disabling cache 2024-03-09T14:40:42.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.358+0000 7fc173531800 20 remove_watcher() i=1 2024-03-09T14:40:42.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.359+0000 7fc173531800 20 remove_watcher() i=2 2024-03-09T14:40:42.361 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.360+0000 7fc173531800 20 remove_watcher() i=3 2024-03-09T14:40:42.362 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.361+0000 7fc173531800 20 remove_watcher() i=4 2024-03-09T14:40:42.363 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.362+0000 7fc173531800 20 remove_watcher() i=5 2024-03-09T14:40:42.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.363+0000 7fc173531800 20 remove_watcher() i=6 2024-03-09T14:40:42.365 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.364+0000 7fc173531800 20 remove_watcher() i=7 2024-03-09T14:40:42.374 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:42.374 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:42.375 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-do-reshard id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:42.375 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:42.376 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:42.376 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:42.406 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:42.406 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:42.466 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:40:42.496 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:42.496 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:42.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.528+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 realm 2024-03-09T14:40:42.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:42.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.530+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.531+0000 7f3f7e324800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.531+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.532+0000 7f3f7e324800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:42.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.532+0000 7f3f7e324800 20 searching for the correct realm 2024-03-09T14:40:42.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.535+0000 7f3f7a023640 0 -- 172.21.15.46:0/3285309830 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f3f7402a070 msgr2=0x7f3f7405be20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.539 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.538+0000 7f3f7a023640 0 -- 172.21.15.46:0/3285309830 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f3f70081290 msgr2=0x7f3f7007d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:42.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:42.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.543+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:42.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 zone default found 2024-03-09T14:40:42.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 4 Realm: () 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 zonegroup default 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.544+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.545+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.545+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.545+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.545+0000 7f3f7e324800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.545+0000 7f3f7e324800 20 started sync module instance, tier type = 2024-03-09T14:40:42.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.545+0000 7f3f7e324800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:42.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=0 2024-03-09T14:40:42.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=1 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=2 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=3 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=4 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=5 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.555+0000 7f3f7e324800 20 add_watcher() i=6 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.556+0000 7f3f7e324800 20 add_watcher() i=7 2024-03-09T14:40:42.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.556+0000 7f3f7e324800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:42.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.557+0000 7f3e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:42.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:42.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 5 note: GC not initialized 2024-03-09T14:40:42.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3dab7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:42.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 Filter name: none 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3da97fa640 20 reqs_thread_entry: start 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 : miss 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.558+0000 7f3f7e324800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.559+0000 7f3f7e324800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.559+0000 7f3f7e324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.559+0000 7f3f7e324800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.559+0000 7f3f7e324800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:42.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.559+0000 7f3f7e324800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.559+0000 7f3f7e324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.562+0000 7f3f7e324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.562+0000 7f3f7e324800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.562+0000 7f3f7e324800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.562+0000 7f3f7e324800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27, ofs0, ns] 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.563+0000 7f3e5dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595090 cookie 94599563503472 notifier 6864 bl.length()=903 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.563+0000 7f3e5dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.563+0000 7f3e5dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.564 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.563+0000 7f3e5dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.564+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_sources= new_sources= 2024-03-09T14:40:42.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.564+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential sources added=[] removed=[] 2024-03-09T14:40:42.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.564+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_dests= new_dests= 2024-03-09T14:40:42.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.564+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential dests added=[] removed=[] 2024-03-09T14:40:42.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.565+0000 7f3f7e324800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27.1.0 2024-03-09T14:40:42.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.565+0000 7f3f7e324800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27.1.0 2024-03-09T14:40:42.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.565+0000 7f3f7e324800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27.1.1 2024-03-09T14:40:42.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.565+0000 7f3f7e324800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27.1.1 2024-03-09T14:40:42.567 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.565+0000 7f3f7e324800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27.0 2024-03-09T14:40:42.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.568+0000 7f3f7e324800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 : hit (requested=0x17, cached=0x17) 2024-03-09T14:40:42.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.568+0000 7f3f7e324800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 2024-03-09T14:40:42.570 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.569+0000 7f3f7e324800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.569+0000 7f3f7e324800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.569+0000 7f3f7e324800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.569+0000 7f3f7e324800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27, ofs0, ns] 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.570+0000 7f3e5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595091 cookie 94599563503472 notifier 6864 bl.length()=871 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.570+0000 7f3e5d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 info.flags=0x17 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.570+0000 7f3e5d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 to cache LRU end 2024-03-09T14:40:42.571 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.570+0000 7f3e5d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:42.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.571+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_sources= new_sources= 2024-03-09T14:40:42.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.571+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential sources added=[] removed=[] 2024-03-09T14:40:42.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.571+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): orig_dests= new_dests= 2024-03-09T14:40:42.572 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.571+0000 7f3f7e324800 20 handle_bi_update(): bucket=:error-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27]): potential dests added=[] removed=[] 2024-03-09T14:40:42.573 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.572+0000 7f3f7e324800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-03-09T14:40:42.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.574+0000 7f3e30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.577+0000 7f3f7e324800 20 remove_watcher() i=0 2024-03-09T14:40:42.578 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.577+0000 7f3f7e324800 2 removed watcher, disabling cache 2024-03-09T14:40:42.579 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.578+0000 7f3f7e324800 20 remove_watcher() i=1 2024-03-09T14:40:42.580 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.579+0000 7f3f7e324800 20 remove_watcher() i=2 2024-03-09T14:40:42.581 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.580+0000 7f3f7e324800 20 remove_watcher() i=3 2024-03-09T14:40:42.582 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.581+0000 7f3f7e324800 20 remove_watcher() i=4 2024-03-09T14:40:42.583 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.582+0000 7f3f7e324800 20 remove_watcher() i=5 2024-03-09T14:40:42.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.583+0000 7f3f7e324800 20 remove_watcher() i=6 2024-03-09T14:40:42.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.584+0000 7f3f7e324800 20 remove_watcher() i=7 2024-03-09T14:40:42.596 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:40:42.624 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:42.624 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:42.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.656+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 realm 2024-03-09T14:40:42.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.659 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:42.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.658+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.659+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.660 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.659+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.660+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:42.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.660+0000 7f955be9d800 20 searching for the correct realm 2024-03-09T14:40:42.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.663+0000 7f955a19a640 0 -- 172.21.15.46:0/3450533859 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x557c090f5bb0 msgr2=0x557c090f7fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.666+0000 7f9559198640 0 -- 172.21.15.46:0/3450533859 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x557c090fd620 msgr2=0x557c090ffa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.670+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:42.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 zone default found 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 4 Realm: () 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 zonegroup default 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.671+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 started sync module instance, tier type = 2024-03-09T14:40:42.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.672+0000 7f955be9d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=0 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=1 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=2 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=3 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=4 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=5 2024-03-09T14:40:42.682 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.681+0000 7f955be9d800 20 add_watcher() i=6 2024-03-09T14:40:42.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.683+0000 7f955be9d800 20 add_watcher() i=7 2024-03-09T14:40:42.684 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.683+0000 7f955be9d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:42.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.684+0000 7f93e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 5 note: GC not initialized 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f93e27fc640 20 reqs_thread_entry: start 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 Filter name: none 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f937bfff640 20 reqs_thread_entry: start 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:42.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.685+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:42.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:42.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:42.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:42.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.686+0000 7f955be9d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:42.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.687+0000 7f955be9d800 20 rados->read ofs=0 len=0 2024-03-09T14:40:42.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.687+0000 7f955be9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:42.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.688+0000 7f93e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:42.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.690+0000 7f955be9d800 20 remove_watcher() i=0 2024-03-09T14:40:42.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.690+0000 7f955be9d800 2 removed watcher, disabling cache 2024-03-09T14:40:42.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.691+0000 7f955be9d800 20 remove_watcher() i=1 2024-03-09T14:40:42.693 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.692+0000 7f955be9d800 20 remove_watcher() i=2 2024-03-09T14:40:42.694 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.693+0000 7f955be9d800 20 remove_watcher() i=3 2024-03-09T14:40:42.695 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.694+0000 7f955be9d800 20 remove_watcher() i=4 2024-03-09T14:40:42.696 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.695+0000 7f955be9d800 20 remove_watcher() i=5 2024-03-09T14:40:42.697 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.696+0000 7f955be9d800 20 remove_watcher() i=6 2024-03-09T14:40:42.698 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:42.697+0000 7f955be9d800 20 remove_watcher() i=7 2024-03-09T14:40:42.707 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:42.708 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:42.708 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: error-at-do-reshard id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:40:42.708 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:42.709 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:42.709 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:42.731 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:42.731 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:42.910 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:42.911 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:42.973 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: reshard bucket with abort at do_reshard 2024-03-09T14:40:42.973 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:42.974 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:42.974 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.018 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.018 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.076 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.076 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.109 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.109 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.141 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.141 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.173 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.173 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.206 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.206 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.239 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.239 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.272 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.272 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.304 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.304 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.337 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.337 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.370 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.370 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.401 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.401 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.437 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.437 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.469 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.470 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.502 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.502 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.534 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.534 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.568 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.568 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.599 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.600 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.633 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.633 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.666 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.666 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.699 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:43.699 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:40:43.733 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:40:43.761 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:43.761 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:43.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.792+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 realm 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.794+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.795+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:43.796 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.795+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.796+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:43.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.796+0000 7fb507222800 20 searching for the correct realm 2024-03-09T14:40:43.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.799+0000 7fb50451d640 0 -- 172.21.15.46:0/658271548 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x5562fab36c90 msgr2=0x5562fab39110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:43.804 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.803+0000 7fb504d1e640 0 -- 172.21.15.46:0/658271548 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fb4f80653f0 msgr2=0x7fb4f808f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.807+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 zone default found 2024-03-09T14:40:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 4 Realm: () 2024-03-09T14:40:43.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 zonegroup default 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.808+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.809+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.809+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.809+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.809+0000 7fb507222800 20 started sync module instance, tier type = 2024-03-09T14:40:43.812 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.809+0000 7fb507222800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=0 2024-03-09T14:40:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=1 2024-03-09T14:40:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=2 2024-03-09T14:40:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=3 2024-03-09T14:40:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=4 2024-03-09T14:40:43.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=5 2024-03-09T14:40:43.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.818+0000 7fb507222800 20 add_watcher() i=6 2024-03-09T14:40:43.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.819+0000 7fb507222800 20 add_watcher() i=7 2024-03-09T14:40:43.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.819+0000 7fb507222800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:43.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.820+0000 7fb3bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:43.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb507222800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:43.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb507222800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:43.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb507222800 5 note: GC not initialized 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb3b9fe3640 20 reqs_thread_entry: start 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb507222800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb507222800 20 Filter name: none 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb32b7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.821+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.822+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:43.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.822+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.822+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.822+0000 7fb507222800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.822+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.823+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:43.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.823+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.823+0000 7fb507222800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.823+0000 7fb507222800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.824+0000 7fb507222800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.825 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.824+0000 7fb507222800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.825+0000 7fb3bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:43.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.827+0000 7fb507222800 20 remove_watcher() i=0 2024-03-09T14:40:43.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.827+0000 7fb507222800 2 removed watcher, disabling cache 2024-03-09T14:40:43.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.828+0000 7fb507222800 20 remove_watcher() i=1 2024-03-09T14:40:43.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.828+0000 7fb507222800 20 remove_watcher() i=2 2024-03-09T14:40:43.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.829+0000 7fb507222800 20 remove_watcher() i=3 2024-03-09T14:40:43.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.830+0000 7fb507222800 20 remove_watcher() i=4 2024-03-09T14:40:43.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.831+0000 7fb507222800 20 remove_watcher() i=5 2024-03-09T14:40:43.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.832+0000 7fb507222800 20 remove_watcher() i=6 2024-03-09T14:40:43.834 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.833+0000 7fb507222800 20 remove_watcher() i=7 2024-03-09T14:40:43.844 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:43.844 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:43.844 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-do-reshard id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:43.844 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:43.845 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-03-09T14:40:43.878 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:43.878 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:43.911 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.910+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 realm 2024-03-09T14:40:43.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.912 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:43.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:43.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.912+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:43.913 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.912+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:43.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.913+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:43.914 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.913+0000 7f924891f800 20 searching for the correct realm 2024-03-09T14:40:43.916 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.915+0000 7f9243de8640 0 -- 172.21.15.46:0/558457849 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x555814476d40 msgr2=0x555814479130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:43.921 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:43.919+0000 7f92445e9640 0 -- 172.21.15.46:0/558457849 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9238066650 msgr2=0x7f92380277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.127 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.125+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.128 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 zone default found 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 4 Realm: () 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 zonegroup default 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.127+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.127+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.127+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.127+0000 7f924891f800 20 started sync module instance, tier type = 2024-03-09T14:40:44.129 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.127+0000 7f924891f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=0 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=1 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=2 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=3 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=4 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=5 2024-03-09T14:40:44.137 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=6 2024-03-09T14:40:44.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=7 2024-03-09T14:40:44.138 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.136+0000 7f924891f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:44.139 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.138+0000 7f90fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.138+0000 7f924891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.138+0000 7f924891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.138+0000 7f924891f800 5 note: GC not initialized 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f90f9fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 20 Filter name: none 2024-03-09T14:40:44.140 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f906b7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:40:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:40:44.141 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 : miss 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.139+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.140+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.140+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.140+0000 7f924891f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.140+0000 7f924891f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.140+0000 7f924891f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.142 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.140+0000 7f924891f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.143+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.143+0000 7f924891f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.143+0000 7f924891f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.143+0000 7f924891f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28, ofs0, ns] 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595099 cookie 93836785748832 notifier 6581 bl.length()=903 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.145 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.146 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_sources= new_sources= 2024-03-09T14:40:44.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential sources added=[] removed=[] 2024-03-09T14:40:44.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_dests= new_dests= 2024-03-09T14:40:44.147 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential dests added=[] removed=[] 2024-03-09T14:40:44.148 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f924891f800 time 2024-03-09T14:40:44.149010+0000 2024-03-09T14:40:44.148 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9249f80e86] 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f924891f800 thread_name:radosgw-admin 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.147+0000 7f924891f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f924891f800 time 2024-03-09T14:40:44.149010+0000 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:44.149 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9249f80e86] 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:44.150 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f9248e54db0] 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f9248ea154c] 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9249f80ee0] 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.166 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.148+0000 7f924891f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f924891f800 thread_name:radosgw-admin 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f9248e54db0] 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f9248ea154c] 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9249f80ee0] 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.167 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:40:43.894+0000 7f924891f800 5 asok(0x555814165780) unregister_commands rotate-key 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:40:43.894+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:40:43.894+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:40:43.894+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.168 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding auth protocol: cephx 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding auth protocol: cephx 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding auth protocol: cephx 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.169 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:40:43.895+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: starting msgr at 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: starting objecter 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:40:43.895+0000 7f924891f800 5 asok(0x555814165780) register_command objecter_requests hook 0x5558143b96e0 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: setting wanted keys 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: calling monclient init 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.170 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding auth protocol: cephx 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding auth protocol: cephx 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding auth protocol: cephx 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.171 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:40:43.895+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:40:43.895+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:40:43.895+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key hook 0x555814383b78 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x55581420bd70 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x5558142397e0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x5558142cbe60 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.268935s 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x55581420bd70 auth_method 0 2024-03-09T14:40:44.172 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x5558142397e0 auth_method 0 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x5558142cbe60 auth_method 0 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.173 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:40:43.896+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:40:43.896+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:40:43.896+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:40:43.896+0000 7f92445e9640 10 monclient(hunting): handle_auth_done global_id 6572 payload 824 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:40:43.896+0000 7f92445e9640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:40:43.896+0000 7f92445e9640 1 monclient: found mon.noname-c 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:40:43.896+0000 7f92445e9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: dump: 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.174 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: dump: 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.175 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:40:43.896+0000 7f924891f800 5 monclient: authenticate success, global_id 6572 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:40:43.896+0000 7f913260c640 4 set_mon_vals no callback set 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:40:43.896+0000 7f924891f800 1 librados: init done 2024-03-09T14:40:44.176 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:40:43.898+0000 7f9130e09640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:40:43.898+0000 7f9130e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:40:43.898+0000 7f9130e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:40:43.898+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f912c06a5b0 auth_method 0 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:40:43.898+0000 7f9244dea640 10 monclient: get_auth_request con 0x5558143ae7c0 auth_method 0 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:40:43.899+0000 7f92445e9640 10 monclient: get_auth_request con 0x5558143cf530 auth_method 0 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:40:43.899+0000 7f9243de8640 10 monclient: get_auth_request con 0x5558143d3890 auth_method 0 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:40:43.901+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:40:43.901+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:40:43.901+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.177 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding auth protocol: cephx 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding auth protocol: cephx 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding auth protocol: cephx 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.178 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:40:43.901+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:40:43.901+0000 7f924891f800 5 asok(0x555814165780) register_command objecter_requests cmddesc objecter_requests hook 0x5558143dddb0 EEXIST 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:40:43.901+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding auth protocol: cephx 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding auth protocol: cephx 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding auth protocol: cephx 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.179 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:40:43.901+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:40:43.902+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:40:43.902+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key cmddesc rotate-key hook 0x5558143d6e70 EEXIST 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x555814402b10 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.180 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x555814402ef0 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x5558143fdfb0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.275444s 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x555814402ef0 auth_method 0 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x5558143fdfb0 auth_method 0 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.181 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x555814402b10 auth_method 0 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_done global_id 6575 payload 824 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.182 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:40:43.902+0000 7f9243de8640 1 monclient: found mon.noname-c 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: dump: 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.183 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: dump: 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.184 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:40:43.902+0000 7f92455eb640 4 set_mon_vals no callback set 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:40:43.902+0000 7f924891f800 5 monclient: authenticate success, global_id 6575 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:40:43.903+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:40:43.903+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:40:43.904+0000 7f9129ffb640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:40:43.904+0000 7f9129ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:40:43.904+0000 7f9129ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:40:43.904+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f911c06a4c0 auth_method 0 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:40:43.904+0000 7f924891f800 10 monclient: get_monmap_and_config 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:40:43.904+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:40:43.904+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.185 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:40:43.904+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.186 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.187 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:40:43.905+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding auth protocol: cephx 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding auth protocol: cephx 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding auth protocol: cephx 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.188 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:40:43.905+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:40:43.905+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:40:43.905+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key cmddesc rotate-key hook 0x7ffeca8884f8 EEXIST 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x555814454eb0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x555814455290 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x55581444f660 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.189 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.278893s 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x555814454eb0 auth_method 0 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x55581444f660 auth_method 0 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.190 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x555814455290 auth_method 0 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_done global_id 6915 payload 274 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:40:43.905+0000 7f92445e9640 1 monclient: found mon.noname-a 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: dump: 2024-03-09T14:40:44.191 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:44.192 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: dump: 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:40:43.906+0000 7f924891f800 5 monclient: authenticate success, global_id 6915 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:40:43.906+0000 7f924891f800 4 set_mon_vals no callback set 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: shutdown 2024-03-09T14:40:44.193 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:40:43.906+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.194 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:40:43.907+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: starting msgr at 2024-03-09T14:40:44.195 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: starting objecter 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:40:43.907+0000 7f924891f800 5 asok(0x555814165780) register_command objecter_requests cmddesc objecter_requests hook 0x5558144230c0 EEXIST 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: setting wanted keys 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: calling monclient init 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding auth protocol: cephx 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding auth protocol: cephx 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding auth protocol: cephx 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.196 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:40:43.907+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:40:43.907+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:40:43.907+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key cmddesc rotate-key hook 0x55581441f978 EEXIST 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x55581444f660 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x555814454eb0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x55581445f6b0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.197 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.281064s 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x55581444f660 auth_method 0 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x55581445f6b0 auth_method 0 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.198 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:40:43.908+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:40:43.908+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:40:43.908+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x555814454eb0 auth_method 0 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_done global_id 6581 payload 824 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:40:43.908+0000 7f92445e9640 1 monclient: found mon.noname-c 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.199 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: dump: 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.200 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: dump: 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:40:43.908+0000 7f911b7fe640 4 set_mon_vals no callback set 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:40:43.908+0000 7f924891f800 5 monclient: authenticate success, global_id 6581 2024-03-09T14:40:44.201 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:40:43.908+0000 7f924891f800 1 librados: init done 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:40:43.908+0000 7f924891f800 5 asok(0x555814165780) register_command cr dump hook 0x5558144628d8 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:40:43.910+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:40:43.910+0000 7f9119ffb640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:40:43.910+0000 7f9119ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:40:43.910+0000 7f9119ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:40:43.910+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f910c06a5e0 auth_method 0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:40:43.910+0000 7f9244dea640 10 monclient: get_auth_request con 0x55581446f2a0 auth_method 0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:40:43.911+0000 7f924891f800 20 realm 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.202 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:40:43.911+0000 7f924891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:40:43.912+0000 7f92445e9640 10 monclient: get_auth_request con 0x5558144734e0 auth_method 0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:40:43.912+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:40:43.912+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:40:43.912+0000 7f9243de8640 10 monclient: get_auth_request con 0x555814476d40 auth_method 0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:40:43.913+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:40:43.913+0000 7f924891f800 20 searching for the correct realm 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:40:43.913+0000 7f9244dea640 10 monclient: get_auth_request con 0x55581447ba90 auth_method 0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:40:43.914+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f923c065040 auth_method 0 2024-03-09T14:40:44.203 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:40:43.915+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f9234018070 auth_method 0 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:40:43.915+0000 7f9243de8640 0 -- 172.21.15.46:0/558457849 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x555814476d40 msgr2=0x555814479130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:40:43.915+0000 7f9119ffb640 1 client.6581.objecter ms_handle_reset 0x555814476d40 session 0x555814472870 osd.4 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:40:43.915+0000 7f9119ffb640 10 monclient: _renew_subs 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:40:43.915+0000 7f9119ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:40:43.916+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f910c07ad10 auth_method 0 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:40:43.917+0000 7f9244dea640 10 monclient: get_auth_request con 0x7f9238031060 auth_method 0 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:40:43.919+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f9238066650 auth_method 0 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:40:43.919+0000 7f92445e9640 0 -- 172.21.15.46:0/558457849 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9238066650 msgr2=0x7f92380277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:40:44.120+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f9238066650 auth_method 0 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:44.204 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:40:44.125+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:40:44.125+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:40:44.125+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:40:44.126+0000 7f924891f800 20 zone default found 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:40:44.126+0000 7f924891f800 4 Realm: () 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:40:44.126+0000 7f924891f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:40:44.126+0000 7f924891f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:40:44.126+0000 7f924891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:40:44.126+0000 7f924891f800 20 zonegroup default 2024-03-09T14:40:44.205 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:40:44.127+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:40:44.127+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:40:44.127+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:40:44.127+0000 7f924891f800 20 started sync module instance, tier type = 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:40:44.127+0000 7f924891f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=0 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=1 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=2 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=3 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=4 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=5 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=6 2024-03-09T14:40:44.206 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=7 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:40:44.136+0000 7f924891f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding auth protocol: cephx 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding auth protocol: cephx 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding auth protocol: cephx 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:40:44.138+0000 7f90fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.207 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:40:44.138+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:40:44.138+0000 7f924891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:40:44.138+0000 7f924891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache list hook 0x55581445fad0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache inspect hook 0x55581445fad0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache erase hook 0x55581445fad0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache zap hook 0x55581445fad0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:40:44.138+0000 7f924891f800 5 note: GC not initialized 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:40:44.139+0000 7f90f9fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace show hook 0x7f92380024c0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace history hook 0x7f92380024c0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace active hook 0x7f92380024c0 2024-03-09T14:40:44.208 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace active_short hook 0x7f92380024c0 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:40:44.139+0000 7f924891f800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:40:44.139+0000 7f924891f800 20 Filter name: none 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:40:44.139+0000 7f906b7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:40:44.139+0000 7f924891f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:40:44.139+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:40:44.139+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:40:44.139+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:40:44.139+0000 7f924891f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:40:44.139+0000 7f924891f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 : miss 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:40:44.139+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:40:44.140+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:40:44.140+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:40:44.140+0000 7f924891f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.209 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:40:44.140+0000 7f924891f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:40:44.140+0000 7f924891f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:40:44.140+0000 7f924891f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:40:44.143+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:40:44.143+0000 7f924891f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:40:44.143+0000 7f924891f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:40:44.143+0000 7f924891f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28, ofs0, ns] 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595099 cookie 93836785748832 notifier 6581 bl.length()=903 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_sources= new_sources= 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential sources added=[] removed=[] 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_dests= new_dests= 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential dests added=[] removed=[] 2024-03-09T14:40:44.210 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:40:44.147+0000 7f924891f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f924891f800 time 2024-03-09T14:40:44.149010+0000 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9249f80e86] 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:40:44.148+0000 7f924891f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:44.211 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f924891f800 thread_name:radosgw-admin 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f9248e54db0] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f9248ea154c] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9249f80ee0] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:44.212 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:40:44.213 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:40:44.214 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:40:44.215 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:40:44.216 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:40:44.217 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:40:44.218 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f906b7fe640 / http_manager 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f90f9fdb640 / http_manager 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f90fafdd640 / rgw_dt_lg_renew 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9119ffb640 / ms_dispatch 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f911b7fe640 / io_context_pool 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9129ffb640 / ms_dispatch 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9130e09640 / ms_dispatch 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f913260c640 / io_context_pool 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9243de8640 / msgr-worker-2 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f92445e9640 / msgr-worker-1 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9244dea640 / msgr-worker-0 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f92455eb640 / io_context_pool 2024-03-09T14:40:44.219 INFO:tasks.workunit.client.0.smithi046.stderr: 7f924891f800 / radosgw-admin 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/log/ceph/ceph-client.admin.110565.log 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:--- begin dump of recent events --- 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: -499> 2024-03-09T14:40:43.894+0000 7f924891f800 5 asok(0x555814165780) unregister_commands rotate-key 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: -498> 2024-03-09T14:40:43.894+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: -497> 2024-03-09T14:40:43.894+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr: -496> 2024-03-09T14:40:43.894+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.220 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -495> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding auth protocol: cephx 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -494> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding auth protocol: cephx 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -493> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding auth protocol: cephx 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -492> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -491> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -490> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -489> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -488> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -487> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -486> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.221 INFO:tasks.workunit.client.0.smithi046.stderr: -485> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -484> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -483> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -482> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: crc 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -481> 2024-03-09T14:40:43.894+0000 7f924891f800 5 AuthRegistry(0x555814386d20) adding con mode: secure 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -480> 2024-03-09T14:40:43.895+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -479> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: starting msgr at 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -478> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: starting objecter 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -477> 2024-03-09T14:40:43.895+0000 7f924891f800 5 asok(0x555814165780) register_command objecter_requests hook 0x5558143b96e0 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -476> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: setting wanted keys 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -475> 2024-03-09T14:40:43.895+0000 7f924891f800 1 librados: calling monclient init 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -474> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -473> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding auth protocol: cephx 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -472> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding auth protocol: cephx 2024-03-09T14:40:44.222 INFO:tasks.workunit.client.0.smithi046.stderr: -471> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding auth protocol: cephx 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -470> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -469> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -468> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -467> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -466> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -465> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -464> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -463> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -462> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -461> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -460> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: crc 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -459> 2024-03-09T14:40:43.895+0000 7f924891f800 5 AuthRegistry(0x555814383a30) adding con mode: secure 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -458> 2024-03-09T14:40:43.895+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -457> 2024-03-09T14:40:43.895+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -456> 2024-03-09T14:40:43.895+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key hook 0x555814383b78 2024-03-09T14:40:44.223 INFO:tasks.workunit.client.0.smithi046.stderr: -455> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -454> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -453> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x55581420bd70 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -452> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x5558142397e0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -451> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x5558142cbe60 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -450> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -449> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -448> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -447> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -446> 2024-03-09T14:40:43.895+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.268935s 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -445> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x55581420bd70 auth_method 0 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -444> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -443> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -442> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -441> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x5558142397e0 auth_method 0 2024-03-09T14:40:44.224 INFO:tasks.workunit.client.0.smithi046.stderr: -440> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -439> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -438> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -437> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x5558142cbe60 auth_method 0 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -436> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -435> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -434> 2024-03-09T14:40:43.895+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -433> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -432> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -431> 2024-03-09T14:40:43.895+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -430> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -429> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -428> 2024-03-09T14:40:43.895+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -427> 2024-03-09T14:40:43.896+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.225 INFO:tasks.workunit.client.0.smithi046.stderr: -426> 2024-03-09T14:40:43.896+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -425> 2024-03-09T14:40:43.896+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -424> 2024-03-09T14:40:43.896+0000 7f92445e9640 10 monclient(hunting): handle_auth_done global_id 6572 payload 824 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -423> 2024-03-09T14:40:43.896+0000 7f92445e9640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -422> 2024-03-09T14:40:43.896+0000 7f92445e9640 1 monclient: found mon.noname-c 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -421> 2024-03-09T14:40:43.896+0000 7f92445e9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -420> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -419> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr: -418> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: dump: 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.226 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: -417> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: -416> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: -415> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: -414> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: -413> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr: -412> 2024-03-09T14:40:43.896+0000 7f9130e09640 10 monclient: dump: 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.227 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -411> 2024-03-09T14:40:43.896+0000 7f924891f800 5 monclient: authenticate success, global_id 6572 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -410> 2024-03-09T14:40:43.896+0000 7f913260c640 4 set_mon_vals no callback set 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -409> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -408> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -407> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -406> 2024-03-09T14:40:43.896+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -405> 2024-03-09T14:40:43.896+0000 7f924891f800 1 librados: init done 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -404> 2024-03-09T14:40:43.898+0000 7f9130e09640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -403> 2024-03-09T14:40:43.898+0000 7f9130e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.228 INFO:tasks.workunit.client.0.smithi046.stderr: -402> 2024-03-09T14:40:43.898+0000 7f9130e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -401> 2024-03-09T14:40:43.898+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f912c06a5b0 auth_method 0 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -400> 2024-03-09T14:40:43.898+0000 7f9244dea640 10 monclient: get_auth_request con 0x5558143ae7c0 auth_method 0 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -399> 2024-03-09T14:40:43.899+0000 7f92445e9640 10 monclient: get_auth_request con 0x5558143cf530 auth_method 0 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -398> 2024-03-09T14:40:43.899+0000 7f9243de8640 10 monclient: get_auth_request con 0x5558143d3890 auth_method 0 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -397> 2024-03-09T14:40:43.901+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -396> 2024-03-09T14:40:43.901+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr: -395> 2024-03-09T14:40:43.901+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.229 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -394> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding auth protocol: cephx 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -393> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding auth protocol: cephx 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -392> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding auth protocol: cephx 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -391> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -390> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -389> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -388> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -387> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -386> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -385> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -384> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -383> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.230 INFO:tasks.workunit.client.0.smithi046.stderr: -382> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -381> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: crc 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -380> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d86c0) adding con mode: secure 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -379> 2024-03-09T14:40:43.901+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -378> 2024-03-09T14:40:43.901+0000 7f924891f800 5 asok(0x555814165780) register_command objecter_requests cmddesc objecter_requests hook 0x5558143dddb0 EEXIST 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -377> 2024-03-09T14:40:43.901+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -376> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding auth protocol: cephx 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -375> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding auth protocol: cephx 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -374> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding auth protocol: cephx 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -373> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -372> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -371> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.231 INFO:tasks.workunit.client.0.smithi046.stderr: -370> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -369> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -368> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -367> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -366> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -365> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -364> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -363> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: crc 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -362> 2024-03-09T14:40:43.901+0000 7f924891f800 5 AuthRegistry(0x5558143d6d28) adding con mode: secure 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -361> 2024-03-09T14:40:43.901+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -360> 2024-03-09T14:40:43.902+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -359> 2024-03-09T14:40:43.902+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key cmddesc rotate-key hook 0x5558143d6e70 EEXIST 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -358> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -357> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:40:44.232 INFO:tasks.workunit.client.0.smithi046.stderr: -356> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x555814402b10 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -355> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x555814402ef0 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -354> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x5558143fdfb0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -353> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -352> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -351> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -350> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -349> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.275444s 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -348> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x555814402ef0 auth_method 0 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -347> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -346> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -345> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -344> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x5558143fdfb0 auth_method 0 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -343> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -342> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.233 INFO:tasks.workunit.client.0.smithi046.stderr: -341> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -340> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x555814402b10 auth_method 0 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -339> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -338> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -337> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -336> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -335> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -334> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -333> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -332> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -331> 2024-03-09T14:40:43.902+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -330> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -329> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -328> 2024-03-09T14:40:43.902+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.234 INFO:tasks.workunit.client.0.smithi046.stderr: -327> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient(hunting): handle_auth_done global_id 6575 payload 824 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr: -326> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr: -325> 2024-03-09T14:40:43.902+0000 7f9243de8640 1 monclient: found mon.noname-c 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr: -324> 2024-03-09T14:40:43.902+0000 7f9243de8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr: -323> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr: -322> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr: -321> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: dump: 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.235 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: -320> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: -319> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: -318> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: -317> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: -316> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr: -315> 2024-03-09T14:40:43.902+0000 7f9129ffb640 10 monclient: dump: 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.236 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -314> 2024-03-09T14:40:43.902+0000 7f92455eb640 4 set_mon_vals no callback set 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -313> 2024-03-09T14:40:43.902+0000 7f924891f800 5 monclient: authenticate success, global_id 6575 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -312> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -311> 2024-03-09T14:40:43.902+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -310> 2024-03-09T14:40:43.903+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -309> 2024-03-09T14:40:43.903+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -308> 2024-03-09T14:40:43.904+0000 7f9129ffb640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -307> 2024-03-09T14:40:43.904+0000 7f9129ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -306> 2024-03-09T14:40:43.904+0000 7f9129ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -305> 2024-03-09T14:40:43.904+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f911c06a4c0 auth_method 0 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -304> 2024-03-09T14:40:43.904+0000 7f924891f800 10 monclient: get_monmap_and_config 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -303> 2024-03-09T14:40:43.904+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.237 INFO:tasks.workunit.client.0.smithi046.stderr: -302> 2024-03-09T14:40:43.904+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr: -301> 2024-03-09T14:40:43.904+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr: -300> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr: -299> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.238 INFO:tasks.workunit.client.0.smithi046.stderr: -298> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -297> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -296> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -295> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -294> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -293> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -292> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -291> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -290> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -289> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -288> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -287> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -286> 2024-03-09T14:40:43.904+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -285> 2024-03-09T14:40:43.905+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -284> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.239 INFO:tasks.workunit.client.0.smithi046.stderr: -283> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding auth protocol: cephx 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -282> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding auth protocol: cephx 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -281> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding auth protocol: cephx 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -280> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -279> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -278> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -277> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -276> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -275> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -274> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -273> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -272> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -271> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -270> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: crc 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -269> 2024-03-09T14:40:43.905+0000 7f924891f800 5 AuthRegistry(0x7ffeca8883b0) adding con mode: secure 2024-03-09T14:40:44.240 INFO:tasks.workunit.client.0.smithi046.stderr: -268> 2024-03-09T14:40:43.905+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -267> 2024-03-09T14:40:43.905+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -266> 2024-03-09T14:40:43.905+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key cmddesc rotate-key hook 0x7ffeca8884f8 EEXIST 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -265> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -264> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -263> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x555814454eb0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -262> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x555814455290 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -261> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x55581444f660 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -260> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -259> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -258> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -257> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -256> 2024-03-09T14:40:43.905+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.278893s 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -255> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x555814454eb0 auth_method 0 2024-03-09T14:40:44.241 INFO:tasks.workunit.client.0.smithi046.stderr: -254> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -253> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -252> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -251> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x55581444f660 auth_method 0 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -250> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -249> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -248> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -247> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -246> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -245> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -244> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x555814455290 auth_method 0 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -243> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -242> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -241> 2024-03-09T14:40:43.905+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -240> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.242 INFO:tasks.workunit.client.0.smithi046.stderr: -239> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -238> 2024-03-09T14:40:43.905+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -237> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient(hunting): handle_auth_done global_id 6915 payload 274 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -236> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -235> 2024-03-09T14:40:43.905+0000 7f92445e9640 1 monclient: found mon.noname-a 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -234> 2024-03-09T14:40:43.905+0000 7f92445e9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.46:3300/0 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -233> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -232> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr: -231> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: dump: 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.243 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: -230> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: -229> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: -228> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: -227> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: -226> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr: -225> 2024-03-09T14:40:43.906+0000 7f911b7fe640 10 monclient: dump: 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.244 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -224> 2024-03-09T14:40:43.906+0000 7f924891f800 5 monclient: authenticate success, global_id 6915 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -223> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: get_monmap_and_config success 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -222> 2024-03-09T14:40:43.906+0000 7f924891f800 4 set_mon_vals no callback set 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -221> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: shutdown 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -220> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: build_initial_monmap 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -219> 2024-03-09T14:40:43.906+0000 7f924891f800 1 build_initial for_mkfs: 0 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr: -218> 2024-03-09T14:40:43.906+0000 7f924891f800 10 monclient: monmap: 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 0 2024-03-09T14:40:44.245 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 0.000000 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:created 0.000000 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 0 (unknown) 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.noname-a 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.noname-b 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.noname-c 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -217> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -216> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -215> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding auth protocol: cephx 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -214> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -213> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -212> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.246 INFO:tasks.workunit.client.0.smithi046.stderr: -211> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -210> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -209> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -208> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -207> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -206> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -205> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -204> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: crc 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -203> 2024-03-09T14:40:43.906+0000 7f924891f800 5 AuthRegistry(0x555814420660) adding con mode: secure 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -202> 2024-03-09T14:40:43.907+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -201> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: starting msgr at 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -200> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: starting objecter 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -199> 2024-03-09T14:40:43.907+0000 7f924891f800 5 asok(0x555814165780) register_command objecter_requests cmddesc objecter_requests hook 0x5558144230c0 EEXIST 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -198> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: setting wanted keys 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -197> 2024-03-09T14:40:43.907+0000 7f924891f800 1 librados: calling monclient init 2024-03-09T14:40:44.247 INFO:tasks.workunit.client.0.smithi046.stderr: -196> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient: init 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -195> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding auth protocol: cephx 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -194> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding auth protocol: cephx 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -193> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding auth protocol: cephx 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -192> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -191> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -190> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -189> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -188> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -187> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -186> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -185> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -184> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -183> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -182> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: crc 2024-03-09T14:40:44.248 INFO:tasks.workunit.client.0.smithi046.stderr: -181> 2024-03-09T14:40:43.907+0000 7f924891f800 5 AuthRegistry(0x55581441f830) adding con mode: secure 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -180> 2024-03-09T14:40:43.907+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -179> 2024-03-09T14:40:43.907+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -178> 2024-03-09T14:40:43.907+0000 7f924891f800 5 asok(0x555814165780) register_command rotate-key cmddesc rotate-key hook 0x55581441f978 EEXIST 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -177> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient: _reopen_session rank -1 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -176> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -175> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): picked mon.noname-c con 0x55581444f660 addr [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -174> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): picked mon.noname-b con 0x555814454eb0 addr [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -173> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): picked mon.noname-a con 0x55581445f6b0 addr [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -172> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -171> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -170> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): start opening mon connection 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -169> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): _renew_subs 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -168> 2024-03-09T14:40:43.907+0000 7f924891f800 10 monclient(hunting): authenticate will time out at 1921.281064s 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -167> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): get_auth_request con 0x55581444f660 auth_method 0 2024-03-09T14:40:44.249 INFO:tasks.workunit.client.0.smithi046.stderr: -166> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -165> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -164> 2024-03-09T14:40:43.907+0000 7f92445e9640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -163> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): get_auth_request con 0x55581445f6b0 auth_method 0 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -162> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -161> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -160> 2024-03-09T14:40:43.907+0000 7f9244dea640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -159> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -158> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -157> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -156> 2024-03-09T14:40:43.908+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -155> 2024-03-09T14:40:43.908+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -154> 2024-03-09T14:40:43.908+0000 7f9244dea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -153> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): get_auth_request con 0x555814454eb0 auth_method 0 2024-03-09T14:40:44.250 INFO:tasks.workunit.client.0.smithi046.stderr: -152> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -151> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -150> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -149> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -148> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -147> 2024-03-09T14:40:43.908+0000 7f9243de8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -146> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient(hunting): handle_auth_done global_id 6581 payload 824 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -145> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient: _finish_hunting 0 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -144> 2024-03-09T14:40:43.908+0000 7f92445e9640 1 monclient: found mon.noname-c 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -143> 2024-03-09T14:40:43.908+0000 7f92445e9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -142> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -141> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr: -140> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: dump: 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.251 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: -139> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: _finish_auth 0 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: -138> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: -137> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: -136> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: -135> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr: -134> 2024-03-09T14:40:43.908+0000 7f9119ffb640 10 monclient: dump: 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:epoch 1 2024-03-09T14:40:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:fsid 89924d1c-8381-4c0c-aba2-532d86495bef 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:last_changed 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:created 2024-03-09T14:20:48.527778+0000 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:min_mon_release 19 (squid) 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:election_strategy: 1 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr:2: [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] mon.c 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -133> 2024-03-09T14:40:43.908+0000 7f911b7fe640 4 set_mon_vals no callback set 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -132> 2024-03-09T14:40:43.908+0000 7f924891f800 5 monclient: authenticate success, global_id 6581 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -131> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -130> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -129> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _renew_subs 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -128> 2024-03-09T14:40:43.908+0000 7f924891f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -127> 2024-03-09T14:40:43.908+0000 7f924891f800 1 librados: init done 2024-03-09T14:40:44.253 INFO:tasks.workunit.client.0.smithi046.stderr: -126> 2024-03-09T14:40:43.908+0000 7f924891f800 5 asok(0x555814165780) register_command cr dump hook 0x5558144628d8 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -125> 2024-03-09T14:40:43.910+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -124> 2024-03-09T14:40:43.910+0000 7f9119ffb640 4 mgrc handle_mgr_map Got map version 6 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -123> 2024-03-09T14:40:43.910+0000 7f9119ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -122> 2024-03-09T14:40:43.910+0000 7f9119ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.46:6832/2436891488,v1:172.21.15.46:6833/2436891488] 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -121> 2024-03-09T14:40:43.910+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f910c06a5e0 auth_method 0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -120> 2024-03-09T14:40:43.910+0000 7f9244dea640 10 monclient: get_auth_request con 0x55581446f2a0 auth_method 0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -119> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -118> 2024-03-09T14:40:43.911+0000 7f924891f800 20 realm 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -117> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -116> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -115> 2024-03-09T14:40:43.911+0000 7f924891f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -114> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -113> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.254 INFO:tasks.workunit.client.0.smithi046.stderr: -112> 2024-03-09T14:40:43.911+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -111> 2024-03-09T14:40:43.912+0000 7f92445e9640 10 monclient: get_auth_request con 0x5558144734e0 auth_method 0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -110> 2024-03-09T14:40:43.912+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -109> 2024-03-09T14:40:43.912+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -108> 2024-03-09T14:40:43.912+0000 7f9243de8640 10 monclient: get_auth_request con 0x555814476d40 auth_method 0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -107> 2024-03-09T14:40:43.913+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -106> 2024-03-09T14:40:43.913+0000 7f924891f800 20 searching for the correct realm 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -105> 2024-03-09T14:40:43.913+0000 7f9244dea640 10 monclient: get_auth_request con 0x55581447ba90 auth_method 0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -104> 2024-03-09T14:40:43.914+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f923c065040 auth_method 0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -103> 2024-03-09T14:40:43.915+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f9234018070 auth_method 0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -102> 2024-03-09T14:40:43.915+0000 7f9243de8640 0 -- 172.21.15.46:0/558457849 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x555814476d40 msgr2=0x555814479130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -101> 2024-03-09T14:40:43.915+0000 7f9119ffb640 1 client.6581.objecter ms_handle_reset 0x555814476d40 session 0x555814472870 osd.4 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -100> 2024-03-09T14:40:43.915+0000 7f9119ffb640 10 monclient: _renew_subs 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -99> 2024-03-09T14:40:43.915+0000 7f9119ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.46:3301/0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -98> 2024-03-09T14:40:43.916+0000 7f9243de8640 10 monclient: get_auth_request con 0x7f910c07ad10 auth_method 0 2024-03-09T14:40:44.255 INFO:tasks.workunit.client.0.smithi046.stderr: -97> 2024-03-09T14:40:43.917+0000 7f9244dea640 10 monclient: get_auth_request con 0x7f9238031060 auth_method 0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -96> 2024-03-09T14:40:43.919+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f9238066650 auth_method 0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -95> 2024-03-09T14:40:43.919+0000 7f92445e9640 0 -- 172.21.15.46:0/558457849 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9238066650 msgr2=0x7f92380277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -94> 2024-03-09T14:40:44.120+0000 7f92445e9640 10 monclient: get_auth_request con 0x7f9238066650 auth_method 0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -93> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -92> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -91> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -90> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -89> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -88> 2024-03-09T14:40:44.125+0000 7f924891f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -87> 2024-03-09T14:40:44.125+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -86> 2024-03-09T14:40:44.125+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -85> 2024-03-09T14:40:44.125+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -84> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -83> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.256 INFO:tasks.workunit.client.0.smithi046.stderr: -82> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -81> 2024-03-09T14:40:44.126+0000 7f924891f800 20 zone default found 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -80> 2024-03-09T14:40:44.126+0000 7f924891f800 4 Realm: () 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -79> 2024-03-09T14:40:44.126+0000 7f924891f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -78> 2024-03-09T14:40:44.126+0000 7f924891f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -77> 2024-03-09T14:40:44.126+0000 7f924891f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -76> 2024-03-09T14:40:44.126+0000 7f924891f800 20 zonegroup default 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -75> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -74> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -73> 2024-03-09T14:40:44.126+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -72> 2024-03-09T14:40:44.127+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -71> 2024-03-09T14:40:44.127+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -70> 2024-03-09T14:40:44.127+0000 7f924891f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -69> 2024-03-09T14:40:44.127+0000 7f924891f800 20 started sync module instance, tier type = 2024-03-09T14:40:44.257 INFO:tasks.workunit.client.0.smithi046.stderr: -68> 2024-03-09T14:40:44.127+0000 7f924891f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -67> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=0 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -66> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=1 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -65> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=2 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -64> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=3 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -63> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=4 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -62> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=5 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -61> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=6 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -60> 2024-03-09T14:40:44.136+0000 7f924891f800 20 add_watcher() i=7 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -59> 2024-03-09T14:40:44.136+0000 7f924891f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -58> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding auth protocol: cephx 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -57> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding auth protocol: cephx 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -56> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding auth protocol: cephx 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -55> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -54> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.258 INFO:tasks.workunit.client.0.smithi046.stderr: -53> 2024-03-09T14:40:44.138+0000 7f90fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -52> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -51> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -50> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -49> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -48> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -47> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -46> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -45> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -44> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: crc 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -43> 2024-03-09T14:40:44.138+0000 7f924891f800 5 AuthRegistry(0x7ffeca888840) adding con mode: secure 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -42> 2024-03-09T14:40:44.138+0000 7f924891f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -41> 2024-03-09T14:40:44.138+0000 7f924891f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -40> 2024-03-09T14:40:44.138+0000 7f924891f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -39> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache list hook 0x55581445fad0 2024-03-09T14:40:44.259 INFO:tasks.workunit.client.0.smithi046.stderr: -38> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache inspect hook 0x55581445fad0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -37> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache erase hook 0x55581445fad0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -36> 2024-03-09T14:40:44.138+0000 7f924891f800 5 asok(0x555814165780) register_command cache zap hook 0x55581445fad0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -35> 2024-03-09T14:40:44.138+0000 7f924891f800 5 note: GC not initialized 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -34> 2024-03-09T14:40:44.139+0000 7f90f9fdb640 20 reqs_thread_entry: start 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -33> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace show hook 0x7f92380024c0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -32> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace history hook 0x7f92380024c0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -31> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace active hook 0x7f92380024c0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -30> 2024-03-09T14:40:44.139+0000 7f924891f800 5 asok(0x555814165780) register_command sync trace active_short hook 0x7f92380024c0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -29> 2024-03-09T14:40:44.139+0000 7f924891f800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -28> 2024-03-09T14:40:44.139+0000 7f924891f800 20 Filter name: none 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -27> 2024-03-09T14:40:44.139+0000 7f906b7fe640 20 reqs_thread_entry: start 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -26> 2024-03-09T14:40:44.139+0000 7f924891f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -25> 2024-03-09T14:40:44.139+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -24> 2024-03-09T14:40:44.139+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:44.260 INFO:tasks.workunit.client.0.smithi046.stderr: -23> 2024-03-09T14:40:44.139+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -22> 2024-03-09T14:40:44.139+0000 7f924891f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -21> 2024-03-09T14:40:44.139+0000 7f924891f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 : miss 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -20> 2024-03-09T14:40:44.139+0000 7f924891f800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -19> 2024-03-09T14:40:44.140+0000 7f924891f800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -18> 2024-03-09T14:40:44.140+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -17> 2024-03-09T14:40:44.140+0000 7f924891f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -16> 2024-03-09T14:40:44.140+0000 7f924891f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -15> 2024-03-09T14:40:44.140+0000 7f924891f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -14> 2024-03-09T14:40:44.140+0000 7f924891f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -13> 2024-03-09T14:40:44.143+0000 7f924891f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -12> 2024-03-09T14:40:44.143+0000 7f924891f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -11> 2024-03-09T14:40:44.143+0000 7f924891f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -10> 2024-03-09T14:40:44.143+0000 7f924891f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28, ofs0, ns] 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -9> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595099 cookie 93836785748832 notifier 6581 bl.length()=903 2024-03-09T14:40:44.261 INFO:tasks.workunit.client.0.smithi046.stderr: -8> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -7> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -6> 2024-03-09T14:40:44.144+0000 7f911b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -5> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_sources= new_sources= 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -4> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential sources added=[] removed=[] 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -3> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_dests= new_dests= 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -2> 2024-03-09T14:40:44.145+0000 7f924891f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential dests added=[] removed=[] 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: -1> 2024-03-09T14:40:44.147+0000 7f924891f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f924891f800 time 2024-03-09T14:40:44.149010+0000 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2079-gc00d9c60/rpm/el9/BUILD/ceph-19.0.0-2079-gc00d9c60/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9249f80e86] 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.262 INFO:tasks.workunit.client.0.smithi046.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 5: main() 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 7: __libc_start_main() 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 8: _start() 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 0> 2024-03-09T14:40:44.148+0000 7f924891f800 -1 *** Caught signal (Aborted) ** 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: in thread 7f924891f800 thread_name:radosgw-admin 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f9248e54db0] 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f9248ea154c] 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 3: raise() 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 4: abort() 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9249f80ee0] 2024-03-09T14:40:44.263 INFO:tasks.workunit.client.0.smithi046.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x181044) [0x7f9249f81044] 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5558122d1f91] 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5558122eced4] 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 9: main() 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f9248e3feb0] 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 11: __libc_start_main() 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 12: _start() 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr:--- logging levels --- 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 none 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 lockdep 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 context 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 crush 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds 2024-03-09T14:40:44.264 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_balancer 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_locker 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_log_expire 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mds_migrator 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 buffer 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 timer 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 filer 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 striper 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 1 objecter 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rados 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_mirror 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_replay 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 rbd_pwl 2024-03-09T14:40:44.265 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 journaler 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objectcacher 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 client 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 osd 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 optracker 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 objclass 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 filestore 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 journal 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 ms 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mon 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/10 monc 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 paxos 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 tp 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 auth 2024-03-09T14:40:44.266 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 crypto 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 finisher 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 reserver 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 heartbeatmap 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 perfcounter 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 20/20 rgw 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_sync 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_datacache 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_access 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_flight 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 javaclient 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 asok 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 1 throttle 2024-03-09T14:40:44.267 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 0 refs 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 compressor 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluestore 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 bluefs 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 3 bdev 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 kstore 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 4/ 5 rocksdb 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 fuse 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 2/ 5 mgr 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mgrc 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 dpdk 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 eventtrace 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 prioritycache 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 test 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cephsqlite 2024-03-09T14:40:44.268 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_onode 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_odata 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_omap 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_tm 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_t 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_epm 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_lba 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_cache 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_journal 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_device 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 seastore_backref 2024-03-09T14:40:44.269 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 alienstore 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 mclock 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 0/ 5 cyanstore 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 ceph_exporter 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 memstore 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 1/ 5 trace 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: -2/-2 (syslog threshold) 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 99/99 (stderr threshold) 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f906b7fe640 / http_manager 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f90f9fdb640 / http_manager 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f90fafdd640 / rgw_dt_lg_renew 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9119ffb640 / ms_dispatch 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f911b7fe640 / io_context_pool 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9129ffb640 / ms_dispatch 2024-03-09T14:40:44.270 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9130e09640 / ms_dispatch 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: 7f913260c640 / io_context_pool 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9243de8640 / msgr-worker-2 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: 7f92445e9640 / msgr-worker-1 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: 7f9244dea640 / msgr-worker-0 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: 7f92455eb640 / io_context_pool 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: 7f924891f800 / radosgw-admin 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: max_recent 500 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: max_new 1000 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:40:44.150414Z_8beee821-f8d5-4920-b605-90e4a8db6daf/log 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr:--- end dump of recent events --- 2024-03-09T14:40:44.271 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.219+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.220+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.220+0000 7f8e92711800 20 realm 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.220+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.276 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.220+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.220+0000 7f8e92711800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.220+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.221+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.221+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.221+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.221+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.222+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.222+0000 7f8e92711800 20 searching for the correct realm 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.225+0000 7f8e90a15640 0 -- 172.21.15.46:0/3878364619 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55f6918adc40 msgr2=0x55f6918b0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.229+0000 7f8e90a15640 0 -- 172.21.15.46:0/3878364619 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f8e8400e040 msgr2=0x7f8e8400fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:40:44.277 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 zone default found 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 4 Realm: () 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 zonegroup default 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.233+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.278 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 started sync module instance, tier type = 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.234+0000 7f8e92711800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=0 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=1 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=2 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=3 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=4 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=5 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.243+0000 7f8e92711800 20 add_watcher() i=6 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.244+0000 7f8e92711800 20 add_watcher() i=7 2024-03-09T14:40:44.279 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.244+0000 7f8e92711800 2 all 8 watchers are set, enabling cache 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.245+0000 7f8d467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8e92711800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8e92711800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8e92711800 5 note: GC not initialized 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8d457e2640 20 reqs_thread_entry: start 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8e92711800 20 init_complete bucket index max shards: 1 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8e92711800 20 Filter name: none 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8cb6ffd640 20 reqs_thread_entry: start 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.246+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.247+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.247+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.247+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=433 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.247+0000 7f8e92711800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.247+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.280 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.248+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.248+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.248+0000 7f8e92711800 20 rados_obj.operate() r=0 bl.length=433 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.248+0000 7f8e92711800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.249+0000 7f8e92711800 20 rados->read ofs=0 len=0 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.249+0000 7f8e92711800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.250+0000 7f8d467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.252+0000 7f8e92711800 20 remove_watcher() i=0 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.252+0000 7f8e92711800 2 removed watcher, disabling cache 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.253+0000 7f8e92711800 20 remove_watcher() i=1 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.254+0000 7f8e92711800 20 remove_watcher() i=2 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.255+0000 7f8e92711800 20 remove_watcher() i=3 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.256+0000 7f8e92711800 20 remove_watcher() i=4 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.257+0000 7f8e92711800 20 remove_watcher() i=5 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.257+0000 7f8e92711800 20 remove_watcher() i=6 2024-03-09T14:40:44.281 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:40:44.258+0000 7f8e92711800 20 remove_watcher() i=7 2024-03-09T14:40:44.282 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.282 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:40:44.282 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-do-reshard id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-03-09T14:40:44.282 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:40:44.282 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:40:44.282 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:14.375 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:14.376 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:14.435 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:41:14.468 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:14.468 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:14.503 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.503+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.504 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.504+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.504+0000 7f4bbed33800 20 realm 2024-03-09T14:41:14.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.504+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.505+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.505+0000 7f4bbed33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:14.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.505+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.505 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.505+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.505+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.506+0000 7f4bbed33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.506 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.506+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.507+0000 7f4bbed33800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:14.507 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.507+0000 7f4bbed33800 20 searching for the correct realm 2024-03-09T14:41:14.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.510+0000 7f4bbb1d4640 0 -- 172.21.15.46:0/1988019499 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x560e0abadc80 msgr2=0x560e0abb0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:14.515 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.515+0000 7f4bba1d2640 0 -- 172.21.15.46:0/1988019499 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x560e0aba8f50 msgr2=0x560e0abab340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:14.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:14.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:14.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:14.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:14.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:14.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:14.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.520+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.522 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 zone default found 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 4 Realm: () 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 zonegroup default 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.521+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.523 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 started sync module instance, tier type = 2024-03-09T14:41:14.524 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.522+0000 7f4bbed33800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:14.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=0 2024-03-09T14:41:14.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=1 2024-03-09T14:41:14.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=2 2024-03-09T14:41:14.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=3 2024-03-09T14:41:14.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=4 2024-03-09T14:41:14.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=5 2024-03-09T14:41:14.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.532+0000 7f4bbed33800 20 add_watcher() i=6 2024-03-09T14:41:14.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.533+0000 7f4bbed33800 20 add_watcher() i=7 2024-03-09T14:41:14.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.533+0000 7f4bbed33800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:14.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4a717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 5 note: GC not initialized 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f49ebfff640 20 reqs_thread_entry: start 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 20 Filter name: none 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f49e9ffb640 20 reqs_thread_entry: start 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:41:14.536 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.535+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.536+0000 7f4bbed33800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:41:14.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.536+0000 7f4bbed33800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:41:14.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.536+0000 7f4bbed33800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:41:14.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.536+0000 7f4bbed33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 : miss 2024-03-09T14:41:14.537 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.536+0000 7f4bbed33800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.537+0000 7f4bbed33800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:41:14.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.537+0000 7f4bbed33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:41:14.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.537+0000 7f4bbed33800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:41:14.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.537+0000 7f4bbed33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:14.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.537+0000 7f4bbed33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.538 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.537+0000 7f4bbed33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 2024-03-09T14:41:14.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4bbed33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:41:14.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4bbed33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:41:14.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4bbed33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4bbed33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28, ofs0, ns] 2024-03-09T14:41:14.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4a9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595101 cookie 94618309565952 notifier 6957 bl.length()=903 2024-03-09T14:41:14.541 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4a9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:41:14.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4a9e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:41:14.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.541+0000 7f4a9e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.542 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.542+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_sources= new_sources= 2024-03-09T14:41:14.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.542+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential sources added=[] removed=[] 2024-03-09T14:41:14.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.542+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_dests= new_dests= 2024-03-09T14:41:14.543 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.542+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential dests added=[] removed=[] 2024-03-09T14:41:14.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.544+0000 7f4bbed33800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28.1.0 2024-03-09T14:41:14.544 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.544+0000 7f4bbed33800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28.1.0 2024-03-09T14:41:14.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.544+0000 7f4bbed33800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28.1.1 2024-03-09T14:41:14.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.544+0000 7f4bbed33800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28.1.1 2024-03-09T14:41:14.545 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.544+0000 7f4bbed33800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28.0 2024-03-09T14:41:14.546 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.546+0000 7f4bbed33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:14.547 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.546+0000 7f4bbed33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 2024-03-09T14:41:14.548 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4bbed33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4bbed33800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4bbed33800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4bbed33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28, ofs0, ns] 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4a9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595102 cookie 94618309565952 notifier 6957 bl.length()=871 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4a9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 info.flags=0x17 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4a9dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 to cache LRU end 2024-03-09T14:41:14.549 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.548+0000 7f4a9dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-03-09T14:41:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.550+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_sources= new_sources= 2024-03-09T14:41:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.550+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential sources added=[] removed=[] 2024-03-09T14:41:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.550+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): orig_dests= new_dests= 2024-03-09T14:41:14.550 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.550+0000 7f4bbed33800 20 handle_bi_update(): bucket=:abort-at-do-reshard[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28]): potential dests added=[] removed=[] 2024-03-09T14:41:14.551 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.551+0000 7f4bbed33800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-03-09T14:41:14.553 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.553+0000 7f4a717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.556+0000 7f4bbed33800 20 remove_watcher() i=0 2024-03-09T14:41:14.556 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.556+0000 7f4bbed33800 2 removed watcher, disabling cache 2024-03-09T14:41:14.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.557+0000 7f4bbed33800 20 remove_watcher() i=1 2024-03-09T14:41:14.558 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.558+0000 7f4bbed33800 20 remove_watcher() i=2 2024-03-09T14:41:14.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.559+0000 7f4bbed33800 20 remove_watcher() i=3 2024-03-09T14:41:14.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.560+0000 7f4bbed33800 20 remove_watcher() i=4 2024-03-09T14:41:14.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.561+0000 7f4bbed33800 20 remove_watcher() i=5 2024-03-09T14:41:14.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.561+0000 7f4bbed33800 20 remove_watcher() i=6 2024-03-09T14:41:14.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.562+0000 7f4bbed33800 20 remove_watcher() i=7 2024-03-09T14:41:14.574 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:41:14.601 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:14.601 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:14.635 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.634+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.636+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.636+0000 7f7c82542800 20 realm 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.636+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.637+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.637+0000 7f7c82542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.637+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.637+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.637+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.638+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.638 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.638+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.639+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:14.639 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.639+0000 7f7c82542800 20 searching for the correct realm 2024-03-09T14:41:14.642 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.642+0000 7f7c7ea42640 0 -- 172.21.15.46:0/17169163 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x55f1990510f0 msgr2=0x55f199053590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:14.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.646+0000 7f7c7e241640 0 -- 172.21.15.46:0/17169163 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f7c70015070 msgr2=0x7f7c7007ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.651+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 zone default found 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 4 Realm: () 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 zonegroup default 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.652+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 started sync module instance, tier type = 2024-03-09T14:41:14.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.653+0000 7f7c82542800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=0 2024-03-09T14:41:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=1 2024-03-09T14:41:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=2 2024-03-09T14:41:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=3 2024-03-09T14:41:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=4 2024-03-09T14:41:14.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=5 2024-03-09T14:41:14.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.662+0000 7f7c82542800 20 add_watcher() i=6 2024-03-09T14:41:14.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.663+0000 7f7c82542800 20 add_watcher() i=7 2024-03-09T14:41:14.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.663+0000 7f7c82542800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:14.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.664+0000 7f7b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7c82542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7c82542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7c82542800 5 note: GC not initialized 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7aaf7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7c82542800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7c82542800 20 Filter name: none 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7aad7fa640 20 reqs_thread_entry: start 2024-03-09T14:41:14.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.665+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.666+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:41:14.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.666+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:41:14.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:14.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=187 2024-03-09T14:41:14.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 rados_obj.operate() r=0 bl.length=401 2024-03-09T14:41:14.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.667+0000 7f7c82542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:14.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.668+0000 7f7c82542800 20 rados->read ofs=0 len=0 2024-03-09T14:41:14.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.668+0000 7f7c82542800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:14.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.669+0000 7f7b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:14.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.671+0000 7f7c82542800 20 remove_watcher() i=0 2024-03-09T14:41:14.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.671+0000 7f7c82542800 2 removed watcher, disabling cache 2024-03-09T14:41:14.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.672+0000 7f7c82542800 20 remove_watcher() i=1 2024-03-09T14:41:14.673 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.673+0000 7f7c82542800 20 remove_watcher() i=2 2024-03-09T14:41:14.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.674+0000 7f7c82542800 20 remove_watcher() i=3 2024-03-09T14:41:14.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.675+0000 7f7c82542800 20 remove_watcher() i=4 2024-03-09T14:41:14.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.676+0000 7f7c82542800 20 remove_watcher() i=5 2024-03-09T14:41:14.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.677+0000 7f7c82542800 20 remove_watcher() i=6 2024-03-09T14:41:14.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:14.678+0000 7f7c82542800 20 remove_watcher() i=7 2024-03-09T14:41:14.688 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:14.688 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:41:14.688 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: abort-at-do-reshard id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-03-09T14:41:14.688 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:14.690 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:14.690 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:14.708 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:14.709 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:14.895 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:14.895 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:14.961 INFO:tasks.workunit.client.0.smithi046.stderr: test: reshard versioned bucket 2024-03-09T14:41:14.963 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:41:14.991 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:14.991 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:15.024 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.024+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.026 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 realm 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.027 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.026+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.027+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:15.028 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.027+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.028+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:15.029 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.028+0000 7f5d94709800 20 searching for the correct realm 2024-03-09T14:41:15.230 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.230+0000 7f5d92205640 0 -- 172.21.15.46:0/1696456090 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f5d7c003970 msgr2=0x7f5d8c0203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:15.637 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.637+0000 7f5d91a04640 0 -- 172.21.15.46:0/1696456090 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f5d840a08c0 msgr2=0x7f5d840d4ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:15.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:15.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:15.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:15.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:15.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:15.645 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:15.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.646 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.645+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 20 zone default found 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 4 Realm: () 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 20 zonegroup default 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.646+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.647 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.647+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.647+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.647+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.647+0000 7f5d94709800 20 started sync module instance, tier type = 2024-03-09T14:41:15.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.647+0000 7f5d94709800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=0 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=1 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=2 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=3 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=4 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=5 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.657+0000 7f5d94709800 20 add_watcher() i=6 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.658+0000 7f5d94709800 20 add_watcher() i=7 2024-03-09T14:41:15.658 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.658+0000 7f5d94709800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:15.661 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.661+0000 7f5c48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:15.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5d94709800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:15.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5d94709800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:15.662 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5d94709800 5 note: GC not initialized 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5bc37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5d94709800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5d94709800 20 Filter name: none 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5bc17fa640 20 reqs_thread_entry: start 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.662+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.663+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:15.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.663+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.664+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:15.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.664+0000 7f5d94709800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:15.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.664+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.664+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:15.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.664+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.665+0000 7f5d94709800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:15.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.665+0000 7f5d94709800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:15.665 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.665+0000 7f5d94709800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.666+0000 7f5d94709800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.666+0000 7f5c48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:15.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.669+0000 7f5d94709800 20 remove_watcher() i=0 2024-03-09T14:41:15.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.669+0000 7f5d94709800 2 removed watcher, disabling cache 2024-03-09T14:41:15.670 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.670+0000 7f5d94709800 20 remove_watcher() i=1 2024-03-09T14:41:15.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.671+0000 7f5d94709800 20 remove_watcher() i=2 2024-03-09T14:41:15.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.672+0000 7f5d94709800 20 remove_watcher() i=3 2024-03-09T14:41:15.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.674+0000 7f5d94709800 20 remove_watcher() i=4 2024-03-09T14:41:15.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.675+0000 7f5d94709800 20 remove_watcher() i=5 2024-03-09T14:41:15.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.676+0000 7f5d94709800 20 remove_watcher() i=6 2024-03-09T14:41:15.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.677+0000 7f5d94709800 20 remove_watcher() i=7 2024-03-09T14:41:15.688 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:15.688 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:41:15.688 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: myver id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-03-09T14:41:15.688 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:15.689 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-03-09T14:41:15.722 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:15.722 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:15.758 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.758+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.759+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.759+0000 7f7c0da2d800 20 realm 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.759+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.759+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.759+0000 7f7c0da2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.759+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.760+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.760 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.760+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.761+0000 7f7c0da2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:15.761 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.761+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.762+0000 7f7c0da2d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:15.762 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.762+0000 7f7c0da2d800 20 searching for the correct realm 2024-03-09T14:41:15.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.766+0000 7f7c0943d640 0 -- 172.21.15.46:0/2282604717 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f7bfc009040 msgr2=0x7f7bfc044970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:15.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.973+0000 7f7c08c3c640 0 -- 172.21.15.46:0/2282604717 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x56374e5a85d0 msgr2=0x56374e5aa9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:15.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:15.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:15.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:15.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:15.976 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:15.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:15.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.977 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.976+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 zone default found 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 4 Realm: () 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:15.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 zonegroup default 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.977+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.978+0000 7f7c0da2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.978+0000 7f7c0da2d800 20 started sync module instance, tier type = 2024-03-09T14:41:15.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.978+0000 7f7c0da2d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:15.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=0 2024-03-09T14:41:15.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=1 2024-03-09T14:41:15.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=2 2024-03-09T14:41:15.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=3 2024-03-09T14:41:15.987 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=4 2024-03-09T14:41:15.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=5 2024-03-09T14:41:15.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.987+0000 7f7c0da2d800 20 add_watcher() i=6 2024-03-09T14:41:15.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.988+0000 7f7c0da2d800 20 add_watcher() i=7 2024-03-09T14:41:15.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.988+0000 7f7c0da2d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:15.990 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7abefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7c0da2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7c0da2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7c0da2d800 5 note: GC not initialized 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7abdfe3640 20 reqs_thread_entry: start 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7c0da2d800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.990+0000 7f7c0da2d800 20 Filter name: none 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7a2f7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:41:15.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : miss 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.991+0000 7f7c0da2d800 20 rados->read ofs=0 len=0 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.992+0000 7f7c0da2d800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:15.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.992+0000 7f7c0da2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:15.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.992+0000 7f7c0da2d800 10 adding default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:15.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.992+0000 7f7c0da2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:15.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.992+0000 7f7c0da2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:15.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.992+0000 7f7c0da2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:15.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7c0da2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:15.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7c0da2d800 10 moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:15.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7c0da2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:15.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7c0da2d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18, ofs0, ns] 2024-03-09T14:41:15.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7adffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595113 cookie 94795537752016 notifier 7008 bl.length()=813 2024-03-09T14:41:15.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7adffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:15.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7adffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:15.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.996+0000 7f7adffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:15.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.998+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_sources= new_sources= 2024-03-09T14:41:15.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.998+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential sources added=[] removed=[] 2024-03-09T14:41:15.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.998+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_dests= new_dests= 2024-03-09T14:41:15.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.998+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential dests added=[] removed=[] 2024-03-09T14:41:16.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.999+0000 7f7c0da2d800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.0 2024-03-09T14:41:16.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.999+0000 7f7c0da2d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.0 2024-03-09T14:41:16.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.999+0000 7f7c0da2d800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.1 2024-03-09T14:41:16.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.999+0000 7f7c0da2d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.1 2024-03-09T14:41:16.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:15.999+0000 7f7c0da2d800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.0 2024-03-09T14:41:16.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.000+0000 7f7c0da2d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:16.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.000+0000 7f7c0da2d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:16.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.001+0000 7f7c0da2d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:16.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.001+0000 7f7c0da2d800 10 moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:16.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.001+0000 7f7c0da2d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:16.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.001+0000 7f7c0da2d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18, ofs0, ns] 2024-03-09T14:41:16.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.002+0000 7f7adf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595114 cookie 94795537752016 notifier 7008 bl.length()=781 2024-03-09T14:41:16.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.002+0000 7f7adf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:16.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.002+0000 7f7adf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:16.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.002+0000 7f7adf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:16.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.003+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_sources= new_sources= 2024-03-09T14:41:16.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.003+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential sources added=[] removed=[] 2024-03-09T14:41:16.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.003+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_dests= new_dests= 2024-03-09T14:41:16.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.003+0000 7f7c0da2d800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential dests added=[] removed=[] 2024-03-09T14:41:16.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.004+0000 7f7c0da2d800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:41:16.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.006+0000 7f7abefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.009+0000 7f7c0da2d800 20 remove_watcher() i=0 2024-03-09T14:41:16.009 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.009+0000 7f7c0da2d800 2 removed watcher, disabling cache 2024-03-09T14:41:16.010 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.010+0000 7f7c0da2d800 20 remove_watcher() i=1 2024-03-09T14:41:16.011 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.011+0000 7f7c0da2d800 20 remove_watcher() i=2 2024-03-09T14:41:16.012 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.012+0000 7f7c0da2d800 20 remove_watcher() i=3 2024-03-09T14:41:16.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.013+0000 7f7c0da2d800 20 remove_watcher() i=4 2024-03-09T14:41:16.014 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.014+0000 7f7c0da2d800 20 remove_watcher() i=5 2024-03-09T14:41:16.015 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.015+0000 7f7c0da2d800 20 remove_watcher() i=6 2024-03-09T14:41:16.016 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.016+0000 7f7c0da2d800 20 remove_watcher() i=7 2024-03-09T14:41:16.028 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:41:16.055 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:16.056 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:16.090 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.089+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.291+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.291+0000 7fc516038800 20 realm 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.291+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.291+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.291+0000 7fc516038800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.291+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.292+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.292+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.293+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.293+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.294+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:16.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.294+0000 7fc516038800 20 searching for the correct realm 2024-03-09T14:41:16.295 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.295+0000 7fc5112e4640 0 -- 172.21.15.46:0/2692556386 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x55cac5d48690 msgr2=0x7fc50c0a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.501 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.500+0000 7fc510ae3640 0 -- 172.21.15.46:0/2692556386 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fc504067bb0 msgr2=0x7fc50405e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:16.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:16.509 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.507+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 zone default found 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 4 Realm: () 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:16.510 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 zonegroup default 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.508+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.509+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.509+0000 7fc516038800 20 started sync module instance, tier type = 2024-03-09T14:41:16.511 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.509+0000 7fc516038800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:16.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=0 2024-03-09T14:41:16.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=1 2024-03-09T14:41:16.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=2 2024-03-09T14:41:16.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=3 2024-03-09T14:41:16.519 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=4 2024-03-09T14:41:16.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=5 2024-03-09T14:41:16.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.518+0000 7fc516038800 20 add_watcher() i=6 2024-03-09T14:41:16.520 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.519+0000 7fc516038800 20 add_watcher() i=7 2024-03-09T14:41:16.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.519+0000 7fc516038800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:16.521 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.521+0000 7fc3c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.521+0000 7fc516038800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:16.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.521+0000 7fc516038800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:16.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.521+0000 7fc516038800 5 note: GC not initialized 2024-03-09T14:41:16.525 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc3c67e4640 20 reqs_thread_entry: start 2024-03-09T14:41:16.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc516038800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:16.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc516038800 20 Filter name: none 2024-03-09T14:41:16.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc337fff640 20 reqs_thread_entry: start 2024-03-09T14:41:16.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:16.526 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.522+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.523+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:16.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.523+0000 7fc516038800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.523+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.523+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:16.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.523+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.527 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.524+0000 7fc516038800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:16.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.524+0000 7fc516038800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.525+0000 7fc516038800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.528 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.525+0000 7fc516038800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.526+0000 7fc3c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.528+0000 7fc516038800 20 remove_watcher() i=0 2024-03-09T14:41:16.529 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.528+0000 7fc516038800 2 removed watcher, disabling cache 2024-03-09T14:41:16.530 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.529+0000 7fc516038800 20 remove_watcher() i=1 2024-03-09T14:41:16.531 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.531+0000 7fc516038800 20 remove_watcher() i=2 2024-03-09T14:41:16.532 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.532+0000 7fc516038800 20 remove_watcher() i=3 2024-03-09T14:41:16.533 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.533+0000 7fc516038800 20 remove_watcher() i=4 2024-03-09T14:41:16.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.533+0000 7fc516038800 20 remove_watcher() i=5 2024-03-09T14:41:16.534 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.534+0000 7fc516038800 20 remove_watcher() i=6 2024-03-09T14:41:16.535 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.535+0000 7fc516038800 20 remove_watcher() i=7 2024-03-09T14:41:16.545 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:16.545 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:41:16.545 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: myver id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-03-09T14:41:16.545 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:16.548 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:16.548 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:16.568 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:16.568 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:16.624 INFO:tasks.workunit.client.0.smithi046.stderr: test: reshard removes olh entries with empty name 2024-03-09T14:41:16.627 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:16.627 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:16.697 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:16.697 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:16.787 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:41:16.814 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:16.814 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:16.848 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.847+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.849 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 realm 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.849+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.850+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.850 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.850+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.851+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:16.851 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.851+0000 7fb5aca83800 20 searching for the correct realm 2024-03-09T14:41:16.854 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.854+0000 7fb5aad80640 0 -- 172.21.15.46:0/3765817072 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x55f8c50684e0 msgr2=0x55f8c506a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.858 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.858+0000 7fb5a9d7e640 0 -- 172.21.15.46:0/3765817072 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55f8c506fef0 msgr2=0x55f8c50722e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:16.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:16.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:16.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:16.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:16.863 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:16.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:16.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.864 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.863+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 zone default found 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 4 Realm: () 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 zonegroup default 2024-03-09T14:41:16.865 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.864+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.865+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.865+0000 7fb5aca83800 20 started sync module instance, tier type = 2024-03-09T14:41:16.866 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.865+0000 7fb5aca83800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=0 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=1 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=2 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=3 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=4 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=5 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.873+0000 7fb5aca83800 20 add_watcher() i=6 2024-03-09T14:41:16.874 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.874+0000 7fb5aca83800 20 add_watcher() i=7 2024-03-09T14:41:16.875 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.874+0000 7fb5aca83800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:16.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.876+0000 7fb460fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.876+0000 7fb5aca83800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.876+0000 7fb5aca83800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.876+0000 7fb5aca83800 5 note: GC not initialized 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.877+0000 7fb3db7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.877+0000 7fb5aca83800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.877+0000 7fb5aca83800 20 Filter name: none 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.877+0000 7fb3d97fa640 20 reqs_thread_entry: start 2024-03-09T14:41:16.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.877+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:41:16.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.878+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.879+0000 7fb5aca83800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.879+0000 7fb5aca83800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.879+0000 7fb5aca83800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.879+0000 7fb5aca83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.880 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.880+0000 7fb460fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.882+0000 7fb5aca83800 20 remove_watcher() i=0 2024-03-09T14:41:16.882 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.882+0000 7fb5aca83800 2 removed watcher, disabling cache 2024-03-09T14:41:16.883 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.883+0000 7fb5aca83800 20 remove_watcher() i=1 2024-03-09T14:41:16.884 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.884+0000 7fb5aca83800 20 remove_watcher() i=2 2024-03-09T14:41:16.885 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.885+0000 7fb5aca83800 20 remove_watcher() i=3 2024-03-09T14:41:16.886 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.886+0000 7fb5aca83800 20 remove_watcher() i=4 2024-03-09T14:41:16.887 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.887+0000 7fb5aca83800 20 remove_watcher() i=5 2024-03-09T14:41:16.888 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.888+0000 7fb5aca83800 20 remove_watcher() i=6 2024-03-09T14:41:16.889 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.889+0000 7fb5aca83800 20 remove_watcher() i=7 2024-03-09T14:41:16.899 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:16.899 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:41:16.899 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: a-bucket id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-03-09T14:41:16.899 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:16.900 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-03-09T14:41:16.928 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:16.928 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:16.962 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.962+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.964 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 realm 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.964+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.965+0000 7f921c8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.965 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.965+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.966+0000 7f921c8c0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:16.966 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.966+0000 7f921c8c0800 20 searching for the correct realm 2024-03-09T14:41:16.969 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.969+0000 7f921abc4640 0 -- 172.21.15.46:0/2258877334 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x557c5e7bf520 msgr2=0x557c5e7c19e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.973 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.973+0000 7f921a3c3640 0 -- 172.21.15.46:0/2258877334 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9210091070 msgr2=0x7f9210092030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:16.978 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.979 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.978+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 zone default found 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 4 Realm: () 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 zonegroup default 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.980 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:16.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 started sync module instance, tier type = 2024-03-09T14:41:16.981 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.979+0000 7f921c8c0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:16.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=0 2024-03-09T14:41:16.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=1 2024-03-09T14:41:16.988 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=2 2024-03-09T14:41:16.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=3 2024-03-09T14:41:16.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=4 2024-03-09T14:41:16.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=5 2024-03-09T14:41:16.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.988+0000 7f921c8c0800 20 add_watcher() i=6 2024-03-09T14:41:16.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.989+0000 7f921c8c0800 20 add_watcher() i=7 2024-03-09T14:41:16.989 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.989+0000 7f921c8c0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:16.991 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f90d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f921c8c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f921c8c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f921c8c0800 5 note: GC not initialized 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f904b7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f921c8c0800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f921c8c0800 20 Filter name: none 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f90497fa640 20 reqs_thread_entry: start 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.991+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.992+0000 7f921c8c0800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:41:16.992 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.992+0000 7f921c8c0800 20 rados->read ofs=0 len=0 2024-03-09T14:41:16.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.992+0000 7f921c8c0800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:41:16.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.992+0000 7f921c8c0800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:16.993 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.993+0000 7f90d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:16.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.995+0000 7f921c8c0800 20 remove_watcher() i=0 2024-03-09T14:41:16.995 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.995+0000 7f921c8c0800 2 removed watcher, disabling cache 2024-03-09T14:41:16.996 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.996+0000 7f921c8c0800 20 remove_watcher() i=1 2024-03-09T14:41:16.997 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.997+0000 7f921c8c0800 20 remove_watcher() i=2 2024-03-09T14:41:16.998 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.998+0000 7f921c8c0800 20 remove_watcher() i=3 2024-03-09T14:41:16.999 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:16.999+0000 7f921c8c0800 20 remove_watcher() i=4 2024-03-09T14:41:17.000 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.000+0000 7f921c8c0800 20 remove_watcher() i=5 2024-03-09T14:41:17.001 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.001+0000 7f921c8c0800 20 remove_watcher() i=6 2024-03-09T14:41:17.002 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.002+0000 7f921c8c0800 20 remove_watcher() i=7 2024-03-09T14:41:17.013 INFO:tasks.workunit.client.0.smithi046.stderr:rados -p default.rgw.buckets.index setomapval .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.038 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.054 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.082 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.114 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.114+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 realm 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.116+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.117+0000 7f7373539800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.117+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.118+0000 7f7373539800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.119 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.118+0000 7f7373539800 20 searching for the correct realm 2024-03-09T14:41:17.121 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.120+0000 7f736eacc640 0 -- 172.21.15.46:0/2938782915 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55b6c1739920 msgr2=0x55b6c173bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.124 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.124+0000 7f736f2cd640 0 -- 172.21.15.46:0/2938782915 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f736405ea10 msgr2=0x7f7364059ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.332 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:17.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:17.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 zone default found 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 4 Realm: () 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 zonegroup default 2024-03-09T14:41:17.335 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.331+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.336 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 started sync module instance, tier type = 2024-03-09T14:41:17.337 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.332+0000 7f7373539800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:17.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=0 2024-03-09T14:41:17.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=1 2024-03-09T14:41:17.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=2 2024-03-09T14:41:17.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=3 2024-03-09T14:41:17.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=4 2024-03-09T14:41:17.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=5 2024-03-09T14:41:17.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.342+0000 7f7373539800 20 add_watcher() i=6 2024-03-09T14:41:17.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.343+0000 7f7373539800 20 add_watcher() i=7 2024-03-09T14:41:17.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.343+0000 7f7373539800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7373539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7373539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7373539800 5 note: GC not initialized 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7224fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7373539800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.345+0000 7f7373539800 20 Filter name: none 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.346+0000 7f719e7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:17.346 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.346+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.346+0000 7f7373539800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.346+0000 7f7373539800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.346+0000 7f7373539800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 INFO: main: starting shard=0 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 2024-03-09T14:41:17.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 2024-03-09T14:41:17.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:41:17.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 INFO: main: starting shard=1 2024-03-09T14:41:17.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.1 2024-03-09T14:41:17.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.347+0000 7f7373539800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.1 2024-03-09T14:41:17.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.348+0000 7f7373539800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:17.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.348+0000 7f7373539800 20 INFO: main: starting shard=2 2024-03-09T14:41:17.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.348+0000 7f7373539800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.2 2024-03-09T14:41:17.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.348+0000 7f7373539800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.2 2024-03-09T14:41:17.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.348+0000 7f7373539800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:17.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.348+0000 7f7373539800 20 INFO: main: done 2024-03-09T14:41:17.349 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.349+0000 7f7225fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.352+0000 7f7373539800 20 remove_watcher() i=0 2024-03-09T14:41:17.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.352+0000 7f7373539800 2 removed watcher, disabling cache 2024-03-09T14:41:17.353 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.353+0000 7f7373539800 20 remove_watcher() i=1 2024-03-09T14:41:17.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.354+0000 7f7373539800 20 remove_watcher() i=2 2024-03-09T14:41:17.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.355+0000 7f7373539800 20 remove_watcher() i=3 2024-03-09T14:41:17.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.356+0000 7f7373539800 20 remove_watcher() i=4 2024-03-09T14:41:17.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.357+0000 7f7373539800 20 remove_watcher() i=5 2024-03-09T14:41:17.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.358+0000 7f7373539800 20 remove_watcher() i=6 2024-03-09T14:41:17.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.359+0000 7f7373539800 20 remove_watcher() i=7 2024-03-09T14:41:17.371 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-03-09T14:41:17.401 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.401 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.434+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.435+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.435+0000 7f82b8f22800 20 realm 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.435+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.435+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.435+0000 7f82b8f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.436+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.436+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.436+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.437+0000 7f82b8f22800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.437 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.437+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.438+0000 7f82b8f22800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.438+0000 7f82b8f22800 20 searching for the correct realm 2024-03-09T14:41:17.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.442+0000 7f82b54b5640 0 -- 172.21.15.46:0/1084225592 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f82a80ad060 msgr2=0x7f82a8069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:17.648 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.648+0000 7f82b54b5640 0 -- 172.21.15.46:0/1084225592 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f82a80ad060 msgr2=0x7f82a8069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.652 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.653 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.652+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 zone default found 2024-03-09T14:41:17.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 4 Realm: () 2024-03-09T14:41:17.654 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 zonegroup default 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.653+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.654+0000 7f82b8f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.654+0000 7f82b8f22800 20 started sync module instance, tier type = 2024-03-09T14:41:17.655 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.654+0000 7f82b8f22800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:17.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=0 2024-03-09T14:41:17.663 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=1 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=2 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=3 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=4 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=5 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.663+0000 7f82b8f22800 20 add_watcher() i=6 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.664+0000 7f82b8f22800 20 add_watcher() i=7 2024-03-09T14:41:17.664 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.664+0000 7f82b8f22800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.666 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f816afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f82b8f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f82b8f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f82b8f22800 5 note: GC not initialized 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f8169fe3640 20 reqs_thread_entry: start 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f82b8f22800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.666+0000 7f82b8f22800 20 Filter name: none 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f80db7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:41:17.667 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:41:17.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:41:17.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:41:17.668 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : miss 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:17.669 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.667+0000 7f82b8f22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:41:17.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.671+0000 7f82b8f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:41:17.671 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.671+0000 7f82b8f22800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:41:17.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.671+0000 7f82b8f22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:17.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.671+0000 7f82b8f22800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17, ofs0, ns] 2024-03-09T14:41:17.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.672+0000 7f818b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595120 cookie 94396843342112 notifier 6755 bl.length()=819 2024-03-09T14:41:17.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.672+0000 7f818b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:41:17.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.672+0000 7f818b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:41:17.672 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.672+0000 7f818b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:17.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.673+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_sources= new_sources= 2024-03-09T14:41:17.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.673+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential sources added=[] removed=[] 2024-03-09T14:41:17.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.673+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_dests= new_dests= 2024-03-09T14:41:17.674 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.673+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential dests added=[] removed=[] 2024-03-09T14:41:17.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.675+0000 7f82b8f22800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.3.0 2024-03-09T14:41:17.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.675+0000 7f82b8f22800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.3.0 2024-03-09T14:41:17.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.675+0000 7f82b8f22800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 2024-03-09T14:41:17.675 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.675+0000 7f82b8f22800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.0 2024-03-09T14:41:17.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.676+0000 7f82b8f22800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-03-09T14:41:17.676 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.676+0000 7f82b8f22800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.1 2024-03-09T14:41:17.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.676+0000 7f82b8f22800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.1 2024-03-09T14:41:17.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.676+0000 7f82b8f22800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.2 2024-03-09T14:41:17.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.676+0000 7f82b8f22800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.2.2 2024-03-09T14:41:17.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.677+0000 7f82b8f22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:17.677 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.677+0000 7f82b8f22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 2024-03-09T14:41:17.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f82b8f22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:41:17.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f82b8f22800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:41:17.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f82b8f22800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:17.678 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f82b8f22800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17, ofs0, ns] 2024-03-09T14:41:17.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f818bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595121 cookie 94396843342112 notifier 6755 bl.length()=787 2024-03-09T14:41:17.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f818bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 info.flags=0x17 2024-03-09T14:41:17.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f818bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17 to cache LRU end 2024-03-09T14:41:17.679 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.678+0000 7f818bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:17.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.680+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_sources= new_sources= 2024-03-09T14:41:17.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.680+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential sources added=[] removed=[] 2024-03-09T14:41:17.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.680+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): orig_dests= new_dests= 2024-03-09T14:41:17.680 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.680+0000 7f82b8f22800 20 handle_bi_update(): bucket=:a-bucket[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17]): potential dests added=[] removed=[] 2024-03-09T14:41:17.681 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.681+0000 7f82b8f22800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:41:17.683 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.683+0000 7f816afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.685+0000 7f82b8f22800 20 remove_watcher() i=0 2024-03-09T14:41:17.685 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.685+0000 7f82b8f22800 2 removed watcher, disabling cache 2024-03-09T14:41:17.686 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.686+0000 7f82b8f22800 20 remove_watcher() i=1 2024-03-09T14:41:17.687 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.687+0000 7f82b8f22800 20 remove_watcher() i=2 2024-03-09T14:41:17.688 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.688+0000 7f82b8f22800 20 remove_watcher() i=3 2024-03-09T14:41:17.689 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.689+0000 7f82b8f22800 20 remove_watcher() i=4 2024-03-09T14:41:17.690 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.690+0000 7f82b8f22800 20 remove_watcher() i=5 2024-03-09T14:41:17.691 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.691+0000 7f82b8f22800 20 remove_watcher() i=6 2024-03-09T14:41:17.692 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.692+0000 7f82b8f22800 20 remove_watcher() i=7 2024-03-09T14:41:17.704 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-09T14:41:17.731 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.731 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.764+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.766 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.765+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.765+0000 7f364e412800 20 realm 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.765+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.765+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.765+0000 7f364e412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.765+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.766+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.766+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.767 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.767+0000 7f364e412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.767+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.767+0000 7f364e412800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.768 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.767+0000 7f364e412800 20 searching for the correct realm 2024-03-09T14:41:17.771 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.771+0000 7f3649280640 0 -- 172.21.15.46:0/271228950 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5620a04cc290 msgr2=0x5620a04ce680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.775 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.775+0000 7f364a282640 0 -- 172.21.15.46:0/271228950 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f3640040070 msgr2=0x7f364004a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:17.778 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.779 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.778+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.780 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 zone default found 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 4 Realm: () 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 zonegroup default 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.779+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.780+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.780+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.780+0000 7f364e412800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.780+0000 7f364e412800 20 started sync module instance, tier type = 2024-03-09T14:41:17.782 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.780+0000 7f364e412800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:17.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=0 2024-03-09T14:41:17.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=1 2024-03-09T14:41:17.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=2 2024-03-09T14:41:17.789 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=3 2024-03-09T14:41:17.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=4 2024-03-09T14:41:17.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=5 2024-03-09T14:41:17.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.789+0000 7f364e412800 20 add_watcher() i=6 2024-03-09T14:41:17.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.790+0000 7f364e412800 20 add_watcher() i=7 2024-03-09T14:41:17.790 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.790+0000 7f364e412800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:17.791 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.791+0000 7f34fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f364e412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:17.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f364e412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:17.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f364e412800 5 note: GC not initialized 2024-03-09T14:41:17.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f34fa7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:17.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f364e412800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:17.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f364e412800 20 Filter name: none 2024-03-09T14:41:17.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f346bfff640 20 reqs_thread_entry: start 2024-03-09T14:41:17.793 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.792+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 rados_obj.operate() r=0 bl.length=176 2024-03-09T14:41:17.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 rados_obj.operate() r=0 bl.length=390 2024-03-09T14:41:17.794 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 INFO: main: starting shard=0 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.3.0 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.793+0000 7f364e412800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17.3.0 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.794+0000 7f364e412800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.794+0000 7f364e412800 20 INFO: main: done 2024-03-09T14:41:17.795 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.795+0000 7f34fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:17.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.797+0000 7f364e412800 20 remove_watcher() i=0 2024-03-09T14:41:17.797 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.797+0000 7f364e412800 2 removed watcher, disabling cache 2024-03-09T14:41:17.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.798+0000 7f364e412800 20 remove_watcher() i=1 2024-03-09T14:41:17.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.799+0000 7f364e412800 20 remove_watcher() i=2 2024-03-09T14:41:17.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.800+0000 7f364e412800 20 remove_watcher() i=3 2024-03-09T14:41:17.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.801+0000 7f364e412800 20 remove_watcher() i=4 2024-03-09T14:41:17.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.801+0000 7f364e412800 20 remove_watcher() i=5 2024-03-09T14:41:17.802 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.802+0000 7f364e412800 20 remove_watcher() i=6 2024-03-09T14:41:17.803 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.803+0000 7f364e412800 20 remove_watcher() i=7 2024-03-09T14:41:17.813 INFO:tasks.workunit.client.0.smithi046.stderr: test: PUT succeeds during reshard 2024-03-09T14:41:17.815 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:41:17.842 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:17.842 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:17.876 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.875+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.876+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.876+0000 7f6fc8b2e800 20 realm 2024-03-09T14:41:17.877 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.876+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.877+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.877+0000 7f6fc8b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:17.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.877+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.877+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:17.878 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.877+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.878+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:17.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.878+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:17.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.879+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:17.879 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:17.879+0000 7f6fc8b2e800 20 searching for the correct realm 2024-03-09T14:41:18.083 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.083+0000 7f6fc50f0640 0 -- 172.21.15.46:0/4209796911 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x563cec288080 msgr2=0x563cec28a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:18.087 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.087+0000 7f6fc48ef640 0 -- 172.21.15.46:0/4209796911 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f6fb000f940 msgr2=0x7f6fb0043410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:18.092 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:18.093 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.092+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:18.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 zone default found 2024-03-09T14:41:18.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 4 Realm: () 2024-03-09T14:41:18.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:18.095 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 zonegroup default 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.093+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.094+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.094+0000 7f6fc8b2e800 20 started sync module instance, tier type = 2024-03-09T14:41:18.096 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.094+0000 7f6fc8b2e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=0 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=1 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=2 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=3 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=4 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=5 2024-03-09T14:41:18.103 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=6 2024-03-09T14:41:18.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 20 add_watcher() i=7 2024-03-09T14:41:18.104 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.103+0000 7f6fc8b2e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:18.105 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.105+0000 7f6e7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:18.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.105+0000 7f6fc8b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:18.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.105+0000 7f6fc8b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:18.106 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.105+0000 7f6fc8b2e800 5 note: GC not initialized 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6e79fe3640 20 reqs_thread_entry: start 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6fc8b2e800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6fc8b2e800 20 Filter name: none 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6deb7fe640 20 reqs_thread_entry: start 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:18.107 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.106+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.107+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:18.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.107+0000 7f6fc8b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:18.108 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.107+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.107+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:18.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.107+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.108+0000 7f6fc8b2e800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:18.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.108+0000 7f6fc8b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:18.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.108+0000 7f6fc8b2e800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.109 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.108+0000 7f6fc8b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.110 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.109+0000 7f6e7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:18.111 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.111+0000 7f6fc8b2e800 20 remove_watcher() i=0 2024-03-09T14:41:18.112 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.111+0000 7f6fc8b2e800 2 removed watcher, disabling cache 2024-03-09T14:41:18.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.112+0000 7f6fc8b2e800 20 remove_watcher() i=1 2024-03-09T14:41:18.113 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.113+0000 7f6fc8b2e800 20 remove_watcher() i=2 2024-03-09T14:41:18.115 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.114+0000 7f6fc8b2e800 20 remove_watcher() i=3 2024-03-09T14:41:18.116 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.116+0000 7f6fc8b2e800 20 remove_watcher() i=4 2024-03-09T14:41:18.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.116+0000 7f6fc8b2e800 20 remove_watcher() i=5 2024-03-09T14:41:18.117 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.117+0000 7f6fc8b2e800 20 remove_watcher() i=6 2024-03-09T14:41:18.118 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.118+0000 7f6fc8b2e800 20 remove_watcher() i=7 2024-03-09T14:41:18.128 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:18.129 INFO:tasks.workunit.client.0.smithi046.stderr:BUCKET_STATS: 2024-03-09T14:41:18.129 INFO:tasks.workunit.client.0.smithi046.stderr:bucket: myver id: 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-03-09T14:41:18.129 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:18.130 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-03-09T14:41:18.161 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:18.161 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:18.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.195+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 realm 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.196+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.197+0000 7fc2cc60f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:18.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.197+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.198+0000 7fc2cc60f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:18.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.198+0000 7fc2cc60f800 20 searching for the correct realm 2024-03-09T14:41:18.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.202+0000 7fc2c8482640 0 -- 172.21.15.46:0/1395658748 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7fc2bc085420 msgr2=0x7fc2bc0858a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:18.408 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.408+0000 7fc2c7c81640 0 -- 172.21.15.46:0/1395658748 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x5642286fb450 msgr2=0x5642286fd8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:18.411 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.412 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.411+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:18.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.413 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 zone default found 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 4 Realm: () 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 zonegroup default 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.412+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.413+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.413+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.413+0000 7fc2cc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:18.414 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.413+0000 7fc2cc60f800 20 started sync module instance, tier type = 2024-03-09T14:41:18.415 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.413+0000 7fc2cc60f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:18.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=0 2024-03-09T14:41:18.422 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=1 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=2 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=3 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=4 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=5 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.422+0000 7fc2cc60f800 20 add_watcher() i=6 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.423+0000 7fc2cc60f800 20 add_watcher() i=7 2024-03-09T14:41:18.423 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.423+0000 7fc2cc60f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc17dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc2cc60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc2cc60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc2cc60f800 5 note: GC not initialized 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc17cfe1640 20 reqs_thread_entry: start 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc2cc60f800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.425+0000 7fc2cc60f800 20 Filter name: none 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc0f67fc640 20 reqs_thread_entry: start 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:41:18.426 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:18.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:41:18.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:41:18.427 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : miss 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 adding default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:18.428 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.426+0000 7fc2cc60f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:18.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc2cc60f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:18.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc2cc60f800 10 moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:18.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc2cc60f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:18.431 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc2cc60f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18, ofs0, ns] 2024-03-09T14:41:18.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595115 cookie 94842146290304 notifier 6806 bl.length()=813 2024-03-09T14:41:18.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:18.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc1a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:18.432 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.431+0000 7fc1a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:18.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.433+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_sources= new_sources= 2024-03-09T14:41:18.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.433+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential sources added=[] removed=[] 2024-03-09T14:41:18.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.433+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_dests= new_dests= 2024-03-09T14:41:18.433 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.433+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential dests added=[] removed=[] 2024-03-09T14:41:18.434 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:18.434+0000 7fc2cc60f800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-03-09T14:41:19.134 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:19.134 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:23.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:23.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:23.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:23.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:23.435 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.0 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.434+0000 7fc2cc60f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.0 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.435+0000 7fc2cc60f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.1 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.435+0000 7fc2cc60f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.1.1 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.436+0000 7fc2cc60f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:23.436 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.436+0000 7fc2cc60f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:23.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.438+0000 7fc2cc60f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:23.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.438+0000 7fc2cc60f800 10 moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:23.438 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.438+0000 7fc2cc60f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:23.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.438+0000 7fc2cc60f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18, ofs0, ns] 2024-03-09T14:41:23.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.439+0000 7fc1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595116 cookie 94842146290304 notifier 6806 bl.length()=781 2024-03-09T14:41:23.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.439+0000 7fc1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:23.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.439+0000 7fc1a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:23.439 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.439+0000 7fc1a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:23.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.440+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_sources= new_sources= 2024-03-09T14:41:23.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.440+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential sources added=[] removed=[] 2024-03-09T14:41:23.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.440+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_dests= new_dests= 2024-03-09T14:41:23.441 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.440+0000 7fc2cc60f800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential dests added=[] removed=[] 2024-03-09T14:41:23.442 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.442+0000 7fc2cc60f800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:41:23.444 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.444+0000 7fc17dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:23.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.447+0000 7fc2cc60f800 20 remove_watcher() i=0 2024-03-09T14:41:23.447 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.447+0000 7fc2cc60f800 2 removed watcher, disabling cache 2024-03-09T14:41:23.448 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.448+0000 7fc2cc60f800 20 remove_watcher() i=1 2024-03-09T14:41:23.450 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.450+0000 7fc2cc60f800 20 remove_watcher() i=2 2024-03-09T14:41:23.451 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.451+0000 7fc2cc60f800 20 remove_watcher() i=3 2024-03-09T14:41:23.452 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.452+0000 7fc2cc60f800 20 remove_watcher() i=4 2024-03-09T14:41:23.453 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.453+0000 7fc2cc60f800 20 remove_watcher() i=5 2024-03-09T14:41:23.455 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.454+0000 7fc2cc60f800 20 remove_watcher() i=6 2024-03-09T14:41:23.456 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:23.456+0000 7fc2cc60f800 20 remove_watcher() i=7 2024-03-09T14:41:24.218 INFO:tasks.workunit.client.0.smithi046.stderr:put object successful 2024-03-09T14:41:24.218 INFO:tasks.workunit.client.0.smithi046.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-03-09T14:41:24.219 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-03-09T14:41:24.221 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.221 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.288 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.288 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.348 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.348 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.398 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.398 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.425 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.425 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.473 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.473 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.498 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.498 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.546 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:24.546 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:24.572 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:41:24.983 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:41:26.400 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:26.400 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:26.485 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:41:26.486 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket myver --object x 2024-03-09T14:41:26.520 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:26.520 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:26.557 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.557+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.559 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 realm 2024-03-09T14:41:26.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:26.560 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.559+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.560+0000 7f7fbf92f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:26.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.560+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.561 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.561+0000 7f7fbf92f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:26.562 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.561+0000 7f7fbf92f800 20 searching for the correct realm 2024-03-09T14:41:26.565 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.565+0000 7f7fbae63640 0 -- 172.21.15.46:0/3717519567 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5636f1eb6260 msgr2=0x5636f1eb8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:26.569 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.569+0000 7f7fbbe65640 0 -- 172.21.15.46:0/3717519567 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f7fb0086060 msgr2=0x7f7fb00a7d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.573+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:26.574 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.575 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 zone default found 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 4 Realm: () 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 zonegroup default 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.574+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.575+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.576 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.575+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.575+0000 7f7fbf92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.575+0000 7f7fbf92f800 20 started sync module instance, tier type = 2024-03-09T14:41:26.577 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.575+0000 7f7fbf92f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:26.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=0 2024-03-09T14:41:26.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=1 2024-03-09T14:41:26.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=2 2024-03-09T14:41:26.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=3 2024-03-09T14:41:26.584 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=4 2024-03-09T14:41:26.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=5 2024-03-09T14:41:26.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.584+0000 7f7fbf92f800 20 add_watcher() i=6 2024-03-09T14:41:26.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.585+0000 7f7fbf92f800 20 add_watcher() i=7 2024-03-09T14:41:26.585 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.585+0000 7f7fbf92f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:26.586 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.586+0000 7f7e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:26.587 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7fbf92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7fbf92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7fbf92f800 5 note: GC not initialized 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7e70fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7fbf92f800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7fbf92f800 20 Filter name: none 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7dea7fc640 20 reqs_thread_entry: start 2024-03-09T14:41:26.588 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.587+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 INFO: main: starting shard=0 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:26.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.588+0000 7f7fbf92f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:26.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.589+0000 7f7fbf92f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:41:26.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.589+0000 7f7fbf92f800 20 INFO: main: starting shard=1 2024-03-09T14:41:26.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.589+0000 7f7fbf92f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:26.590 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.589+0000 7f7fbf92f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:26.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.590+0000 7f7fbf92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:26.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.590+0000 7f7fbf92f800 20 INFO: main: starting shard=2 2024-03-09T14:41:26.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.590+0000 7f7fbf92f800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:26.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.590+0000 7f7fbf92f800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:26.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.590+0000 7f7fbf92f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:26.591 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.590+0000 7f7fbf92f800 20 INFO: main: done 2024-03-09T14:41:26.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.591+0000 7f7e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:26.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.593+0000 7f7fbf92f800 20 remove_watcher() i=0 2024-03-09T14:41:26.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.593+0000 7f7fbf92f800 2 removed watcher, disabling cache 2024-03-09T14:41:26.594 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.594+0000 7f7fbf92f800 20 remove_watcher() i=1 2024-03-09T14:41:26.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.595+0000 7f7fbf92f800 20 remove_watcher() i=2 2024-03-09T14:41:26.597 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.596+0000 7f7fbf92f800 20 remove_watcher() i=3 2024-03-09T14:41:26.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.597+0000 7f7fbf92f800 20 remove_watcher() i=4 2024-03-09T14:41:26.598 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.598+0000 7f7fbf92f800 20 remove_watcher() i=5 2024-03-09T14:41:26.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.599+0000 7f7fbf92f800 20 remove_watcher() i=6 2024-03-09T14:41:26.600 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.600+0000 7f7fbf92f800 20 remove_watcher() i=7 2024-03-09T14:41:26.613 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:26.613 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:26.637 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:26.638 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:26.717 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:41:26.718 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket myver --object y 2024-03-09T14:41:26.748 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:26.748 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:26.781 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.781+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 realm 2024-03-09T14:41:26.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:26.783 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.783+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.784+0000 7fc2f6044800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:26.784 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.784+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.785+0000 7fc2f6044800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:26.785 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.785+0000 7fc2f6044800 20 searching for the correct realm 2024-03-09T14:41:26.788 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.788+0000 7fc2f4341640 0 -- 172.21.15.46:0/3725104923 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x56497fc17620 msgr2=0x56497fc19ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:26.792 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.792+0000 7fc2f3b40640 0 -- 172.21.15.46:0/3725104923 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fc2e800c050 msgr2=0x7fc2e8001460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.797+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.798 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:26.799 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 zone default found 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 4 Realm: () 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 zonegroup default 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.800 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.798+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.799+0000 7fc2f6044800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:26.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.799+0000 7fc2f6044800 20 started sync module instance, tier type = 2024-03-09T14:41:26.801 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.799+0000 7fc2f6044800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:26.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=0 2024-03-09T14:41:26.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=1 2024-03-09T14:41:26.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=2 2024-03-09T14:41:26.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=3 2024-03-09T14:41:26.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=4 2024-03-09T14:41:26.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=5 2024-03-09T14:41:26.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.808+0000 7fc2f6044800 20 add_watcher() i=6 2024-03-09T14:41:26.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.809+0000 7fc2f6044800 20 add_watcher() i=7 2024-03-09T14:41:26.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.809+0000 7fc2f6044800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:26.811 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc1a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:26.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc2f6044800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:26.815 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc2f6044800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc2f6044800 5 note: GC not initialized 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc1a8fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc2f6044800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc2f6044800 20 Filter name: none 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc1227fc640 20 reqs_thread_entry: start 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.811+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 rados->read ofs=0 len=0 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 INFO: main: starting shard=0 2024-03-09T14:41:26.816 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.812+0000 7fc2f6044800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 20 INFO: main: starting shard=1 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 20 INFO: main: starting shard=2 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.813+0000 7fc2f6044800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.814+0000 7fc2f6044800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.814+0000 7fc2f6044800 20 INFO: main: done 2024-03-09T14:41:26.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.814+0000 7fc1a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:26.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.817+0000 7fc2f6044800 20 remove_watcher() i=0 2024-03-09T14:41:26.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.817+0000 7fc2f6044800 2 removed watcher, disabling cache 2024-03-09T14:41:26.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.818+0000 7fc2f6044800 20 remove_watcher() i=1 2024-03-09T14:41:26.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.819+0000 7fc2f6044800 20 remove_watcher() i=2 2024-03-09T14:41:26.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.820+0000 7fc2f6044800 20 remove_watcher() i=3 2024-03-09T14:41:26.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.821+0000 7fc2f6044800 20 remove_watcher() i=4 2024-03-09T14:41:26.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.822+0000 7fc2f6044800 20 remove_watcher() i=5 2024-03-09T14:41:26.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.823+0000 7fc2f6044800 20 remove_watcher() i=6 2024-03-09T14:41:26.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:26.824+0000 7fc2f6044800 20 remove_watcher() i=7 2024-03-09T14:41:26.836 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:26.836 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:26.860 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:26.860 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:26.938 INFO:tasks.workunit.client.0.smithi046.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:41:26.940 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bi list --bucket myver --object z 2024-03-09T14:41:26.969 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:26.969 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:27.003 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.003+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.004 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 realm 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.005 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.004+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.005+0000 7f21ac533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:27.006 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.005+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.006+0000 7f21ac533800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:27.007 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.006+0000 7f21ac533800 20 searching for the correct realm 2024-03-09T14:41:27.008 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.008+0000 7f21a79d2640 0 -- 172.21.15.46:0/4140639331 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f219805ffc0 msgr2=0x7f2198056c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:27.013 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.013+0000 7f21a81d3640 0 -- 172.21.15.46:0/4140639331 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f219c0c5c40 msgr2=0x7f219c0c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:27.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:27.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:27.220 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:27.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:27.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:27.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:27.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.221 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:27.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.220+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:27.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 zone default found 2024-03-09T14:41:27.222 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 4 Realm: () 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 zonegroup default 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.221+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.222+0000 7f21ac533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:27.223 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.222+0000 7f21ac533800 20 started sync module instance, tier type = 2024-03-09T14:41:27.224 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.222+0000 7f21ac533800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:27.231 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=0 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=1 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=2 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=3 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=4 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=5 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.231+0000 7f21ac533800 20 add_watcher() i=6 2024-03-09T14:41:27.232 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.232+0000 7f21ac533800 20 add_watcher() i=7 2024-03-09T14:41:27.233 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.232+0000 7f21ac533800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:27.234 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.234+0000 7f205e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:27.235 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.234+0000 7f21ac533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.234+0000 7f21ac533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.234+0000 7f21ac533800 5 note: GC not initialized 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f205d7e2640 20 reqs_thread_entry: start 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f21ac533800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f21ac533800 20 Filter name: none 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f1fceffd640 20 reqs_thread_entry: start 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f21ac533800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:27.236 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.235+0000 7f21ac533800 20 rados->read ofs=0 len=0 2024-03-09T14:41:27.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:27.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:27.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-03-09T14:41:27.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 INFO: main: starting shard=0 2024-03-09T14:41:27.237 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 INFO: main: starting shard=1 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.236+0000 7f21ac533800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.237+0000 7f21ac533800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.237+0000 7f21ac533800 20 INFO: main: starting shard=2 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.237+0000 7f21ac533800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:27.238 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.237+0000 7f21ac533800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:27.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.237+0000 7f21ac533800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:41:27.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.237+0000 7f21ac533800 20 INFO: main: done 2024-03-09T14:41:27.239 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.238+0000 7f205e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:27.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.241+0000 7f21ac533800 20 remove_watcher() i=0 2024-03-09T14:41:27.241 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.241+0000 7f21ac533800 2 removed watcher, disabling cache 2024-03-09T14:41:27.242 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.242+0000 7f21ac533800 20 remove_watcher() i=1 2024-03-09T14:41:27.243 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.243+0000 7f21ac533800 20 remove_watcher() i=2 2024-03-09T14:41:27.244 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.244+0000 7f21ac533800 20 remove_watcher() i=3 2024-03-09T14:41:27.245 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.245+0000 7f21ac533800 20 remove_watcher() i=4 2024-03-09T14:41:27.246 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.246+0000 7f21ac533800 20 remove_watcher() i=5 2024-03-09T14:41:27.247 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.247+0000 7f21ac533800 20 remove_watcher() i=6 2024-03-09T14:41:27.248 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:27.248+0000 7f21ac533800 20 remove_watcher() i=7 2024-03-09T14:41:27.260 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:27.260 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:27.285 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:41:27.691 INFO:tasks.workunit.client.0.smithi046.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:41:28.088 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-03-09T14:41:28.117 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:28.118 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:28.151 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.151+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 realm 2024-03-09T14:41:28.153 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.153+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.154+0000 7f058d530800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:28.154 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.154+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.155+0000 7f058d530800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:28.155 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.155+0000 7f058d530800 20 searching for the correct realm 2024-03-09T14:41:28.159 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.159+0000 7f0588af5640 0 -- 172.21.15.46:0/900496982 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5636bc193ee0 msgr2=0x5636bc1962d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:28.162 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.162+0000 7f0588af5640 0 -- 172.21.15.46:0/900496982 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x7f045407ace0 msgr2=0x7f045407d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.166+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.167 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 zone default found 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 4 Realm: () 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 zonegroup default 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.167+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.168+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.169 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.168+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.168+0000 7f058d530800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.168+0000 7f058d530800 20 started sync module instance, tier type = 2024-03-09T14:41:28.170 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.168+0000 7f058d530800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=0 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=1 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=2 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=3 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=4 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=5 2024-03-09T14:41:28.178 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=6 2024-03-09T14:41:28.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 20 add_watcher() i=7 2024-03-09T14:41:28.179 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.178+0000 7f058d530800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:28.180 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.180+0000 7f043ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:28.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.180+0000 7f058d530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:28.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.180+0000 7f058d530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:28.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 5 note: GC not initialized 2024-03-09T14:41:28.181 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f043efe5640 20 reqs_thread_entry: start 2024-03-09T14:41:28.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:28.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 20 Filter name: none 2024-03-09T14:41:28.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f043cfe1640 20 reqs_thread_entry: start 2024-03-09T14:41:28.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:41:28.182 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : miss 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.181+0000 7f058d530800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.182+0000 7f058d530800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.182+0000 7f058d530800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.182+0000 7f058d530800 10 adding default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:28.183 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.182+0000 7f058d530800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:28.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.182+0000 7f058d530800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:28.184 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.182+0000 7f058d530800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:28.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f058d530800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:28.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f058d530800 10 moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:28.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f058d530800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:28.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f058d530800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18, ofs0, ns] 2024-03-09T14:41:28.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f046cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595117 cookie 94793084034704 notifier 6896 bl.length()=813 2024-03-09T14:41:28.189 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f046cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:28.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f046cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:28.190 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.189+0000 7f046cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:28.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.191+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_sources= new_sources= 2024-03-09T14:41:28.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.191+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential sources added=[] removed=[] 2024-03-09T14:41:28.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.191+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_dests= new_dests= 2024-03-09T14:41:28.191 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.191+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential dests added=[] removed=[] 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.0 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.0 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.1 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.1 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.2 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.2 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.3 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.3 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.4 2024-03-09T14:41:28.193 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.4 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.5 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.5 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.6 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.6 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.7 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.7 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.8 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.8 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.10 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.10 2024-03-09T14:41:28.194 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.11 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.11 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.12 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.12 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.13 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.13 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.14 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.14 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.15 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.15 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.16 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.16 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.192+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.0 2024-03-09T14:41:28.195 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.193+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:28.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.193+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.1 2024-03-09T14:41:28.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.193+0000 7f058d530800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:28.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.193+0000 7f058d530800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.2.2 2024-03-09T14:41:28.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.195+0000 7f058d530800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:41:28.196 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.195+0000 7f058d530800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:28.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f058d530800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:28.197 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f058d530800 10 moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:28.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f058d530800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:28.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f058d530800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18, ofs0, ns] 2024-03-09T14:41:28.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f046cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595118 cookie 94793084034704 notifier 6896 bl.length()=781 2024-03-09T14:41:28.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f046cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:28.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f046cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:28.198 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.197+0000 7f046cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:28.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.199+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_sources= new_sources= 2024-03-09T14:41:28.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.199+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential sources added=[] removed=[] 2024-03-09T14:41:28.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.199+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): orig_dests= new_dests= 2024-03-09T14:41:28.199 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.199+0000 7f058d530800 20 handle_bi_update(): bucket=:myver[9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18]): potential dests added=[] removed=[] 2024-03-09T14:41:28.200 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.200+0000 7f058d530800 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:41:28.202 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.202+0000 7f043ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:28.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.204+0000 7f058d530800 20 remove_watcher() i=0 2024-03-09T14:41:28.204 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.204+0000 7f058d530800 2 removed watcher, disabling cache 2024-03-09T14:41:28.205 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.205+0000 7f058d530800 20 remove_watcher() i=1 2024-03-09T14:41:28.206 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.206+0000 7f058d530800 20 remove_watcher() i=2 2024-03-09T14:41:28.208 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.208+0000 7f058d530800 20 remove_watcher() i=3 2024-03-09T14:41:28.209 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.209+0000 7f058d530800 20 remove_watcher() i=4 2024-03-09T14:41:28.210 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.210+0000 7f058d530800 20 remove_watcher() i=5 2024-03-09T14:41:28.211 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.211+0000 7f058d530800 20 remove_watcher() i=6 2024-03-09T14:41:28.212 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.212+0000 7f058d530800 20 remove_watcher() i=7 2024-03-09T14:41:28.223 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:41:28.256 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:28.256 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:28.290 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.290+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.291+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.291+0000 7fcf84a13800 20 realm 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.291+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.291+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.291+0000 7fcf84a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.291+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.292+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.292 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.292+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.293+0000 7fcf84a13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:28.293 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.293+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.293+0000 7fcf84a13800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:28.294 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.294+0000 7fcf84a13800 20 searching for the correct realm 2024-03-09T14:41:28.297 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.297+0000 7fcf82d10640 0 -- 172.21.15.46:0/3022467972 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x560733163f10 msgr2=0x5607331663d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:28.300 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.300+0000 7fcf8250f640 0 -- 172.21.15.46:0/3022467972 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fcf780d2bd0 msgr2=0x7fcf780b6a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.305+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:28.306 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 zone default found 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 4 Realm: () 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 zonegroup default 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.308 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.306+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.307+0000 7fcf84a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.307+0000 7fcf84a13800 20 started sync module instance, tier type = 2024-03-09T14:41:28.309 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.307+0000 7fcf84a13800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:28.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=0 2024-03-09T14:41:28.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=1 2024-03-09T14:41:28.316 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=2 2024-03-09T14:41:28.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=3 2024-03-09T14:41:28.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=4 2024-03-09T14:41:28.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=5 2024-03-09T14:41:28.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.316+0000 7fcf84a13800 20 add_watcher() i=6 2024-03-09T14:41:28.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.317+0000 7fcf84a13800 20 add_watcher() i=7 2024-03-09T14:41:28.317 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.317+0000 7fcf84a13800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:28.319 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fce38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:28.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcf84a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:28.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcf84a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:28.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcf84a13800 5 note: GC not initialized 2024-03-09T14:41:28.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcdb37fe640 20 reqs_thread_entry: start 2024-03-09T14:41:28.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcf84a13800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:28.320 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcf84a13800 20 Filter name: none 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.319+0000 7fcdb17fa640 20 reqs_thread_entry: start 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 : miss 2024-03-09T14:41:28.321 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.320+0000 7fcf84a13800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:28.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 info.flags=0x17 2024-03-09T14:41:28.322 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 adding default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 to cache LRU end 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.0 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.0 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.1 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.1 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.2 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.321+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.2 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.322+0000 7fcf84a13800 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:41:28.323 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.322+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.3 2024-03-09T14:41:28.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.322+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.3 2024-03-09T14:41:28.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.322+0000 7fcf84a13800 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:41:28.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.322+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.4 2024-03-09T14:41:28.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.322+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.4 2024-03-09T14:41:28.324 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.323+0000 7fcf84a13800 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.323+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.5 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.323+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.5 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.323+0000 7fcf84a13800 1 NOTICE: finished shard 5 (0 entries removed) 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.323+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.6 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.323+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.6 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.324+0000 7fcf84a13800 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.324+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.7 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.324+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.7 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.324+0000 7fcf84a13800 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.324+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.8 2024-03-09T14:41:28.325 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.324+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.8 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.325+0000 7fcf84a13800 1 NOTICE: finished shard 8 (0 entries removed) 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.325+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.325+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.325+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.10 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.325+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.10 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.326+0000 7fcf84a13800 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-09T14:41:28.326 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.326+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.11 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.326+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.11 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.326+0000 7fcf84a13800 1 NOTICE: finished shard 11 (0 entries removed) 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.326+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.12 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.326+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.12 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.327+0000 7fcf84a13800 1 NOTICE: finished shard 12 (0 entries removed) 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.327+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.13 2024-03-09T14:41:28.327 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.327+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.13 2024-03-09T14:41:28.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.327+0000 7fcf84a13800 1 NOTICE: finished shard 13 (0 entries removed) 2024-03-09T14:41:28.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.327+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.14 2024-03-09T14:41:28.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.327+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.14 2024-03-09T14:41:28.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.328+0000 7fcf84a13800 1 NOTICE: finished shard 14 (0 entries removed) 2024-03-09T14:41:28.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.328+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.15 2024-03-09T14:41:28.328 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.328+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.15 2024-03-09T14:41:28.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.328+0000 7fcf84a13800 1 NOTICE: finished shard 15 (0 entries removed) 2024-03-09T14:41:28.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.328+0000 7fcf84a13800 10 bucket_obj is .dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.16 2024-03-09T14:41:28.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.328+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.16 2024-03-09T14:41:28.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.329+0000 7fcf84a13800 1 NOTICE: finished shard 16 (0 entries removed) 2024-03-09T14:41:28.329 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.329+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.329+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:x state=0x5607331cae08 s->prefetch_data=0 2024-03-09T14:41:28.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.330+0000 7fcf84a13800 20 get_obj_state: setting s->obj_tag to fb5prr24re7nmhwk2vv5fd5jq5sa0doy 2024-03-09T14:41:28.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.330+0000 7fcf84a13800 20 get_obj_state_impl: setting s->olh_tag to 07ds3pm9yw4ekxsf3li7polvo22rfcz3 2024-03-09T14:41:28.330 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.330+0000 7fcf84a13800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=07ds3pm9yw4ekxsf3li7polvo22rfcz3 2024-03-09T14:41:28.331 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.331+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.333+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.333+0000 7fcf84a13800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-03-09T14:41:28.333 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.333+0000 7fcf84a13800 20 olh_log_entry: epoch=2 op=3 key=x[eyT37qXpsIy.X48fXvs9ebYLKe5zUoq] 2024-03-09T14:41:28.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.333+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:_:eyT37qXpsIy.X48fXvs9ebYLKe5zUoq_x state=0x5607331d4798 s->prefetch_data=0 2024-03-09T14:41:28.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.334+0000 7fcf84a13800 10 manifest: total_size = 11 2024-03-09T14:41:28.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.334+0000 7fcf84a13800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.694830901312223558 2024-03-09T14:41:28.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.334+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:_:eyT37qXpsIy.X48fXvs9ebYLKe5zUoq_x state=0x5607331d4798 s->prefetch_data=0 2024-03-09T14:41:28.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.334+0000 7fcf84a13800 20 prepare_atomic_modification: state is not atomic. state=0x5607331d4798 2024-03-09T14:41:28.334 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.334+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.338+0000 7fce65ffb640 20 handle_completion(): completion ok for obj=x[eyT37qXpsIy.X48fXvs9ebYLKe5zUoq] 2024-03-09T14:41:28.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.338+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:x state=0x5607331cae08 s->prefetch_data=0 2024-03-09T14:41:28.338 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.338+0000 7fcf84a13800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=07ds3pm9yw4ekxsf3li7polvo22rfcz3 2024-03-09T14:41:28.342 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.342+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.343+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.343 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.344+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.344+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:y state=0x5607331d7dc8 s->prefetch_data=0 2024-03-09T14:41:28.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.344+0000 7fcf84a13800 20 get_obj_state: setting s->obj_tag to e4od3j5dwcqgraiqiz11cxubah6d9ucy 2024-03-09T14:41:28.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.344+0000 7fcf84a13800 20 get_obj_state_impl: setting s->olh_tag to bci0edfxuyaib5g7mmgk473gfj2p4ygu 2024-03-09T14:41:28.344 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.344+0000 7fcf84a13800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bci0edfxuyaib5g7mmgk473gfj2p4ygu 2024-03-09T14:41:28.345 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.345+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.347 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.347+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.347+0000 7fcf84a13800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.347+0000 7fcf84a13800 20 olh_log_entry: epoch=2 op=3 key=y[eg82EYc1z7AS7hMLsoU4vBLGQpyXmfA] 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.347+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:_:eg82EYc1z7AS7hMLsoU4vBLGQpyXmfA_y state=0x5607331d2118 s->prefetch_data=0 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.348+0000 7fcf84a13800 10 manifest: total_size = 12 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.348+0000 7fcf84a13800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13035896520298447824 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.348+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:_:eg82EYc1z7AS7hMLsoU4vBLGQpyXmfA_y state=0x5607331d2118 s->prefetch_data=0 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.348+0000 7fcf84a13800 20 prepare_atomic_modification: state is not atomic. state=0x5607331d2118 2024-03-09T14:41:28.348 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.348+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.351+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:y state=0x5607331d7dc8 s->prefetch_data=0 2024-03-09T14:41:28.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.352+0000 7fcf84a13800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bci0edfxuyaib5g7mmgk473gfj2p4ygu 2024-03-09T14:41:28.352 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.352+0000 7fce65ffb640 20 handle_completion(): completion ok for obj=y[eg82EYc1z7AS7hMLsoU4vBLGQpyXmfA] 2024-03-09T14:41:28.354 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.354+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.355 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.355+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.356+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.356 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.356+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:z state=0x5607331d7dc8 s->prefetch_data=0 2024-03-09T14:41:28.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.356+0000 7fcf84a13800 20 get_obj_state: setting s->obj_tag to cnuc9iqz19ywsoa8l2r50ig7g77p5fa2 2024-03-09T14:41:28.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.356+0000 7fcf84a13800 20 get_obj_state_impl: setting s->olh_tag to 46d67fto68rqvdws139qejjuomve5ap6 2024-03-09T14:41:28.357 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.356+0000 7fcf84a13800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=46d67fto68rqvdws139qejjuomve5ap6 2024-03-09T14:41:28.358 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.358+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-03-09T14:41:28.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 olh_log_entry: epoch=2 op=3 key=z[QPChSLxfu6NjUDIq.9o.o2tWVw5FUj8] 2024-03-09T14:41:28.359 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:_:QPChSLxfu6NjUDIq.9o.o2tWVw5FUj8_z state=0x5607331d00f8 s->prefetch_data=0 2024-03-09T14:41:28.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 10 manifest: total_size = 22 2024-03-09T14:41:28.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 get_obj_state: setting s->obj_tag to 9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16892146973438357749 2024-03-09T14:41:28.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:_:QPChSLxfu6NjUDIq.9o.o2tWVw5FUj8_z state=0x5607331d00f8 s->prefetch_data=0 2024-03-09T14:41:28.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 prepare_atomic_modification: state is not atomic. state=0x5607331d00f8 2024-03-09T14:41:28.360 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.359+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.363+0000 7fce65ffb640 20 handle_completion(): completion ok for obj=z[QPChSLxfu6NjUDIq.9o.o2tWVw5FUj8] 2024-03-09T14:41:28.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.363+0000 7fcf84a13800 20 get_obj_state: octx=0x560732eca540 obj=myver:z state=0x5607331d7dc8 s->prefetch_data=0 2024-03-09T14:41:28.364 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.363+0000 7fcf84a13800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=46d67fto68rqvdws139qejjuomve5ap6 2024-03-09T14:41:28.366 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.366+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.367+0000 7fcf84a13800 20 bucket index object: :.dir.9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18.3.9 2024-03-09T14:41:28.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.367+0000 7fcf84a13800 1 NOTICE: finished shard 9 (3 entries removed) 2024-03-09T14:41:28.367 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.367+0000 7fcf84a13800 1 NOTICE: finished all shards (3 entries removed) 2024-03-09T14:41:28.368 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.368+0000 7fce38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:28.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.370+0000 7fcf84a13800 20 remove_watcher() i=0 2024-03-09T14:41:28.370 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.370+0000 7fcf84a13800 2 removed watcher, disabling cache 2024-03-09T14:41:28.371 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.371+0000 7fcf84a13800 20 remove_watcher() i=1 2024-03-09T14:41:28.372 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.372+0000 7fcf84a13800 20 remove_watcher() i=2 2024-03-09T14:41:28.373 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.373+0000 7fcf84a13800 20 remove_watcher() i=3 2024-03-09T14:41:28.374 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.374+0000 7fcf84a13800 20 remove_watcher() i=4 2024-03-09T14:41:28.375 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.375+0000 7fcf84a13800 20 remove_watcher() i=5 2024-03-09T14:41:28.376 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.376+0000 7fcf84a13800 20 remove_watcher() i=6 2024-03-09T14:41:28.377 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.377+0000 7fcf84a13800 20 remove_watcher() i=7 2024-03-09T14:41:28.389 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:28.389 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:28.432 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:28.432 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:28.528 INFO:tasks.workunit.client.0.smithi046.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:41:28.556 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:28.556 INFO:tasks.workunit.client.0.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:28.589 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.589+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 realm 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.591+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.592 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.592+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:28.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.592+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.593+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:28.593 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.593+0000 7fa30e23a800 20 searching for the correct realm 2024-03-09T14:41:28.595 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.595+0000 7fa308ce3640 0 -- 172.21.15.46:0/3181939528 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fa2fc06b0b0 msgr2=0x7fa2fc056ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:28.599 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.599+0000 7fa3094e4640 0 -- 172.21.15.46:0/3181939528 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fa30001f070 msgr2=0x7fa300052450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:28.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:28.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:28.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:28.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:28.806 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:28.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:28.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.805+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:28.807 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:28.808 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 zone default found 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 4 Realm: () 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 zonegroup default 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.809 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.806+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.807+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.807+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.807+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.807+0000 7fa30e23a800 20 started sync module instance, tier type = 2024-03-09T14:41:28.810 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.807+0000 7fa30e23a800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=0 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=1 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=2 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=3 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=4 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=5 2024-03-09T14:41:28.817 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.816+0000 7fa30e23a800 20 add_watcher() i=6 2024-03-09T14:41:28.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.817+0000 7fa30e23a800 20 add_watcher() i=7 2024-03-09T14:41:28.818 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.817+0000 7fa30e23a800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:28.819 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.819+0000 7fa1bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:28.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.819+0000 7fa30e23a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:28.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.819+0000 7fa30e23a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:28.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.819+0000 7fa30e23a800 5 note: GC not initialized 2024-03-09T14:41:28.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa1be7e4640 20 reqs_thread_entry: start 2024-03-09T14:41:28.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa30e23a800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:28.820 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa30e23a800 20 Filter name: none 2024-03-09T14:41:28.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa12ffff640 20 reqs_thread_entry: start 2024-03-09T14:41:28.821 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.820+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=173 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 rados_obj.operate() r=0 bl.length=387 2024-03-09T14:41:28.822 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.821+0000 7fa30e23a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:41:28.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.823+0000 7fa30e23a800 20 rados->read ofs=0 len=0 2024-03-09T14:41:28.823 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.823+0000 7fa30e23a800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:28.824 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.824+0000 7fa1bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:28.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.826+0000 7fa30e23a800 20 remove_watcher() i=0 2024-03-09T14:41:28.826 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.826+0000 7fa30e23a800 2 removed watcher, disabling cache 2024-03-09T14:41:28.827 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.827+0000 7fa30e23a800 20 remove_watcher() i=1 2024-03-09T14:41:28.828 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.828+0000 7fa30e23a800 20 remove_watcher() i=2 2024-03-09T14:41:28.829 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.829+0000 7fa30e23a800 20 remove_watcher() i=3 2024-03-09T14:41:28.830 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.830+0000 7fa30e23a800 20 remove_watcher() i=4 2024-03-09T14:41:28.831 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.831+0000 7fa30e23a800 20 remove_watcher() i=5 2024-03-09T14:41:28.832 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.832+0000 7fa30e23a800 20 remove_watcher() i=6 2024-03-09T14:41:28.833 INFO:tasks.workunit.client.0.smithi046.stderr:2024-03-09T14:41:28.833+0000 7fa30e23a800 20 remove_watcher() i=7 2024-03-09T14:41:28.843 INFO:tasks.workunit.client.0.smithi046.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-09T14:41:28.844 INFO:tasks.workunit.client.0.smithi046.stderr:Deleting bucket a-bucket 2024-03-09T14:41:28.845 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:28.845 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:28.870 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:28.870 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:28.922 INFO:tasks.workunit.client.0.smithi046.stderr:Deleting bucket myver 2024-03-09T14:41:28.922 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:28.923 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:28.998 INFO:tasks.workunit.client.0.smithi046.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T14:41:28.998 INFO:tasks.workunit.client.0.smithi046.stderr: warnings.warn( 2024-03-09T14:41:29.158 INFO:tasks.workunit.client.0.smithi046.stderr:Completed resharding tests 2024-03-09T14:41:29.158 INFO:tasks.workunit.client.0.smithi046.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-09T14:41:29.158 INFO:tasks.workunit.client.0.smithi046.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-09T14:41:29.158 INFO:tasks.workunit.client.0.smithi046.stdout:connected to https://localhost:443 2024-03-09T14:41:29.227 INFO:tasks.workunit.client.0.smithi046.stderr:+ deactivate 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ export PATH 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n '' ']' 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ hash -r 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' -n '' ']' 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ unset -f deactivate 2024-03-09T14:41:29.228 INFO:tasks.workunit.client.0.smithi046.stderr:+ echo OK. 2024-03-09T14:41:29.229 INFO:tasks.workunit.client.0.smithi046.stdout:OK. 2024-03-09T14:41:29.230 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:41:29.230 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:41:29.309 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-03-09T14:41:29.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:41:29.708 DEBUG:teuthology.parallel:result is None 2024-03-09T14:41:29.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:41:29.748 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:41:29.748 DEBUG:teuthology.orchestra.run.smithi046:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:41:29.815 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:41:29.815 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-03-09T14:41:29.832 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-03-09T14:41:29.832 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-03-09T14:41:29.832 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-03-09T14:41:29.832 DEBUG:teuthology.orchestra.run.smithi046:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-03-09T14:41:29.882 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-03-09T14:41:34.345 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-03-09T14:41:34.345 DEBUG:teuthology.orchestra.run.smithi046:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-03-09T14:41:37.586 INFO:teuthology.orchestra.run.smithi046.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-03-09T14:41:38.160 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:22:48 ago on Sat 09 Mar 2024 02:18:50 PM UTC. 2024-03-09T14:41:38.325 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2024-03-09T14:41:38.326 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: java-1.8.0-openjdk-headless 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout:Install 5 Packages 2024-03-09T14:41:38.327 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:38.328 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 45 M 2024-03-09T14:41:38.328 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 166 M 2024-03-09T14:41:38.328 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-03-09T14:41:38.513 INFO:teuthology.orchestra.run.smithi046.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.2 MB/s | 424 kB 00:00 2024-03-09T14:41:38.630 INFO:teuthology.orchestra.run.smithi046.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2024-03-09T14:41:38.764 INFO:teuthology.orchestra.run.smithi046.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 21 MB/s | 9.3 MB 00:00 2024-03-09T14:41:38.930 INFO:teuthology.orchestra.run.smithi046.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 84 kB/s | 25 kB 00:00 2024-03-09T14:41:39.364 INFO:teuthology.orchestra.run.smithi046.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 38 MB/s | 32 MB 00:00 2024-03-09T14:41:39.367 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-03-09T14:41:39.367 INFO:teuthology.orchestra.run.smithi046.stdout:Total 44 MB/s | 45 MB 00:01 2024-03-09T14:41:39.367 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-03-09T14:41:39.388 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-03-09T14:41:39.388 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-03-09T14:41:39.771 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-03-09T14:41:39.772 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-03-09T14:41:40.206 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-03-09T14:41:40.349 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-03-09T14:41:40.525 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-03-09T14:41:41.159 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-03-09T14:41:41.198 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-09T14:41:41.438 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-03-09T14:41:41.466 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-09T14:41:41.705 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-03-09T14:41:41.745 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-09T14:41:41.752 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-09T14:41:41.760 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-03-09T14:41:41.796 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-03-09T14:41:44.841 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-03-09T14:41:44.842 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-03-09T14:41:44.842 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-03-09T14:41:44.842 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-03-09T14:41:44.842 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-03-09T14:41:45.238 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-03-09T14:41:45.238 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:45.238 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout: gtk2-2.24.33-8.el9.x86_64 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:45.239 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-03-09T14:41:45.679 INFO:teuthology.orchestra.run.smithi046.stdout: Gradle will be installed under /opt/gradle 2024-03-09T14:41:45.773 INFO:teuthology.orchestra.run.smithi046.stderr:--2024-03-09 14:41:45-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-03-09T14:41:45.907 INFO:teuthology.orchestra.run.smithi046.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8125, ... 2024-03-09T14:41:45.944 INFO:teuthology.orchestra.run.smithi046.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2024-03-09T14:41:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-03-09T14:41:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-03-09T14:41:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:--2024-03-09 14:41:46-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-03-09T14:41:46.156 INFO:teuthology.orchestra.run.smithi046.stderr:Resolving github.com (github.com)... 140.82.114.3 2024-03-09T14:41:46.177 INFO:teuthology.orchestra.run.smithi046.stderr:Connecting to github.com (github.com)|140.82.114.3|:443... connected. 2024-03-09T14:41:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:HTTP request sent, awaiting response... 302 Found 2024-03-09T14:41:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240309T144146Z&X-Amz-Expires=300&X-Amz-Signature=4c04b4e2685760064415de31803e424af07728be495795e8af82f271e24ca128&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-03-09T14:41:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:--2024-03-09 14:41:46-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240309T144146Z&X-Amz-Expires=300&X-Amz-Signature=4c04b4e2685760064415de31803e424af07728be495795e8af82f271e24ca128&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-03-09T14:41:46.370 INFO:teuthology.orchestra.run.smithi046.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.108.133, 185.199.109.133, ... 2024-03-09T14:41:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-03-09T14:41:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-09T14:41:46.501 INFO:teuthology.orchestra.run.smithi046.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-03-09T14:41:46.502 INFO:teuthology.orchestra.run.smithi046.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-03-09T14:41:46.507 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-03-09T14:41:46.534 INFO:teuthology.orchestra.run.smithi046.stderr: 0K .......... .......... .......... .......... .......... 0% 1.48M 61s 2024-03-09T14:41:46.539 INFO:teuthology.orchestra.run.smithi046.stderr: 50K .......... .......... .......... .......... .......... 0% 10.5M 35s 2024-03-09T14:41:46.549 INFO:teuthology.orchestra.run.smithi046.stderr: 100K .......... .......... .......... .......... .......... 0% 4.78M 30s 2024-03-09T14:41:46.552 INFO:teuthology.orchestra.run.smithi046.stderr: 150K .......... .......... .......... .......... .......... 0% 16.2M 24s 2024-03-09T14:41:46.555 INFO:teuthology.orchestra.run.smithi046.stderr: 200K .......... .......... .......... .......... .......... 0% 18.2M 20s 2024-03-09T14:41:46.556 INFO:teuthology.orchestra.run.smithi046.stderr: 250K .......... .......... .......... .......... .......... 0% 31.6M 17s 2024-03-09T14:41:46.564 INFO:teuthology.orchestra.run.smithi046.stderr: 300K .......... .......... .......... .......... .......... 0% 6.38M 17s 2024-03-09T14:41:46.566 INFO:teuthology.orchestra.run.smithi046.stderr: 350K .......... .......... .......... .......... .......... 0% 35.9M 15s 2024-03-09T14:41:46.567 INFO:teuthology.orchestra.run.smithi046.stderr: 400K .......... .......... .......... .......... .......... 0% 24.8M 14s 2024-03-09T14:41:46.570 INFO:teuthology.orchestra.run.smithi046.stderr: 450K .......... .......... .......... .......... .......... 0% 24.4M 13s 2024-03-09T14:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr: 500K .......... .......... .......... .......... .......... 0% 48.8M 12s 2024-03-09T14:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr: 550K .......... .......... .......... .......... .......... 0% 59.2M 11s 2024-03-09T14:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr: 600K .......... .......... .......... .......... .......... 0% 43.4M 10s 2024-03-09T14:41:46.574 INFO:teuthology.orchestra.run.smithi046.stderr: 650K .......... .......... .......... .......... .......... 0% 40.2M 10s 2024-03-09T14:41:46.770 INFO:teuthology.orchestra.run.smithi046.stderr: 700K .......... .......... .......... .......... .......... 0% 7.10M 10s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 750K .......... .......... .......... .......... .......... 0% 81.4M 9s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 800K .......... .......... .......... .......... .......... 0% 53.4M 9s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 850K .......... .......... .......... .......... .......... 0% 116M 8s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 900K .......... .......... .......... .......... .......... 1% 44.4M 8s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 950K .......... .......... .......... .......... .......... 1% 69.3M 8s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 1000K .......... .......... .......... .......... .......... 1% 52.5M 7s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 1050K .......... .......... .......... .......... .......... 1% 113M 7s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 1100K .......... .......... .......... .......... .......... 1% 73.2M 7s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 1150K .......... .......... .......... .......... .......... 1% 55.4M 7s 2024-03-09T14:41:46.771 INFO:teuthology.orchestra.run.smithi046.stderr: 1200K .......... .......... .......... .......... .......... 1% 55.6M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1250K .......... .......... .......... .......... .......... 1% 58.3M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1300K .......... .......... .......... .......... .......... 1% 125M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1350K .......... .......... .......... .......... .......... 1% 99.8M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1400K .......... .......... .......... .......... .......... 1% 67.3M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1450K .......... .......... .......... .......... .......... 1% 14.9M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1500K .......... .......... .......... .......... .......... 1% 22.1M 6s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1550K .......... .......... .......... .......... .......... 1% 108M 5s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1600K .......... .......... .......... .......... .......... 1% 37.4M 5s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1650K .......... .......... .......... .......... .......... 1% 29.0M 5s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1700K .......... .......... .......... .......... .......... 1% 61.8M 5s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1750K .......... .......... .......... .......... .......... 1% 111M 5s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1800K .......... .......... .......... .......... .......... 1% 65.2M 5s 2024-03-09T14:41:46.772 INFO:teuthology.orchestra.run.smithi046.stderr: 1850K .......... .......... .......... .......... .......... 2% 89.8M 5s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 1900K .......... .......... .......... .......... .......... 2% 73.6M 5s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 1950K .......... .......... .......... .......... .......... 2% 105M 5s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2000K .......... .......... .......... .......... .......... 2% 93.7M 5s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2050K .......... .......... .......... .......... .......... 2% 54.9M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2100K .......... .......... .......... .......... .......... 2% 113M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2150K .......... .......... .......... .......... .......... 2% 63.6M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2200K .......... .......... .......... .......... .......... 2% 56.3M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2250K .......... .......... .......... .......... .......... 2% 125M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2300K .......... .......... .......... .......... .......... 2% 97.9M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2350K .......... .......... .......... .......... .......... 2% 112M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2400K .......... .......... .......... .......... .......... 2% 66.2M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2450K .......... .......... .......... .......... .......... 2% 41.9M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2500K .......... .......... .......... .......... .......... 2% 120M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2550K .......... .......... .......... .......... .......... 2% 111M 4s 2024-03-09T14:41:46.773 INFO:teuthology.orchestra.run.smithi046.stderr: 2600K .......... .......... .......... .......... .......... 2% 65.4M 4s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2650K .......... .......... .......... .......... .......... 2% 88.0M 4s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2700K .......... .......... .......... .......... .......... 2% 117M 4s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2750K .......... .......... .......... .......... .......... 3% 65.8M 4s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2800K .......... .......... .......... .......... .......... 3% 74.2M 4s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2850K .......... .......... .......... .......... .......... 3% 73.8M 4s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2900K .......... .......... .......... .......... .......... 3% 117M 3s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 2950K .......... .......... .......... .......... .......... 3% 116M 3s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 3000K .......... .......... .......... .......... .......... 3% 17.4M 3s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 3050K .......... .......... .......... .......... .......... 3% 62.3M 3s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 3100K .......... .......... .......... .......... .......... 3% 107M 3s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 3150K .......... .......... .......... .......... .......... 3% 99.3M 3s 2024-03-09T14:41:46.774 INFO:teuthology.orchestra.run.smithi046.stderr: 3200K .......... .......... .......... .......... .......... 3% 86.3M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3250K .......... .......... .......... .......... .......... 3% 48.7M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3300K .......... .......... .......... .......... .......... 3% 88.3M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3350K .......... .......... .......... .......... .......... 3% 41.7M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3400K .......... .......... .......... .......... .......... 3% 106M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3450K .......... .......... .......... .......... .......... 3% 67.8M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3500K .......... .......... .......... .......... .......... 3% 61.8M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3550K .......... .......... .......... .......... .......... 3% 90.6M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3600K .......... .......... .......... .......... .......... 3% 67.0M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3650K .......... .......... .......... .......... .......... 3% 116M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3700K .......... .......... .......... .......... .......... 4% 108M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3750K .......... .......... .......... .......... .......... 4% 57.7M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3800K .......... .......... .......... .......... .......... 4% 89.3M 3s 2024-03-09T14:41:46.775 INFO:teuthology.orchestra.run.smithi046.stderr: 3850K .......... .......... .......... .......... .......... 4% 112M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 3900K .......... .......... .......... .......... .......... 4% 82.2M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 3950K .......... .......... .......... .......... .......... 4% 44.3M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4000K .......... .......... .......... .......... .......... 4% 102M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4050K .......... .......... .......... .......... .......... 4% 120M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4100K .......... .......... .......... .......... .......... 4% 111M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4150K .......... .......... .......... .......... .......... 4% 44.6M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4200K .......... .......... .......... .......... .......... 4% 107M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4250K .......... .......... .......... .......... .......... 4% 93.0M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4300K .......... .......... .......... .......... .......... 4% 111M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4350K .......... .......... .......... .......... .......... 4% 50.3M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4400K .......... .......... .......... .......... .......... 4% 90.4M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4450K .......... .......... .......... .......... .......... 4% 97.5M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4500K .......... .......... .......... .......... .......... 4% 41.8M 3s 2024-03-09T14:41:46.776 INFO:teuthology.orchestra.run.smithi046.stderr: 4550K .......... .......... .......... .......... .......... 4% 120M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4600K .......... .......... .......... .......... .......... 5% 107M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4650K .......... .......... .......... .......... .......... 5% 43.5M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4700K .......... .......... .......... .......... .......... 5% 120M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4750K .......... .......... .......... .......... .......... 5% 119M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4800K .......... .......... .......... .......... .......... 5% 44.3M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4850K .......... .......... .......... .......... .......... 5% 79.1M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4900K .......... .......... .......... .......... .......... 5% 119M 3s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 4950K .......... .......... .......... .......... .......... 5% 120M 2s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 5000K .......... .......... .......... .......... .......... 5% 42.0M 2s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 5050K .......... .......... .......... .......... .......... 5% 47.6M 2s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 5100K .......... .......... .......... .......... .......... 5% 88.7M 2s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 5150K .......... .......... .......... .......... .......... 5% 50.3M 2s 2024-03-09T14:41:46.777 INFO:teuthology.orchestra.run.smithi046.stderr: 5200K .......... .......... .......... .......... .......... 5% 39.8M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5250K .......... .......... .......... .......... .......... 5% 44.5M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5300K .......... .......... .......... .......... .......... 5% 116M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5350K .......... .......... .......... .......... .......... 5% 43.6M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5400K .......... .......... .......... .......... .......... 5% 64.0M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5450K .......... .......... .......... .......... .......... 5% 58.3M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5500K .......... .......... .......... .......... .......... 5% 116M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5550K .......... .......... .......... .......... .......... 6% 13.8M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5600K .......... .......... .......... .......... .......... 6% 41.6M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5650K .......... .......... .......... .......... .......... 6% 44.7M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5700K .......... .......... .......... .......... .......... 6% 86.4M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5750K .......... .......... .......... .......... .......... 6% 94.4M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5800K .......... .......... .......... .......... .......... 6% 31.2M 2s 2024-03-09T14:41:46.778 INFO:teuthology.orchestra.run.smithi046.stderr: 5850K .......... .......... .......... .......... .......... 6% 45.0M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 5900K .......... .......... .......... .......... .......... 6% 46.6M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 5950K .......... .......... .......... .......... .......... 6% 116M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6000K .......... .......... .......... .......... .......... 6% 27.4M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6050K .......... .......... .......... .......... .......... 6% 44.6M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6100K .......... .......... .......... .......... .......... 6% 43.6M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6150K .......... .......... .......... .......... .......... 6% 43.3M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6200K .......... .......... .......... .......... .......... 6% 120M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6250K .......... .......... .......... .......... .......... 6% 50.8M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6300K .......... .......... .......... .......... .......... 6% 39.2M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6350K .......... .......... .......... .......... .......... 6% 55.4M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6400K .......... .......... .......... .......... .......... 6% 68.4M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6450K .......... .......... .......... .......... .......... 6% 121M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6500K .......... .......... .......... .......... .......... 7% 46.0M 2s 2024-03-09T14:41:46.779 INFO:teuthology.orchestra.run.smithi046.stderr: 6550K .......... .......... .......... .......... .......... 7% 45.6M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6600K .......... .......... .......... .......... .......... 7% 98.1M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6650K .......... .......... .......... .......... .......... 7% 118M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6700K .......... .......... .......... .......... .......... 7% 27.1M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6750K .......... .......... .......... .......... .......... 7% 40.3M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6800K .......... .......... .......... .......... .......... 7% 56.2M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6850K .......... .......... .......... .......... .......... 7% 30.9M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6900K .......... .......... .......... .......... .......... 7% 120M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 6950K .......... .......... .......... .......... .......... 7% 65.8M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 7000K .......... .......... .......... .......... .......... 7% 32.0M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 7050K .......... .......... .......... .......... .......... 7% 95.5M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 7100K .......... .......... .......... .......... .......... 7% 117M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 7150K .......... .......... .......... .......... .......... 7% 52.2M 2s 2024-03-09T14:41:46.780 INFO:teuthology.orchestra.run.smithi046.stderr: 7200K .......... .......... .......... .......... .......... 7% 37.6M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7250K .......... .......... .......... .......... .......... 7% 119M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7300K .......... .......... .......... .......... .......... 7% 108M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7350K .......... .......... .......... .......... .......... 7% 112M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7400K .......... .......... .......... .......... .......... 8% 40.7M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7450K .......... .......... .......... .......... .......... 8% 51.8M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7500K .......... .......... .......... .......... .......... 8% 42.7M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7550K .......... .......... .......... .......... .......... 8% 21.4M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7600K .......... .......... .......... .......... .......... 8% 118M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7650K .......... .......... .......... .......... .......... 8% 116M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7700K .......... .......... .......... .......... .......... 8% 28.8M 2s 2024-03-09T14:41:46.781 INFO:teuthology.orchestra.run.smithi046.stderr: 7750K .......... .......... .......... .......... .......... 8% 30.4M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 7800K .......... .......... .......... .......... .......... 8% 76.8M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 7850K .......... .......... .......... .......... .......... 8% 95.3M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 7900K .......... .......... .......... .......... .......... 8% 32.9M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 7950K .......... .......... .......... .......... .......... 8% 30.4M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8000K .......... .......... .......... .......... .......... 8% 77.6M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8050K .......... .......... .......... .......... .......... 8% 20.4M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8100K .......... .......... .......... .......... .......... 8% 118M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8150K .......... .......... .......... .......... .......... 8% 28.2M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8200K .......... .......... .......... .......... .......... 8% 88.8M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8250K .......... .......... .......... .......... .......... 8% 29.7M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8300K .......... .......... .......... .......... .......... 8% 147M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8350K .......... .......... .......... .......... .......... 9% 94.1M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8400K .......... .......... .......... .......... .......... 9% 27.5M 2s 2024-03-09T14:41:46.782 INFO:teuthology.orchestra.run.smithi046.stderr: 8450K .......... .......... .......... .......... .......... 9% 27.6M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8500K .......... .......... .......... .......... .......... 9% 46.8M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8550K .......... .......... .......... .......... .......... 9% 114M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8600K .......... .......... .......... .......... .......... 9% 43.2M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8650K .......... .......... .......... .......... .......... 9% 92.9M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8700K .......... .......... .......... .......... .......... 9% 31.8M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8750K .......... .......... .......... .......... .......... 9% 90.3M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8800K .......... .......... .......... .......... .......... 9% 45.8M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8850K .......... .......... .......... .......... .......... 9% 91.8M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8900K .......... .......... .......... .......... .......... 9% 65.8M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 8950K .......... .......... .......... .......... .......... 9% 35.9M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 9000K .......... .......... .......... .......... .......... 9% 112M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 9050K .......... .......... .......... .......... .......... 9% 44.5M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 9100K .......... .......... .......... .......... .......... 9% 46.0M 2s 2024-03-09T14:41:46.783 INFO:teuthology.orchestra.run.smithi046.stderr: 9150K .......... .......... .......... .......... .......... 9% 98.4M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9200K .......... .......... .......... .......... .......... 9% 26.7M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9250K .......... .......... .......... .......... .......... 10% 87.4M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9300K .......... .......... .......... .......... .......... 10% 45.4M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9350K .......... .......... .......... .......... .......... 10% 92.2M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9400K .......... .......... .......... .......... .......... 10% 28.7M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9450K .......... .......... .......... .......... .......... 10% 117M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9500K .......... .......... .......... .......... .......... 10% 44.6M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9550K .......... .......... .......... .......... .......... 10% 30.3M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9600K .......... .......... .......... .......... .......... 10% 72.0M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9650K .......... .......... .......... .......... .......... 10% 43.2M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9700K .......... .......... .......... .......... .......... 10% 102M 2s 2024-03-09T14:41:46.784 INFO:teuthology.orchestra.run.smithi046.stderr: 9750K .......... .......... .......... .......... .......... 10% 46.3M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 9800K .......... .......... .......... .......... .......... 10% 42.0M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 9850K .......... .......... .......... .......... .......... 10% 105M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 9900K .......... .......... .......... .......... .......... 10% 114M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 9950K .......... .......... .......... .......... .......... 10% 45.1M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10000K .......... .......... .......... .......... .......... 10% 39.8M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10050K .......... .......... .......... .......... .......... 10% 47.1M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10100K .......... .......... .......... .......... .......... 10% 28.1M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10150K .......... .......... .......... .......... .......... 10% 44.1M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10200K .......... .......... .......... .......... .......... 11% 97.3M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10250K .......... .......... .......... .......... .......... 11% 44.4M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10300K .......... .......... .......... .......... .......... 11% 25.5M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10350K .......... .......... .......... .......... .......... 11% 159M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10400K .......... .......... .......... .......... .......... 11% 33.2M 2s 2024-03-09T14:41:46.785 INFO:teuthology.orchestra.run.smithi046.stderr: 10450K .......... .......... .......... .......... .......... 11% 63.5M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10500K .......... .......... .......... .......... .......... 11% 67.4M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10550K .......... .......... .......... .......... .......... 11% 95.6M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10600K .......... .......... .......... .......... .......... 11% 19.8M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10650K .......... .......... .......... .......... .......... 11% 69.1M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10700K .......... .......... .......... .......... .......... 11% 177M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10750K .......... .......... .......... .......... .......... 11% 42.5M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10800K .......... .......... .......... .......... .......... 11% 45.2M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10850K .......... .......... .......... .......... .......... 11% 74.7M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10900K .......... .......... .......... .......... .......... 11% 118M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 10950K .......... .......... .......... .......... .......... 11% 40.5M 2s 2024-03-09T14:41:46.786 INFO:teuthology.orchestra.run.smithi046.stderr: 11000K .......... .......... .......... .......... .......... 11% 41.5M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11050K .......... .......... .......... .......... .......... 11% 40.9M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11100K .......... .......... .......... .......... .......... 12% 44.8M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11150K .......... .......... .......... .......... .......... 12% 81.9M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11200K .......... .......... .......... .......... .......... 12% 78.1M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11250K .......... .......... .......... .......... .......... 12% 28.0M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11300K .......... .......... .......... .......... .......... 12% 48.5M 2s 2024-03-09T14:41:46.787 INFO:teuthology.orchestra.run.smithi046.stderr: 11350K .......... .......... .......... .......... .......... 12% 101M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11400K .......... .......... .......... .......... .......... 12% 47.7M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11450K .......... .......... .......... .......... .......... 12% 52.3M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11500K .......... .......... .......... .......... .......... 12% 71.6M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11550K .......... .......... .......... .......... .......... 12% 119M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11600K .......... .......... .......... .......... .......... 12% 26.9M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11650K .......... .......... .......... .......... .......... 12% 50.1M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11700K .......... .......... .......... .......... .......... 12% 38.6M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11750K .......... .......... .......... .......... .......... 12% 17.8M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11800K .......... .......... .......... .......... .......... 12% 48.3M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11850K .......... .......... .......... .......... .......... 12% 102M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11900K .......... .......... .......... .......... .......... 12% 92.5M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 11950K .......... .......... .......... .......... .......... 12% 27.9M 2s 2024-03-09T14:41:46.822 INFO:teuthology.orchestra.run.smithi046.stderr: 12000K .......... .......... .......... .......... .......... 12% 40.8M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12050K .......... .......... .......... .......... .......... 13% 95.4M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12100K .......... .......... .......... .......... .......... 13% 92.2M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12150K .......... .......... .......... .......... .......... 13% 29.5M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12200K .......... .......... .......... .......... .......... 13% 44.5M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12250K .......... .......... .......... .......... .......... 13% 42.0M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12300K .......... .......... .......... .......... .......... 13% 97.2M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12350K .......... .......... .......... .......... .......... 13% 59.9M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12400K .......... .......... .......... .......... .......... 13% 32.5M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12450K .......... .......... .......... .......... .......... 13% 38.4M 2s 2024-03-09T14:41:46.823 INFO:teuthology.orchestra.run.smithi046.stderr: 12500K .......... .......... .......... .......... .......... 13% 75.6M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12550K .......... .......... .......... .......... .......... 13% 44.8M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12600K .......... .......... .......... .......... .......... 13% 33.3M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12650K .......... .......... .......... .......... .......... 13% 26.0M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12700K .......... .......... .......... .......... .......... 13% 117M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12750K .......... .......... .......... .......... .......... 13% 29.7M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12800K .......... .......... .......... .......... .......... 13% 36.5M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12850K .......... .......... .......... .......... .......... 13% 47.4M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12900K .......... .......... .......... .......... .......... 13% 43.4M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 12950K .......... .......... .......... .......... .......... 13% 39.0M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 13000K .......... .......... .......... .......... .......... 14% 117M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 13050K .......... .......... .......... .......... .......... 14% 75.3M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 13100K .......... .......... .......... .......... .......... 14% 55.7M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 13150K .......... .......... .......... .......... .......... 14% 24.4M 2s 2024-03-09T14:41:46.824 INFO:teuthology.orchestra.run.smithi046.stderr: 13200K .......... .......... .......... .......... .......... 14% 29.4M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13250K .......... .......... .......... .......... .......... 14% 117M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13300K .......... .......... .......... .......... .......... 14% 118M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13350K .......... .......... .......... .......... .......... 14% 27.9M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13400K .......... .......... .......... .......... .......... 14% 110M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13450K .......... .......... .......... .......... .......... 14% 114M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13500K .......... .......... .......... .......... .......... 14% 43.2M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13550K .......... .......... .......... .......... .......... 14% 45.6M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13600K .......... .......... .......... .......... .......... 14% 42.9M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13650K .......... .......... .......... .......... .......... 14% 38.8M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13700K .......... .......... .......... .......... .......... 14% 118M 2s 2024-03-09T14:41:46.825 INFO:teuthology.orchestra.run.smithi046.stderr: 13750K .......... .......... .......... .......... .......... 14% 94.3M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 13800K .......... .......... .......... .......... .......... 14% 28.2M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 13850K .......... .......... .......... .......... .......... 14% 44.2M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 13900K .......... .......... .......... .......... .......... 15% 115M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 13950K .......... .......... .......... .......... .......... 15% 41.3M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 14000K .......... .......... .......... .......... .......... 15% 27.5M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 14050K .......... .......... .......... .......... .......... 15% 105M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 14100K .......... .......... .......... .......... .......... 15% 26.1M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 14150K .......... .......... .......... .......... .......... 15% 110M 2s 2024-03-09T14:41:46.834 INFO:teuthology.orchestra.run.smithi046.stderr: 14200K .......... .......... .......... .......... .......... 15% 42.6M 2s 2024-03-09T14:41:46.835 INFO:teuthology.orchestra.run.smithi046.stderr: 14250K .......... .......... .......... .......... .......... 15% 40.6M 2s 2024-03-09T14:41:46.835 INFO:teuthology.orchestra.run.smithi046.stderr: 14300K .......... .......... .......... .......... .......... 15% 28.3M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14350K .......... .......... .......... .......... .......... 15% 48.4M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14400K .......... .......... .......... .......... .......... 15% 60.9M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14450K .......... .......... .......... .......... .......... 15% 118M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14500K .......... .......... .......... .......... .......... 15% 41.4M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14550K .......... .......... .......... .......... .......... 15% 42.7M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14600K .......... .......... .......... .......... .......... 15% 85.7M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14650K .......... .......... .......... .......... .......... 15% 44.1M 2s 2024-03-09T14:41:46.841 INFO:teuthology.orchestra.run.smithi046.stderr: 14700K .......... .......... .......... .......... .......... 15% 91.6M 2s 2024-03-09T14:41:46.845 INFO:teuthology.orchestra.run.smithi046.stderr: 14750K .......... .......... .......... .......... .......... 15% 43.8M 2s 2024-03-09T14:41:46.845 INFO:teuthology.orchestra.run.smithi046.stderr: 14800K .......... .......... .......... .......... .......... 15% 37.1M 2s 2024-03-09T14:41:46.845 INFO:teuthology.orchestra.run.smithi046.stderr: 14850K .......... .......... .......... .......... .......... 16% 49.7M 2s 2024-03-09T14:41:46.845 INFO:teuthology.orchestra.run.smithi046.stderr: 14900K .......... .......... .......... .......... .......... 16% 82.7M 2s 2024-03-09T14:41:46.848 INFO:teuthology.orchestra.run.smithi046.stderr: 14950K .......... .......... .......... .......... .......... 16% 40.1M 2s 2024-03-09T14:41:46.848 INFO:teuthology.orchestra.run.smithi046.stderr: 15000K .......... .......... .......... .......... .......... 16% 44.8M 2s 2024-03-09T14:41:46.848 INFO:teuthology.orchestra.run.smithi046.stderr: 15050K .......... .......... .......... .......... .......... 16% 96.1M 2s 2024-03-09T14:41:46.848 INFO:teuthology.orchestra.run.smithi046.stderr: 15100K .......... .......... .......... .......... .......... 16% 61.3M 2s 2024-03-09T14:41:46.850 INFO:teuthology.orchestra.run.smithi046.stderr: 15150K .......... .......... .......... .......... .......... 16% 24.2M 2s 2024-03-09T14:41:46.851 INFO:teuthology.orchestra.run.smithi046.stderr: 15200K .......... .......... .......... .......... .......... 16% 36.7M 2s 2024-03-09T14:41:46.853 INFO:teuthology.orchestra.run.smithi046.stderr: 15250K .......... .......... .......... .......... .......... 16% 42.8M 2s 2024-03-09T14:41:46.854 INFO:teuthology.orchestra.run.smithi046.stderr: 15300K .......... .......... .......... .......... .......... 16% 50.1M 2s 2024-03-09T14:41:46.854 INFO:teuthology.orchestra.run.smithi046.stderr: 15350K .......... .......... .......... .......... .......... 16% 90.5M 2s 2024-03-09T14:41:46.855 INFO:teuthology.orchestra.run.smithi046.stderr: 15400K .......... .......... .......... .......... .......... 16% 40.1M 2s 2024-03-09T14:41:46.857 INFO:teuthology.orchestra.run.smithi046.stderr: 15450K .......... .......... .......... .......... .......... 16% 45.8M 2s 2024-03-09T14:41:46.857 INFO:teuthology.orchestra.run.smithi046.stderr: 15500K .......... .......... .......... .......... .......... 16% 97.0M 2s 2024-03-09T14:41:46.859 INFO:teuthology.orchestra.run.smithi046.stderr: 15550K .......... .......... .......... .......... .......... 16% 29.7M 2s 2024-03-09T14:41:46.859 INFO:teuthology.orchestra.run.smithi046.stderr: 15600K .......... .......... .......... .......... .......... 16% 42.5M 2s 2024-03-09T14:41:46.860 INFO:teuthology.orchestra.run.smithi046.stderr: 15650K .......... .......... .......... .......... .......... 16% 67.3M 2s 2024-03-09T14:41:46.862 INFO:teuthology.orchestra.run.smithi046.stderr: 15700K .......... .......... .......... .......... .......... 16% 25.2M 2s 2024-03-09T14:41:46.865 INFO:teuthology.orchestra.run.smithi046.stderr: 15750K .......... .......... .......... .......... .......... 17% 32.2M 2s 2024-03-09T14:41:46.865 INFO:teuthology.orchestra.run.smithi046.stderr: 15800K .......... .......... .......... .......... .......... 17% 113M 2s 2024-03-09T14:41:46.865 INFO:teuthology.orchestra.run.smithi046.stderr: 15850K .......... .......... .......... .......... .......... 17% 95.6M 2s 2024-03-09T14:41:46.867 INFO:teuthology.orchestra.run.smithi046.stderr: 15900K .......... .......... .......... .......... .......... 17% 29.9M 2s 2024-03-09T14:41:46.868 INFO:teuthology.orchestra.run.smithi046.stderr: 15950K .......... .......... .......... .......... .......... 17% 58.0M 2s 2024-03-09T14:41:46.869 INFO:teuthology.orchestra.run.smithi046.stderr: 16000K .......... .......... .......... .......... .......... 17% 54.9M 2s 2024-03-09T14:41:46.869 INFO:teuthology.orchestra.run.smithi046.stderr: 16050K .......... .......... .......... .......... .......... 17% 90.9M 2s 2024-03-09T14:41:46.870 INFO:teuthology.orchestra.run.smithi046.stderr: 16100K .......... .......... .......... .......... .......... 17% 34.5M 2s 2024-03-09T14:41:46.875 INFO:teuthology.orchestra.run.smithi046.stderr: 16150K .......... .......... .......... .......... .......... 17% 36.0M 2s 2024-03-09T14:41:46.875 INFO:teuthology.orchestra.run.smithi046.stderr: 16200K .......... .......... .......... .......... .......... 17% 88.2M 2s 2024-03-09T14:41:46.875 INFO:teuthology.orchestra.run.smithi046.stderr: 16250K .......... .......... .......... .......... .......... 17% 119M 2s 2024-03-09T14:41:46.875 INFO:teuthology.orchestra.run.smithi046.stderr: 16300K .......... .......... .......... .......... .......... 17% 93.3M 2s 2024-03-09T14:41:46.875 INFO:teuthology.orchestra.run.smithi046.stderr: 16350K .......... .......... .......... .......... .......... 17% 92.0M 2s 2024-03-09T14:41:46.876 INFO:teuthology.orchestra.run.smithi046.stderr: 16400K .......... .......... .......... .......... .......... 17% 37.9M 2s 2024-03-09T14:41:46.877 INFO:teuthology.orchestra.run.smithi046.stderr: 16450K .......... .......... .......... .......... .......... 17% 45.9M 2s 2024-03-09T14:41:46.877 INFO:teuthology.orchestra.run.smithi046.stderr: 16500K .......... .......... .......... .......... .......... 17% 109M 2s 2024-03-09T14:41:46.879 INFO:teuthology.orchestra.run.smithi046.stderr: 16550K .......... .......... .......... .......... .......... 17% 28.2M 2s 2024-03-09T14:41:46.879 INFO:teuthology.orchestra.run.smithi046.stderr: 16600K .......... .......... .......... .......... .......... 17% 44.9M 2s 2024-03-09T14:41:46.881 INFO:teuthology.orchestra.run.smithi046.stderr: 16650K .......... .......... .......... .......... .......... 17% 28.2M 2s 2024-03-09T14:41:46.882 INFO:teuthology.orchestra.run.smithi046.stderr: 16700K .......... .......... .......... .......... .......... 18% 44.9M 2s 2024-03-09T14:41:46.883 INFO:teuthology.orchestra.run.smithi046.stderr: 16750K .......... .......... .......... .......... .......... 18% 93.2M 2s 2024-03-09T14:41:46.883 INFO:teuthology.orchestra.run.smithi046.stderr: 16800K .......... .......... .......... .......... .......... 18% 39.4M 2s 2024-03-09T14:41:46.887 INFO:teuthology.orchestra.run.smithi046.stderr: 16850K .......... .......... .......... .......... .......... 18% 27.3M 2s 2024-03-09T14:41:46.887 INFO:teuthology.orchestra.run.smithi046.stderr: 16900K .......... .......... .......... .......... .......... 18% 107M 2s 2024-03-09T14:41:46.888 INFO:teuthology.orchestra.run.smithi046.stderr: 16950K .......... .......... .......... .......... .......... 18% 46.0M 2s 2024-03-09T14:41:46.888 INFO:teuthology.orchestra.run.smithi046.stderr: 17000K .......... .......... .......... .......... .......... 18% 82.5M 2s 2024-03-09T14:41:46.889 INFO:teuthology.orchestra.run.smithi046.stderr: 17050K .......... .......... .......... .......... .......... 18% 42.5M 2s 2024-03-09T14:41:46.891 INFO:teuthology.orchestra.run.smithi046.stderr: 17100K .......... .......... .......... .......... .......... 18% 42.6M 2s 2024-03-09T14:41:46.891 INFO:teuthology.orchestra.run.smithi046.stderr: 17150K .......... .......... .......... .......... .......... 18% 92.1M 2s 2024-03-09T14:41:46.893 INFO:teuthology.orchestra.run.smithi046.stderr: 17200K .......... .......... .......... .......... .......... 18% 40.3M 2s 2024-03-09T14:41:46.893 INFO:teuthology.orchestra.run.smithi046.stderr: 17250K .......... .......... .......... .......... .......... 18% 95.1M 2s 2024-03-09T14:41:46.893 INFO:teuthology.orchestra.run.smithi046.stderr: 17300K .......... .......... .......... .......... .......... 18% 45.1M 2s 2024-03-09T14:41:46.895 INFO:teuthology.orchestra.run.smithi046.stderr: 17350K .......... .......... .......... .......... .......... 18% 45.1M 2s 2024-03-09T14:41:46.896 INFO:teuthology.orchestra.run.smithi046.stderr: 17400K .......... .......... .......... .......... .......... 18% 46.2M 2s 2024-03-09T14:41:46.896 INFO:teuthology.orchestra.run.smithi046.stderr: 17450K .......... .......... .......... .......... .......... 18% 94.6M 2s 2024-03-09T14:41:46.897 INFO:teuthology.orchestra.run.smithi046.stderr: 17500K .......... .......... .......... .......... .......... 18% 44.9M 2s 2024-03-09T14:41:46.899 INFO:teuthology.orchestra.run.smithi046.stderr: 17550K .......... .......... .......... .......... .......... 18% 47.5M 2s 2024-03-09T14:41:46.900 INFO:teuthology.orchestra.run.smithi046.stderr: 17600K .......... .......... .......... .......... .......... 18% 35.8M 2s 2024-03-09T14:41:46.900 INFO:teuthology.orchestra.run.smithi046.stderr: 17650K .......... .......... .......... .......... .......... 19% 118M 2s 2024-03-09T14:41:46.901 INFO:teuthology.orchestra.run.smithi046.stderr: 17700K .......... .......... .......... .......... .......... 19% 28.8M 2s 2024-03-09T14:41:46.905 INFO:teuthology.orchestra.run.smithi046.stderr: 17750K .......... .......... .......... .......... .......... 19% 45.1M 2s 2024-03-09T14:41:46.908 INFO:teuthology.orchestra.run.smithi046.stderr: 17800K .......... .......... .......... .......... .......... 19% 26.8M 2s 2024-03-09T14:41:46.908 INFO:teuthology.orchestra.run.smithi046.stderr: 17850K .......... .......... .......... .......... .......... 19% 48.5M 2s 2024-03-09T14:41:46.908 INFO:teuthology.orchestra.run.smithi046.stderr: 17900K .......... .......... .......... .......... .......... 19% 45.6M 2s 2024-03-09T14:41:46.910 INFO:teuthology.orchestra.run.smithi046.stderr: 17950K .......... .......... .......... .......... .......... 19% 23.7M 2s 2024-03-09T14:41:46.910 INFO:teuthology.orchestra.run.smithi046.stderr: 18000K .......... .......... .......... .......... .......... 19% 40.6M 2s 2024-03-09T14:41:46.914 INFO:teuthology.orchestra.run.smithi046.stderr: 18050K .......... .......... .......... .......... .......... 19% 13.5M 2s 2024-03-09T14:41:46.914 INFO:teuthology.orchestra.run.smithi046.stderr: 18100K .......... .......... .......... .......... .......... 19% 117M 2s 2024-03-09T14:41:46.916 INFO:teuthology.orchestra.run.smithi046.stderr: 18150K .......... .......... .......... .......... .......... 19% 26.3M 2s 2024-03-09T14:41:46.917 INFO:teuthology.orchestra.run.smithi046.stderr: 18200K .......... .......... .......... .......... .......... 19% 37.6M 2s 2024-03-09T14:41:46.919 INFO:teuthology.orchestra.run.smithi046.stderr: 18250K .......... .......... .......... .......... .......... 19% 18.7M 2s 2024-03-09T14:41:46.922 INFO:teuthology.orchestra.run.smithi046.stderr: 18300K .......... .......... .......... .......... .......... 19% 31.1M 2s 2024-03-09T14:41:46.922 INFO:teuthology.orchestra.run.smithi046.stderr: 18350K .......... .......... .......... .......... .......... 19% 144M 2s 2024-03-09T14:41:46.923 INFO:teuthology.orchestra.run.smithi046.stderr: 18400K .......... .......... .......... .......... .......... 19% 38.2M 2s 2024-03-09T14:41:46.926 INFO:teuthology.orchestra.run.smithi046.stderr: 18450K .......... .......... .......... .......... .......... 19% 16.7M 2s 2024-03-09T14:41:46.927 INFO:teuthology.orchestra.run.smithi046.stderr: 18500K .......... .......... .......... .......... .......... 19% 28.8M 2s 2024-03-09T14:41:46.929 INFO:teuthology.orchestra.run.smithi046.stderr: 18550K .......... .......... .......... .......... .......... 20% 48.0M 2s 2024-03-09T14:41:46.929 INFO:teuthology.orchestra.run.smithi046.stderr: 18600K .......... .......... .......... .......... .......... 20% 113M 2s 2024-03-09T14:41:46.931 INFO:teuthology.orchestra.run.smithi046.stderr: 18650K .......... .......... .......... .......... .......... 20% 16.3M 2s 2024-03-09T14:41:47.003 INFO:teuthology.orchestra.run.smithi046.stderr: 18700K .......... .......... .......... .......... .......... 20% 761K 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 18750K .......... .......... .......... .......... .......... 20% 106M 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 18800K .......... .......... .......... .......... .......... 20% 286M 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 18850K .......... .......... .......... .......... .......... 20% 37.0M 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 18900K .......... .......... .......... .......... .......... 20% 360M 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 18950K .......... .......... .......... .......... .......... 20% 203M 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 19000K .......... .......... .......... .......... .......... 20% 357M 2s 2024-03-09T14:41:47.004 INFO:teuthology.orchestra.run.smithi046.stderr: 19050K .......... .......... .......... .......... .......... 20% 16.7M 2s 2024-03-09T14:41:47.005 INFO:teuthology.orchestra.run.smithi046.stderr: 19100K .......... .......... .......... .......... .......... 20% 19.9M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19150K .......... .......... .......... .......... .......... 20% 21.7M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19200K .......... .......... .......... .......... .......... 20% 309M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19250K .......... .......... .......... .......... .......... 20% 383M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19300K .......... .......... .......... .......... .......... 20% 407M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19350K .......... .......... .......... .......... .......... 20% 377M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19400K .......... .......... .......... .......... .......... 20% 347M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19450K .......... .......... .......... .......... .......... 20% 282M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19500K .......... .......... .......... .......... .......... 21% 338M 2s 2024-03-09T14:41:47.018 INFO:teuthology.orchestra.run.smithi046.stderr: 19550K .......... .......... .......... .......... .......... 21% 334M 2s 2024-03-09T14:41:47.019 INFO:teuthology.orchestra.run.smithi046.stderr: 19600K .......... .......... .......... .......... .......... 21% 317M 2s 2024-03-09T14:41:47.019 INFO:teuthology.orchestra.run.smithi046.stderr: 19650K .......... .......... .......... .......... .......... 21% 5.32M 2s 2024-03-09T14:41:47.109 INFO:teuthology.orchestra.run.smithi046.stderr: 19700K .......... .......... .......... .......... .......... 21% 74.2M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 19750K .......... .......... .......... .......... .......... 21% 331M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 19800K .......... .......... .......... .......... .......... 21% 327M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 19850K .......... .......... .......... .......... .......... 21% 51.1M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 19900K .......... .......... .......... .......... .......... 21% 70.6M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 19950K .......... .......... .......... .......... .......... 21% 358M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 20000K .......... .......... .......... .......... .......... 21% 56.2M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 20050K .......... .......... .......... .......... .......... 21% 393M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 20100K .......... .......... .......... .......... .......... 21% 84.5M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 20150K .......... .......... .......... .......... .......... 21% 55.8M 2s 2024-03-09T14:41:47.110 INFO:teuthology.orchestra.run.smithi046.stderr: 20200K .......... .......... .......... .......... .......... 21% 358M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20250K .......... .......... .......... .......... .......... 21% 393M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20300K .......... .......... .......... .......... .......... 21% 109M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20350K .......... .......... .......... .......... .......... 21% 43.4M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20400K .......... .......... .......... .......... .......... 22% 123M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20450K .......... .......... .......... .......... .......... 22% 351M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20500K .......... .......... .......... .......... .......... 22% 408M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20550K .......... .......... .......... .......... .......... 22% 416M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20600K .......... .......... .......... .......... .......... 22% 372M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20650K .......... .......... .......... .......... .......... 22% 348M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20700K .......... .......... .......... .......... .......... 22% 371M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20750K .......... .......... .......... .......... .......... 22% 379M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20800K .......... .......... .......... .......... .......... 22% 249M 2s 2024-03-09T14:41:47.111 INFO:teuthology.orchestra.run.smithi046.stderr: 20850K .......... .......... .......... .......... .......... 22% 418M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 20900K .......... .......... .......... .......... .......... 22% 402M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 20950K .......... .......... .......... .......... .......... 22% 380M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21000K .......... .......... .......... .......... .......... 22% 274M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21050K .......... .......... .......... .......... .......... 22% 356M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21100K .......... .......... .......... .......... .......... 22% 351M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21150K .......... .......... .......... .......... .......... 22% 336M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21200K .......... .......... .......... .......... .......... 22% 339M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21250K .......... .......... .......... .......... .......... 22% 390M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21300K .......... .......... .......... .......... .......... 22% 416M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21350K .......... .......... .......... .......... .......... 23% 390M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21400K .......... .......... .......... .......... .......... 23% 368M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21450K .......... .......... .......... .......... .......... 23% 409M 2s 2024-03-09T14:41:47.112 INFO:teuthology.orchestra.run.smithi046.stderr: 21500K .......... .......... .......... .......... .......... 23% 2.49M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21550K .......... .......... .......... .......... .......... 23% 338M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21600K .......... .......... .......... .......... .......... 23% 293M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21650K .......... .......... .......... .......... .......... 23% 396M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21700K .......... .......... .......... .......... .......... 23% 410M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21750K .......... .......... .......... .......... .......... 23% 335M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21800K .......... .......... .......... .......... .......... 23% 370M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21850K .......... .......... .......... .......... .......... 23% 412M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21900K .......... .......... .......... .......... .......... 23% 351M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 21950K .......... .......... .......... .......... .......... 23% 402M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 22000K .......... .......... .......... .......... .......... 23% 319M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 22050K .......... .......... .......... .......... .......... 23% 416M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 22100K .......... .......... .......... .......... .......... 23% 401M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 22150K .......... .......... .......... .......... .......... 23% 412M 2s 2024-03-09T14:41:47.113 INFO:teuthology.orchestra.run.smithi046.stderr: 22200K .......... .......... .......... .......... .......... 23% 380M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22250K .......... .......... .......... .......... .......... 24% 398M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22300K .......... .......... .......... .......... .......... 24% 408M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22350K .......... .......... .......... .......... .......... 24% 410M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22400K .......... .......... .......... .......... .......... 24% 328M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22450K .......... .......... .......... .......... .......... 24% 398M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22500K .......... .......... .......... .......... .......... 24% 378M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22550K .......... .......... .......... .......... .......... 24% 384M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22600K .......... .......... .......... .......... .......... 24% 326M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22650K .......... .......... .......... .......... .......... 24% 393M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22700K .......... .......... .......... .......... .......... 24% 72.4M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22750K .......... .......... .......... .......... .......... 24% 48.3M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22800K .......... .......... .......... .......... .......... 24% 42.0M 2s 2024-03-09T14:41:47.114 INFO:teuthology.orchestra.run.smithi046.stderr: 22850K .......... .......... .......... .......... .......... 24% 48.4M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 22900K .......... .......... .......... .......... .......... 24% 52.2M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 22950K .......... .......... .......... .......... .......... 24% 34.3M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23000K .......... .......... .......... .......... .......... 24% 46.7M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23050K .......... .......... .......... .......... .......... 24% 41.8M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23100K .......... .......... .......... .......... .......... 24% 77.5M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23150K .......... .......... .......... .......... .......... 24% 54.8M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23200K .......... .......... .......... .......... .......... 25% 51.5M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23250K .......... .......... .......... .......... .......... 25% 77.5M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23300K .......... .......... .......... .......... .......... 25% 49.9M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23350K .......... .......... .......... .......... .......... 25% 110M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23400K .......... .......... .......... .......... .......... 25% 30.4M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23450K .......... .......... .......... .......... .......... 25% 107M 2s 2024-03-09T14:41:47.115 INFO:teuthology.orchestra.run.smithi046.stderr: 23500K .......... .......... .......... .......... .......... 25% 54.2M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23550K .......... .......... .......... .......... .......... 25% 50.3M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23600K .......... .......... .......... .......... .......... 25% 36.6M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23650K .......... .......... .......... .......... .......... 25% 51.0M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23700K .......... .......... .......... .......... .......... 25% 29.8M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23750K .......... .......... .......... .......... .......... 25% 118M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23800K .......... .......... .......... .......... .......... 25% 27.9M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23850K .......... .......... .......... .......... .......... 25% 23.4M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23900K .......... .......... .......... .......... .......... 25% 66.8M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 23950K .......... .......... .......... .......... .......... 25% 116M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 24000K .......... .......... .......... .......... .......... 25% 55.6M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 24050K .......... .......... .......... .......... .......... 25% 56.5M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 24100K .......... .......... .......... .......... .......... 25% 65.7M 2s 2024-03-09T14:41:47.116 INFO:teuthology.orchestra.run.smithi046.stderr: 24150K .......... .......... .......... .......... .......... 26% 68.1M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24200K .......... .......... .......... .......... .......... 26% 113M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24250K .......... .......... .......... .......... .......... 26% 56.7M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24300K .......... .......... .......... .......... .......... 26% 38.5M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24350K .......... .......... .......... .......... .......... 26% 30.7M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24400K .......... .......... .......... .......... .......... 26% 24.8M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24450K .......... .......... .......... .......... .......... 26% 116M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24500K .......... .......... .......... .......... .......... 26% 46.7M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24550K .......... .......... .......... .......... .......... 26% 42.3M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24600K .......... .......... .......... .......... .......... 26% 28.7M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24650K .......... .......... .......... .......... .......... 26% 104M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24700K .......... .......... .......... .......... .......... 26% 63.0M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24750K .......... .......... .......... .......... .......... 26% 31.1M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24800K .......... .......... .......... .......... .......... 26% 29.9M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24850K .......... .......... .......... .......... .......... 26% 38.2M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24900K .......... .......... .......... .......... .......... 26% 117M 2s 2024-03-09T14:41:47.117 INFO:teuthology.orchestra.run.smithi046.stderr: 24950K .......... .......... .......... .......... .......... 26% 30.4M 2s 2024-03-09T14:41:47.118 INFO:teuthology.orchestra.run.smithi046.stderr: 25000K .......... .......... .......... .......... .......... 26% 25.7M 2s 2024-03-09T14:41:47.118 INFO:teuthology.orchestra.run.smithi046.stderr: 25050K .......... .......... .......... .......... .......... 27% 24.5M 2s 2024-03-09T14:41:47.118 INFO:teuthology.orchestra.run.smithi046.stderr: 25100K .......... .......... .......... .......... .......... 27% 49.1M 2s 2024-03-09T14:41:47.118 INFO:teuthology.orchestra.run.smithi046.stderr: 25150K .......... .......... .......... .......... .......... 27% 32.3M 2s 2024-03-09T14:41:47.118 INFO:teuthology.orchestra.run.smithi046.stderr: 25200K .......... .......... .......... .......... .......... 27% 51.1M 2s 2024-03-09T14:41:47.118 INFO:teuthology.orchestra.run.smithi046.stderr: 25250K .......... .......... .......... .......... .......... 27% 33.6M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25300K .......... .......... .......... .......... .......... 27% 36.7M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25350K .......... .......... .......... .......... .......... 27% 116M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25400K .......... .......... .......... .......... .......... 27% 29.4M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25450K .......... .......... .......... .......... .......... 27% 43.8M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25500K .......... .......... .......... .......... .......... 27% 22.1M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25550K .......... .......... .......... .......... .......... 27% 99.1M 2s 2024-03-09T14:41:47.125 INFO:teuthology.orchestra.run.smithi046.stderr: 25600K .......... .......... .......... .......... .......... 27% 21.9M 2s 2024-03-09T14:41:47.126 INFO:teuthology.orchestra.run.smithi046.stderr: 25650K .......... .......... .......... .......... .......... 27% 22.1M 2s 2024-03-09T14:41:47.126 INFO:teuthology.orchestra.run.smithi046.stderr: 25700K .......... .......... .......... .......... .......... 27% 20.1M 2s 2024-03-09T14:41:47.126 INFO:teuthology.orchestra.run.smithi046.stderr: 25750K .......... .......... .......... .......... .......... 27% 27.8M 2s 2024-03-09T14:41:47.126 INFO:teuthology.orchestra.run.smithi046.stderr: 25800K .......... .......... .......... .......... .......... 27% 66.3M 2s 2024-03-09T14:41:47.127 INFO:teuthology.orchestra.run.smithi046.stderr: 25850K .......... .......... .......... .......... .......... 27% 22.2M 2s 2024-03-09T14:41:47.128 INFO:teuthology.orchestra.run.smithi046.stderr: 25900K .......... .......... .......... .......... .......... 27% 26.6M 2s 2024-03-09T14:41:47.131 INFO:teuthology.orchestra.run.smithi046.stderr: 25950K .......... .......... .......... .......... .......... 27% 19.6M 2s 2024-03-09T14:41:47.133 INFO:teuthology.orchestra.run.smithi046.stderr: 26000K .......... .......... .......... .......... .......... 28% 22.2M 2s 2024-03-09T14:41:47.133 INFO:teuthology.orchestra.run.smithi046.stderr: 26050K .......... .......... .......... .......... .......... 28% 50.0M 2s 2024-03-09T14:41:47.135 INFO:teuthology.orchestra.run.smithi046.stderr: 26100K .......... .......... .......... .......... .......... 28% 28.4M 2s 2024-03-09T14:41:47.138 INFO:teuthology.orchestra.run.smithi046.stderr: 26150K .......... .......... .......... .......... .......... 28% 21.0M 2s 2024-03-09T14:41:47.141 INFO:teuthology.orchestra.run.smithi046.stderr: 26200K .......... .......... .......... .......... .......... 28% 16.2M 2s 2024-03-09T14:41:47.141 INFO:teuthology.orchestra.run.smithi046.stderr: 26250K .......... .......... .......... .......... .......... 28% 68.0M 2s 2024-03-09T14:41:47.144 INFO:teuthology.orchestra.run.smithi046.stderr: 26300K .......... .......... .......... .......... .......... 28% 14.9M 2s 2024-03-09T14:41:47.148 INFO:teuthology.orchestra.run.smithi046.stderr: 26350K .......... .......... .......... .......... .......... 28% 16.4M 2s 2024-03-09T14:41:47.149 INFO:teuthology.orchestra.run.smithi046.stderr: 26400K .......... .......... .......... .......... .......... 28% 26.2M 2s 2024-03-09T14:41:47.152 INFO:teuthology.orchestra.run.smithi046.stderr: 26450K .......... .......... .......... .......... .......... 28% 19.6M 2s 2024-03-09T14:41:47.155 INFO:teuthology.orchestra.run.smithi046.stderr: 26500K .......... .......... .......... .......... .......... 28% 20.8M 2s 2024-03-09T14:41:47.155 INFO:teuthology.orchestra.run.smithi046.stderr: 26550K .......... .......... .......... .......... .......... 28% 144M 2s 2024-03-09T14:41:47.157 INFO:teuthology.orchestra.run.smithi046.stderr: 26600K .......... .......... .......... .......... .......... 28% 25.0M 2s 2024-03-09T14:41:47.159 INFO:teuthology.orchestra.run.smithi046.stderr: 26650K .......... .......... .......... .......... .......... 28% 29.1M 2s 2024-03-09T14:41:47.162 INFO:teuthology.orchestra.run.smithi046.stderr: 26700K .......... .......... .......... .......... .......... 28% 14.3M 2s 2024-03-09T14:41:47.163 INFO:teuthology.orchestra.run.smithi046.stderr: 26750K .......... .......... .......... .......... .......... 28% 59.8M 2s 2024-03-09T14:41:47.166 INFO:teuthology.orchestra.run.smithi046.stderr: 26800K .......... .......... .......... .......... .......... 28% 14.5M 2s 2024-03-09T14:41:47.167 INFO:teuthology.orchestra.run.smithi046.stderr: 26850K .......... .......... .......... .......... .......... 28% 55.3M 2s 2024-03-09T14:41:47.170 INFO:teuthology.orchestra.run.smithi046.stderr: 26900K .......... .......... .......... .......... .......... 29% 13.6M 2s 2024-03-09T14:41:47.173 INFO:teuthology.orchestra.run.smithi046.stderr: 26950K .......... .......... .......... .......... .......... 29% 26.7M 2s 2024-03-09T14:41:47.175 INFO:teuthology.orchestra.run.smithi046.stderr: 27000K .......... .......... .......... .......... .......... 29% 23.6M 2s 2024-03-09T14:41:47.175 INFO:teuthology.orchestra.run.smithi046.stderr: 27050K .......... .......... .......... .......... .......... 29% 74.8M 2s 2024-03-09T14:41:47.177 INFO:teuthology.orchestra.run.smithi046.stderr: 27100K .......... .......... .......... .......... .......... 29% 20.7M 2s 2024-03-09T14:41:47.179 INFO:teuthology.orchestra.run.smithi046.stderr: 27150K .......... .......... .......... .......... .......... 29% 24.8M 2s 2024-03-09T14:41:47.184 INFO:teuthology.orchestra.run.smithi046.stderr: 27200K .......... .......... .......... .......... .......... 29% 10.9M 2s 2024-03-09T14:41:47.185 INFO:teuthology.orchestra.run.smithi046.stderr: 27250K .......... .......... .......... .......... .......... 29% 31.9M 2s 2024-03-09T14:41:47.188 INFO:teuthology.orchestra.run.smithi046.stderr: 27300K .......... .......... .......... .......... .......... 29% 16.9M 2s 2024-03-09T14:41:47.189 INFO:teuthology.orchestra.run.smithi046.stderr: 27350K .......... .......... .......... .......... .......... 29% 78.9M 2s 2024-03-09T14:41:47.192 INFO:teuthology.orchestra.run.smithi046.stderr: 27400K .......... .......... .......... .......... .......... 29% 15.8M 2s 2024-03-09T14:41:47.196 INFO:teuthology.orchestra.run.smithi046.stderr: 27450K .......... .......... .......... .......... .......... 29% 12.8M 2s 2024-03-09T14:41:47.198 INFO:teuthology.orchestra.run.smithi046.stderr: 27500K .......... .......... .......... .......... .......... 29% 15.9M 2s 2024-03-09T14:41:47.203 INFO:teuthology.orchestra.run.smithi046.stderr: 27550K .......... .......... .......... .......... .......... 29% 24.1M 2s 2024-03-09T14:41:47.205 INFO:teuthology.orchestra.run.smithi046.stderr: 27600K .......... .......... .......... .......... .......... 29% 12.2M 2s 2024-03-09T14:41:47.207 INFO:teuthology.orchestra.run.smithi046.stderr: 27650K .......... .......... .......... .......... .......... 29% 20.1M 2s 2024-03-09T14:41:47.210 INFO:teuthology.orchestra.run.smithi046.stderr: 27700K .......... .......... .......... .......... .......... 29% 19.7M 2s 2024-03-09T14:41:47.214 INFO:teuthology.orchestra.run.smithi046.stderr: 27750K .......... .......... .......... .......... .......... 29% 15.1M 2s 2024-03-09T14:41:47.214 INFO:teuthology.orchestra.run.smithi046.stderr: 27800K .......... .......... .......... .......... .......... 29% 63.4M 2s 2024-03-09T14:41:47.216 INFO:teuthology.orchestra.run.smithi046.stderr: 27850K .......... .......... .......... .......... .......... 30% 19.6M 2s 2024-03-09T14:41:47.218 INFO:teuthology.orchestra.run.smithi046.stderr: 27900K .......... .......... .......... .......... .......... 30% 34.2M 2s 2024-03-09T14:41:47.222 INFO:teuthology.orchestra.run.smithi046.stderr: 27950K .......... .......... .......... .......... .......... 30% 11.8M 2s 2024-03-09T14:41:47.224 INFO:teuthology.orchestra.run.smithi046.stderr: 28000K .......... .......... .......... .......... .......... 30% 23.5M 2s 2024-03-09T14:41:47.226 INFO:teuthology.orchestra.run.smithi046.stderr: 28050K .......... .......... .......... .......... .......... 30% 26.0M 2s 2024-03-09T14:41:47.292 INFO:teuthology.orchestra.run.smithi046.stderr: 28100K .......... .......... .......... .......... .......... 30% 792K 2s 2024-03-09T14:41:47.293 INFO:teuthology.orchestra.run.smithi046.stderr: 28150K .......... .......... .......... .......... .......... 30% 331M 2s 2024-03-09T14:41:47.293 INFO:teuthology.orchestra.run.smithi046.stderr: 28200K .......... .......... .......... .......... .......... 30% 354M 2s 2024-03-09T14:41:47.293 INFO:teuthology.orchestra.run.smithi046.stderr: 28250K .......... .......... .......... .......... .......... 30% 416M 2s 2024-03-09T14:41:47.293 INFO:teuthology.orchestra.run.smithi046.stderr: 28300K .......... .......... .......... .......... .......... 30% 386M 2s 2024-03-09T14:41:47.296 INFO:teuthology.orchestra.run.smithi046.stderr: 28350K .......... .......... .......... .......... .......... 30% 11.4M 2s 2024-03-09T14:41:47.296 INFO:teuthology.orchestra.run.smithi046.stderr: 28400K .......... .......... .......... .......... .......... 30% 300M 2s 2024-03-09T14:41:47.297 INFO:teuthology.orchestra.run.smithi046.stderr: 28450K .......... .......... .......... .......... .......... 30% 383M 2s 2024-03-09T14:41:47.304 INFO:teuthology.orchestra.run.smithi046.stderr: 28500K .......... .......... .......... .......... .......... 30% 8.73M 2s 2024-03-09T14:41:47.304 INFO:teuthology.orchestra.run.smithi046.stderr: 28550K .......... .......... .......... .......... .......... 30% 257M 2s 2024-03-09T14:41:47.304 INFO:teuthology.orchestra.run.smithi046.stderr: 28600K .......... .......... .......... .......... .......... 30% 346M 2s 2024-03-09T14:41:47.304 INFO:teuthology.orchestra.run.smithi046.stderr: 28650K .......... .......... .......... .......... .......... 30% 420M 2s 2024-03-09T14:41:47.304 INFO:teuthology.orchestra.run.smithi046.stderr: 28700K .......... .......... .......... .......... .......... 30% 398M 2s 2024-03-09T14:41:47.305 INFO:teuthology.orchestra.run.smithi046.stderr: 28750K .......... .......... .......... .......... .......... 31% 386M 2s 2024-03-09T14:41:47.308 INFO:teuthology.orchestra.run.smithi046.stderr: 28800K .......... .......... .......... .......... .......... 31% 6.03M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 28850K .......... .......... .......... .......... .......... 31% 67.1M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 28900K .......... .......... .......... .......... .......... 31% 85.1M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 28950K .......... .......... .......... .......... .......... 31% 358M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 29000K .......... .......... .......... .......... .......... 31% 363M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 29050K .......... .......... .......... .......... .......... 31% 375M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 29100K .......... .......... .......... .......... .......... 31% 401M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 29150K .......... .......... .......... .......... .......... 31% 406M 2s 2024-03-09T14:41:47.342 INFO:teuthology.orchestra.run.smithi046.stderr: 29200K .......... .......... .......... .......... .......... 31% 334M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29250K .......... .......... .......... .......... .......... 31% 395M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29300K .......... .......... .......... .......... .......... 31% 356M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29350K .......... .......... .......... .......... .......... 31% 367M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29400K .......... .......... .......... .......... .......... 31% 338M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29450K .......... .......... .......... .......... .......... 31% 421M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29500K .......... .......... .......... .......... .......... 31% 394M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29550K .......... .......... .......... .......... .......... 31% 404M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29600K .......... .......... .......... .......... .......... 31% 325M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29650K .......... .......... .......... .......... .......... 31% 405M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29700K .......... .......... .......... .......... .......... 32% 359M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29750K .......... .......... .......... .......... .......... 32% 377M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29800K .......... .......... .......... .......... .......... 32% 337M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29850K .......... .......... .......... .......... .......... 32% 404M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29900K .......... .......... .......... .......... .......... 32% 412M 2s 2024-03-09T14:41:47.343 INFO:teuthology.orchestra.run.smithi046.stderr: 29950K .......... .......... .......... .......... .......... 32% 66.3M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30000K .......... .......... .......... .......... .......... 32% 25.1M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30050K .......... .......... .......... .......... .......... 32% 57.5M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30100K .......... .......... .......... .......... .......... 32% 35.3M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30150K .......... .......... .......... .......... .......... 32% 28.6M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30200K .......... .......... .......... .......... .......... 32% 30.2M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30250K .......... .......... .......... .......... .......... 32% 53.9M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30300K .......... .......... .......... .......... .......... 32% 35.3M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30350K .......... .......... .......... .......... .......... 32% 32.0M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30400K .......... .......... .......... .......... .......... 32% 20.2M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30450K .......... .......... .......... .......... .......... 32% 22.9M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30500K .......... .......... .......... .......... .......... 32% 35.2M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30550K .......... .......... .......... .......... .......... 32% 17.5M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30600K .......... .......... .......... .......... .......... 32% 21.7M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30650K .......... .......... .......... .......... .......... 33% 16.0M 2s 2024-03-09T14:41:47.344 INFO:teuthology.orchestra.run.smithi046.stderr: 30700K .......... .......... .......... .......... .......... 33% 40.0M 2s 2024-03-09T14:41:47.345 INFO:teuthology.orchestra.run.smithi046.stderr: 30750K .......... .......... .......... .......... .......... 33% 39.1M 2s 2024-03-09T14:41:47.348 INFO:teuthology.orchestra.run.smithi046.stderr: 30800K .......... .......... .......... .......... .......... 33% 26.9M 2s 2024-03-09T14:41:47.348 INFO:teuthology.orchestra.run.smithi046.stderr: 30850K .......... .......... .......... .......... .......... 33% 29.5M 2s 2024-03-09T14:41:47.348 INFO:teuthology.orchestra.run.smithi046.stderr: 30900K .......... .......... .......... .......... .......... 33% 51.4M 2s 2024-03-09T14:41:47.348 INFO:teuthology.orchestra.run.smithi046.stderr: 30950K .......... .......... .......... .......... .......... 33% 47.6M 2s 2024-03-09T14:41:47.350 INFO:teuthology.orchestra.run.smithi046.stderr: 31000K .......... .......... .......... .......... .......... 33% 16.2M 2s 2024-03-09T14:41:47.350 INFO:teuthology.orchestra.run.smithi046.stderr: 31050K .......... .......... .......... .......... .......... 33% 110M 2s 2024-03-09T14:41:47.352 INFO:teuthology.orchestra.run.smithi046.stderr: 31100K .......... .......... .......... .......... .......... 33% 29.9M 2s 2024-03-09T14:41:47.353 INFO:teuthology.orchestra.run.smithi046.stderr: 31150K .......... .......... .......... .......... .......... 33% 73.7M 2s 2024-03-09T14:41:47.353 INFO:teuthology.orchestra.run.smithi046.stderr: 31200K .......... .......... .......... .......... .......... 33% 39.6M 2s 2024-03-09T14:41:47.354 INFO:teuthology.orchestra.run.smithi046.stderr: 31250K .......... .......... .......... .......... .......... 33% 37.7M 2s 2024-03-09T14:41:47.355 INFO:teuthology.orchestra.run.smithi046.stderr: 31300K .......... .......... .......... .......... .......... 33% 44.7M 2s 2024-03-09T14:41:47.358 INFO:teuthology.orchestra.run.smithi046.stderr: 31350K .......... .......... .......... .......... .......... 33% 23.2M 2s 2024-03-09T14:41:47.359 INFO:teuthology.orchestra.run.smithi046.stderr: 31400K .......... .......... .......... .......... .......... 33% 27.0M 2s 2024-03-09T14:41:47.362 INFO:teuthology.orchestra.run.smithi046.stderr: 31450K .......... .......... .......... .......... .......... 33% 19.2M 2s 2024-03-09T14:41:47.366 INFO:teuthology.orchestra.run.smithi046.stderr: 31500K .......... .......... .......... .......... .......... 33% 12.6M 2s 2024-03-09T14:41:47.371 INFO:teuthology.orchestra.run.smithi046.stderr: 31550K .......... .......... .......... .......... .......... 34% 20.6M 2s 2024-03-09T14:41:47.371 INFO:teuthology.orchestra.run.smithi046.stderr: 31600K .......... .......... .......... .......... .......... 34% 26.8M 2s 2024-03-09T14:41:47.376 INFO:teuthology.orchestra.run.smithi046.stderr: 31650K .......... .......... .......... .......... .......... 34% 22.2M 2s 2024-03-09T14:41:47.376 INFO:teuthology.orchestra.run.smithi046.stderr: 31700K .......... .......... .......... .......... .......... 34% 26.9M 2s 2024-03-09T14:41:47.376 INFO:teuthology.orchestra.run.smithi046.stderr: 31750K .......... .......... .......... .......... .......... 34% 52.6M 2s 2024-03-09T14:41:47.377 INFO:teuthology.orchestra.run.smithi046.stderr: 31800K .......... .......... .......... .......... .......... 34% 27.1M 2s 2024-03-09T14:41:47.389 INFO:teuthology.orchestra.run.smithi046.stderr: 31850K .......... .......... .......... .......... .......... 34% 18.2M 2s 2024-03-09T14:41:47.389 INFO:teuthology.orchestra.run.smithi046.stderr: 31900K .......... .......... .......... .......... .......... 34% 92.9M 2s 2024-03-09T14:41:47.389 INFO:teuthology.orchestra.run.smithi046.stderr: 31950K .......... .......... .......... .......... .......... 34% 39.7M 2s 2024-03-09T14:41:47.389 INFO:teuthology.orchestra.run.smithi046.stderr: 32000K .......... .......... .......... .......... .......... 34% 17.7M 2s 2024-03-09T14:41:47.389 INFO:teuthology.orchestra.run.smithi046.stderr: 32050K .......... .......... .......... .......... .......... 34% 42.1M 2s 2024-03-09T14:41:47.389 INFO:teuthology.orchestra.run.smithi046.stderr: 32100K .......... .......... .......... .......... .......... 34% 29.7M 2s 2024-03-09T14:41:47.390 INFO:teuthology.orchestra.run.smithi046.stderr: 32150K .......... .......... .......... .......... .......... 34% 34.4M 2s 2024-03-09T14:41:47.392 INFO:teuthology.orchestra.run.smithi046.stderr: 32200K .......... .......... .......... .......... .......... 34% 36.2M 2s 2024-03-09T14:41:47.393 INFO:teuthology.orchestra.run.smithi046.stderr: 32250K .......... .......... .......... .......... .......... 34% 23.5M 2s 2024-03-09T14:41:47.395 INFO:teuthology.orchestra.run.smithi046.stderr: 32300K .......... .......... .......... .......... .......... 34% 13.4M 2s 2024-03-09T14:41:47.399 INFO:teuthology.orchestra.run.smithi046.stderr: 32350K .......... .......... .......... .......... .......... 34% 21.5M 2s 2024-03-09T14:41:47.403 INFO:teuthology.orchestra.run.smithi046.stderr: 32400K .......... .......... .......... .......... .......... 34% 9.22M 2s 2024-03-09T14:41:47.406 INFO:teuthology.orchestra.run.smithi046.stderr: 32450K .......... .......... .......... .......... .......... 34% 19.4M 2s 2024-03-09T14:41:47.407 INFO:teuthology.orchestra.run.smithi046.stderr: 32500K .......... .......... .......... .......... .......... 35% 24.0M 2s 2024-03-09T14:41:47.411 INFO:teuthology.orchestra.run.smithi046.stderr: 32550K .......... .......... .......... .......... .......... 35% 18.0M 2s 2024-03-09T14:41:47.414 INFO:teuthology.orchestra.run.smithi046.stderr: 32600K .......... .......... .......... .......... .......... 35% 22.8M 2s 2024-03-09T14:41:47.415 INFO:teuthology.orchestra.run.smithi046.stderr: 32650K .......... .......... .......... .......... .......... 35% 22.0M 2s 2024-03-09T14:41:47.417 INFO:teuthology.orchestra.run.smithi046.stderr: 32700K .......... .......... .......... .......... .......... 35% 33.5M 2s 2024-03-09T14:41:47.419 INFO:teuthology.orchestra.run.smithi046.stderr: 32750K .......... .......... .......... .......... .......... 35% 16.1M 2s 2024-03-09T14:41:47.422 INFO:teuthology.orchestra.run.smithi046.stderr: 32800K .......... .......... .......... .......... .......... 35% 17.1M 2s 2024-03-09T14:41:47.424 INFO:teuthology.orchestra.run.smithi046.stderr: 32850K .......... .......... .......... .......... .......... 35% 26.2M 2s 2024-03-09T14:41:47.426 INFO:teuthology.orchestra.run.smithi046.stderr: 32900K .......... .......... .......... .......... .......... 35% 26.6M 2s 2024-03-09T14:41:47.427 INFO:teuthology.orchestra.run.smithi046.stderr: 32950K .......... .......... .......... .......... .......... 35% 34.9M 2s 2024-03-09T14:41:47.429 INFO:teuthology.orchestra.run.smithi046.stderr: 33000K .......... .......... .......... .......... .......... 35% 21.5M 2s 2024-03-09T14:41:47.431 INFO:teuthology.orchestra.run.smithi046.stderr: 33050K .......... .......... .......... .......... .......... 35% 26.6M 2s 2024-03-09T14:41:47.435 INFO:teuthology.orchestra.run.smithi046.stderr: 33100K .......... .......... .......... .......... .......... 35% 14.7M 2s 2024-03-09T14:41:47.437 INFO:teuthology.orchestra.run.smithi046.stderr: 33150K .......... .......... .......... .......... .......... 35% 43.7M 2s 2024-03-09T14:41:47.440 INFO:teuthology.orchestra.run.smithi046.stderr: 33200K .......... .......... .......... .......... .......... 35% 10.0M 2s 2024-03-09T14:41:47.447 INFO:teuthology.orchestra.run.smithi046.stderr: 33250K .......... .......... .......... .......... .......... 35% 7.33M 2s 2024-03-09T14:41:47.451 INFO:teuthology.orchestra.run.smithi046.stderr: 33300K .......... .......... .......... .......... .......... 35% 16.2M 2s 2024-03-09T14:41:47.451 INFO:teuthology.orchestra.run.smithi046.stderr: 33350K .......... .......... .......... .......... .......... 35% 35.0M 2s 2024-03-09T14:41:47.453 INFO:teuthology.orchestra.run.smithi046.stderr: 33400K .......... .......... .......... .......... .......... 36% 34.4M 2s 2024-03-09T14:41:47.455 INFO:teuthology.orchestra.run.smithi046.stderr: 33450K .......... .......... .......... .......... .......... 36% 23.0M 2s 2024-03-09T14:41:47.456 INFO:teuthology.orchestra.run.smithi046.stderr: 33500K .......... .......... .......... .......... .......... 36% 34.9M 2s 2024-03-09T14:41:47.458 INFO:teuthology.orchestra.run.smithi046.stderr: 33550K .......... .......... .......... .......... .......... 36% 28.2M 2s 2024-03-09T14:41:47.463 INFO:teuthology.orchestra.run.smithi046.stderr: 33600K .......... .......... .......... .......... .......... 36% 12.6M 2s 2024-03-09T14:41:47.464 INFO:teuthology.orchestra.run.smithi046.stderr: 33650K .......... .......... .......... .......... .......... 36% 27.8M 2s 2024-03-09T14:41:47.465 INFO:teuthology.orchestra.run.smithi046.stderr: 33700K .......... .......... .......... .......... .......... 36% 34.3M 2s 2024-03-09T14:41:47.467 INFO:teuthology.orchestra.run.smithi046.stderr: 33750K .......... .......... .......... .......... .......... 36% 32.9M 2s 2024-03-09T14:41:47.469 INFO:teuthology.orchestra.run.smithi046.stderr: 33800K .......... .......... .......... .......... .......... 36% 24.7M 2s 2024-03-09T14:41:47.471 INFO:teuthology.orchestra.run.smithi046.stderr: 33850K .......... .......... .......... .......... .......... 36% 26.1M 2s 2024-03-09T14:41:47.472 INFO:teuthology.orchestra.run.smithi046.stderr: 33900K .......... .......... .......... .......... .......... 36% 32.8M 2s 2024-03-09T14:41:47.474 INFO:teuthology.orchestra.run.smithi046.stderr: 33950K .......... .......... .......... .......... .......... 36% 36.6M 2s 2024-03-09T14:41:47.477 INFO:teuthology.orchestra.run.smithi046.stderr: 34000K .......... .......... .......... .......... .......... 36% 18.4M 2s 2024-03-09T14:41:47.478 INFO:teuthology.orchestra.run.smithi046.stderr: 34050K .......... .......... .......... .......... .......... 36% 24.2M 2s 2024-03-09T14:41:47.483 INFO:teuthology.orchestra.run.smithi046.stderr: 34100K .......... .......... .......... .......... .......... 36% 9.91M 2s 2024-03-09T14:41:47.487 INFO:teuthology.orchestra.run.smithi046.stderr: 34150K .......... .......... .......... .......... .......... 36% 14.7M 2s 2024-03-09T14:41:47.489 INFO:teuthology.orchestra.run.smithi046.stderr: 34200K .......... .......... .......... .......... .......... 36% 29.3M 2s 2024-03-09T14:41:47.490 INFO:teuthology.orchestra.run.smithi046.stderr: 34250K .......... .......... .......... .......... .......... 36% 26.4M 2s 2024-03-09T14:41:47.491 INFO:teuthology.orchestra.run.smithi046.stderr: 34300K .......... .......... .......... .......... .......... 36% 24.6M 2s 2024-03-09T14:41:47.494 INFO:teuthology.orchestra.run.smithi046.stderr: 34350K .......... .......... .......... .......... .......... 37% 29.5M 2s 2024-03-09T14:41:47.497 INFO:teuthology.orchestra.run.smithi046.stderr: 34400K .......... .......... .......... .......... .......... 37% 14.6M 2s 2024-03-09T14:41:47.499 INFO:teuthology.orchestra.run.smithi046.stderr: 34450K .......... .......... .......... .......... .......... 37% 21.0M 2s 2024-03-09T14:41:47.501 INFO:teuthology.orchestra.run.smithi046.stderr: 34500K .......... .......... .......... .......... .......... 37% 18.8M 2s 2024-03-09T14:41:47.503 INFO:teuthology.orchestra.run.smithi046.stderr: 34550K .......... .......... .......... .......... .......... 37% 27.6M 2s 2024-03-09T14:41:47.505 INFO:teuthology.orchestra.run.smithi046.stderr: 34600K .......... .......... .......... .......... .......... 37% 32.6M 2s 2024-03-09T14:41:47.507 INFO:teuthology.orchestra.run.smithi046.stderr: 34650K .......... .......... .......... .......... .......... 37% 23.9M 2s 2024-03-09T14:41:47.508 INFO:teuthology.orchestra.run.smithi046.stderr: 34700K .......... .......... .......... .......... .......... 37% 32.1M 2s 2024-03-09T14:41:47.510 INFO:teuthology.orchestra.run.smithi046.stderr: 34750K .......... .......... .......... .......... .......... 37% 34.5M 2s 2024-03-09T14:41:47.511 INFO:teuthology.orchestra.run.smithi046.stderr: 34800K .......... .......... .......... .......... .......... 37% 30.1M 2s 2024-03-09T14:41:47.513 INFO:teuthology.orchestra.run.smithi046.stderr: 34850K .......... .......... .......... .......... .......... 37% 33.1M 2s 2024-03-09T14:41:47.519 INFO:teuthology.orchestra.run.smithi046.stderr: 34900K .......... .......... .......... .......... .......... 37% 22.8M 2s 2024-03-09T14:41:47.519 INFO:teuthology.orchestra.run.smithi046.stderr: 34950K .......... .......... .......... .......... .......... 37% 37.1M 2s 2024-03-09T14:41:47.519 INFO:teuthology.orchestra.run.smithi046.stderr: 35000K .......... .......... .......... .......... .......... 37% 33.6M 2s 2024-03-09T14:41:47.521 INFO:teuthology.orchestra.run.smithi046.stderr: 35050K .......... .......... .......... .......... .......... 37% 19.5M 2s 2024-03-09T14:41:47.522 INFO:teuthology.orchestra.run.smithi046.stderr: 35100K .......... .......... .......... .......... .......... 37% 39.9M 2s 2024-03-09T14:41:47.523 INFO:teuthology.orchestra.run.smithi046.stderr: 35150K .......... .......... .......... .......... .......... 37% 36.4M 2s 2024-03-09T14:41:47.525 INFO:teuthology.orchestra.run.smithi046.stderr: 35200K .......... .......... .......... .......... .......... 37% 28.2M 2s 2024-03-09T14:41:47.528 INFO:teuthology.orchestra.run.smithi046.stderr: 35250K .......... .......... .......... .......... .......... 37% 14.0M 2s 2024-03-09T14:41:47.530 INFO:teuthology.orchestra.run.smithi046.stderr: 35300K .......... .......... .......... .......... .......... 38% 24.9M 2s 2024-03-09T14:41:47.532 INFO:teuthology.orchestra.run.smithi046.stderr: 35350K .......... .......... .......... .......... .......... 38% 25.5M 2s 2024-03-09T14:41:47.534 INFO:teuthology.orchestra.run.smithi046.stderr: 35400K .......... .......... .......... .......... .......... 38% 34.4M 2s 2024-03-09T14:41:47.535 INFO:teuthology.orchestra.run.smithi046.stderr: 35450K .......... .......... .......... .......... .......... 38% 24.3M 2s 2024-03-09T14:41:47.536 INFO:teuthology.orchestra.run.smithi046.stderr: 35500K .......... .......... .......... .......... .......... 38% 43.1M 2s 2024-03-09T14:41:47.538 INFO:teuthology.orchestra.run.smithi046.stderr: 35550K .......... .......... .......... .......... .......... 38% 31.2M 2s 2024-03-09T14:41:47.540 INFO:teuthology.orchestra.run.smithi046.stderr: 35600K .......... .......... .......... .......... .......... 38% 23.7M 2s 2024-03-09T14:41:47.541 INFO:teuthology.orchestra.run.smithi046.stderr: 35650K .......... .......... .......... .......... .......... 38% 37.2M 2s 2024-03-09T14:41:47.543 INFO:teuthology.orchestra.run.smithi046.stderr: 35700K .......... .......... .......... .......... .......... 38% 32.3M 2s 2024-03-09T14:41:47.544 INFO:teuthology.orchestra.run.smithi046.stderr: 35750K .......... .......... .......... .......... .......... 38% 34.2M 2s 2024-03-09T14:41:47.546 INFO:teuthology.orchestra.run.smithi046.stderr: 35800K .......... .......... .......... .......... .......... 38% 23.4M 2s 2024-03-09T14:41:47.548 INFO:teuthology.orchestra.run.smithi046.stderr: 35850K .......... .......... .......... .......... .......... 38% 42.1M 2s 2024-03-09T14:41:47.549 INFO:teuthology.orchestra.run.smithi046.stderr: 35900K .......... .......... .......... .......... .......... 38% 32.9M 2s 2024-03-09T14:41:47.552 INFO:teuthology.orchestra.run.smithi046.stderr: 35950K .......... .......... .......... .......... .......... 38% 32.0M 2s 2024-03-09T14:41:47.553 INFO:teuthology.orchestra.run.smithi046.stderr: 36000K .......... .......... .......... .......... .......... 38% 17.2M 2s 2024-03-09T14:41:47.558 INFO:teuthology.orchestra.run.smithi046.stderr: 36050K .......... .......... .......... .......... .......... 38% 12.7M 2s 2024-03-09T14:41:47.558 INFO:teuthology.orchestra.run.smithi046.stderr: 36100K .......... .......... .......... .......... .......... 38% 47.0M 2s 2024-03-09T14:41:47.562 INFO:teuthology.orchestra.run.smithi046.stderr: 36150K .......... .......... .......... .......... .......... 38% 13.5M 2s 2024-03-09T14:41:47.564 INFO:teuthology.orchestra.run.smithi046.stderr: 36200K .......... .......... .......... .......... .......... 39% 29.7M 2s 2024-03-09T14:41:47.566 INFO:teuthology.orchestra.run.smithi046.stderr: 36250K .......... .......... .......... .......... .......... 39% 23.5M 2s 2024-03-09T14:41:47.567 INFO:teuthology.orchestra.run.smithi046.stderr: 36300K .......... .......... .......... .......... .......... 39% 42.4M 2s 2024-03-09T14:41:47.569 INFO:teuthology.orchestra.run.smithi046.stderr: 36350K .......... .......... .......... .......... .......... 39% 24.9M 2s 2024-03-09T14:41:47.571 INFO:teuthology.orchestra.run.smithi046.stderr: 36400K .......... .......... .......... .......... .......... 39% 25.9M 2s 2024-03-09T14:41:47.572 INFO:teuthology.orchestra.run.smithi046.stderr: 36450K .......... .......... .......... .......... .......... 39% 47.2M 2s 2024-03-09T14:41:47.574 INFO:teuthology.orchestra.run.smithi046.stderr: 36500K .......... .......... .......... .......... .......... 39% 34.4M 2s 2024-03-09T14:41:47.575 INFO:teuthology.orchestra.run.smithi046.stderr: 36550K .......... .......... .......... .......... .......... 39% 38.4M 2s 2024-03-09T14:41:47.576 INFO:teuthology.orchestra.run.smithi046.stderr: 36600K .......... .......... .......... .......... .......... 39% 26.0M 2s 2024-03-09T14:41:47.578 INFO:teuthology.orchestra.run.smithi046.stderr: 36650K .......... .......... .......... .......... .......... 39% 31.0M 2s 2024-03-09T14:41:47.581 INFO:teuthology.orchestra.run.smithi046.stderr: 36700K .......... .......... .......... .......... .......... 39% 17.8M 2s 2024-03-09T14:41:47.583 INFO:teuthology.orchestra.run.smithi046.stderr: 36750K .......... .......... .......... .......... .......... 39% 42.1M 2s 2024-03-09T14:41:47.584 INFO:teuthology.orchestra.run.smithi046.stderr: 36800K .......... .......... .......... .......... .......... 39% 18.4M 2s 2024-03-09T14:41:47.588 INFO:teuthology.orchestra.run.smithi046.stderr: 36850K .......... .......... .......... .......... .......... 39% 15.5M 2s 2024-03-09T14:41:47.589 INFO:teuthology.orchestra.run.smithi046.stderr: 36900K .......... .......... .......... .......... .......... 39% 38.2M 2s 2024-03-09T14:41:47.593 INFO:teuthology.orchestra.run.smithi046.stderr: 36950K .......... .......... .......... .......... .......... 39% 13.8M 2s 2024-03-09T14:41:47.595 INFO:teuthology.orchestra.run.smithi046.stderr: 37000K .......... .......... .......... .......... .......... 39% 54.9M 2s 2024-03-09T14:41:47.596 INFO:teuthology.orchestra.run.smithi046.stderr: 37050K .......... .......... .......... .......... .......... 39% 16.9M 2s 2024-03-09T14:41:47.599 INFO:teuthology.orchestra.run.smithi046.stderr: 37100K .......... .......... .......... .......... .......... 39% 23.6M 2s 2024-03-09T14:41:47.600 INFO:teuthology.orchestra.run.smithi046.stderr: 37150K .......... .......... .......... .......... .......... 40% 39.5M 2s 2024-03-09T14:41:47.601 INFO:teuthology.orchestra.run.smithi046.stderr: 37200K .......... .......... .......... .......... .......... 40% 26.7M 2s 2024-03-09T14:41:47.603 INFO:teuthology.orchestra.run.smithi046.stderr: 37250K .......... .......... .......... .......... .......... 40% 28.9M 2s 2024-03-09T14:41:47.604 INFO:teuthology.orchestra.run.smithi046.stderr: 37300K .......... .......... .......... .......... .......... 40% 47.6M 2s 2024-03-09T14:41:47.606 INFO:teuthology.orchestra.run.smithi046.stderr: 37350K .......... .......... .......... .......... .......... 40% 32.0M 2s 2024-03-09T14:41:47.607 INFO:teuthology.orchestra.run.smithi046.stderr: 37400K .......... .......... .......... .......... .......... 40% 35.4M 2s 2024-03-09T14:41:47.609 INFO:teuthology.orchestra.run.smithi046.stderr: 37450K .......... .......... .......... .......... .......... 40% 26.3M 2s 2024-03-09T14:41:47.610 INFO:teuthology.orchestra.run.smithi046.stderr: 37500K .......... .......... .......... .......... .......... 40% 35.8M 2s 2024-03-09T14:41:47.614 INFO:teuthology.orchestra.run.smithi046.stderr: 37550K .......... .......... .......... .......... .......... 40% 13.9M 2s 2024-03-09T14:41:47.616 INFO:teuthology.orchestra.run.smithi046.stderr: 37600K .......... .......... .......... .......... .......... 40% 18.6M 2s 2024-03-09T14:41:47.618 INFO:teuthology.orchestra.run.smithi046.stderr: 37650K .......... .......... .......... .......... .......... 40% 30.1M 2s 2024-03-09T14:41:47.620 INFO:teuthology.orchestra.run.smithi046.stderr: 37700K .......... .......... .......... .......... .......... 40% 27.9M 2s 2024-03-09T14:41:47.622 INFO:teuthology.orchestra.run.smithi046.stderr: 37750K .......... .......... .......... .......... .......... 40% 23.0M 2s 2024-03-09T14:41:47.624 INFO:teuthology.orchestra.run.smithi046.stderr: 37800K .......... .......... .......... .......... .......... 40% 22.7M 2s 2024-03-09T14:41:47.628 INFO:teuthology.orchestra.run.smithi046.stderr: 37850K .......... .......... .......... .......... .......... 40% 24.1M 2s 2024-03-09T14:41:47.628 INFO:teuthology.orchestra.run.smithi046.stderr: 37900K .......... .......... .......... .......... .......... 40% 31.2M 2s 2024-03-09T14:41:47.631 INFO:teuthology.orchestra.run.smithi046.stderr: 37950K .......... .......... .......... .......... .......... 40% 23.9M 2s 2024-03-09T14:41:47.632 INFO:teuthology.orchestra.run.smithi046.stderr: 38000K .......... .......... .......... .......... .......... 40% 23.8M 2s 2024-03-09T14:41:47.634 INFO:teuthology.orchestra.run.smithi046.stderr: 38050K .......... .......... .......... .......... .......... 41% 23.2M 2s 2024-03-09T14:41:47.635 INFO:teuthology.orchestra.run.smithi046.stderr: 38100K .......... .......... .......... .......... .......... 41% 53.3M 2s 2024-03-09T14:41:47.637 INFO:teuthology.orchestra.run.smithi046.stderr: 38150K .......... .......... .......... .......... .......... 41% 21.5M 2s 2024-03-09T14:41:47.638 INFO:teuthology.orchestra.run.smithi046.stderr: 38200K .......... .......... .......... .......... .......... 41% 40.7M 2s 2024-03-09T14:41:47.641 INFO:teuthology.orchestra.run.smithi046.stderr: 38250K .......... .......... .......... .......... .......... 41% 19.4M 2s 2024-03-09T14:41:47.642 INFO:teuthology.orchestra.run.smithi046.stderr: 38300K .......... .......... .......... .......... .......... 41% 41.1M 2s 2024-03-09T14:41:47.644 INFO:teuthology.orchestra.run.smithi046.stderr: 38350K .......... .......... .......... .......... .......... 41% 26.0M 2s 2024-03-09T14:41:47.647 INFO:teuthology.orchestra.run.smithi046.stderr: 38400K .......... .......... .......... .......... .......... 41% 15.1M 2s 2024-03-09T14:41:47.649 INFO:teuthology.orchestra.run.smithi046.stderr: 38450K .......... .......... .......... .......... .......... 41% 22.3M 2s 2024-03-09T14:41:47.652 INFO:teuthology.orchestra.run.smithi046.stderr: 38500K .......... .......... .......... .......... .......... 41% 22.0M 2s 2024-03-09T14:41:47.653 INFO:teuthology.orchestra.run.smithi046.stderr: 38550K .......... .......... .......... .......... .......... 41% 28.3M 2s 2024-03-09T14:41:47.655 INFO:teuthology.orchestra.run.smithi046.stderr: 38600K .......... .......... .......... .......... .......... 41% 28.7M 2s 2024-03-09T14:41:47.657 INFO:teuthology.orchestra.run.smithi046.stderr: 38650K .......... .......... .......... .......... .......... 41% 23.9M 2s 2024-03-09T14:41:47.659 INFO:teuthology.orchestra.run.smithi046.stderr: 38700K .......... .......... .......... .......... .......... 41% 22.2M 2s 2024-03-09T14:41:47.662 INFO:teuthology.orchestra.run.smithi046.stderr: 38750K .......... .......... .......... .......... .......... 41% 18.9M 2s 2024-03-09T14:41:47.663 INFO:teuthology.orchestra.run.smithi046.stderr: 38800K .......... .......... .......... .......... .......... 41% 40.5M 2s 2024-03-09T14:41:47.665 INFO:teuthology.orchestra.run.smithi046.stderr: 38850K .......... .......... .......... .......... .......... 41% 19.4M 2s 2024-03-09T14:41:47.666 INFO:teuthology.orchestra.run.smithi046.stderr: 38900K .......... .......... .......... .......... .......... 41% 42.7M 2s 2024-03-09T14:41:47.668 INFO:teuthology.orchestra.run.smithi046.stderr: 38950K .......... .......... .......... .......... .......... 41% 24.6M 2s 2024-03-09T14:41:47.670 INFO:teuthology.orchestra.run.smithi046.stderr: 39000K .......... .......... .......... .......... .......... 42% 45.7M 2s 2024-03-09T14:41:47.672 INFO:teuthology.orchestra.run.smithi046.stderr: 39050K .......... .......... .......... .......... .......... 42% 20.4M 2s 2024-03-09T14:41:47.673 INFO:teuthology.orchestra.run.smithi046.stderr: 39100K .......... .......... .......... .......... .......... 42% 36.1M 2s 2024-03-09T14:41:47.676 INFO:teuthology.orchestra.run.smithi046.stderr: 39150K .......... .......... .......... .......... .......... 42% 18.6M 2s 2024-03-09T14:41:47.678 INFO:teuthology.orchestra.run.smithi046.stderr: 39200K .......... .......... .......... .......... .......... 42% 25.8M 2s 2024-03-09T14:41:47.679 INFO:teuthology.orchestra.run.smithi046.stderr: 39250K .......... .......... .......... .......... .......... 42% 40.1M 2s 2024-03-09T14:41:47.682 INFO:teuthology.orchestra.run.smithi046.stderr: 39300K .......... .......... .......... .......... .......... 42% 14.5M 2s 2024-03-09T14:41:47.685 INFO:teuthology.orchestra.run.smithi046.stderr: 39350K .......... .......... .......... .......... .......... 42% 17.6M 2s 2024-03-09T14:41:47.687 INFO:teuthology.orchestra.run.smithi046.stderr: 39400K .......... .......... .......... .......... .......... 42% 22.6M 2s 2024-03-09T14:41:47.689 INFO:teuthology.orchestra.run.smithi046.stderr: 39450K .......... .......... .......... .......... .......... 42% 23.3M 2s 2024-03-09T14:41:47.691 INFO:teuthology.orchestra.run.smithi046.stderr: 39500K .......... .......... .......... .......... .......... 42% 45.1M 2s 2024-03-09T14:41:47.693 INFO:teuthology.orchestra.run.smithi046.stderr: 39550K .......... .......... .......... .......... .......... 42% 23.1M 2s 2024-03-09T14:41:47.695 INFO:teuthology.orchestra.run.smithi046.stderr: 39600K .......... .......... .......... .......... .......... 42% 19.0M 2s 2024-03-09T14:41:47.697 INFO:teuthology.orchestra.run.smithi046.stderr: 39650K .......... .......... .......... .......... .......... 42% 36.9M 2s 2024-03-09T14:41:47.698 INFO:teuthology.orchestra.run.smithi046.stderr: 39700K .......... .......... .......... .......... .......... 42% 24.7M 2s 2024-03-09T14:41:47.700 INFO:teuthology.orchestra.run.smithi046.stderr: 39750K .......... .......... .......... .......... .......... 42% 35.5M 2s 2024-03-09T14:41:47.702 INFO:teuthology.orchestra.run.smithi046.stderr: 39800K .......... .......... .......... .......... .......... 42% 27.5M 2s 2024-03-09T14:41:47.703 INFO:teuthology.orchestra.run.smithi046.stderr: 39850K .......... .......... .......... .......... .......... 42% 32.8M 2s 2024-03-09T14:41:47.706 INFO:teuthology.orchestra.run.smithi046.stderr: 39900K .......... .......... .......... .......... .......... 43% 19.3M 2s 2024-03-09T14:41:47.708 INFO:teuthology.orchestra.run.smithi046.stderr: 39950K .......... .......... .......... .......... .......... 43% 54.9M 2s 2024-03-09T14:41:47.709 INFO:teuthology.orchestra.run.smithi046.stderr: 40000K .......... .......... .......... .......... .......... 43% 18.0M 2s 2024-03-09T14:41:47.712 INFO:teuthology.orchestra.run.smithi046.stderr: 40050K .......... .......... .......... .......... .......... 43% 21.9M 2s 2024-03-09T14:41:47.713 INFO:teuthology.orchestra.run.smithi046.stderr: 40100K .......... .......... .......... .......... .......... 43% 33.6M 2s 2024-03-09T14:41:47.715 INFO:teuthology.orchestra.run.smithi046.stderr: 40150K .......... .......... .......... .......... .......... 43% 25.0M 2s 2024-03-09T14:41:47.717 INFO:teuthology.orchestra.run.smithi046.stderr: 40200K .......... .......... .......... .......... .......... 43% 19.1M 2s 2024-03-09T14:41:47.722 INFO:teuthology.orchestra.run.smithi046.stderr: 40250K .......... .......... .......... .......... .......... 43% 11.7M 2s 2024-03-09T14:41:47.723 INFO:teuthology.orchestra.run.smithi046.stderr: 40300K .......... .......... .......... .......... .......... 43% 45.4M 2s 2024-03-09T14:41:47.725 INFO:teuthology.orchestra.run.smithi046.stderr: 40350K .......... .......... .......... .......... .......... 43% 22.4M 2s 2024-03-09T14:41:47.728 INFO:teuthology.orchestra.run.smithi046.stderr: 40400K .......... .......... .......... .......... .......... 43% 16.2M 2s 2024-03-09T14:41:47.729 INFO:teuthology.orchestra.run.smithi046.stderr: 40450K .......... .......... .......... .......... .......... 43% 44.2M 2s 2024-03-09T14:41:47.732 INFO:teuthology.orchestra.run.smithi046.stderr: 40500K .......... .......... .......... .......... .......... 43% 19.8M 2s 2024-03-09T14:41:47.732 INFO:teuthology.orchestra.run.smithi046.stderr: 40550K .......... .......... .......... .......... .......... 43% 53.8M 2s 2024-03-09T14:41:47.735 INFO:teuthology.orchestra.run.smithi046.stderr: 40600K .......... .......... .......... .......... .......... 43% 21.7M 2s 2024-03-09T14:41:47.736 INFO:teuthology.orchestra.run.smithi046.stderr: 40650K .......... .......... .......... .......... .......... 43% 43.0M 2s 2024-03-09T14:41:47.738 INFO:teuthology.orchestra.run.smithi046.stderr: 40700K .......... .......... .......... .......... .......... 43% 22.9M 2s 2024-03-09T14:41:47.741 INFO:teuthology.orchestra.run.smithi046.stderr: 40750K .......... .......... .......... .......... .......... 43% 27.3M 2s 2024-03-09T14:41:47.743 INFO:teuthology.orchestra.run.smithi046.stderr: 40800K .......... .......... .......... .......... .......... 43% 16.6M 2s 2024-03-09T14:41:47.745 INFO:teuthology.orchestra.run.smithi046.stderr: 40850K .......... .......... .......... .......... .......... 44% 21.7M 2s 2024-03-09T14:41:47.747 INFO:teuthology.orchestra.run.smithi046.stderr: 40900K .......... .......... .......... .......... .......... 44% 29.6M 2s 2024-03-09T14:41:47.749 INFO:teuthology.orchestra.run.smithi046.stderr: 40950K .......... .......... .......... .......... .......... 44% 17.4M 2s 2024-03-09T14:41:47.751 INFO:teuthology.orchestra.run.smithi046.stderr: 41000K .......... .......... .......... .......... .......... 44% 31.6M 2s 2024-03-09T14:41:47.753 INFO:teuthology.orchestra.run.smithi046.stderr: 41050K .......... .......... .......... .......... .......... 44% 21.4M 2s 2024-03-09T14:41:47.756 INFO:teuthology.orchestra.run.smithi046.stderr: 41100K .......... .......... .......... .......... .......... 44% 19.9M 2s 2024-03-09T14:41:47.759 INFO:teuthology.orchestra.run.smithi046.stderr: 41150K .......... .......... .......... .......... .......... 44% 15.0M 2s 2024-03-09T14:41:47.762 INFO:teuthology.orchestra.run.smithi046.stderr: 41200K .......... .......... .......... .......... .......... 44% 16.9M 2s 2024-03-09T14:41:47.763 INFO:teuthology.orchestra.run.smithi046.stderr: 41250K .......... .......... .......... .......... .......... 44% 59.3M 2s 2024-03-09T14:41:47.765 INFO:teuthology.orchestra.run.smithi046.stderr: 41300K .......... .......... .......... .......... .......... 44% 18.2M 2s 2024-03-09T14:41:47.766 INFO:teuthology.orchestra.run.smithi046.stderr: 41350K .......... .......... .......... .......... .......... 44% 58.0M 2s 2024-03-09T14:41:47.769 INFO:teuthology.orchestra.run.smithi046.stderr: 41400K .......... .......... .......... .......... .......... 44% 20.8M 2s 2024-03-09T14:41:47.769 INFO:teuthology.orchestra.run.smithi046.stderr: 41450K .......... .......... .......... .......... .......... 44% 68.0M 2s 2024-03-09T14:41:47.771 INFO:teuthology.orchestra.run.smithi046.stderr: 41500K .......... .......... .......... .......... .......... 44% 24.8M 2s 2024-03-09T14:41:47.773 INFO:teuthology.orchestra.run.smithi046.stderr: 41550K .......... .......... .......... .......... .......... 44% 41.9M 2s 2024-03-09T14:41:47.774 INFO:teuthology.orchestra.run.smithi046.stderr: 41600K .......... .......... .......... .......... .......... 44% 24.9M 2s 2024-03-09T14:41:47.777 INFO:teuthology.orchestra.run.smithi046.stderr: 41650K .......... .......... .......... .......... .......... 44% 20.7M 2s 2024-03-09T14:41:47.779 INFO:teuthology.orchestra.run.smithi046.stderr: 41700K .......... .......... .......... .......... .......... 44% 25.0M 2s 2024-03-09T14:41:47.781 INFO:teuthology.orchestra.run.smithi046.stderr: 41750K .......... .......... .......... .......... .......... 44% 26.8M 2s 2024-03-09T14:41:47.782 INFO:teuthology.orchestra.run.smithi046.stderr: 41800K .......... .......... .......... .......... .......... 45% 31.6M 2s 2024-03-09T14:41:47.785 INFO:teuthology.orchestra.run.smithi046.stderr: 41850K .......... .......... .......... .......... .......... 45% 18.9M 2s 2024-03-09T14:41:47.786 INFO:teuthology.orchestra.run.smithi046.stderr: 41900K .......... .......... .......... .......... .......... 45% 32.7M 2s 2024-03-09T14:41:47.789 INFO:teuthology.orchestra.run.smithi046.stderr: 41950K .......... .......... .......... .......... .......... 45% 24.4M 2s 2024-03-09T14:41:47.792 INFO:teuthology.orchestra.run.smithi046.stderr: 42000K .......... .......... .......... .......... .......... 45% 12.0M 2s 2024-03-09T14:41:47.794 INFO:teuthology.orchestra.run.smithi046.stderr: 42050K .......... .......... .......... .......... .......... 45% 27.6M 2s 2024-03-09T14:41:47.796 INFO:teuthology.orchestra.run.smithi046.stderr: 42100K .......... .......... .......... .......... .......... 45% 25.8M 2s 2024-03-09T14:41:47.799 INFO:teuthology.orchestra.run.smithi046.stderr: 42150K .......... .......... .......... .......... .......... 45% 33.8M 2s 2024-03-09T14:41:47.799 INFO:teuthology.orchestra.run.smithi046.stderr: 42200K .......... .......... .......... .......... .......... 45% 30.2M 2s 2024-03-09T14:41:47.801 INFO:teuthology.orchestra.run.smithi046.stderr: 42250K .......... .......... .......... .......... .......... 45% 23.4M 2s 2024-03-09T14:41:47.803 INFO:teuthology.orchestra.run.smithi046.stderr: 42300K .......... .......... .......... .......... .......... 45% 23.9M 2s 2024-03-09T14:41:47.804 INFO:teuthology.orchestra.run.smithi046.stderr: 42350K .......... .......... .......... .......... .......... 45% 38.8M 2s 2024-03-09T14:41:47.806 INFO:teuthology.orchestra.run.smithi046.stderr: 42400K .......... .......... .......... .......... .......... 45% 23.7M 2s 2024-03-09T14:41:47.807 INFO:teuthology.orchestra.run.smithi046.stderr: 42450K .......... .......... .......... .......... .......... 45% 42.0M 2s 2024-03-09T14:41:47.810 INFO:teuthology.orchestra.run.smithi046.stderr: 42500K .......... .......... .......... .......... .......... 45% 21.5M 2s 2024-03-09T14:41:47.811 INFO:teuthology.orchestra.run.smithi046.stderr: 42550K .......... .......... .......... .......... .......... 45% 35.0M 2s 2024-03-09T14:41:47.814 INFO:teuthology.orchestra.run.smithi046.stderr: 42600K .......... .......... .......... .......... .......... 45% 19.7M 2s 2024-03-09T14:41:47.815 INFO:teuthology.orchestra.run.smithi046.stderr: 42650K .......... .......... .......... .......... .......... 45% 41.7M 2s 2024-03-09T14:41:47.818 INFO:teuthology.orchestra.run.smithi046.stderr: 42700K .......... .......... .......... .......... .......... 46% 17.3M 2s 2024-03-09T14:41:47.820 INFO:teuthology.orchestra.run.smithi046.stderr: 42750K .......... .......... .......... .......... .......... 46% 39.2M 2s 2024-03-09T14:41:47.823 INFO:teuthology.orchestra.run.smithi046.stderr: 42800K .......... .......... .......... .......... .......... 46% 13.9M 2s 2024-03-09T14:41:47.824 INFO:teuthology.orchestra.run.smithi046.stderr: 42850K .......... .......... .......... .......... .......... 46% 25.7M 2s 2024-03-09T14:41:47.826 INFO:teuthology.orchestra.run.smithi046.stderr: 42900K .......... .......... .......... .......... .......... 46% 22.3M 2s 2024-03-09T14:41:47.829 INFO:teuthology.orchestra.run.smithi046.stderr: 42950K .......... .......... .......... .......... .......... 46% 23.1M 2s 2024-03-09T14:41:47.830 INFO:teuthology.orchestra.run.smithi046.stderr: 43000K .......... .......... .......... .......... .......... 46% 29.4M 2s 2024-03-09T14:41:47.833 INFO:teuthology.orchestra.run.smithi046.stderr: 43050K .......... .......... .......... .......... .......... 46% 22.1M 2s 2024-03-09T14:41:47.833 INFO:teuthology.orchestra.run.smithi046.stderr: 43100K .......... .......... .......... .......... .......... 46% 48.9M 2s 2024-03-09T14:41:47.836 INFO:teuthology.orchestra.run.smithi046.stderr: 43150K .......... .......... .......... .......... .......... 46% 22.6M 2s 2024-03-09T14:41:47.838 INFO:teuthology.orchestra.run.smithi046.stderr: 43200K .......... .......... .......... .......... .......... 46% 22.0M 2s 2024-03-09T14:41:47.839 INFO:teuthology.orchestra.run.smithi046.stderr: 43250K .......... .......... .......... .......... .......... 46% 47.0M 2s 2024-03-09T14:41:47.841 INFO:teuthology.orchestra.run.smithi046.stderr: 43300K .......... .......... .......... .......... .......... 46% 22.2M 2s 2024-03-09T14:41:47.842 INFO:teuthology.orchestra.run.smithi046.stderr: 43350K .......... .......... .......... .......... .......... 46% 44.9M 2s 2024-03-09T14:41:47.845 INFO:teuthology.orchestra.run.smithi046.stderr: 43400K .......... .......... .......... .......... .......... 46% 17.8M 2s 2024-03-09T14:41:47.846 INFO:teuthology.orchestra.run.smithi046.stderr: 43450K .......... .......... .......... .......... .......... 46% 49.8M 2s 2024-03-09T14:41:47.849 INFO:teuthology.orchestra.run.smithi046.stderr: 43500K .......... .......... .......... .......... .......... 46% 15.5M 2s 2024-03-09T14:41:47.852 INFO:teuthology.orchestra.run.smithi046.stderr: 43550K .......... .......... .......... .......... .......... 46% 34.1M 2s 2024-03-09T14:41:47.854 INFO:teuthology.orchestra.run.smithi046.stderr: 43600K .......... .......... .......... .......... .......... 46% 18.6M 2s 2024-03-09T14:41:47.855 INFO:teuthology.orchestra.run.smithi046.stderr: 43650K .......... .......... .......... .......... .......... 47% 24.3M 2s 2024-03-09T14:41:47.857 INFO:teuthology.orchestra.run.smithi046.stderr: 43700K .......... .......... .......... .......... .......... 47% 22.8M 2s 2024-03-09T14:41:47.859 INFO:teuthology.orchestra.run.smithi046.stderr: 43750K .......... .......... .......... .......... .......... 47% 30.2M 2s 2024-03-09T14:41:47.860 INFO:teuthology.orchestra.run.smithi046.stderr: 43800K .......... .......... .......... .......... .......... 47% 41.8M 2s 2024-03-09T14:41:47.864 INFO:teuthology.orchestra.run.smithi046.stderr: 43850K .......... .......... .......... .......... .......... 47% 13.3M 2s 2024-03-09T14:41:47.866 INFO:teuthology.orchestra.run.smithi046.stderr: 43900K .......... .......... .......... .......... .......... 47% 27.2M 2s 2024-03-09T14:41:47.868 INFO:teuthology.orchestra.run.smithi046.stderr: 43950K .......... .......... .......... .......... .......... 47% 18.6M 2s 2024-03-09T14:41:47.871 INFO:teuthology.orchestra.run.smithi046.stderr: 44000K .......... .......... .......... .......... .......... 47% 21.6M 2s 2024-03-09T14:41:47.871 INFO:teuthology.orchestra.run.smithi046.stderr: 44050K .......... .......... .......... .......... .......... 47% 48.1M 2s 2024-03-09T14:41:47.874 INFO:teuthology.orchestra.run.smithi046.stderr: 44100K .......... .......... .......... .......... .......... 47% 19.5M 2s 2024-03-09T14:41:47.875 INFO:teuthology.orchestra.run.smithi046.stderr: 44150K .......... .......... .......... .......... .......... 47% 33.8M 2s 2024-03-09T14:41:47.878 INFO:teuthology.orchestra.run.smithi046.stderr: 44200K .......... .......... .......... .......... .......... 47% 21.3M 2s 2024-03-09T14:41:47.879 INFO:teuthology.orchestra.run.smithi046.stderr: 44250K .......... .......... .......... .......... .......... 47% 52.8M 2s 2024-03-09T14:41:47.881 INFO:teuthology.orchestra.run.smithi046.stderr: 44300K .......... .......... .......... .......... .......... 47% 20.5M 2s 2024-03-09T14:41:47.883 INFO:teuthology.orchestra.run.smithi046.stderr: 44350K .......... .......... .......... .......... .......... 47% 39.8M 2s 2024-03-09T14:41:47.885 INFO:teuthology.orchestra.run.smithi046.stderr: 44400K .......... .......... .......... .......... .......... 47% 16.7M 2s 2024-03-09T14:41:47.888 INFO:teuthology.orchestra.run.smithi046.stderr: 44450K .......... .......... .......... .......... .......... 47% 18.0M 2s 2024-03-09T14:41:47.889 INFO:teuthology.orchestra.run.smithi046.stderr: 44500K .......... .......... .......... .......... .......... 47% 35.6M 2s 2024-03-09T14:41:47.891 INFO:teuthology.orchestra.run.smithi046.stderr: 44550K .......... .......... .......... .......... .......... 48% 24.4M 2s 2024-03-09T14:41:47.892 INFO:teuthology.orchestra.run.smithi046.stderr: 44600K .......... .......... .......... .......... .......... 48% 47.6M 2s 2024-03-09T14:41:47.895 INFO:teuthology.orchestra.run.smithi046.stderr: 44650K .......... .......... .......... .......... .......... 48% 16.9M 2s 2024-03-09T14:41:47.897 INFO:teuthology.orchestra.run.smithi046.stderr: 44700K .......... .......... .......... .......... .......... 48% 24.3M 2s 2024-03-09T14:41:47.901 INFO:teuthology.orchestra.run.smithi046.stderr: 44750K .......... .......... .......... .......... .......... 48% 13.0M 2s 2024-03-09T14:41:47.903 INFO:teuthology.orchestra.run.smithi046.stderr: 44800K .......... .......... .......... .......... .......... 48% 23.7M 2s 2024-03-09T14:41:47.906 INFO:teuthology.orchestra.run.smithi046.stderr: 44850K .......... .......... .......... .......... .......... 48% 18.1M 2s 2024-03-09T14:41:47.906 INFO:teuthology.orchestra.run.smithi046.stderr: 44900K .......... .......... .......... .......... .......... 48% 55.3M 1s 2024-03-09T14:41:47.909 INFO:teuthology.orchestra.run.smithi046.stderr: 44950K .......... .......... .......... .......... .......... 48% 21.4M 1s 2024-03-09T14:41:47.911 INFO:teuthology.orchestra.run.smithi046.stderr: 45000K .......... .......... .......... .......... .......... 48% 20.8M 1s 2024-03-09T14:41:47.913 INFO:teuthology.orchestra.run.smithi046.stderr: 45050K .......... .......... .......... .......... .......... 48% 26.4M 1s 2024-03-09T14:41:47.914 INFO:teuthology.orchestra.run.smithi046.stderr: 45100K .......... .......... .......... .......... .......... 48% 30.9M 1s 2024-03-09T14:41:47.916 INFO:teuthology.orchestra.run.smithi046.stderr: 45150K .......... .......... .......... .......... .......... 48% 24.8M 1s 2024-03-09T14:41:47.919 INFO:teuthology.orchestra.run.smithi046.stderr: 45200K .......... .......... .......... .......... .......... 48% 21.6M 1s 2024-03-09T14:41:47.920 INFO:teuthology.orchestra.run.smithi046.stderr: 45250K .......... .......... .......... .......... .......... 48% 36.3M 1s 2024-03-09T14:41:47.923 INFO:teuthology.orchestra.run.smithi046.stderr: 45300K .......... .......... .......... .......... .......... 48% 16.1M 1s 2024-03-09T14:41:47.924 INFO:teuthology.orchestra.run.smithi046.stderr: 45350K .......... .......... .......... .......... .......... 48% 37.0M 1s 2024-03-09T14:41:47.927 INFO:teuthology.orchestra.run.smithi046.stderr: 45400K .......... .......... .......... .......... .......... 48% 20.8M 1s 2024-03-09T14:41:47.928 INFO:teuthology.orchestra.run.smithi046.stderr: 45450K .......... .......... .......... .......... .......... 48% 43.3M 1s 2024-03-09T14:41:47.930 INFO:teuthology.orchestra.run.smithi046.stderr: 45500K .......... .......... .......... .......... .......... 49% 25.1M 1s 2024-03-09T14:41:47.933 INFO:teuthology.orchestra.run.smithi046.stderr: 45550K .......... .......... .......... .......... .......... 49% 22.4M 1s 2024-03-09T14:41:47.934 INFO:teuthology.orchestra.run.smithi046.stderr: 45600K .......... .......... .......... .......... .......... 49% 23.5M 1s 2024-03-09T14:41:47.939 INFO:teuthology.orchestra.run.smithi046.stderr: 45650K .......... .......... .......... .......... .......... 49% 11.5M 1s 2024-03-09T14:41:47.940 INFO:teuthology.orchestra.run.smithi046.stderr: 45700K .......... .......... .......... .......... .......... 49% 55.1M 1s 2024-03-09T14:41:47.942 INFO:teuthology.orchestra.run.smithi046.stderr: 45750K .......... .......... .......... .......... .......... 49% 23.5M 1s 2024-03-09T14:41:47.944 INFO:teuthology.orchestra.run.smithi046.stderr: 45800K .......... .......... .......... .......... .......... 49% 23.4M 1s 2024-03-09T14:41:47.946 INFO:teuthology.orchestra.run.smithi046.stderr: 45850K .......... .......... .......... .......... .......... 49% 23.2M 1s 2024-03-09T14:41:47.947 INFO:teuthology.orchestra.run.smithi046.stderr: 45900K .......... .......... .......... .......... .......... 49% 37.9M 1s 2024-03-09T14:41:47.950 INFO:teuthology.orchestra.run.smithi046.stderr: 45950K .......... .......... .......... .......... .......... 49% 18.4M 1s 2024-03-09T14:41:47.952 INFO:teuthology.orchestra.run.smithi046.stderr: 46000K .......... .......... .......... .......... .......... 49% 17.3M 1s 2024-03-09T14:41:47.953 INFO:teuthology.orchestra.run.smithi046.stderr: 46050K .......... .......... .......... .......... .......... 49% 50.8M 1s 2024-03-09T14:41:47.956 INFO:teuthology.orchestra.run.smithi046.stderr: 46100K .......... .......... .......... .......... .......... 49% 20.7M 1s 2024-03-09T14:41:47.957 INFO:teuthology.orchestra.run.smithi046.stderr: 46150K .......... .......... .......... .......... .......... 49% 41.5M 1s 2024-03-09T14:41:47.959 INFO:teuthology.orchestra.run.smithi046.stderr: 46200K .......... .......... .......... .......... .......... 49% 22.1M 1s 2024-03-09T14:41:47.963 INFO:teuthology.orchestra.run.smithi046.stderr: 46250K .......... .......... .......... .......... .......... 49% 14.5M 1s 2024-03-09T14:41:47.964 INFO:teuthology.orchestra.run.smithi046.stderr: 46300K .......... .......... .......... .......... .......... 49% 28.5M 1s 2024-03-09T14:41:47.967 INFO:teuthology.orchestra.run.smithi046.stderr: 46350K .......... .......... .......... .......... .......... 49% 31.3M 1s 2024-03-09T14:41:47.969 INFO:teuthology.orchestra.run.smithi046.stderr: 46400K .......... .......... .......... .......... .......... 49% 18.5M 1s 2024-03-09T14:41:47.971 INFO:teuthology.orchestra.run.smithi046.stderr: 46450K .......... .......... .......... .......... .......... 50% 20.6M 1s 2024-03-09T14:41:47.972 INFO:teuthology.orchestra.run.smithi046.stderr: 46500K .......... .......... .......... .......... .......... 50% 35.4M 1s 2024-03-09T14:41:47.978 INFO:teuthology.orchestra.run.smithi046.stderr: 46550K .......... .......... .......... .......... .......... 50% 9.32M 1s 2024-03-09T14:41:47.980 INFO:teuthology.orchestra.run.smithi046.stderr: 46600K .......... .......... .......... .......... .......... 50% 20.8M 1s 2024-03-09T14:41:47.982 INFO:teuthology.orchestra.run.smithi046.stderr: 46650K .......... .......... .......... .......... .......... 50% 24.0M 1s 2024-03-09T14:41:47.983 INFO:teuthology.orchestra.run.smithi046.stderr: 46700K .......... .......... .......... .......... .......... 50% 39.8M 1s 2024-03-09T14:41:47.986 INFO:teuthology.orchestra.run.smithi046.stderr: 46750K .......... .......... .......... .......... .......... 50% 15.9M 1s 2024-03-09T14:41:47.989 INFO:teuthology.orchestra.run.smithi046.stderr: 46800K .......... .......... .......... .......... .......... 50% 15.6M 1s 2024-03-09T14:41:47.992 INFO:teuthology.orchestra.run.smithi046.stderr: 46850K .......... .......... .......... .......... .......... 50% 18.4M 1s 2024-03-09T14:41:47.993 INFO:teuthology.orchestra.run.smithi046.stderr: 46900K .......... .......... .......... .......... .......... 50% 36.0M 1s 2024-03-09T14:41:47.996 INFO:teuthology.orchestra.run.smithi046.stderr: 46950K .......... .......... .......... .......... .......... 50% 19.2M 1s 2024-03-09T14:41:47.997 INFO:teuthology.orchestra.run.smithi046.stderr: 47000K .......... .......... .......... .......... .......... 50% 30.5M 1s 2024-03-09T14:41:47.998 INFO:teuthology.orchestra.run.smithi046.stderr: 47050K .......... .......... .......... .......... .......... 50% 34.8M 1s 2024-03-09T14:41:48.000 INFO:teuthology.orchestra.run.smithi046.stderr: 47100K .......... .......... .......... .......... .......... 50% 28.4M 1s 2024-03-09T14:41:48.003 INFO:teuthology.orchestra.run.smithi046.stderr: 47150K .......... .......... .......... .......... .......... 50% 40.7M 1s 2024-03-09T14:41:48.004 INFO:teuthology.orchestra.run.smithi046.stderr: 47200K .......... .......... .......... .......... .......... 50% 17.0M 1s 2024-03-09T14:41:48.007 INFO:teuthology.orchestra.run.smithi046.stderr: 47250K .......... .......... .......... .......... .......... 50% 22.6M 1s 2024-03-09T14:41:48.007 INFO:teuthology.orchestra.run.smithi046.stderr: 47300K .......... .......... .......... .......... .......... 50% 45.4M 1s 2024-03-09T14:41:48.009 INFO:teuthology.orchestra.run.smithi046.stderr: 47350K .......... .......... .......... .......... .......... 51% 30.4M 1s 2024-03-09T14:41:48.011 INFO:teuthology.orchestra.run.smithi046.stderr: 47400K .......... .......... .......... .......... .......... 51% 23.3M 1s 2024-03-09T14:41:48.014 INFO:teuthology.orchestra.run.smithi046.stderr: 47450K .......... .......... .......... .......... .......... 51% 17.8M 1s 2024-03-09T14:41:48.016 INFO:teuthology.orchestra.run.smithi046.stderr: 47500K .......... .......... .......... .......... .......... 51% 18.8M 1s 2024-03-09T14:41:48.019 INFO:teuthology.orchestra.run.smithi046.stderr: 47550K .......... .......... .......... .......... .......... 51% 18.9M 1s 2024-03-09T14:41:48.022 INFO:teuthology.orchestra.run.smithi046.stderr: 47600K .......... .......... .......... .......... .......... 51% 20.8M 1s 2024-03-09T14:41:48.025 INFO:teuthology.orchestra.run.smithi046.stderr: 47650K .......... .......... .......... .......... .......... 51% 18.6M 1s 2024-03-09T14:41:48.026 INFO:teuthology.orchestra.run.smithi046.stderr: 47700K .......... .......... .......... .......... .......... 51% 30.0M 1s 2024-03-09T14:41:48.028 INFO:teuthology.orchestra.run.smithi046.stderr: 47750K .......... .......... .......... .......... .......... 51% 23.0M 1s 2024-03-09T14:41:48.030 INFO:teuthology.orchestra.run.smithi046.stderr: 47800K .......... .......... .......... .......... .......... 51% 22.0M 1s 2024-03-09T14:41:48.033 INFO:teuthology.orchestra.run.smithi046.stderr: 47850K .......... .......... .......... .......... .......... 51% 15.2M 1s 2024-03-09T14:41:48.035 INFO:teuthology.orchestra.run.smithi046.stderr: 47900K .......... .......... .......... .......... .......... 51% 33.4M 1s 2024-03-09T14:41:48.037 INFO:teuthology.orchestra.run.smithi046.stderr: 47950K .......... .......... .......... .......... .......... 51% 25.7M 1s 2024-03-09T14:41:48.040 INFO:teuthology.orchestra.run.smithi046.stderr: 48000K .......... .......... .......... .......... .......... 51% 16.7M 1s 2024-03-09T14:41:48.041 INFO:teuthology.orchestra.run.smithi046.stderr: 48050K .......... .......... .......... .......... .......... 51% 40.8M 1s 2024-03-09T14:41:48.044 INFO:teuthology.orchestra.run.smithi046.stderr: 48100K .......... .......... .......... .......... .......... 51% 23.6M 1s 2024-03-09T14:41:48.045 INFO:teuthology.orchestra.run.smithi046.stderr: 48150K .......... .......... .......... .......... .......... 51% 31.7M 1s 2024-03-09T14:41:48.047 INFO:teuthology.orchestra.run.smithi046.stderr: 48200K .......... .......... .......... .......... .......... 51% 19.3M 1s 2024-03-09T14:41:48.048 INFO:teuthology.orchestra.run.smithi046.stderr: 48250K .......... .......... .......... .......... .......... 51% 45.8M 1s 2024-03-09T14:41:48.051 INFO:teuthology.orchestra.run.smithi046.stderr: 48300K .......... .......... .......... .......... .......... 52% 17.6M 1s 2024-03-09T14:41:48.054 INFO:teuthology.orchestra.run.smithi046.stderr: 48350K .......... .......... .......... .......... .......... 52% 33.7M 1s 2024-03-09T14:41:48.056 INFO:teuthology.orchestra.run.smithi046.stderr: 48400K .......... .......... .......... .......... .......... 52% 13.3M 1s 2024-03-09T14:41:48.059 INFO:teuthology.orchestra.run.smithi046.stderr: 48450K .......... .......... .......... .......... .......... 52% 16.7M 1s 2024-03-09T14:41:48.060 INFO:teuthology.orchestra.run.smithi046.stderr: 48500K .......... .......... .......... .......... .......... 52% 43.8M 1s 2024-03-09T14:41:48.063 INFO:teuthology.orchestra.run.smithi046.stderr: 48550K .......... .......... .......... .......... .......... 52% 17.0M 1s 2024-03-09T14:41:48.065 INFO:teuthology.orchestra.run.smithi046.stderr: 48600K .......... .......... .......... .......... .......... 52% 27.1M 1s 2024-03-09T14:41:48.068 INFO:teuthology.orchestra.run.smithi046.stderr: 48650K .......... .......... .......... .......... .......... 52% 16.5M 1s 2024-03-09T14:41:48.069 INFO:teuthology.orchestra.run.smithi046.stderr: 48700K .......... .......... .......... .......... .......... 52% 28.0M 1s 2024-03-09T14:41:48.072 INFO:teuthology.orchestra.run.smithi046.stderr: 48750K .......... .......... .......... .......... .......... 52% 20.1M 1s 2024-03-09T14:41:48.075 INFO:teuthology.orchestra.run.smithi046.stderr: 48800K .......... .......... .......... .......... .......... 52% 16.5M 1s 2024-03-09T14:41:48.077 INFO:teuthology.orchestra.run.smithi046.stderr: 48850K .......... .......... .......... .......... .......... 52% 28.1M 1s 2024-03-09T14:41:48.079 INFO:teuthology.orchestra.run.smithi046.stderr: 48900K .......... .......... .......... .......... .......... 52% 18.0M 1s 2024-03-09T14:41:48.081 INFO:teuthology.orchestra.run.smithi046.stderr: 48950K .......... .......... .......... .......... .......... 52% 25.2M 1s 2024-03-09T14:41:48.084 INFO:teuthology.orchestra.run.smithi046.stderr: 49000K .......... .......... .......... .......... .......... 52% 21.2M 1s 2024-03-09T14:41:48.085 INFO:teuthology.orchestra.run.smithi046.stderr: 49050K .......... .......... .......... .......... .......... 52% 29.2M 1s 2024-03-09T14:41:48.088 INFO:teuthology.orchestra.run.smithi046.stderr: 49100K .......... .......... .......... .......... .......... 52% 18.2M 1s 2024-03-09T14:41:48.091 INFO:teuthology.orchestra.run.smithi046.stderr: 49150K .......... .......... .......... .......... .......... 52% 23.7M 1s 2024-03-09T14:41:48.093 INFO:teuthology.orchestra.run.smithi046.stderr: 49200K .......... .......... .......... .......... .......... 53% 17.1M 1s 2024-03-09T14:41:48.095 INFO:teuthology.orchestra.run.smithi046.stderr: 49250K .......... .......... .......... .......... .......... 53% 23.0M 1s 2024-03-09T14:41:48.097 INFO:teuthology.orchestra.run.smithi046.stderr: 49300K .......... .......... .......... .......... .......... 53% 23.5M 1s 2024-03-09T14:41:48.103 INFO:teuthology.orchestra.run.smithi046.stderr: 49350K .......... .......... .......... .......... .......... 53% 8.91M 1s 2024-03-09T14:41:48.103 INFO:teuthology.orchestra.run.smithi046.stderr: 49400K .......... .......... .......... .......... .......... 53% 40.1M 1s 2024-03-09T14:41:48.106 INFO:teuthology.orchestra.run.smithi046.stderr: 49450K .......... .......... .......... .......... .......... 53% 18.6M 1s 2024-03-09T14:41:48.108 INFO:teuthology.orchestra.run.smithi046.stderr: 49500K .......... .......... .......... .......... .......... 53% 23.5M 1s 2024-03-09T14:41:48.111 INFO:teuthology.orchestra.run.smithi046.stderr: 49550K .......... .......... .......... .......... .......... 53% 16.7M 1s 2024-03-09T14:41:48.115 INFO:teuthology.orchestra.run.smithi046.stderr: 49600K .......... .......... .......... .......... .......... 53% 13.0M 1s 2024-03-09T14:41:48.117 INFO:teuthology.orchestra.run.smithi046.stderr: 49650K .......... .......... .......... .......... .......... 53% 25.6M 1s 2024-03-09T14:41:48.120 INFO:teuthology.orchestra.run.smithi046.stderr: 49700K .......... .......... .......... .......... .......... 53% 18.5M 1s 2024-03-09T14:41:48.122 INFO:teuthology.orchestra.run.smithi046.stderr: 49750K .......... .......... .......... .......... .......... 53% 19.7M 1s 2024-03-09T14:41:48.123 INFO:teuthology.orchestra.run.smithi046.stderr: 49800K .......... .......... .......... .......... .......... 53% 38.0M 1s 2024-03-09T14:41:48.125 INFO:teuthology.orchestra.run.smithi046.stderr: 49850K .......... .......... .......... .......... .......... 53% 24.2M 1s 2024-03-09T14:41:48.132 INFO:teuthology.orchestra.run.smithi046.stderr: 49900K .......... .......... .......... .......... .......... 53% 18.7M 1s 2024-03-09T14:41:48.132 INFO:teuthology.orchestra.run.smithi046.stderr: 49950K .......... .......... .......... .......... .......... 53% 20.4M 1s 2024-03-09T14:41:48.134 INFO:teuthology.orchestra.run.smithi046.stderr: 50000K .......... .......... .......... .......... .......... 53% 15.8M 1s 2024-03-09T14:41:48.135 INFO:teuthology.orchestra.run.smithi046.stderr: 50050K .......... .......... .......... .......... .......... 53% 26.9M 1s 2024-03-09T14:41:48.137 INFO:teuthology.orchestra.run.smithi046.stderr: 50100K .......... .......... .......... .......... .......... 53% 22.3M 1s 2024-03-09T14:41:48.140 INFO:teuthology.orchestra.run.smithi046.stderr: 50150K .......... .......... .......... .......... .......... 54% 23.2M 1s 2024-03-09T14:41:48.143 INFO:teuthology.orchestra.run.smithi046.stderr: 50200K .......... .......... .......... .......... .......... 54% 15.2M 1s 2024-03-09T14:41:48.146 INFO:teuthology.orchestra.run.smithi046.stderr: 50250K .......... .......... .......... .......... .......... 54% 17.5M 1s 2024-03-09T14:41:48.148 INFO:teuthology.orchestra.run.smithi046.stderr: 50300K .......... .......... .......... .......... .......... 54% 22.5M 1s 2024-03-09T14:41:48.150 INFO:teuthology.orchestra.run.smithi046.stderr: 50350K .......... .......... .......... .......... .......... 54% 27.0M 1s 2024-03-09T14:41:48.152 INFO:teuthology.orchestra.run.smithi046.stderr: 50400K .......... .......... .......... .......... .......... 54% 20.4M 1s 2024-03-09T14:41:48.154 INFO:teuthology.orchestra.run.smithi046.stderr: 50450K .......... .......... .......... .......... .......... 54% 19.5M 1s 2024-03-09T14:41:48.156 INFO:teuthology.orchestra.run.smithi046.stderr: 50500K .......... .......... .......... .......... .......... 54% 27.8M 1s 2024-03-09T14:41:48.159 INFO:teuthology.orchestra.run.smithi046.stderr: 50550K .......... .......... .......... .......... .......... 54% 22.0M 1s 2024-03-09T14:41:48.161 INFO:teuthology.orchestra.run.smithi046.stderr: 50600K .......... .......... .......... .......... .......... 54% 21.7M 1s 2024-03-09T14:41:48.162 INFO:teuthology.orchestra.run.smithi046.stderr: 50650K .......... .......... .......... .......... .......... 54% 38.2M 1s 2024-03-09T14:41:48.164 INFO:teuthology.orchestra.run.smithi046.stderr: 50700K .......... .......... .......... .......... .......... 54% 35.0M 1s 2024-03-09T14:41:48.165 INFO:teuthology.orchestra.run.smithi046.stderr: 50750K .......... .......... .......... .......... .......... 54% 28.5M 1s 2024-03-09T14:41:48.167 INFO:teuthology.orchestra.run.smithi046.stderr: 50800K .......... .......... .......... .......... .......... 54% 30.3M 1s 2024-03-09T14:41:48.168 INFO:teuthology.orchestra.run.smithi046.stderr: 50850K .......... .......... .......... .......... .......... 54% 38.0M 1s 2024-03-09T14:41:48.169 INFO:teuthology.orchestra.run.smithi046.stderr: 50900K .......... .......... .......... .......... .......... 54% 50.3M 1s 2024-03-09T14:41:48.171 INFO:teuthology.orchestra.run.smithi046.stderr: 50950K .......... .......... .......... .......... .......... 54% 32.6M 1s 2024-03-09T14:41:48.173 INFO:teuthology.orchestra.run.smithi046.stderr: 51000K .......... .......... .......... .......... .......... 54% 22.2M 1s 2024-03-09T14:41:48.174 INFO:teuthology.orchestra.run.smithi046.stderr: 51050K .......... .......... .......... .......... .......... 55% 28.2M 1s 2024-03-09T14:41:48.176 INFO:teuthology.orchestra.run.smithi046.stderr: 51100K .......... .......... .......... .......... .......... 55% 29.0M 1s 2024-03-09T14:41:48.179 INFO:teuthology.orchestra.run.smithi046.stderr: 51150K .......... .......... .......... .......... .......... 55% 15.7M 1s 2024-03-09T14:41:48.182 INFO:teuthology.orchestra.run.smithi046.stderr: 51200K .......... .......... .......... .......... .......... 55% 16.7M 1s 2024-03-09T14:41:48.185 INFO:teuthology.orchestra.run.smithi046.stderr: 51250K .......... .......... .......... .......... .......... 55% 18.0M 1s 2024-03-09T14:41:48.186 INFO:teuthology.orchestra.run.smithi046.stderr: 51300K .......... .......... .......... .......... .......... 55% 33.5M 1s 2024-03-09T14:41:48.188 INFO:teuthology.orchestra.run.smithi046.stderr: 51350K .......... .......... .......... .......... .......... 55% 33.6M 1s 2024-03-09T14:41:48.190 INFO:teuthology.orchestra.run.smithi046.stderr: 51400K .......... .......... .......... .......... .......... 55% 27.6M 1s 2024-03-09T14:41:48.191 INFO:teuthology.orchestra.run.smithi046.stderr: 51450K .......... .......... .......... .......... .......... 55% 28.3M 1s 2024-03-09T14:41:48.193 INFO:teuthology.orchestra.run.smithi046.stderr: 51500K .......... .......... .......... .......... .......... 55% 25.9M 1s 2024-03-09T14:41:48.195 INFO:teuthology.orchestra.run.smithi046.stderr: 51550K .......... .......... .......... .......... .......... 55% 25.6M 1s 2024-03-09T14:41:48.198 INFO:teuthology.orchestra.run.smithi046.stderr: 51600K .......... .......... .......... .......... .......... 55% 37.6M 1s 2024-03-09T14:41:48.198 INFO:teuthology.orchestra.run.smithi046.stderr: 51650K .......... .......... .......... .......... .......... 55% 53.4M 1s 2024-03-09T14:41:48.199 INFO:teuthology.orchestra.run.smithi046.stderr: 51700K .......... .......... .......... .......... .......... 55% 43.2M 1s 2024-03-09T14:41:48.200 INFO:teuthology.orchestra.run.smithi046.stderr: 51750K .......... .......... .......... .......... .......... 55% 24.9M 1s 2024-03-09T14:41:48.201 INFO:teuthology.orchestra.run.smithi046.stderr: 51800K .......... .......... .......... .......... .......... 55% 46.6M 1s 2024-03-09T14:41:48.216 INFO:teuthology.orchestra.run.smithi046.stderr: 51850K .......... .......... .......... .......... .......... 55% 62.0M 1s 2024-03-09T14:41:48.216 INFO:teuthology.orchestra.run.smithi046.stderr: 51900K .......... .......... .......... .......... .......... 55% 54.8M 1s 2024-03-09T14:41:48.216 INFO:teuthology.orchestra.run.smithi046.stderr: 51950K .......... .......... .......... .......... .......... 55% 85.4M 1s 2024-03-09T14:41:48.216 INFO:teuthology.orchestra.run.smithi046.stderr: 52000K .......... .......... .......... .......... .......... 56% 39.5M 1s 2024-03-09T14:41:48.217 INFO:teuthology.orchestra.run.smithi046.stderr: 52050K .......... .......... .......... .......... .......... 56% 34.7M 1s 2024-03-09T14:41:48.217 INFO:teuthology.orchestra.run.smithi046.stderr: 52100K .......... .......... .......... .......... .......... 56% 84.0M 1s 2024-03-09T14:41:48.217 INFO:teuthology.orchestra.run.smithi046.stderr: 52150K .......... .......... .......... .......... .......... 56% 27.2M 1s 2024-03-09T14:41:48.217 INFO:teuthology.orchestra.run.smithi046.stderr: 52200K .......... .......... .......... .......... .......... 56% 56.1M 1s 2024-03-09T14:41:48.217 INFO:teuthology.orchestra.run.smithi046.stderr: 52250K .......... .......... .......... .......... .......... 56% 41.7M 1s 2024-03-09T14:41:48.217 INFO:teuthology.orchestra.run.smithi046.stderr: 52300K .......... .......... .......... .......... .......... 56% 41.9M 1s 2024-03-09T14:41:48.218 INFO:teuthology.orchestra.run.smithi046.stderr: 52350K .......... .......... .......... .......... .......... 56% 22.2M 1s 2024-03-09T14:41:48.220 INFO:teuthology.orchestra.run.smithi046.stderr: 52400K .......... .......... .......... .......... .......... 56% 19.2M 1s 2024-03-09T14:41:48.220 INFO:teuthology.orchestra.run.smithi046.stderr: 52450K .......... .......... .......... .......... .......... 56% 38.7M 1s 2024-03-09T14:41:48.225 INFO:teuthology.orchestra.run.smithi046.stderr: 52500K .......... .......... .......... .......... .......... 56% 18.5M 1s 2024-03-09T14:41:48.226 INFO:teuthology.orchestra.run.smithi046.stderr: 52550K .......... .......... .......... .......... .......... 56% 42.7M 1s 2024-03-09T14:41:48.226 INFO:teuthology.orchestra.run.smithi046.stderr: 52600K .......... .......... .......... .......... .......... 56% 28.3M 1s 2024-03-09T14:41:48.226 INFO:teuthology.orchestra.run.smithi046.stderr: 52650K .......... .......... .......... .......... .......... 56% 46.9M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 52700K .......... .......... .......... .......... .......... 56% 29.3M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 52750K .......... .......... .......... .......... .......... 56% 56.8M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 52800K .......... .......... .......... .......... .......... 56% 40.0M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 52850K .......... .......... .......... .......... .......... 56% 45.8M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 52900K .......... .......... .......... .......... .......... 56% 64.1M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 52950K .......... .......... .......... .......... .......... 57% 29.6M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 53000K .......... .......... .......... .......... .......... 57% 81.1M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 53050K .......... .......... .......... .......... .......... 57% 39.9M 1s 2024-03-09T14:41:48.241 INFO:teuthology.orchestra.run.smithi046.stderr: 53100K .......... .......... .......... .......... .......... 57% 62.0M 1s 2024-03-09T14:41:48.242 INFO:teuthology.orchestra.run.smithi046.stderr: 53150K .......... .......... .......... .......... .......... 57% 40.2M 1s 2024-03-09T14:41:48.242 INFO:teuthology.orchestra.run.smithi046.stderr: 53200K .......... .......... .......... .......... .......... 57% 32.3M 1s 2024-03-09T14:41:48.242 INFO:teuthology.orchestra.run.smithi046.stderr: 53250K .......... .......... .......... .......... .......... 57% 58.5M 1s 2024-03-09T14:41:48.242 INFO:teuthology.orchestra.run.smithi046.stderr: 53300K .......... .......... .......... .......... .......... 57% 50.6M 1s 2024-03-09T14:41:48.242 INFO:teuthology.orchestra.run.smithi046.stderr: 53350K .......... .......... .......... .......... .......... 57% 35.5M 1s 2024-03-09T14:41:48.243 INFO:teuthology.orchestra.run.smithi046.stderr: 53400K .......... .......... .......... .......... .......... 57% 43.0M 1s 2024-03-09T14:41:48.243 INFO:teuthology.orchestra.run.smithi046.stderr: 53450K .......... .......... .......... .......... .......... 57% 33.5M 1s 2024-03-09T14:41:48.244 INFO:teuthology.orchestra.run.smithi046.stderr: 53500K .......... .......... .......... .......... .......... 57% 41.5M 1s 2024-03-09T14:41:48.245 INFO:teuthology.orchestra.run.smithi046.stderr: 53550K .......... .......... .......... .......... .......... 57% 46.2M 1s 2024-03-09T14:41:48.247 INFO:teuthology.orchestra.run.smithi046.stderr: 53600K .......... .......... .......... .......... .......... 57% 31.5M 1s 2024-03-09T14:41:48.247 INFO:teuthology.orchestra.run.smithi046.stderr: 53650K .......... .......... .......... .......... .......... 57% 62.5M 1s 2024-03-09T14:41:48.248 INFO:teuthology.orchestra.run.smithi046.stderr: 53700K .......... .......... .......... .......... .......... 57% 52.4M 1s 2024-03-09T14:41:48.249 INFO:teuthology.orchestra.run.smithi046.stderr: 53750K .......... .......... .......... .......... .......... 57% 52.1M 1s 2024-03-09T14:41:48.251 INFO:teuthology.orchestra.run.smithi046.stderr: 53800K .......... .......... .......... .......... .......... 57% 39.1M 1s 2024-03-09T14:41:48.251 INFO:teuthology.orchestra.run.smithi046.stderr: 53850K .......... .......... .......... .......... .......... 58% 61.5M 1s 2024-03-09T14:41:48.252 INFO:teuthology.orchestra.run.smithi046.stderr: 53900K .......... .......... .......... .......... .......... 58% 44.2M 1s 2024-03-09T14:41:48.255 INFO:teuthology.orchestra.run.smithi046.stderr: 53950K .......... .......... .......... .......... .......... 58% 18.8M 1s 2024-03-09T14:41:48.257 INFO:teuthology.orchestra.run.smithi046.stderr: 54000K .......... .......... .......... .......... .......... 58% 27.2M 1s 2024-03-09T14:41:48.258 INFO:teuthology.orchestra.run.smithi046.stderr: 54050K .......... .......... .......... .......... .......... 58% 37.3M 1s 2024-03-09T14:41:48.259 INFO:teuthology.orchestra.run.smithi046.stderr: 54100K .......... .......... .......... .......... .......... 58% 39.0M 1s 2024-03-09T14:41:48.262 INFO:teuthology.orchestra.run.smithi046.stderr: 54150K .......... .......... .......... .......... .......... 58% 50.6M 1s 2024-03-09T14:41:48.262 INFO:teuthology.orchestra.run.smithi046.stderr: 54200K .......... .......... .......... .......... .......... 58% 50.9M 1s 2024-03-09T14:41:48.264 INFO:teuthology.orchestra.run.smithi046.stderr: 54250K .......... .......... .......... .......... .......... 58% 58.6M 1s 2024-03-09T14:41:48.264 INFO:teuthology.orchestra.run.smithi046.stderr: 54300K .......... .......... .......... .......... .......... 58% 56.0M 1s 2024-03-09T14:41:48.264 INFO:teuthology.orchestra.run.smithi046.stderr: 54350K .......... .......... .......... .......... .......... 58% 63.0M 1s 2024-03-09T14:41:48.272 INFO:teuthology.orchestra.run.smithi046.stderr: 54400K .......... .......... .......... .......... .......... 58% 9.33M 1s 2024-03-09T14:41:48.272 INFO:teuthology.orchestra.run.smithi046.stderr: 54450K .......... .......... .......... .......... .......... 58% 432M 1s 2024-03-09T14:41:48.272 INFO:teuthology.orchestra.run.smithi046.stderr: 54500K .......... .......... .......... .......... .......... 58% 184M 1s 2024-03-09T14:41:48.272 INFO:teuthology.orchestra.run.smithi046.stderr: 54550K .......... .......... .......... .......... .......... 58% 71.7M 1s 2024-03-09T14:41:48.272 INFO:teuthology.orchestra.run.smithi046.stderr: 54600K .......... .......... .......... .......... .......... 58% 29.6M 1s 2024-03-09T14:41:48.274 INFO:teuthology.orchestra.run.smithi046.stderr: 54650K .......... .......... .......... .......... .......... 58% 28.6M 1s 2024-03-09T14:41:48.276 INFO:teuthology.orchestra.run.smithi046.stderr: 54700K .......... .......... .......... .......... .......... 58% 53.2M 1s 2024-03-09T14:41:48.276 INFO:teuthology.orchestra.run.smithi046.stderr: 54750K .......... .......... .......... .......... .......... 58% 115M 1s 2024-03-09T14:41:48.276 INFO:teuthology.orchestra.run.smithi046.stderr: 54800K .......... .......... .......... .......... .......... 59% 45.4M 1s 2024-03-09T14:41:48.278 INFO:teuthology.orchestra.run.smithi046.stderr: 54850K .......... .......... .......... .......... .......... 59% 22.2M 1s 2024-03-09T14:41:48.279 INFO:teuthology.orchestra.run.smithi046.stderr: 54900K .......... .......... .......... .......... .......... 59% 44.1M 1s 2024-03-09T14:41:48.281 INFO:teuthology.orchestra.run.smithi046.stderr: 54950K .......... .......... .......... .......... .......... 59% 40.1M 1s 2024-03-09T14:41:48.281 INFO:teuthology.orchestra.run.smithi046.stderr: 55000K .......... .......... .......... .......... .......... 59% 85.4M 1s 2024-03-09T14:41:48.282 INFO:teuthology.orchestra.run.smithi046.stderr: 55050K .......... .......... .......... .......... .......... 59% 52.7M 1s 2024-03-09T14:41:48.284 INFO:teuthology.orchestra.run.smithi046.stderr: 55100K .......... .......... .......... .......... .......... 59% 81.6M 1s 2024-03-09T14:41:48.284 INFO:teuthology.orchestra.run.smithi046.stderr: 55150K .......... .......... .......... .......... .......... 59% 80.5M 1s 2024-03-09T14:41:48.284 INFO:teuthology.orchestra.run.smithi046.stderr: 55200K .......... .......... .......... .......... .......... 59% 62.2M 1s 2024-03-09T14:41:48.285 INFO:teuthology.orchestra.run.smithi046.stderr: 55250K .......... .......... .......... .......... .......... 59% 46.8M 1s 2024-03-09T14:41:48.287 INFO:teuthology.orchestra.run.smithi046.stderr: 55300K .......... .......... .......... .......... .......... 59% 32.0M 1s 2024-03-09T14:41:48.288 INFO:teuthology.orchestra.run.smithi046.stderr: 55350K .......... .......... .......... .......... .......... 59% 45.7M 1s 2024-03-09T14:41:48.289 INFO:teuthology.orchestra.run.smithi046.stderr: 55400K .......... .......... .......... .......... .......... 59% 44.4M 1s 2024-03-09T14:41:48.293 INFO:teuthology.orchestra.run.smithi046.stderr: 55450K .......... .......... .......... .......... .......... 59% 46.5M 1s 2024-03-09T14:41:48.293 INFO:teuthology.orchestra.run.smithi046.stderr: 55500K .......... .......... .......... .......... .......... 59% 75.7M 1s 2024-03-09T14:41:48.293 INFO:teuthology.orchestra.run.smithi046.stderr: 55550K .......... .......... .......... .......... .......... 59% 67.1M 1s 2024-03-09T14:41:48.293 INFO:teuthology.orchestra.run.smithi046.stderr: 55600K .......... .......... .......... .......... .......... 59% 63.2M 1s 2024-03-09T14:41:48.293 INFO:teuthology.orchestra.run.smithi046.stderr: 55650K .......... .......... .......... .......... .......... 59% 59.9M 1s 2024-03-09T14:41:48.295 INFO:teuthology.orchestra.run.smithi046.stderr: 55700K .......... .......... .......... .......... .......... 60% 50.5M 1s 2024-03-09T14:41:48.295 INFO:teuthology.orchestra.run.smithi046.stderr: 55750K .......... .......... .......... .......... .......... 60% 53.3M 1s 2024-03-09T14:41:48.295 INFO:teuthology.orchestra.run.smithi046.stderr: 55800K .......... .......... .......... .......... .......... 60% 58.0M 1s 2024-03-09T14:41:48.296 INFO:teuthology.orchestra.run.smithi046.stderr: 55850K .......... .......... .......... .......... .......... 60% 45.5M 1s 2024-03-09T14:41:48.298 INFO:teuthology.orchestra.run.smithi046.stderr: 55900K .......... .......... .......... .......... .......... 60% 48.5M 1s 2024-03-09T14:41:48.299 INFO:teuthology.orchestra.run.smithi046.stderr: 55950K .......... .......... .......... .......... .......... 60% 114M 1s 2024-03-09T14:41:48.300 INFO:teuthology.orchestra.run.smithi046.stderr: 56000K .......... .......... .......... .......... .......... 60% 40.1M 1s 2024-03-09T14:41:48.381 INFO:teuthology.orchestra.run.smithi046.stderr: 56050K .......... .......... .......... .......... .......... 60% 31.4M 1s 2024-03-09T14:41:48.381 INFO:teuthology.orchestra.run.smithi046.stderr: 56100K .......... .......... .......... .......... .......... 60% 49.8M 1s 2024-03-09T14:41:48.381 INFO:teuthology.orchestra.run.smithi046.stderr: 56150K .......... .......... .......... .......... .......... 60% 55.8M 1s 2024-03-09T14:41:48.381 INFO:teuthology.orchestra.run.smithi046.stderr: 56200K .......... .......... .......... .......... .......... 60% 112M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56250K .......... .......... .......... .......... .......... 60% 43.0M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56300K .......... .......... .......... .......... .......... 60% 39.1M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56350K .......... .......... .......... .......... .......... 60% 36.5M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56400K .......... .......... .......... .......... .......... 60% 33.5M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56450K .......... .......... .......... .......... .......... 60% 128M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56500K .......... .......... .......... .......... .......... 60% 55.3M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56550K .......... .......... .......... .......... .......... 60% 55.0M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56600K .......... .......... .......... .......... .......... 60% 53.4M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56650K .......... .......... .......... .......... .......... 61% 108M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56700K .......... .......... .......... .......... .......... 61% 54.8M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56750K .......... .......... .......... .......... .......... 61% 70.2M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56800K .......... .......... .......... .......... .......... 61% 63.1M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56850K .......... .......... .......... .......... .......... 61% 60.7M 1s 2024-03-09T14:41:48.382 INFO:teuthology.orchestra.run.smithi046.stderr: 56900K .......... .......... .......... .......... .......... 61% 113M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 56950K .......... .......... .......... .......... .......... 61% 48.5M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57000K .......... .......... .......... .......... .......... 61% 49.7M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57050K .......... .......... .......... .......... .......... 61% 53.7M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57100K .......... .......... .......... .......... .......... 61% 87.0M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57150K .......... .......... .......... .......... .......... 61% 41.7M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57200K .......... .......... .......... .......... .......... 61% 39.1M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57250K .......... .......... .......... .......... .......... 61% 67.0M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57300K .......... .......... .......... .......... .......... 61% 44.3M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57350K .......... .......... .......... .......... .......... 61% 142M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57400K .......... .......... .......... .......... .......... 61% 94.1M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57450K .......... .......... .......... .......... .......... 61% 53.2M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57500K .......... .......... .......... .......... .......... 61% 47.7M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57550K .......... .......... .......... .......... .......... 62% 122M 1s 2024-03-09T14:41:48.383 INFO:teuthology.orchestra.run.smithi046.stderr: 57600K .......... .......... .......... .......... .......... 62% 39.6M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57650K .......... .......... .......... .......... .......... 62% 42.6M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57700K .......... .......... .......... .......... .......... 62% 70.0M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57750K .......... .......... .......... .......... .......... 62% 46.9M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57800K .......... .......... .......... .......... .......... 62% 113M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57850K .......... .......... .......... .......... .......... 62% 50.8M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57900K .......... .......... .......... .......... .......... 62% 38.4M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 57950K .......... .......... .......... .......... .......... 62% 81.8M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58000K .......... .......... .......... .......... .......... 62% 42.2M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58050K .......... .......... .......... .......... .......... 62% 118M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58100K .......... .......... .......... .......... .......... 62% 52.2M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58150K .......... .......... .......... .......... .......... 62% 58.5M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58200K .......... .......... .......... .......... .......... 62% 61.9M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58250K .......... .......... .......... .......... .......... 62% 126M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58300K .......... .......... .......... .......... .......... 62% 48.9M 1s 2024-03-09T14:41:48.384 INFO:teuthology.orchestra.run.smithi046.stderr: 58350K .......... .......... .......... .......... .......... 62% 56.5M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58400K .......... .......... .......... .......... .......... 62% 50.8M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58450K .......... .......... .......... .......... .......... 62% 50.1M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58500K .......... .......... .......... .......... .......... 63% 117M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58550K .......... .......... .......... .......... .......... 63% 48.6M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58600K .......... .......... .......... .......... .......... 63% 43.5M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58650K .......... .......... .......... .......... .......... 63% 34.9M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58700K .......... .......... .......... .......... .......... 63% 52.9M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58750K .......... .......... .......... .......... .......... 63% 121M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58800K .......... .......... .......... .......... .......... 63% 55.0M 1s 2024-03-09T14:41:48.385 INFO:teuthology.orchestra.run.smithi046.stderr: 58850K .......... .......... .......... .......... .......... 63% 28.5M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 58900K .......... .......... .......... .......... .......... 63% 44.1M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 58950K .......... .......... .......... .......... .......... 63% 29.3M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59000K .......... .......... .......... .......... .......... 63% 275M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59050K .......... .......... .......... .......... .......... 63% 65.2M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59100K .......... .......... .......... .......... .......... 63% 47.9M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59150K .......... .......... .......... .......... .......... 63% 81.4M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59200K .......... .......... .......... .......... .......... 63% 45.6M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59250K .......... .......... .......... .......... .......... 63% 127M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59300K .......... .......... .......... .......... .......... 63% 70.5M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59350K .......... .......... .......... .......... .......... 63% 48.2M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59400K .......... .......... .......... .......... .......... 63% 78.1M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59450K .......... .......... .......... .......... .......... 64% 114M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59500K .......... .......... .......... .......... .......... 64% 48.6M 1s 2024-03-09T14:41:48.386 INFO:teuthology.orchestra.run.smithi046.stderr: 59550K .......... .......... .......... .......... .......... 64% 27.7M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59600K .......... .......... .......... .......... .......... 64% 42.9M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59650K .......... .......... .......... .......... .......... 64% 52.5M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59700K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59750K .......... .......... .......... .......... .......... 64% 38.0M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59800K .......... .......... .......... .......... .......... 64% 25.0M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59850K .......... .......... .......... .......... .......... 64% 53.6M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59900K .......... .......... .......... .......... .......... 64% 115M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 59950K .......... .......... .......... .......... .......... 64% 32.9M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60000K .......... .......... .......... .......... .......... 64% 60.5M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60050K .......... .......... .......... .......... .......... 64% 32.2M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60100K .......... .......... .......... .......... .......... 64% 49.6M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60150K .......... .......... .......... .......... .......... 64% 104M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60200K .......... .......... .......... .......... .......... 64% 36.6M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60250K .......... .......... .......... .......... .......... 64% 36.6M 1s 2024-03-09T14:41:48.387 INFO:teuthology.orchestra.run.smithi046.stderr: 60300K .......... .......... .......... .......... .......... 64% 52.5M 1s 2024-03-09T14:41:48.388 INFO:teuthology.orchestra.run.smithi046.stderr: 60350K .......... .......... .......... .......... .......... 65% 115M 1s 2024-03-09T14:41:48.388 INFO:teuthology.orchestra.run.smithi046.stderr: 60400K .......... .......... .......... .......... .......... 65% 49.4M 1s 2024-03-09T14:41:48.388 INFO:teuthology.orchestra.run.smithi046.stderr: 60450K .......... .......... .......... .......... .......... 65% 33.9M 1s 2024-03-09T14:41:48.396 INFO:teuthology.orchestra.run.smithi046.stderr: 60500K .......... .......... .......... .......... .......... 65% 23.9M 1s 2024-03-09T14:41:48.396 INFO:teuthology.orchestra.run.smithi046.stderr: 60550K .......... .......... .......... .......... .......... 65% 44.6M 1s 2024-03-09T14:41:48.396 INFO:teuthology.orchestra.run.smithi046.stderr: 60600K .......... .......... .......... .......... .......... 65% 108M 1s 2024-03-09T14:41:48.396 INFO:teuthology.orchestra.run.smithi046.stderr: 60650K .......... .......... .......... .......... .......... 65% 42.7M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 60700K .......... .......... .......... .......... .......... 65% 44.6M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 60750K .......... .......... .......... .......... .......... 65% 32.7M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 60800K .......... .......... .......... .......... .......... 65% 29.9M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 60850K .......... .......... .......... .......... .......... 65% 73.2M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 60900K .......... .......... .......... .......... .......... 65% 37.5M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 60950K .......... .......... .......... .......... .......... 65% 44.6M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 61000K .......... .......... .......... .......... .......... 65% 34.7M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 61050K .......... .......... .......... .......... .......... 65% 57.7M 1s 2024-03-09T14:41:48.397 INFO:teuthology.orchestra.run.smithi046.stderr: 61100K .......... .......... .......... .......... .......... 65% 77.7M 1s 2024-03-09T14:41:48.399 INFO:teuthology.orchestra.run.smithi046.stderr: 61150K .......... .......... .......... .......... .......... 65% 33.2M 1s 2024-03-09T14:41:48.399 INFO:teuthology.orchestra.run.smithi046.stderr: 61200K .......... .......... .......... .......... .......... 65% 30.4M 1s 2024-03-09T14:41:48.401 INFO:teuthology.orchestra.run.smithi046.stderr: 61250K .......... .......... .......... .......... .......... 65% 46.0M 1s 2024-03-09T14:41:48.401 INFO:teuthology.orchestra.run.smithi046.stderr: 61300K .......... .......... .......... .......... .......... 66% 50.3M 1s 2024-03-09T14:41:48.401 INFO:teuthology.orchestra.run.smithi046.stderr: 61350K .......... .......... .......... .......... .......... 66% 101M 1s 2024-03-09T14:41:48.403 INFO:teuthology.orchestra.run.smithi046.stderr: 61400K .......... .......... .......... .......... .......... 66% 25.9M 1s 2024-03-09T14:41:48.405 INFO:teuthology.orchestra.run.smithi046.stderr: 61450K .......... .......... .......... .......... .......... 66% 23.7M 1s 2024-03-09T14:41:48.407 INFO:teuthology.orchestra.run.smithi046.stderr: 61500K .......... .......... .......... .......... .......... 66% 42.5M 1s 2024-03-09T14:41:48.410 INFO:teuthology.orchestra.run.smithi046.stderr: 61550K .......... .......... .......... .......... .......... 66% 119M 1s 2024-03-09T14:41:48.410 INFO:teuthology.orchestra.run.smithi046.stderr: 61600K .......... .......... .......... .......... .......... 66% 34.9M 1s 2024-03-09T14:41:48.410 INFO:teuthology.orchestra.run.smithi046.stderr: 61650K .......... .......... .......... .......... .......... 66% 50.3M 1s 2024-03-09T14:41:48.411 INFO:teuthology.orchestra.run.smithi046.stderr: 61700K .......... .......... .......... .......... .......... 66% 28.5M 1s 2024-03-09T14:41:48.413 INFO:teuthology.orchestra.run.smithi046.stderr: 61750K .......... .......... .......... .......... .......... 66% 34.2M 1s 2024-03-09T14:41:48.413 INFO:teuthology.orchestra.run.smithi046.stderr: 61800K .......... .......... .......... .......... .......... 66% 67.2M 1s 2024-03-09T14:41:48.414 INFO:teuthology.orchestra.run.smithi046.stderr: 61850K .......... .......... .......... .......... .......... 66% 39.2M 1s 2024-03-09T14:41:48.415 INFO:teuthology.orchestra.run.smithi046.stderr: 61900K .......... .......... .......... .......... .......... 66% 45.7M 1s 2024-03-09T14:41:48.417 INFO:teuthology.orchestra.run.smithi046.stderr: 61950K .......... .......... .......... .......... .......... 66% 28.1M 1s 2024-03-09T14:41:48.418 INFO:teuthology.orchestra.run.smithi046.stderr: 62000K .......... .......... .......... .......... .......... 66% 46.3M 1s 2024-03-09T14:41:48.419 INFO:teuthology.orchestra.run.smithi046.stderr: 62050K .......... .......... .......... .......... .......... 66% 54.9M 1s 2024-03-09T14:41:48.420 INFO:teuthology.orchestra.run.smithi046.stderr: 62100K .......... .......... .......... .......... .......... 66% 54.4M 1s 2024-03-09T14:41:48.421 INFO:teuthology.orchestra.run.smithi046.stderr: 62150K .......... .......... .......... .......... .......... 66% 34.5M 1s 2024-03-09T14:41:48.423 INFO:teuthology.orchestra.run.smithi046.stderr: 62200K .......... .......... .......... .......... .......... 67% 41.2M 1s 2024-03-09T14:41:48.423 INFO:teuthology.orchestra.run.smithi046.stderr: 62250K .......... .......... .......... .......... .......... 67% 42.2M 1s 2024-03-09T14:41:48.424 INFO:teuthology.orchestra.run.smithi046.stderr: 62300K .......... .......... .......... .......... .......... 67% 71.0M 1s 2024-03-09T14:41:48.426 INFO:teuthology.orchestra.run.smithi046.stderr: 62350K .......... .......... .......... .......... .......... 67% 24.1M 1s 2024-03-09T14:41:48.429 INFO:teuthology.orchestra.run.smithi046.stderr: 62400K .......... .......... .......... .......... .......... 67% 20.3M 1s 2024-03-09T14:41:48.430 INFO:teuthology.orchestra.run.smithi046.stderr: 62450K .......... .......... .......... .......... .......... 67% 55.5M 1s 2024-03-09T14:41:48.430 INFO:teuthology.orchestra.run.smithi046.stderr: 62500K .......... .......... .......... .......... .......... 67% 66.6M 1s 2024-03-09T14:41:48.431 INFO:teuthology.orchestra.run.smithi046.stderr: 62550K .......... .......... .......... .......... .......... 67% 55.4M 1s 2024-03-09T14:41:48.432 INFO:teuthology.orchestra.run.smithi046.stderr: 62600K .......... .......... .......... .......... .......... 67% 41.9M 1s 2024-03-09T14:41:48.436 INFO:teuthology.orchestra.run.smithi046.stderr: 62650K .......... .......... .......... .......... .......... 67% 23.0M 1s 2024-03-09T14:41:48.436 INFO:teuthology.orchestra.run.smithi046.stderr: 62700K .......... .......... .......... .......... .......... 67% 54.1M 1s 2024-03-09T14:41:48.437 INFO:teuthology.orchestra.run.smithi046.stderr: 62750K .......... .......... .......... .......... .......... 67% 36.4M 1s 2024-03-09T14:41:48.439 INFO:teuthology.orchestra.run.smithi046.stderr: 62800K .......... .......... .......... .......... .......... 67% 29.2M 1s 2024-03-09T14:41:48.440 INFO:teuthology.orchestra.run.smithi046.stderr: 62850K .......... .......... .......... .......... .......... 67% 45.4M 1s 2024-03-09T14:41:48.441 INFO:teuthology.orchestra.run.smithi046.stderr: 62900K .......... .......... .......... .......... .......... 67% 27.4M 1s 2024-03-09T14:41:48.442 INFO:teuthology.orchestra.run.smithi046.stderr: 62950K .......... .......... .......... .......... .......... 67% 54.6M 1s 2024-03-09T14:41:48.445 INFO:teuthology.orchestra.run.smithi046.stderr: 63000K .......... .......... .......... .......... .......... 67% 41.6M 1s 2024-03-09T14:41:48.445 INFO:teuthology.orchestra.run.smithi046.stderr: 63050K .......... .......... .......... .......... .......... 67% 42.4M 1s 2024-03-09T14:41:48.447 INFO:teuthology.orchestra.run.smithi046.stderr: 63100K .......... .......... .......... .......... .......... 67% 32.3M 1s 2024-03-09T14:41:48.448 INFO:teuthology.orchestra.run.smithi046.stderr: 63150K .......... .......... .......... .......... .......... 68% 65.3M 1s 2024-03-09T14:41:48.448 INFO:teuthology.orchestra.run.smithi046.stderr: 63200K .......... .......... .......... .......... .......... 68% 29.5M 1s 2024-03-09T14:41:48.449 INFO:teuthology.orchestra.run.smithi046.stderr: 63250K .......... .......... .......... .......... .......... 68% 57.3M 1s 2024-03-09T14:41:48.451 INFO:teuthology.orchestra.run.smithi046.stderr: 63300K .......... .......... .......... .......... .......... 68% 30.3M 1s 2024-03-09T14:41:48.453 INFO:teuthology.orchestra.run.smithi046.stderr: 63350K .......... .......... .......... .......... .......... 68% 19.3M 1s 2024-03-09T14:41:48.454 INFO:teuthology.orchestra.run.smithi046.stderr: 63400K .......... .......... .......... .......... .......... 68% 46.1M 1s 2024-03-09T14:41:48.456 INFO:teuthology.orchestra.run.smithi046.stderr: 63450K .......... .......... .......... .......... .......... 68% 45.5M 1s 2024-03-09T14:41:48.457 INFO:teuthology.orchestra.run.smithi046.stderr: 63500K .......... .......... .......... .......... .......... 68% 53.6M 1s 2024-03-09T14:41:48.458 INFO:teuthology.orchestra.run.smithi046.stderr: 63550K .......... .......... .......... .......... .......... 68% 46.6M 1s 2024-03-09T14:41:48.460 INFO:teuthology.orchestra.run.smithi046.stderr: 63600K .......... .......... .......... .......... .......... 68% 21.9M 1s 2024-03-09T14:41:48.460 INFO:teuthology.orchestra.run.smithi046.stderr: 63650K .......... .......... .......... .......... .......... 68% 55.6M 1s 2024-03-09T14:41:48.463 INFO:teuthology.orchestra.run.smithi046.stderr: 63700K .......... .......... .......... .......... .......... 68% 23.0M 1s 2024-03-09T14:41:48.464 INFO:teuthology.orchestra.run.smithi046.stderr: 63750K .......... .......... .......... .......... .......... 68% 54.1M 1s 2024-03-09T14:41:48.466 INFO:teuthology.orchestra.run.smithi046.stderr: 63800K .......... .......... .......... .......... .......... 68% 35.8M 1s 2024-03-09T14:41:48.466 INFO:teuthology.orchestra.run.smithi046.stderr: 63850K .......... .......... .......... .......... .......... 68% 66.9M 1s 2024-03-09T14:41:48.467 INFO:teuthology.orchestra.run.smithi046.stderr: 63900K .......... .......... .......... .......... .......... 68% 32.3M 1s 2024-03-09T14:41:48.468 INFO:teuthology.orchestra.run.smithi046.stderr: 63950K .......... .......... .......... .......... .......... 68% 47.9M 1s 2024-03-09T14:41:48.469 INFO:teuthology.orchestra.run.smithi046.stderr: 64000K .......... .......... .......... .......... .......... 68% 44.4M 1s 2024-03-09T14:41:48.471 INFO:teuthology.orchestra.run.smithi046.stderr: 64050K .......... .......... .......... .......... .......... 68% 46.5M 1s 2024-03-09T14:41:48.472 INFO:teuthology.orchestra.run.smithi046.stderr: 64100K .......... .......... .......... .......... .......... 69% 50.6M 1s 2024-03-09T14:41:48.472 INFO:teuthology.orchestra.run.smithi046.stderr: 64150K .......... .......... .......... .......... .......... 69% 46.5M 1s 2024-03-09T14:41:48.473 INFO:teuthology.orchestra.run.smithi046.stderr: 64200K .......... .......... .......... .......... .......... 69% 53.3M 1s 2024-03-09T14:41:48.475 INFO:teuthology.orchestra.run.smithi046.stderr: 64250K .......... .......... .......... .......... .......... 69% 31.6M 1s 2024-03-09T14:41:48.476 INFO:teuthology.orchestra.run.smithi046.stderr: 64300K .......... .......... .......... .......... .......... 69% 28.6M 1s 2024-03-09T14:41:48.479 INFO:teuthology.orchestra.run.smithi046.stderr: 64350K .......... .......... .......... .......... .......... 69% 40.6M 1s 2024-03-09T14:41:48.480 INFO:teuthology.orchestra.run.smithi046.stderr: 64400K .......... .......... .......... .......... .......... 69% 35.5M 1s 2024-03-09T14:41:48.480 INFO:teuthology.orchestra.run.smithi046.stderr: 64450K .......... .......... .......... .......... .......... 69% 59.8M 1s 2024-03-09T14:41:48.481 INFO:teuthology.orchestra.run.smithi046.stderr: 64500K .......... .......... .......... .......... .......... 69% 38.9M 1s 2024-03-09T14:41:48.483 INFO:teuthology.orchestra.run.smithi046.stderr: 64550K .......... .......... .......... .......... .......... 69% 39.1M 1s 2024-03-09T14:41:48.483 INFO:teuthology.orchestra.run.smithi046.stderr: 64600K .......... .......... .......... .......... .......... 69% 60.4M 1s 2024-03-09T14:41:48.485 INFO:teuthology.orchestra.run.smithi046.stderr: 64650K .......... .......... .......... .......... .......... 69% 44.3M 1s 2024-03-09T14:41:48.485 INFO:teuthology.orchestra.run.smithi046.stderr: 64700K .......... .......... .......... .......... .......... 69% 65.5M 1s 2024-03-09T14:41:48.486 INFO:teuthology.orchestra.run.smithi046.stderr: 64750K .......... .......... .......... .......... .......... 69% 49.2M 1s 2024-03-09T14:41:48.487 INFO:teuthology.orchestra.run.smithi046.stderr: 64800K .......... .......... .......... .......... .......... 69% 41.4M 1s 2024-03-09T14:41:48.488 INFO:teuthology.orchestra.run.smithi046.stderr: 64850K .......... .......... .......... .......... .......... 69% 66.9M 1s 2024-03-09T14:41:48.490 INFO:teuthology.orchestra.run.smithi046.stderr: 64900K .......... .......... .......... .......... .......... 69% 74.9M 1s 2024-03-09T14:41:48.490 INFO:teuthology.orchestra.run.smithi046.stderr: 64950K .......... .......... .......... .......... .......... 69% 72.5M 1s 2024-03-09T14:41:48.491 INFO:teuthology.orchestra.run.smithi046.stderr: 65000K .......... .......... .......... .......... .......... 70% 42.9M 1s 2024-03-09T14:41:48.492 INFO:teuthology.orchestra.run.smithi046.stderr: 65050K .......... .......... .......... .......... .......... 70% 23.9M 1s 2024-03-09T14:41:48.494 INFO:teuthology.orchestra.run.smithi046.stderr: 65100K .......... .......... .......... .......... .......... 70% 62.9M 1s 2024-03-09T14:41:48.495 INFO:teuthology.orchestra.run.smithi046.stderr: 65150K .......... .......... .......... .......... .......... 70% 33.2M 1s 2024-03-09T14:41:48.497 INFO:teuthology.orchestra.run.smithi046.stderr: 65200K .......... .......... .......... .......... .......... 70% 19.5M 1s 2024-03-09T14:41:48.499 INFO:teuthology.orchestra.run.smithi046.stderr: 65250K .......... .......... .......... .......... .......... 70% 26.8M 1s 2024-03-09T14:41:48.500 INFO:teuthology.orchestra.run.smithi046.stderr: 65300K .......... .......... .......... .......... .......... 70% 68.5M 1s 2024-03-09T14:41:48.501 INFO:teuthology.orchestra.run.smithi046.stderr: 65350K .......... .......... .......... .......... .......... 70% 62.0M 1s 2024-03-09T14:41:48.502 INFO:teuthology.orchestra.run.smithi046.stderr: 65400K .......... .......... .......... .......... .......... 70% 47.5M 1s 2024-03-09T14:41:48.503 INFO:teuthology.orchestra.run.smithi046.stderr: 65450K .......... .......... .......... .......... .......... 70% 48.6M 1s 2024-03-09T14:41:48.503 INFO:teuthology.orchestra.run.smithi046.stderr: 65500K .......... .......... .......... .......... .......... 70% 108M 1s 2024-03-09T14:41:48.504 INFO:teuthology.orchestra.run.smithi046.stderr: 65550K .......... .......... .......... .......... .......... 70% 61.6M 1s 2024-03-09T14:41:48.505 INFO:teuthology.orchestra.run.smithi046.stderr: 65600K .......... .......... .......... .......... .......... 70% 36.3M 1s 2024-03-09T14:41:48.506 INFO:teuthology.orchestra.run.smithi046.stderr: 65650K .......... .......... .......... .......... .......... 70% 56.2M 1s 2024-03-09T14:41:48.508 INFO:teuthology.orchestra.run.smithi046.stderr: 65700K .......... .......... .......... .......... .......... 70% 25.3M 1s 2024-03-09T14:41:48.509 INFO:teuthology.orchestra.run.smithi046.stderr: 65750K .......... .......... .......... .......... .......... 70% 45.6M 1s 2024-03-09T14:41:48.510 INFO:teuthology.orchestra.run.smithi046.stderr: 65800K .......... .......... .......... .......... .......... 70% 55.4M 1s 2024-03-09T14:41:48.511 INFO:teuthology.orchestra.run.smithi046.stderr: 65850K .......... .......... .......... .......... .......... 70% 50.6M 1s 2024-03-09T14:41:48.512 INFO:teuthology.orchestra.run.smithi046.stderr: 65900K .......... .......... .......... .......... .......... 70% 49.8M 1s 2024-03-09T14:41:48.513 INFO:teuthology.orchestra.run.smithi046.stderr: 65950K .......... .......... .......... .......... .......... 71% 58.4M 1s 2024-03-09T14:41:48.515 INFO:teuthology.orchestra.run.smithi046.stderr: 66000K .......... .......... .......... .......... .......... 71% 30.0M 1s 2024-03-09T14:41:48.515 INFO:teuthology.orchestra.run.smithi046.stderr: 66050K .......... .......... .......... .......... .......... 71% 72.1M 1s 2024-03-09T14:41:48.516 INFO:teuthology.orchestra.run.smithi046.stderr: 66100K .......... .......... .......... .......... .......... 71% 50.2M 1s 2024-03-09T14:41:48.518 INFO:teuthology.orchestra.run.smithi046.stderr: 66150K .......... .......... .......... .......... .......... 71% 26.8M 1s 2024-03-09T14:41:48.519 INFO:teuthology.orchestra.run.smithi046.stderr: 66200K .......... .......... .......... .......... .......... 71% 55.2M 1s 2024-03-09T14:41:48.523 INFO:teuthology.orchestra.run.smithi046.stderr: 66250K .......... .......... .......... .......... .......... 71% 17.2M 1s 2024-03-09T14:41:48.523 INFO:teuthology.orchestra.run.smithi046.stderr: 66300K .......... .......... .......... .......... .......... 71% 82.5M 1s 2024-03-09T14:41:48.524 INFO:teuthology.orchestra.run.smithi046.stderr: 66350K .......... .......... .......... .......... .......... 71% 29.0M 1s 2024-03-09T14:41:48.527 INFO:teuthology.orchestra.run.smithi046.stderr: 66400K .......... .......... .......... .......... .......... 71% 31.7M 1s 2024-03-09T14:41:48.527 INFO:teuthology.orchestra.run.smithi046.stderr: 66450K .......... .......... .......... .......... .......... 71% 46.3M 1s 2024-03-09T14:41:48.527 INFO:teuthology.orchestra.run.smithi046.stderr: 66500K .......... .......... .......... .......... .......... 71% 81.7M 1s 2024-03-09T14:41:48.530 INFO:teuthology.orchestra.run.smithi046.stderr: 66550K .......... .......... .......... .......... .......... 71% 39.9M 1s 2024-03-09T14:41:48.530 INFO:teuthology.orchestra.run.smithi046.stderr: 66600K .......... .......... .......... .......... .......... 71% 54.0M 1s 2024-03-09T14:41:48.531 INFO:teuthology.orchestra.run.smithi046.stderr: 66650K .......... .......... .......... .......... .......... 71% 28.9M 1s 2024-03-09T14:41:48.531 INFO:teuthology.orchestra.run.smithi046.stderr: 66700K .......... .......... .......... .......... .......... 71% 116M 1s 2024-03-09T14:41:48.533 INFO:teuthology.orchestra.run.smithi046.stderr: 66750K .......... .......... .......... .......... .......... 71% 30.7M 1s 2024-03-09T14:41:48.534 INFO:teuthology.orchestra.run.smithi046.stderr: 66800K .......... .......... .......... .......... .......... 71% 44.5M 1s 2024-03-09T14:41:48.542 INFO:teuthology.orchestra.run.smithi046.stderr: 66850K .......... .......... .......... .......... .......... 72% 56.2M 1s 2024-03-09T14:41:48.542 INFO:teuthology.orchestra.run.smithi046.stderr: 66900K .......... .......... .......... .......... .......... 72% 48.7M 1s 2024-03-09T14:41:48.542 INFO:teuthology.orchestra.run.smithi046.stderr: 66950K .......... .......... .......... .......... .......... 72% 118M 1s 2024-03-09T14:41:48.542 INFO:teuthology.orchestra.run.smithi046.stderr: 67000K .......... .......... .......... .......... .......... 72% 35.7M 1s 2024-03-09T14:41:48.542 INFO:teuthology.orchestra.run.smithi046.stderr: 67050K .......... .......... .......... .......... .......... 72% 56.5M 1s 2024-03-09T14:41:48.542 INFO:teuthology.orchestra.run.smithi046.stderr: 67100K .......... .......... .......... .......... .......... 72% 24.7M 1s 2024-03-09T14:41:48.545 INFO:teuthology.orchestra.run.smithi046.stderr: 67150K .......... .......... .......... .......... .......... 72% 35.1M 1s 2024-03-09T14:41:48.545 INFO:teuthology.orchestra.run.smithi046.stderr: 67200K .......... .......... .......... .......... .......... 72% 14.6M 1s 2024-03-09T14:41:48.546 INFO:teuthology.orchestra.run.smithi046.stderr: 67250K .......... .......... .......... .......... .......... 72% 62.7M 1s 2024-03-09T14:41:48.548 INFO:teuthology.orchestra.run.smithi046.stderr: 67300K .......... .......... .......... .......... .......... 72% 32.5M 1s 2024-03-09T14:41:48.549 INFO:teuthology.orchestra.run.smithi046.stderr: 67350K .......... .......... .......... .......... .......... 72% 50.1M 1s 2024-03-09T14:41:48.549 INFO:teuthology.orchestra.run.smithi046.stderr: 67400K .......... .......... .......... .......... .......... 72% 50.7M 1s 2024-03-09T14:41:48.552 INFO:teuthology.orchestra.run.smithi046.stderr: 67450K .......... .......... .......... .......... .......... 72% 47.2M 1s 2024-03-09T14:41:48.552 INFO:teuthology.orchestra.run.smithi046.stderr: 67500K .......... .......... .......... .......... .......... 72% 49.6M 1s 2024-03-09T14:41:48.553 INFO:teuthology.orchestra.run.smithi046.stderr: 67550K .......... .......... .......... .......... .......... 72% 36.2M 1s 2024-03-09T14:41:48.556 INFO:teuthology.orchestra.run.smithi046.stderr: 67600K .......... .......... .......... .......... .......... 72% 22.6M 1s 2024-03-09T14:41:48.556 INFO:teuthology.orchestra.run.smithi046.stderr: 67650K .......... .......... .......... .......... .......... 72% 74.0M 1s 2024-03-09T14:41:48.558 INFO:teuthology.orchestra.run.smithi046.stderr: 67700K .......... .......... .......... .......... .......... 72% 36.3M 1s 2024-03-09T14:41:48.558 INFO:teuthology.orchestra.run.smithi046.stderr: 67750K .......... .......... .......... .......... .......... 72% 43.7M 1s 2024-03-09T14:41:48.560 INFO:teuthology.orchestra.run.smithi046.stderr: 67800K .......... .......... .......... .......... .......... 73% 33.8M 1s 2024-03-09T14:41:48.561 INFO:teuthology.orchestra.run.smithi046.stderr: 67850K .......... .......... .......... .......... .......... 73% 41.4M 1s 2024-03-09T14:41:48.561 INFO:teuthology.orchestra.run.smithi046.stderr: 67900K .......... .......... .......... .......... .......... 73% 112M 1s 2024-03-09T14:41:48.563 INFO:teuthology.orchestra.run.smithi046.stderr: 67950K .......... .......... .......... .......... .......... 73% 39.6M 1s 2024-03-09T14:41:48.564 INFO:teuthology.orchestra.run.smithi046.stderr: 68000K .......... .......... .......... .......... .......... 73% 36.3M 1s 2024-03-09T14:41:48.566 INFO:teuthology.orchestra.run.smithi046.stderr: 68050K .......... .......... .......... .......... .......... 73% 30.7M 1s 2024-03-09T14:41:48.566 INFO:teuthology.orchestra.run.smithi046.stderr: 68100K .......... .......... .......... .......... .......... 73% 44.2M 1s 2024-03-09T14:41:48.570 INFO:teuthology.orchestra.run.smithi046.stderr: 68150K .......... .......... .......... .......... .......... 73% 16.8M 1s 2024-03-09T14:41:48.572 INFO:teuthology.orchestra.run.smithi046.stderr: 68200K .......... .......... .......... .......... .......... 73% 56.3M 1s 2024-03-09T14:41:48.572 INFO:teuthology.orchestra.run.smithi046.stderr: 68250K .......... .......... .......... .......... .......... 73% 48.5M 1s 2024-03-09T14:41:48.572 INFO:teuthology.orchestra.run.smithi046.stderr: 68300K .......... .......... .......... .......... .......... 73% 54.5M 1s 2024-03-09T14:41:48.573 INFO:teuthology.orchestra.run.smithi046.stderr: 68350K .......... .......... .......... .......... .......... 73% 56.4M 1s 2024-03-09T14:41:48.574 INFO:teuthology.orchestra.run.smithi046.stderr: 68400K .......... .......... .......... .......... .......... 73% 47.6M 1s 2024-03-09T14:41:48.575 INFO:teuthology.orchestra.run.smithi046.stderr: 68450K .......... .......... .......... .......... .......... 73% 40.2M 1s 2024-03-09T14:41:48.577 INFO:teuthology.orchestra.run.smithi046.stderr: 68500K .......... .......... .......... .......... .......... 73% 32.3M 1s 2024-03-09T14:41:48.578 INFO:teuthology.orchestra.run.smithi046.stderr: 68550K .......... .......... .......... .......... .......... 73% 51.5M 1s 2024-03-09T14:41:48.579 INFO:teuthology.orchestra.run.smithi046.stderr: 68600K .......... .......... .......... .......... .......... 73% 44.8M 1s 2024-03-09T14:41:48.581 INFO:teuthology.orchestra.run.smithi046.stderr: 68650K .......... .......... .......... .......... .......... 73% 27.6M 1s 2024-03-09T14:41:48.582 INFO:teuthology.orchestra.run.smithi046.stderr: 68700K .......... .......... .......... .......... .......... 74% 32.8M 1s 2024-03-09T14:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr: 68750K .......... .......... .......... .......... .......... 74% 58.4M 1s 2024-03-09T14:41:48.584 INFO:teuthology.orchestra.run.smithi046.stderr: 68800K .......... .......... .......... .......... .......... 74% 36.9M 1s 2024-03-09T14:41:48.585 INFO:teuthology.orchestra.run.smithi046.stderr: 68850K .......... .......... .......... .......... .......... 74% 36.1M 1s 2024-03-09T14:41:48.586 INFO:teuthology.orchestra.run.smithi046.stderr: 68900K .......... .......... .......... .......... .......... 74% 59.6M 1s 2024-03-09T14:41:48.588 INFO:teuthology.orchestra.run.smithi046.stderr: 68950K .......... .......... .......... .......... .......... 74% 40.8M 1s 2024-03-09T14:41:48.588 INFO:teuthology.orchestra.run.smithi046.stderr: 69000K .......... .......... .......... .......... .......... 74% 54.1M 1s 2024-03-09T14:41:48.590 INFO:teuthology.orchestra.run.smithi046.stderr: 69050K .......... .......... .......... .......... .......... 74% 38.3M 1s 2024-03-09T14:41:48.593 INFO:teuthology.orchestra.run.smithi046.stderr: 69100K .......... .......... .......... .......... .......... 74% 18.3M 1s 2024-03-09T14:41:48.593 INFO:teuthology.orchestra.run.smithi046.stderr: 69150K .......... .......... .......... .......... .......... 74% 53.7M 1s 2024-03-09T14:41:48.595 INFO:teuthology.orchestra.run.smithi046.stderr: 69200K .......... .......... .......... .......... .......... 74% 39.4M 1s 2024-03-09T14:41:48.595 INFO:teuthology.orchestra.run.smithi046.stderr: 69250K .......... .......... .......... .......... .......... 74% 43.7M 1s 2024-03-09T14:41:48.597 INFO:teuthology.orchestra.run.smithi046.stderr: 69300K .......... .......... .......... .......... .......... 74% 38.1M 1s 2024-03-09T14:41:48.598 INFO:teuthology.orchestra.run.smithi046.stderr: 69350K .......... .......... .......... .......... .......... 74% 50.7M 1s 2024-03-09T14:41:48.599 INFO:teuthology.orchestra.run.smithi046.stderr: 69400K .......... .......... .......... .......... .......... 74% 45.1M 1s 2024-03-09T14:41:48.601 INFO:teuthology.orchestra.run.smithi046.stderr: 69450K .......... .......... .......... .......... .......... 74% 32.8M 1s 2024-03-09T14:41:48.601 INFO:teuthology.orchestra.run.smithi046.stderr: 69500K .......... .......... .......... .......... .......... 74% 70.0M 1s 2024-03-09T14:41:48.603 INFO:teuthology.orchestra.run.smithi046.stderr: 69550K .......... .......... .......... .......... .......... 74% 49.7M 1s 2024-03-09T14:41:48.604 INFO:teuthology.orchestra.run.smithi046.stderr: 69600K .......... .......... .......... .......... .......... 74% 25.2M 1s 2024-03-09T14:41:48.607 INFO:teuthology.orchestra.run.smithi046.stderr: 69650K .......... .......... .......... .......... .......... 75% 18.0M 1s 2024-03-09T14:41:48.608 INFO:teuthology.orchestra.run.smithi046.stderr: 69700K .......... .......... .......... .......... .......... 75% 46.2M 1s 2024-03-09T14:41:48.609 INFO:teuthology.orchestra.run.smithi046.stderr: 69750K .......... .......... .......... .......... .......... 75% 62.2M 1s 2024-03-09T14:41:48.610 INFO:teuthology.orchestra.run.smithi046.stderr: 69800K .......... .......... .......... .......... .......... 75% 49.0M 1s 2024-03-09T14:41:48.611 INFO:teuthology.orchestra.run.smithi046.stderr: 69850K .......... .......... .......... .......... .......... 75% 32.6M 1s 2024-03-09T14:41:48.613 INFO:teuthology.orchestra.run.smithi046.stderr: 69900K .......... .......... .......... .......... .......... 75% 40.0M 1s 2024-03-09T14:41:48.614 INFO:teuthology.orchestra.run.smithi046.stderr: 69950K .......... .......... .......... .......... .......... 75% 60.4M 1s 2024-03-09T14:41:48.615 INFO:teuthology.orchestra.run.smithi046.stderr: 70000K .......... .......... .......... .......... .......... 75% 30.1M 1s 2024-03-09T14:41:48.619 INFO:teuthology.orchestra.run.smithi046.stderr: 70050K .......... .......... .......... .......... .......... 75% 16.3M 1s 2024-03-09T14:41:48.619 INFO:teuthology.orchestra.run.smithi046.stderr: 70100K .......... .......... .......... .......... .......... 75% 55.2M 1s 2024-03-09T14:41:48.620 INFO:teuthology.orchestra.run.smithi046.stderr: 70150K .......... .......... .......... .......... .......... 75% 46.5M 1s 2024-03-09T14:41:48.620 INFO:teuthology.orchestra.run.smithi046.stderr: 70200K .......... .......... .......... .......... .......... 75% 57.2M 1s 2024-03-09T14:41:48.622 INFO:teuthology.orchestra.run.smithi046.stderr: 70250K .......... .......... .......... .......... .......... 75% 41.8M 1s 2024-03-09T14:41:48.624 INFO:teuthology.orchestra.run.smithi046.stderr: 70300K .......... .......... .......... .......... .......... 75% 28.9M 1s 2024-03-09T14:41:48.625 INFO:teuthology.orchestra.run.smithi046.stderr: 70350K .......... .......... .......... .......... .......... 75% 48.8M 1s 2024-03-09T14:41:48.626 INFO:teuthology.orchestra.run.smithi046.stderr: 70400K .......... .......... .......... .......... .......... 75% 31.7M 1s 2024-03-09T14:41:48.627 INFO:teuthology.orchestra.run.smithi046.stderr: 70450K .......... .......... .......... .......... .......... 75% 79.0M 1s 2024-03-09T14:41:48.627 INFO:teuthology.orchestra.run.smithi046.stderr: 70500K .......... .......... .......... .......... .......... 75% 47.7M 1s 2024-03-09T14:41:48.629 INFO:teuthology.orchestra.run.smithi046.stderr: 70550K .......... .......... .......... .......... .......... 75% 35.0M 1s 2024-03-09T14:41:48.631 INFO:teuthology.orchestra.run.smithi046.stderr: 70600K .......... .......... .......... .......... .......... 76% 29.0M 1s 2024-03-09T14:41:48.631 INFO:teuthology.orchestra.run.smithi046.stderr: 70650K .......... .......... .......... .......... .......... 76% 107M 1s 2024-03-09T14:41:48.633 INFO:teuthology.orchestra.run.smithi046.stderr: 70700K .......... .......... .......... .......... .......... 76% 26.7M 1s 2024-03-09T14:41:48.634 INFO:teuthology.orchestra.run.smithi046.stderr: 70750K .......... .......... .......... .......... .......... 76% 47.8M 1s 2024-03-09T14:41:48.636 INFO:teuthology.orchestra.run.smithi046.stderr: 70800K .......... .......... .......... .......... .......... 76% 26.8M 1s 2024-03-09T14:41:48.637 INFO:teuthology.orchestra.run.smithi046.stderr: 70850K .......... .......... .......... .......... .......... 76% 45.1M 1s 2024-03-09T14:41:48.638 INFO:teuthology.orchestra.run.smithi046.stderr: 70900K .......... .......... .......... .......... .......... 76% 53.6M 1s 2024-03-09T14:41:48.639 INFO:teuthology.orchestra.run.smithi046.stderr: 70950K .......... .......... .......... .......... .......... 76% 49.9M 1s 2024-03-09T14:41:48.656 INFO:teuthology.orchestra.run.smithi046.stderr: 71000K .......... .......... .......... .......... .......... 76% 13.9M 1s 2024-03-09T14:41:48.656 INFO:teuthology.orchestra.run.smithi046.stderr: 71050K .......... .......... .......... .......... .......... 76% 61.7M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71100K .......... .......... .......... .......... .......... 76% 56.4M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71150K .......... .......... .......... .......... .......... 76% 68.8M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71200K .......... .......... .......... .......... .......... 76% 36.6M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71250K .......... .......... .......... .......... .......... 76% 28.0M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71300K .......... .......... .......... .......... .......... 76% 52.9M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71350K .......... .......... .......... .......... .......... 76% 53.5M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71400K .......... .......... .......... .......... .......... 76% 38.4M 1s 2024-03-09T14:41:48.657 INFO:teuthology.orchestra.run.smithi046.stderr: 71450K .......... .......... .......... .......... .......... 76% 48.7M 1s 2024-03-09T14:41:48.658 INFO:teuthology.orchestra.run.smithi046.stderr: 71500K .......... .......... .......... .......... .......... 77% 27.8M 1s 2024-03-09T14:41:48.658 INFO:teuthology.orchestra.run.smithi046.stderr: 71550K .......... .......... .......... .......... .......... 77% 82.4M 1s 2024-03-09T14:41:48.658 INFO:teuthology.orchestra.run.smithi046.stderr: 71600K .......... .......... .......... .......... .......... 77% 28.9M 1s 2024-03-09T14:41:48.672 INFO:teuthology.orchestra.run.smithi046.stderr: 71650K .......... .......... .......... .......... .......... 77% 31.8M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 71700K .......... .......... .......... .......... .......... 77% 60.3M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 71750K .......... .......... .......... .......... .......... 77% 27.0M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 71800K .......... .......... .......... .......... .......... 77% 67.6M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 71850K .......... .......... .......... .......... .......... 77% 38.3M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 71900K .......... .......... .......... .......... .......... 77% 50.7M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 71950K .......... .......... .......... .......... .......... 77% 34.5M 1s 2024-03-09T14:41:48.673 INFO:teuthology.orchestra.run.smithi046.stderr: 72000K .......... .......... .......... .......... .......... 77% 19.8M 1s 2024-03-09T14:41:48.674 INFO:teuthology.orchestra.run.smithi046.stderr: 72050K .......... .......... .......... .......... .......... 77% 39.9M 1s 2024-03-09T14:41:48.674 INFO:teuthology.orchestra.run.smithi046.stderr: 72100K .......... .......... .......... .......... .......... 77% 47.3M 1s 2024-03-09T14:41:48.674 INFO:teuthology.orchestra.run.smithi046.stderr: 72150K .......... .......... .......... .......... .......... 77% 56.2M 1s 2024-03-09T14:41:48.674 INFO:teuthology.orchestra.run.smithi046.stderr: 72200K .......... .......... .......... .......... .......... 77% 31.4M 1s 2024-03-09T14:41:48.695 INFO:teuthology.orchestra.run.smithi046.stderr: 72250K .......... .......... .......... .......... .......... 77% 36.8M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72300K .......... .......... .......... .......... .......... 77% 61.9M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72350K .......... .......... .......... .......... .......... 77% 45.3M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72400K .......... .......... .......... .......... .......... 77% 32.5M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72450K .......... .......... .......... .......... .......... 78% 24.8M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72500K .......... .......... .......... .......... .......... 78% 44.4M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72550K .......... .......... .......... .......... .......... 78% 51.9M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72600K .......... .......... .......... .......... .......... 78% 24.6M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72650K .......... .......... .......... .......... .......... 78% 26.8M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72700K .......... .......... .......... .......... .......... 78% 26.2M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72750K .......... .......... .......... .......... .......... 78% 79.1M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72800K .......... .......... .......... .......... .......... 78% 37.6M 1s 2024-03-09T14:41:48.696 INFO:teuthology.orchestra.run.smithi046.stderr: 72850K .......... .......... .......... .......... .......... 78% 47.2M 1s 2024-03-09T14:41:48.697 INFO:teuthology.orchestra.run.smithi046.stderr: 72900K .......... .......... .......... .......... .......... 78% 19.0M 1s 2024-03-09T14:41:48.697 INFO:teuthology.orchestra.run.smithi046.stderr: 72950K .......... .......... .......... .......... .......... 78% 36.0M 1s 2024-03-09T14:41:48.697 INFO:teuthology.orchestra.run.smithi046.stderr: 73000K .......... .......... .......... .......... .......... 78% 50.3M 1s 2024-03-09T14:41:48.697 INFO:teuthology.orchestra.run.smithi046.stderr: 73050K .......... .......... .......... .......... .......... 78% 74.4M 1s 2024-03-09T14:41:48.698 INFO:teuthology.orchestra.run.smithi046.stderr: 73100K .......... .......... .......... .......... .......... 78% 21.2M 1s 2024-03-09T14:41:48.698 INFO:teuthology.orchestra.run.smithi046.stderr: 73150K .......... .......... .......... .......... .......... 78% 36.0M 1s 2024-03-09T14:41:48.700 INFO:teuthology.orchestra.run.smithi046.stderr: 73200K .......... .......... .......... .......... .......... 78% 26.0M 1s 2024-03-09T14:41:48.701 INFO:teuthology.orchestra.run.smithi046.stderr: 73250K .......... .......... .......... .......... .......... 78% 56.6M 1s 2024-03-09T14:41:48.702 INFO:teuthology.orchestra.run.smithi046.stderr: 73300K .......... .......... .......... .......... .......... 78% 36.4M 1s 2024-03-09T14:41:48.704 INFO:teuthology.orchestra.run.smithi046.stderr: 73350K .......... .......... .......... .......... .......... 79% 28.3M 1s 2024-03-09T14:41:48.706 INFO:teuthology.orchestra.run.smithi046.stderr: 73400K .......... .......... .......... .......... .......... 79% 26.2M 1s 2024-03-09T14:41:48.706 INFO:teuthology.orchestra.run.smithi046.stderr: 73450K .......... .......... .......... .......... .......... 79% 74.0M 1s 2024-03-09T14:41:48.708 INFO:teuthology.orchestra.run.smithi046.stderr: 73500K .......... .......... .......... .......... .......... 79% 33.5M 1s 2024-03-09T14:41:48.710 INFO:teuthology.orchestra.run.smithi046.stderr: 73550K .......... .......... .......... .......... .......... 79% 33.4M 1s 2024-03-09T14:41:48.712 INFO:teuthology.orchestra.run.smithi046.stderr: 73600K .......... .......... .......... .......... .......... 79% 21.9M 1s 2024-03-09T14:41:48.714 INFO:teuthology.orchestra.run.smithi046.stderr: 73650K .......... .......... .......... .......... .......... 79% 25.5M 1s 2024-03-09T14:41:48.714 INFO:teuthology.orchestra.run.smithi046.stderr: 73700K .......... .......... .......... .......... .......... 79% 95.0M 1s 2024-03-09T14:41:48.715 INFO:teuthology.orchestra.run.smithi046.stderr: 73750K .......... .......... .......... .......... .......... 79% 44.4M 1s 2024-03-09T14:41:48.716 INFO:teuthology.orchestra.run.smithi046.stderr: 73800K .......... .......... .......... .......... .......... 79% 47.0M 1s 2024-03-09T14:41:48.718 INFO:teuthology.orchestra.run.smithi046.stderr: 73850K .......... .......... .......... .......... .......... 79% 23.9M 1s 2024-03-09T14:41:48.719 INFO:teuthology.orchestra.run.smithi046.stderr: 73900K .......... .......... .......... .......... .......... 79% 46.7M 1s 2024-03-09T14:41:48.720 INFO:teuthology.orchestra.run.smithi046.stderr: 73950K .......... .......... .......... .......... .......... 79% 64.5M 1s 2024-03-09T14:41:48.722 INFO:teuthology.orchestra.run.smithi046.stderr: 74000K .......... .......... .......... .......... .......... 79% 24.6M 1s 2024-03-09T14:41:48.724 INFO:teuthology.orchestra.run.smithi046.stderr: 74050K .......... .......... .......... .......... .......... 79% 28.8M 1s 2024-03-09T14:41:48.726 INFO:teuthology.orchestra.run.smithi046.stderr: 74100K .......... .......... .......... .......... .......... 79% 29.2M 1s 2024-03-09T14:41:48.726 INFO:teuthology.orchestra.run.smithi046.stderr: 74150K .......... .......... .......... .......... .......... 79% 78.4M 1s 2024-03-09T14:41:48.728 INFO:teuthology.orchestra.run.smithi046.stderr: 74200K .......... .......... .......... .......... .......... 79% 30.4M 1s 2024-03-09T14:41:48.729 INFO:teuthology.orchestra.run.smithi046.stderr: 74250K .......... .......... .......... .......... .......... 79% 28.6M 1s 2024-03-09T14:41:48.731 INFO:teuthology.orchestra.run.smithi046.stderr: 74300K .......... .......... .......... .......... .......... 80% 32.8M 1s 2024-03-09T14:41:48.733 INFO:teuthology.orchestra.run.smithi046.stderr: 74350K .......... .......... .......... .......... .......... 80% 76.5M 1s 2024-03-09T14:41:48.733 INFO:teuthology.orchestra.run.smithi046.stderr: 74400K .......... .......... .......... .......... .......... 80% 23.0M 1s 2024-03-09T14:41:48.735 INFO:teuthology.orchestra.run.smithi046.stderr: 74450K .......... .......... .......... .......... .......... 80% 29.6M 1s 2024-03-09T14:41:48.736 INFO:teuthology.orchestra.run.smithi046.stderr: 74500K .......... .......... .......... .......... .......... 80% 45.3M 1s 2024-03-09T14:41:48.739 INFO:teuthology.orchestra.run.smithi046.stderr: 74550K .......... .......... .......... .......... .......... 80% 29.0M 1s 2024-03-09T14:41:48.739 INFO:teuthology.orchestra.run.smithi046.stderr: 74600K .......... .......... .......... .......... .......... 80% 59.0M 1s 2024-03-09T14:41:48.744 INFO:teuthology.orchestra.run.smithi046.stderr: 74650K .......... .......... .......... .......... .......... 80% 32.9M 1s 2024-03-09T14:41:48.744 INFO:teuthology.orchestra.run.smithi046.stderr: 74700K .......... .......... .......... .......... .......... 80% 48.4M 1s 2024-03-09T14:41:48.745 INFO:teuthology.orchestra.run.smithi046.stderr: 74750K .......... .......... .......... .......... .......... 80% 52.1M 1s 2024-03-09T14:41:48.745 INFO:teuthology.orchestra.run.smithi046.stderr: 74800K .......... .......... .......... .......... .......... 80% 24.7M 1s 2024-03-09T14:41:48.746 INFO:teuthology.orchestra.run.smithi046.stderr: 74850K .......... .......... .......... .......... .......... 80% 34.5M 1s 2024-03-09T14:41:48.747 INFO:teuthology.orchestra.run.smithi046.stderr: 74900K .......... .......... .......... .......... .......... 80% 44.0M 1s 2024-03-09T14:41:48.748 INFO:teuthology.orchestra.run.smithi046.stderr: 74950K .......... .......... .......... .......... .......... 80% 51.7M 1s 2024-03-09T14:41:48.750 INFO:teuthology.orchestra.run.smithi046.stderr: 75000K .......... .......... .......... .......... .......... 80% 19.9M 1s 2024-03-09T14:41:48.752 INFO:teuthology.orchestra.run.smithi046.stderr: 75050K .......... .......... .......... .......... .......... 80% 26.1M 1s 2024-03-09T14:41:48.752 INFO:teuthology.orchestra.run.smithi046.stderr: 75100K .......... .......... .......... .......... .......... 80% 69.3M 1s 2024-03-09T14:41:48.755 INFO:teuthology.orchestra.run.smithi046.stderr: 75150K .......... .......... .......... .......... .......... 80% 27.8M 1s 2024-03-09T14:41:48.756 INFO:teuthology.orchestra.run.smithi046.stderr: 75200K .......... .......... .......... .......... .......... 81% 25.8M 1s 2024-03-09T14:41:48.758 INFO:teuthology.orchestra.run.smithi046.stderr: 75250K .......... .......... .......... .......... .......... 81% 40.8M 1s 2024-03-09T14:41:48.759 INFO:teuthology.orchestra.run.smithi046.stderr: 75300K .......... .......... .......... .......... .......... 81% 32.8M 1s 2024-03-09T14:41:48.760 INFO:teuthology.orchestra.run.smithi046.stderr: 75350K .......... .......... .......... .......... .......... 81% 42.5M 1s 2024-03-09T14:41:48.762 INFO:teuthology.orchestra.run.smithi046.stderr: 75400K .......... .......... .......... .......... .......... 81% 34.1M 1s 2024-03-09T14:41:48.763 INFO:teuthology.orchestra.run.smithi046.stderr: 75450K .......... .......... .......... .......... .......... 81% 59.4M 1s 2024-03-09T14:41:48.764 INFO:teuthology.orchestra.run.smithi046.stderr: 75500K .......... .......... .......... .......... .......... 81% 40.2M 1s 2024-03-09T14:41:48.765 INFO:teuthology.orchestra.run.smithi046.stderr: 75550K .......... .......... .......... .......... .......... 81% 52.3M 1s 2024-03-09T14:41:48.766 INFO:teuthology.orchestra.run.smithi046.stderr: 75600K .......... .......... .......... .......... .......... 81% 30.6M 1s 2024-03-09T14:41:48.767 INFO:teuthology.orchestra.run.smithi046.stderr: 75650K .......... .......... .......... .......... .......... 81% 38.1M 1s 2024-03-09T14:41:48.769 INFO:teuthology.orchestra.run.smithi046.stderr: 75700K .......... .......... .......... .......... .......... 81% 47.8M 1s 2024-03-09T14:41:48.771 INFO:teuthology.orchestra.run.smithi046.stderr: 75750K .......... .......... .......... .......... .......... 81% 23.2M 1s 2024-03-09T14:41:48.773 INFO:teuthology.orchestra.run.smithi046.stderr: 75800K .......... .......... .......... .......... .......... 81% 31.0M 1s 2024-03-09T14:41:48.773 INFO:teuthology.orchestra.run.smithi046.stderr: 75850K .......... .......... .......... .......... .......... 81% 119M 1s 2024-03-09T14:41:48.775 INFO:teuthology.orchestra.run.smithi046.stderr: 75900K .......... .......... .......... .......... .......... 81% 23.6M 1s 2024-03-09T14:41:48.776 INFO:teuthology.orchestra.run.smithi046.stderr: 75950K .......... .......... .......... .......... .......... 81% 28.7M 1s 2024-03-09T14:41:48.778 INFO:teuthology.orchestra.run.smithi046.stderr: 76000K .......... .......... .......... .......... .......... 81% 25.3M 1s 2024-03-09T14:41:48.779 INFO:teuthology.orchestra.run.smithi046.stderr: 76050K .......... .......... .......... .......... .......... 81% 80.9M 1s 2024-03-09T14:41:48.780 INFO:teuthology.orchestra.run.smithi046.stderr: 76100K .......... .......... .......... .......... .......... 81% 30.5M 1s 2024-03-09T14:41:48.782 INFO:teuthology.orchestra.run.smithi046.stderr: 76150K .......... .......... .......... .......... .......... 82% 35.7M 0s 2024-03-09T14:41:48.783 INFO:teuthology.orchestra.run.smithi046.stderr: 76200K .......... .......... .......... .......... .......... 82% 46.4M 0s 2024-03-09T14:41:48.784 INFO:teuthology.orchestra.run.smithi046.stderr: 76250K .......... .......... .......... .......... .......... 82% 47.4M 0s 2024-03-09T14:41:48.785 INFO:teuthology.orchestra.run.smithi046.stderr: 76300K .......... .......... .......... .......... .......... 82% 40.9M 0s 2024-03-09T14:41:48.787 INFO:teuthology.orchestra.run.smithi046.stderr: 76350K .......... .......... .......... .......... .......... 82% 24.1M 0s 2024-03-09T14:41:48.789 INFO:teuthology.orchestra.run.smithi046.stderr: 76400K .......... .......... .......... .......... .......... 82% 33.1M 0s 2024-03-09T14:41:48.790 INFO:teuthology.orchestra.run.smithi046.stderr: 76450K .......... .......... .......... .......... .......... 82% 37.2M 0s 2024-03-09T14:41:48.791 INFO:teuthology.orchestra.run.smithi046.stderr: 76500K .......... .......... .......... .......... .......... 82% 55.7M 0s 2024-03-09T14:41:48.792 INFO:teuthology.orchestra.run.smithi046.stderr: 76550K .......... .......... .......... .......... .......... 82% 41.7M 0s 2024-03-09T14:41:48.795 INFO:teuthology.orchestra.run.smithi046.stderr: 76600K .......... .......... .......... .......... .......... 82% 19.6M 0s 2024-03-09T14:41:48.799 INFO:teuthology.orchestra.run.smithi046.stderr: 76650K .......... .......... .......... .......... .......... 82% 32.8M 0s 2024-03-09T14:41:48.799 INFO:teuthology.orchestra.run.smithi046.stderr: 76700K .......... .......... .......... .......... .......... 82% 84.9M 0s 2024-03-09T14:41:48.799 INFO:teuthology.orchestra.run.smithi046.stderr: 76750K .......... .......... .......... .......... .......... 82% 23.6M 0s 2024-03-09T14:41:48.800 INFO:teuthology.orchestra.run.smithi046.stderr: 76800K .......... .......... .......... .......... .......... 82% 28.8M 0s 2024-03-09T14:41:48.802 INFO:teuthology.orchestra.run.smithi046.stderr: 76850K .......... .......... .......... .......... .......... 82% 35.2M 0s 2024-03-09T14:41:48.803 INFO:teuthology.orchestra.run.smithi046.stderr: 76900K .......... .......... .......... .......... .......... 82% 34.9M 0s 2024-03-09T14:41:48.804 INFO:teuthology.orchestra.run.smithi046.stderr: 76950K .......... .......... .......... .......... .......... 82% 50.9M 0s 2024-03-09T14:41:48.806 INFO:teuthology.orchestra.run.smithi046.stderr: 77000K .......... .......... .......... .......... .......... 82% 36.6M 0s 2024-03-09T14:41:48.807 INFO:teuthology.orchestra.run.smithi046.stderr: 77050K .......... .......... .......... .......... .......... 82% 33.0M 0s 2024-03-09T14:41:48.809 INFO:teuthology.orchestra.run.smithi046.stderr: 77100K .......... .......... .......... .......... .......... 83% 31.4M 0s 2024-03-09T14:41:48.810 INFO:teuthology.orchestra.run.smithi046.stderr: 77150K .......... .......... .......... .......... .......... 83% 71.2M 0s 2024-03-09T14:41:48.811 INFO:teuthology.orchestra.run.smithi046.stderr: 77200K .......... .......... .......... .......... .......... 83% 29.4M 0s 2024-03-09T14:41:48.812 INFO:teuthology.orchestra.run.smithi046.stderr: 77250K .......... .......... .......... .......... .......... 83% 34.5M 0s 2024-03-09T14:41:48.814 INFO:teuthology.orchestra.run.smithi046.stderr: 77300K .......... .......... .......... .......... .......... 83% 27.2M 0s 2024-03-09T14:41:48.816 INFO:teuthology.orchestra.run.smithi046.stderr: 77350K .......... .......... .......... .......... .......... 83% 32.6M 0s 2024-03-09T14:41:48.817 INFO:teuthology.orchestra.run.smithi046.stderr: 77400K .......... .......... .......... .......... .......... 83% 43.8M 0s 2024-03-09T14:41:48.817 INFO:teuthology.orchestra.run.smithi046.stderr: 77450K .......... .......... .......... .......... .......... 83% 50.6M 0s 2024-03-09T14:41:48.819 INFO:teuthology.orchestra.run.smithi046.stderr: 77500K .......... .......... .......... .......... .......... 83% 26.6M 0s 2024-03-09T14:41:48.823 INFO:teuthology.orchestra.run.smithi046.stderr: 77550K .......... .......... .......... .......... .......... 83% 16.4M 0s 2024-03-09T14:41:48.825 INFO:teuthology.orchestra.run.smithi046.stderr: 77600K .......... .......... .......... .......... .......... 83% 22.8M 0s 2024-03-09T14:41:48.827 INFO:teuthology.orchestra.run.smithi046.stderr: 77650K .......... .......... .......... .......... .......... 83% 36.2M 0s 2024-03-09T14:41:48.827 INFO:teuthology.orchestra.run.smithi046.stderr: 77700K .......... .......... .......... .......... .......... 83% 50.7M 0s 2024-03-09T14:41:48.828 INFO:teuthology.orchestra.run.smithi046.stderr: 77750K .......... .......... .......... .......... .......... 83% 55.1M 0s 2024-03-09T14:41:48.830 INFO:teuthology.orchestra.run.smithi046.stderr: 77800K .......... .......... .......... .......... .......... 83% 25.2M 0s 2024-03-09T14:41:48.831 INFO:teuthology.orchestra.run.smithi046.stderr: 77850K .......... .......... .......... .......... .......... 83% 43.2M 0s 2024-03-09T14:41:48.831 INFO:teuthology.orchestra.run.smithi046.stderr: 77900K .......... .......... .......... .......... .......... 83% 66.2M 0s 2024-03-09T14:41:48.833 INFO:teuthology.orchestra.run.smithi046.stderr: 77950K .......... .......... .......... .......... .......... 83% 51.8M 0s 2024-03-09T14:41:48.835 INFO:teuthology.orchestra.run.smithi046.stderr: 78000K .......... .......... .......... .......... .......... 84% 23.1M 0s 2024-03-09T14:41:48.836 INFO:teuthology.orchestra.run.smithi046.stderr: 78050K .......... .......... .......... .......... .......... 84% 36.1M 0s 2024-03-09T14:41:48.837 INFO:teuthology.orchestra.run.smithi046.stderr: 78100K .......... .......... .......... .......... .......... 84% 52.4M 0s 2024-03-09T14:41:48.838 INFO:teuthology.orchestra.run.smithi046.stderr: 78150K .......... .......... .......... .......... .......... 84% 44.8M 0s 2024-03-09T14:41:48.839 INFO:teuthology.orchestra.run.smithi046.stderr: 78200K .......... .......... .......... .......... .......... 84% 44.1M 0s 2024-03-09T14:41:48.842 INFO:teuthology.orchestra.run.smithi046.stderr: 78250K .......... .......... .......... .......... .......... 84% 18.5M 0s 2024-03-09T14:41:48.844 INFO:teuthology.orchestra.run.smithi046.stderr: 78300K .......... .......... .......... .......... .......... 84% 22.4M 0s 2024-03-09T14:41:48.846 INFO:teuthology.orchestra.run.smithi046.stderr: 78350K .......... .......... .......... .......... .......... 84% 66.1M 0s 2024-03-09T14:41:48.846 INFO:teuthology.orchestra.run.smithi046.stderr: 78400K .......... .......... .......... .......... .......... 84% 36.0M 0s 2024-03-09T14:41:48.848 INFO:teuthology.orchestra.run.smithi046.stderr: 78450K .......... .......... .......... .......... .......... 84% 22.8M 0s 2024-03-09T14:41:48.850 INFO:teuthology.orchestra.run.smithi046.stderr: 78500K .......... .......... .......... .......... .......... 84% 30.8M 0s 2024-03-09T14:41:48.852 INFO:teuthology.orchestra.run.smithi046.stderr: 78550K .......... .......... .......... .......... .......... 84% 26.9M 0s 2024-03-09T14:41:48.852 INFO:teuthology.orchestra.run.smithi046.stderr: 78600K .......... .......... .......... .......... .......... 84% 59.9M 0s 2024-03-09T14:41:48.853 INFO:teuthology.orchestra.run.smithi046.stderr: 78650K .......... .......... .......... .......... .......... 84% 56.8M 0s 2024-03-09T14:41:48.855 INFO:teuthology.orchestra.run.smithi046.stderr: 78700K .......... .......... .......... .......... .......... 84% 39.3M 0s 2024-03-09T14:41:48.856 INFO:teuthology.orchestra.run.smithi046.stderr: 78750K .......... .......... .......... .......... .......... 84% 40.8M 0s 2024-03-09T14:41:48.860 INFO:teuthology.orchestra.run.smithi046.stderr: 78800K .......... .......... .......... .......... .......... 84% 35.3M 0s 2024-03-09T14:41:48.860 INFO:teuthology.orchestra.run.smithi046.stderr: 78850K .......... .......... .......... .......... .......... 84% 73.2M 0s 2024-03-09T14:41:48.860 INFO:teuthology.orchestra.run.smithi046.stderr: 78900K .......... .......... .......... .......... .......... 84% 38.0M 0s 2024-03-09T14:41:48.861 INFO:teuthology.orchestra.run.smithi046.stderr: 78950K .......... .......... .......... .......... .......... 85% 34.3M 0s 2024-03-09T14:41:48.862 INFO:teuthology.orchestra.run.smithi046.stderr: 79000K .......... .......... .......... .......... .......... 85% 37.7M 0s 2024-03-09T14:41:48.863 INFO:teuthology.orchestra.run.smithi046.stderr: 79050K .......... .......... .......... .......... .......... 85% 50.2M 0s 2024-03-09T14:41:48.863 INFO:teuthology.orchestra.run.smithi046.stderr: 79100K .......... .......... .......... .......... .......... 85% 51.7M 0s 2024-03-09T14:41:48.865 INFO:teuthology.orchestra.run.smithi046.stderr: 79150K .......... .......... .......... .......... .......... 85% 45.5M 0s 2024-03-09T14:41:48.867 INFO:teuthology.orchestra.run.smithi046.stderr: 79200K .......... .......... .......... .......... .......... 85% 21.2M 0s 2024-03-09T14:41:48.869 INFO:teuthology.orchestra.run.smithi046.stderr: 79250K .......... .......... .......... .......... .......... 85% 29.1M 0s 2024-03-09T14:41:48.869 INFO:teuthology.orchestra.run.smithi046.stderr: 79300K .......... .......... .......... .......... .......... 85% 62.1M 0s 2024-03-09T14:41:48.871 INFO:teuthology.orchestra.run.smithi046.stderr: 79350K .......... .......... .......... .......... .......... 85% 33.2M 0s 2024-03-09T14:41:48.873 INFO:teuthology.orchestra.run.smithi046.stderr: 79400K .......... .......... .......... .......... .......... 85% 22.4M 0s 2024-03-09T14:41:48.875 INFO:teuthology.orchestra.run.smithi046.stderr: 79450K .......... .......... .......... .......... .......... 85% 31.8M 0s 2024-03-09T14:41:48.875 INFO:teuthology.orchestra.run.smithi046.stderr: 79500K .......... .......... .......... .......... .......... 85% 48.9M 0s 2024-03-09T14:41:48.877 INFO:teuthology.orchestra.run.smithi046.stderr: 79550K .......... .......... .......... .......... .......... 85% 40.0M 0s 2024-03-09T14:41:48.879 INFO:teuthology.orchestra.run.smithi046.stderr: 79600K .......... .......... .......... .......... .......... 85% 29.2M 0s 2024-03-09T14:41:48.879 INFO:teuthology.orchestra.run.smithi046.stderr: 79650K .......... .......... .......... .......... .......... 85% 53.3M 0s 2024-03-09T14:41:48.891 INFO:teuthology.orchestra.run.smithi046.stderr: 79700K .......... .......... .......... .......... .......... 85% 34.1M 0s 2024-03-09T14:41:48.891 INFO:teuthology.orchestra.run.smithi046.stderr: 79750K .......... .......... .......... .......... .......... 85% 46.7M 0s 2024-03-09T14:41:48.891 INFO:teuthology.orchestra.run.smithi046.stderr: 79800K .......... .......... .......... .......... .......... 85% 36.3M 0s 2024-03-09T14:41:48.892 INFO:teuthology.orchestra.run.smithi046.stderr: 79850K .......... .......... .......... .......... .......... 86% 53.6M 0s 2024-03-09T14:41:48.892 INFO:teuthology.orchestra.run.smithi046.stderr: 79900K .......... .......... .......... .......... .......... 86% 18.9M 0s 2024-03-09T14:41:48.892 INFO:teuthology.orchestra.run.smithi046.stderr: 79950K .......... .......... .......... .......... .......... 86% 87.6M 0s 2024-03-09T14:41:48.892 INFO:teuthology.orchestra.run.smithi046.stderr: 80000K .......... .......... .......... .......... .......... 86% 27.4M 0s 2024-03-09T14:41:48.892 INFO:teuthology.orchestra.run.smithi046.stderr: 80050K .......... .......... .......... .......... .......... 86% 42.9M 0s 2024-03-09T14:41:48.892 INFO:teuthology.orchestra.run.smithi046.stderr: 80100K .......... .......... .......... .......... .......... 86% 46.2M 0s 2024-03-09T14:41:48.893 INFO:teuthology.orchestra.run.smithi046.stderr: 80150K .......... .......... .......... .......... .......... 86% 30.7M 0s 2024-03-09T14:41:48.895 INFO:teuthology.orchestra.run.smithi046.stderr: 80200K .......... .......... .......... .......... .......... 86% 24.5M 0s 2024-03-09T14:41:48.895 INFO:teuthology.orchestra.run.smithi046.stderr: 80250K .......... .......... .......... .......... .......... 86% 65.0M 0s 2024-03-09T14:41:48.897 INFO:teuthology.orchestra.run.smithi046.stderr: 80300K .......... .......... .......... .......... .......... 86% 48.5M 0s 2024-03-09T14:41:48.899 INFO:teuthology.orchestra.run.smithi046.stderr: 80350K .......... .......... .......... .......... .......... 86% 20.3M 0s 2024-03-09T14:41:48.901 INFO:teuthology.orchestra.run.smithi046.stderr: 80400K .......... .......... .......... .......... .......... 86% 34.4M 0s 2024-03-09T14:41:48.902 INFO:teuthology.orchestra.run.smithi046.stderr: 80450K .......... .......... .......... .......... .......... 86% 23.1M 0s 2024-03-09T14:41:48.903 INFO:teuthology.orchestra.run.smithi046.stderr: 80500K .......... .......... .......... .......... .......... 86% 76.9M 0s 2024-03-09T14:41:48.905 INFO:teuthology.orchestra.run.smithi046.stderr: 80550K .......... .......... .......... .......... .......... 86% 31.7M 0s 2024-03-09T14:41:48.909 INFO:teuthology.orchestra.run.smithi046.stderr: 80600K .......... .......... .......... .......... .......... 86% 29.1M 0s 2024-03-09T14:41:48.909 INFO:teuthology.orchestra.run.smithi046.stderr: 80650K .......... .......... .......... .......... .......... 86% 31.5M 0s 2024-03-09T14:41:48.909 INFO:teuthology.orchestra.run.smithi046.stderr: 80700K .......... .......... .......... .......... .......... 86% 110M 0s 2024-03-09T14:41:48.910 INFO:teuthology.orchestra.run.smithi046.stderr: 80750K .......... .......... .......... .......... .......... 86% 36.3M 0s 2024-03-09T14:41:48.911 INFO:teuthology.orchestra.run.smithi046.stderr: 80800K .......... .......... .......... .......... .......... 87% 30.8M 0s 2024-03-09T14:41:48.914 INFO:teuthology.orchestra.run.smithi046.stderr: 80850K .......... .......... .......... .......... .......... 87% 24.1M 0s 2024-03-09T14:41:48.915 INFO:teuthology.orchestra.run.smithi046.stderr: 80900K .......... .......... .......... .......... .......... 87% 32.9M 0s 2024-03-09T14:41:48.916 INFO:teuthology.orchestra.run.smithi046.stderr: 80950K .......... .......... .......... .......... .......... 87% 50.4M 0s 2024-03-09T14:41:48.919 INFO:teuthology.orchestra.run.smithi046.stderr: 81000K .......... .......... .......... .......... .......... 87% 35.5M 0s 2024-03-09T14:41:48.919 INFO:teuthology.orchestra.run.smithi046.stderr: 81050K .......... .......... .......... .......... .......... 87% 41.4M 0s 2024-03-09T14:41:48.921 INFO:teuthology.orchestra.run.smithi046.stderr: 81100K .......... .......... .......... .......... .......... 87% 31.3M 0s 2024-03-09T14:41:48.923 INFO:teuthology.orchestra.run.smithi046.stderr: 81150K .......... .......... .......... .......... .......... 87% 67.4M 0s 2024-03-09T14:41:48.923 INFO:teuthology.orchestra.run.smithi046.stderr: 81200K .......... .......... .......... .......... .......... 87% 24.9M 0s 2024-03-09T14:41:48.925 INFO:teuthology.orchestra.run.smithi046.stderr: 81250K .......... .......... .......... .......... .......... 87% 28.3M 0s 2024-03-09T14:41:48.927 INFO:teuthology.orchestra.run.smithi046.stderr: 81300K .......... .......... .......... .......... .......... 87% 26.5M 0s 2024-03-09T14:41:48.930 INFO:teuthology.orchestra.run.smithi046.stderr: 81350K .......... .......... .......... .......... .......... 87% 23.7M 0s 2024-03-09T14:41:48.930 INFO:teuthology.orchestra.run.smithi046.stderr: 81400K .......... .......... .......... .......... .......... 87% 75.4M 0s 2024-03-09T14:41:48.932 INFO:teuthology.orchestra.run.smithi046.stderr: 81450K .......... .......... .......... .......... .......... 87% 25.2M 0s 2024-03-09T14:41:48.934 INFO:teuthology.orchestra.run.smithi046.stderr: 81500K .......... .......... .......... .......... .......... 87% 22.4M 0s 2024-03-09T14:41:48.936 INFO:teuthology.orchestra.run.smithi046.stderr: 81550K .......... .......... .......... .......... .......... 87% 21.4M 0s 2024-03-09T14:41:48.938 INFO:teuthology.orchestra.run.smithi046.stderr: 81600K .......... .......... .......... .......... .......... 87% 22.7M 0s 2024-03-09T14:41:48.938 INFO:teuthology.orchestra.run.smithi046.stderr: 81650K .......... .......... .......... .......... .......... 87% 111M 0s 2024-03-09T14:41:48.939 INFO:teuthology.orchestra.run.smithi046.stderr: 81700K .......... .......... .......... .......... .......... 87% 39.4M 0s 2024-03-09T14:41:48.941 INFO:teuthology.orchestra.run.smithi046.stderr: 81750K .......... .......... .......... .......... .......... 88% 31.9M 0s 2024-03-09T14:41:48.943 INFO:teuthology.orchestra.run.smithi046.stderr: 81800K .......... .......... .......... .......... .......... 88% 31.7M 0s 2024-03-09T14:41:48.943 INFO:teuthology.orchestra.run.smithi046.stderr: 81850K .......... .......... .......... .......... .......... 88% 103M 0s 2024-03-09T14:41:48.944 INFO:teuthology.orchestra.run.smithi046.stderr: 81900K .......... .......... .......... .......... .......... 88% 38.9M 0s 2024-03-09T14:41:48.946 INFO:teuthology.orchestra.run.smithi046.stderr: 81950K .......... .......... .......... .......... .......... 88% 37.8M 0s 2024-03-09T14:41:48.950 INFO:teuthology.orchestra.run.smithi046.stderr: 82000K .......... .......... .......... .......... .......... 88% 31.6M 0s 2024-03-09T14:41:48.953 INFO:teuthology.orchestra.run.smithi046.stderr: 82050K .......... .......... .......... .......... .......... 88% 26.3M 0s 2024-03-09T14:41:48.953 INFO:teuthology.orchestra.run.smithi046.stderr: 82100K .......... .......... .......... .......... .......... 88% 92.4M 0s 2024-03-09T14:41:48.953 INFO:teuthology.orchestra.run.smithi046.stderr: 82150K .......... .......... .......... .......... .......... 88% 23.2M 0s 2024-03-09T14:41:48.953 INFO:teuthology.orchestra.run.smithi046.stderr: 82200K .......... .......... .......... .......... .......... 88% 39.5M 0s 2024-03-09T14:41:48.954 INFO:teuthology.orchestra.run.smithi046.stderr: 82250K .......... .......... .......... .......... .......... 88% 31.6M 0s 2024-03-09T14:41:48.955 INFO:teuthology.orchestra.run.smithi046.stderr: 82300K .......... .......... .......... .......... .......... 88% 53.8M 0s 2024-03-09T14:41:48.956 INFO:teuthology.orchestra.run.smithi046.stderr: 82350K .......... .......... .......... .......... .......... 88% 31.1M 0s 2024-03-09T14:41:48.958 INFO:teuthology.orchestra.run.smithi046.stderr: 82400K .......... .......... .......... .......... .......... 88% 27.5M 0s 2024-03-09T14:41:48.960 INFO:teuthology.orchestra.run.smithi046.stderr: 82450K .......... .......... .......... .......... .......... 88% 37.0M 0s 2024-03-09T14:41:48.962 INFO:teuthology.orchestra.run.smithi046.stderr: 82500K .......... .......... .......... .......... .......... 88% 26.6M 0s 2024-03-09T14:41:48.962 INFO:teuthology.orchestra.run.smithi046.stderr: 82550K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-09T14:41:48.964 INFO:teuthology.orchestra.run.smithi046.stderr: 82600K .......... .......... .......... .......... .......... 88% 26.5M 0s 2024-03-09T14:41:48.965 INFO:teuthology.orchestra.run.smithi046.stderr: 82650K .......... .......... .......... .......... .......... 89% 46.7M 0s 2024-03-09T14:41:48.966 INFO:teuthology.orchestra.run.smithi046.stderr: 82700K .......... .......... .......... .......... .......... 89% 30.8M 0s 2024-03-09T14:41:48.968 INFO:teuthology.orchestra.run.smithi046.stderr: 82750K .......... .......... .......... .......... .......... 89% 54.8M 0s 2024-03-09T14:41:48.977 INFO:teuthology.orchestra.run.smithi046.stderr: 82800K .......... .......... .......... .......... .......... 89% 16.1M 0s 2024-03-09T14:41:48.977 INFO:teuthology.orchestra.run.smithi046.stderr: 82850K .......... .......... .......... .......... .......... 89% 69.3M 0s 2024-03-09T14:41:48.977 INFO:teuthology.orchestra.run.smithi046.stderr: 82900K .......... .......... .......... .......... .......... 89% 31.7M 0s 2024-03-09T14:41:48.977 INFO:teuthology.orchestra.run.smithi046.stderr: 82950K .......... .......... .......... .......... .......... 89% 41.5M 0s 2024-03-09T14:41:48.977 INFO:teuthology.orchestra.run.smithi046.stderr: 83000K .......... .......... .......... .......... .......... 89% 26.2M 0s 2024-03-09T14:41:48.978 INFO:teuthology.orchestra.run.smithi046.stderr: 83050K .......... .......... .......... .......... .......... 89% 70.2M 0s 2024-03-09T14:41:48.985 INFO:teuthology.orchestra.run.smithi046.stderr: 83100K .......... .......... .......... .......... .......... 89% 36.1M 0s 2024-03-09T14:41:48.985 INFO:teuthology.orchestra.run.smithi046.stderr: 83150K .......... .......... .......... .......... .......... 89% 37.6M 0s 2024-03-09T14:41:48.985 INFO:teuthology.orchestra.run.smithi046.stderr: 83200K .......... .......... .......... .......... .......... 89% 21.3M 0s 2024-03-09T14:41:48.985 INFO:teuthology.orchestra.run.smithi046.stderr: 83250K .......... .......... .......... .......... .......... 89% 30.2M 0s 2024-03-09T14:41:48.985 INFO:teuthology.orchestra.run.smithi046.stderr: 83300K .......... .......... .......... .......... .......... 89% 51.3M 0s 2024-03-09T14:41:48.986 INFO:teuthology.orchestra.run.smithi046.stderr: 83350K .......... .......... .......... .......... .......... 89% 49.1M 0s 2024-03-09T14:41:48.988 INFO:teuthology.orchestra.run.smithi046.stderr: 83400K .......... .......... .......... .......... .......... 89% 24.8M 0s 2024-03-09T14:41:48.990 INFO:teuthology.orchestra.run.smithi046.stderr: 83450K .......... .......... .......... .......... .......... 89% 25.8M 0s 2024-03-09T14:41:48.990 INFO:teuthology.orchestra.run.smithi046.stderr: 83500K .......... .......... .......... .......... .......... 89% 73.9M 0s 2024-03-09T14:41:48.992 INFO:teuthology.orchestra.run.smithi046.stderr: 83550K .......... .......... .......... .......... .......... 89% 30.5M 0s 2024-03-09T14:41:48.993 INFO:teuthology.orchestra.run.smithi046.stderr: 83600K .......... .......... .......... .......... .......... 90% 27.7M 0s 2024-03-09T14:41:48.994 INFO:teuthology.orchestra.run.smithi046.stderr: 83650K .......... .......... .......... .......... .......... 90% 29.1M 0s 2024-03-09T14:41:48.997 INFO:teuthology.orchestra.run.smithi046.stderr: 83700K .......... .......... .......... .......... .......... 90% 26.0M 0s 2024-03-09T14:41:48.997 INFO:teuthology.orchestra.run.smithi046.stderr: 83750K .......... .......... .......... .......... .......... 90% 110M 0s 2024-03-09T14:41:48.998 INFO:teuthology.orchestra.run.smithi046.stderr: 83800K .......... .......... .......... .......... .......... 90% 28.5M 0s 2024-03-09T14:41:49.000 INFO:teuthology.orchestra.run.smithi046.stderr: 83850K .......... .......... .......... .......... .......... 90% 31.0M 0s 2024-03-09T14:41:49.002 INFO:teuthology.orchestra.run.smithi046.stderr: 83900K .......... .......... .......... .......... .......... 90% 31.5M 0s 2024-03-09T14:41:49.004 INFO:teuthology.orchestra.run.smithi046.stderr: 83950K .......... .......... .......... .......... .......... 90% 52.5M 0s 2024-03-09T14:41:49.004 INFO:teuthology.orchestra.run.smithi046.stderr: 84000K .......... .......... .......... .......... .......... 90% 26.2M 0s 2024-03-09T14:41:49.006 INFO:teuthology.orchestra.run.smithi046.stderr: 84050K .......... .......... .......... .......... .......... 90% 36.2M 0s 2024-03-09T14:41:49.007 INFO:teuthology.orchestra.run.smithi046.stderr: 84100K .......... .......... .......... .......... .......... 90% 39.4M 0s 2024-03-09T14:41:49.009 INFO:teuthology.orchestra.run.smithi046.stderr: 84150K .......... .......... .......... .......... .......... 90% 25.4M 0s 2024-03-09T14:41:49.010 INFO:teuthology.orchestra.run.smithi046.stderr: 84200K .......... .......... .......... .......... .......... 90% 55.3M 0s 2024-03-09T14:41:49.011 INFO:teuthology.orchestra.run.smithi046.stderr: 84250K .......... .......... .......... .......... .......... 90% 34.0M 0s 2024-03-09T14:41:49.013 INFO:teuthology.orchestra.run.smithi046.stderr: 84300K .......... .......... .......... .......... .......... 90% 35.1M 0s 2024-03-09T14:41:49.015 INFO:teuthology.orchestra.run.smithi046.stderr: 84350K .......... .......... .......... .......... .......... 90% 32.8M 0s 2024-03-09T14:41:49.016 INFO:teuthology.orchestra.run.smithi046.stderr: 84400K .......... .......... .......... .......... .......... 90% 25.2M 0s 2024-03-09T14:41:49.017 INFO:teuthology.orchestra.run.smithi046.stderr: 84450K .......... .......... .......... .......... .......... 90% 58.9M 0s 2024-03-09T14:41:49.019 INFO:teuthology.orchestra.run.smithi046.stderr: 84500K .......... .......... .......... .......... .......... 91% 28.3M 0s 2024-03-09T14:41:49.020 INFO:teuthology.orchestra.run.smithi046.stderr: 84550K .......... .......... .......... .......... .......... 91% 43.1M 0s 2024-03-09T14:41:49.022 INFO:teuthology.orchestra.run.smithi046.stderr: 84600K .......... .......... .......... .......... .......... 91% 29.7M 0s 2024-03-09T14:41:49.022 INFO:teuthology.orchestra.run.smithi046.stderr: 84650K .......... .......... .......... .......... .......... 91% 49.2M 0s 2024-03-09T14:41:49.024 INFO:teuthology.orchestra.run.smithi046.stderr: 84700K .......... .......... .......... .......... .......... 91% 32.9M 0s 2024-03-09T14:41:49.026 INFO:teuthology.orchestra.run.smithi046.stderr: 84750K .......... .......... .......... .......... .......... 91% 32.5M 0s 2024-03-09T14:41:49.027 INFO:teuthology.orchestra.run.smithi046.stderr: 84800K .......... .......... .......... .......... .......... 91% 32.1M 0s 2024-03-09T14:41:49.029 INFO:teuthology.orchestra.run.smithi046.stderr: 84850K .......... .......... .......... .......... .......... 91% 24.8M 0s 2024-03-09T14:41:49.029 INFO:teuthology.orchestra.run.smithi046.stderr: 84900K .......... .......... .......... .......... .......... 91% 69.1M 0s 2024-03-09T14:41:49.031 INFO:teuthology.orchestra.run.smithi046.stderr: 84950K .......... .......... .......... .......... .......... 91% 23.2M 0s 2024-03-09T14:41:49.033 INFO:teuthology.orchestra.run.smithi046.stderr: 85000K .......... .......... .......... .......... .......... 91% 33.6M 0s 2024-03-09T14:41:49.034 INFO:teuthology.orchestra.run.smithi046.stderr: 85050K .......... .......... .......... .......... .......... 91% 35.9M 0s 2024-03-09T14:41:49.035 INFO:teuthology.orchestra.run.smithi046.stderr: 85100K .......... .......... .......... .......... .......... 91% 62.7M 0s 2024-03-09T14:41:49.037 INFO:teuthology.orchestra.run.smithi046.stderr: 85150K .......... .......... .......... .......... .......... 91% 29.5M 0s 2024-03-09T14:41:49.039 INFO:teuthology.orchestra.run.smithi046.stderr: 85200K .......... .......... .......... .......... .......... 91% 23.2M 0s 2024-03-09T14:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr: 85250K .......... .......... .......... .......... .......... 91% 34.3M 0s 2024-03-09T14:41:49.041 INFO:teuthology.orchestra.run.smithi046.stderr: 85300K .......... .......... .......... .......... .......... 91% 47.8M 0s 2024-03-09T14:41:49.042 INFO:teuthology.orchestra.run.smithi046.stderr: 85350K .......... .......... .......... .......... .......... 91% 62.3M 0s 2024-03-09T14:41:49.044 INFO:teuthology.orchestra.run.smithi046.stderr: 85400K .......... .......... .......... .......... .......... 91% 29.1M 0s 2024-03-09T14:41:49.045 INFO:teuthology.orchestra.run.smithi046.stderr: 85450K .......... .......... .......... .......... .......... 92% 38.4M 0s 2024-03-09T14:41:49.047 INFO:teuthology.orchestra.run.smithi046.stderr: 85500K .......... .......... .......... .......... .......... 92% 27.2M 0s 2024-03-09T14:41:49.049 INFO:teuthology.orchestra.run.smithi046.stderr: 85550K .......... .......... .......... .......... .......... 92% 20.6M 0s 2024-03-09T14:41:49.051 INFO:teuthology.orchestra.run.smithi046.stderr: 85600K .......... .......... .......... .......... .......... 92% 34.3M 0s 2024-03-09T14:41:49.052 INFO:teuthology.orchestra.run.smithi046.stderr: 85650K .......... .......... .......... .......... .......... 92% 56.3M 0s 2024-03-09T14:41:49.054 INFO:teuthology.orchestra.run.smithi046.stderr: 85700K .......... .......... .......... .......... .......... 92% 34.0M 0s 2024-03-09T14:41:49.055 INFO:teuthology.orchestra.run.smithi046.stderr: 85750K .......... .......... .......... .......... .......... 92% 35.8M 0s 2024-03-09T14:41:49.058 INFO:teuthology.orchestra.run.smithi046.stderr: 85800K .......... .......... .......... .......... .......... 92% 22.2M 0s 2024-03-09T14:41:49.058 INFO:teuthology.orchestra.run.smithi046.stderr: 85850K .......... .......... .......... .......... .......... 92% 55.3M 0s 2024-03-09T14:41:49.060 INFO:teuthology.orchestra.run.smithi046.stderr: 85900K .......... .......... .......... .......... .......... 92% 29.5M 0s 2024-03-09T14:41:49.061 INFO:teuthology.orchestra.run.smithi046.stderr: 85950K .......... .......... .......... .......... .......... 92% 27.4M 0s 2024-03-09T14:41:49.063 INFO:teuthology.orchestra.run.smithi046.stderr: 86000K .......... .......... .......... .......... .......... 92% 24.5M 0s 2024-03-09T14:41:49.065 INFO:teuthology.orchestra.run.smithi046.stderr: 86050K .......... .......... .......... .......... .......... 92% 33.2M 0s 2024-03-09T14:41:49.065 INFO:teuthology.orchestra.run.smithi046.stderr: 86100K .......... .......... .......... .......... .......... 92% 53.6M 0s 2024-03-09T14:41:49.066 INFO:teuthology.orchestra.run.smithi046.stderr: 86150K .......... .......... .......... .......... .......... 92% 37.9M 0s 2024-03-09T14:41:49.068 INFO:teuthology.orchestra.run.smithi046.stderr: 86200K .......... .......... .......... .......... .......... 92% 27.5M 0s 2024-03-09T14:41:49.070 INFO:teuthology.orchestra.run.smithi046.stderr: 86250K .......... .......... .......... .......... .......... 92% 35.7M 0s 2024-03-09T14:41:49.070 INFO:teuthology.orchestra.run.smithi046.stderr: 86300K .......... .......... .......... .......... .......... 92% 59.3M 0s 2024-03-09T14:41:49.072 INFO:teuthology.orchestra.run.smithi046.stderr: 86350K .......... .......... .......... .......... .......... 93% 32.0M 0s 2024-03-09T14:41:49.074 INFO:teuthology.orchestra.run.smithi046.stderr: 86400K .......... .......... .......... .......... .......... 93% 23.0M 0s 2024-03-09T14:41:49.076 INFO:teuthology.orchestra.run.smithi046.stderr: 86450K .......... .......... .......... .......... .......... 93% 24.7M 0s 2024-03-09T14:41:49.079 INFO:teuthology.orchestra.run.smithi046.stderr: 86500K .......... .......... .......... .......... .......... 93% 21.5M 0s 2024-03-09T14:41:49.079 INFO:teuthology.orchestra.run.smithi046.stderr: 86550K .......... .......... .......... .......... .......... 93% 48.8M 0s 2024-03-09T14:41:49.080 INFO:teuthology.orchestra.run.smithi046.stderr: 86600K .......... .......... .......... .......... .......... 93% 56.8M 0s 2024-03-09T14:41:49.083 INFO:teuthology.orchestra.run.smithi046.stderr: 86650K .......... .......... .......... .......... .......... 93% 23.2M 0s 2024-03-09T14:41:49.084 INFO:teuthology.orchestra.run.smithi046.stderr: 86700K .......... .......... .......... .......... .......... 93% 36.1M 0s 2024-03-09T14:41:49.086 INFO:teuthology.orchestra.run.smithi046.stderr: 86750K .......... .......... .......... .......... .......... 93% 83.4M 0s 2024-03-09T14:41:49.086 INFO:teuthology.orchestra.run.smithi046.stderr: 86800K .......... .......... .......... .......... .......... 93% 25.8M 0s 2024-03-09T14:41:49.088 INFO:teuthology.orchestra.run.smithi046.stderr: 86850K .......... .......... .......... .......... .......... 93% 25.4M 0s 2024-03-09T14:41:49.090 INFO:teuthology.orchestra.run.smithi046.stderr: 86900K .......... .......... .......... .......... .......... 93% 24.8M 0s 2024-03-09T14:41:49.092 INFO:teuthology.orchestra.run.smithi046.stderr: 86950K .......... .......... .......... .......... .......... 93% 31.3M 0s 2024-03-09T14:41:49.093 INFO:teuthology.orchestra.run.smithi046.stderr: 87000K .......... .......... .......... .......... .......... 93% 45.6M 0s 2024-03-09T14:41:49.094 INFO:teuthology.orchestra.run.smithi046.stderr: 87050K .......... .......... .......... .......... .......... 93% 29.5M 0s 2024-03-09T14:41:49.095 INFO:teuthology.orchestra.run.smithi046.stderr: 87100K .......... .......... .......... .......... .......... 93% 50.6M 0s 2024-03-09T14:41:49.098 INFO:teuthology.orchestra.run.smithi046.stderr: 87150K .......... .......... .......... .......... .......... 93% 19.5M 0s 2024-03-09T14:41:49.101 INFO:teuthology.orchestra.run.smithi046.stderr: 87200K .......... .......... .......... .......... .......... 93% 14.9M 0s 2024-03-09T14:41:49.102 INFO:teuthology.orchestra.run.smithi046.stderr: 87250K .......... .......... .......... .......... .......... 93% 57.2M 0s 2024-03-09T14:41:49.104 INFO:teuthology.orchestra.run.smithi046.stderr: 87300K .......... .......... .......... .......... .......... 94% 28.1M 0s 2024-03-09T14:41:49.104 INFO:teuthology.orchestra.run.smithi046.stderr: 87350K .......... .......... .......... .......... .......... 94% 69.7M 0s 2024-03-09T14:41:49.106 INFO:teuthology.orchestra.run.smithi046.stderr: 87400K .......... .......... .......... .......... .......... 94% 26.4M 0s 2024-03-09T14:41:49.108 INFO:teuthology.orchestra.run.smithi046.stderr: 87450K .......... .......... .......... .......... .......... 94% 50.3M 0s 2024-03-09T14:41:49.110 INFO:teuthology.orchestra.run.smithi046.stderr: 87500K .......... .......... .......... .......... .......... 94% 35.8M 0s 2024-03-09T14:41:49.110 INFO:teuthology.orchestra.run.smithi046.stderr: 87550K .......... .......... .......... .......... .......... 94% 82.3M 0s 2024-03-09T14:41:49.110 INFO:teuthology.orchestra.run.smithi046.stderr: 87600K .......... .......... .......... .......... .......... 94% 48.2M 0s 2024-03-09T14:41:49.115 INFO:teuthology.orchestra.run.smithi046.stderr: 87650K .......... .......... .......... .......... .......... 94% 40.1M 0s 2024-03-09T14:41:49.115 INFO:teuthology.orchestra.run.smithi046.stderr: 87700K .......... .......... .......... .......... .......... 94% 78.5M 0s 2024-03-09T14:41:49.115 INFO:teuthology.orchestra.run.smithi046.stderr: 87750K .......... .......... .......... .......... .......... 94% 74.5M 0s 2024-03-09T14:41:49.115 INFO:teuthology.orchestra.run.smithi046.stderr: 87800K .......... .......... .......... .......... .......... 94% 77.1M 0s 2024-03-09T14:41:49.115 INFO:teuthology.orchestra.run.smithi046.stderr: 87850K .......... .......... .......... .......... .......... 94% 42.4M 0s 2024-03-09T14:41:49.117 INFO:teuthology.orchestra.run.smithi046.stderr: 87900K .......... .......... .......... .......... .......... 94% 49.9M 0s 2024-03-09T14:41:49.117 INFO:teuthology.orchestra.run.smithi046.stderr: 87950K .......... .......... .......... .......... .......... 94% 48.3M 0s 2024-03-09T14:41:49.119 INFO:teuthology.orchestra.run.smithi046.stderr: 88000K .......... .......... .......... .......... .......... 94% 35.1M 0s 2024-03-09T14:41:49.119 INFO:teuthology.orchestra.run.smithi046.stderr: 88050K .......... .......... .......... .......... .......... 94% 64.2M 0s 2024-03-09T14:41:49.120 INFO:teuthology.orchestra.run.smithi046.stderr: 88100K .......... .......... .......... .......... .......... 94% 40.6M 0s 2024-03-09T14:41:49.122 INFO:teuthology.orchestra.run.smithi046.stderr: 88150K .......... .......... .......... .......... .......... 94% 22.3M 0s 2024-03-09T14:41:49.123 INFO:teuthology.orchestra.run.smithi046.stderr: 88200K .......... .......... .......... .......... .......... 94% 31.2M 0s 2024-03-09T14:41:49.124 INFO:teuthology.orchestra.run.smithi046.stderr: 88250K .......... .......... .......... .......... .......... 95% 50.0M 0s 2024-03-09T14:41:49.126 INFO:teuthology.orchestra.run.smithi046.stderr: 88300K .......... .......... .......... .......... .......... 95% 29.4M 0s 2024-03-09T14:41:49.128 INFO:teuthology.orchestra.run.smithi046.stderr: 88350K .......... .......... .......... .......... .......... 95% 32.1M 0s 2024-03-09T14:41:49.130 INFO:teuthology.orchestra.run.smithi046.stderr: 88400K .......... .......... .......... .......... .......... 95% 24.6M 0s 2024-03-09T14:41:49.131 INFO:teuthology.orchestra.run.smithi046.stderr: 88450K .......... .......... .......... .......... .......... 95% 51.7M 0s 2024-03-09T14:41:49.132 INFO:teuthology.orchestra.run.smithi046.stderr: 88500K .......... .......... .......... .......... .......... 95% 58.7M 0s 2024-03-09T14:41:49.134 INFO:teuthology.orchestra.run.smithi046.stderr: 88550K .......... .......... .......... .......... .......... 95% 26.1M 0s 2024-03-09T14:41:49.135 INFO:teuthology.orchestra.run.smithi046.stderr: 88600K .......... .......... .......... .......... .......... 95% 27.7M 0s 2024-03-09T14:41:49.136 INFO:teuthology.orchestra.run.smithi046.stderr: 88650K .......... .......... .......... .......... .......... 95% 41.0M 0s 2024-03-09T14:41:49.137 INFO:teuthology.orchestra.run.smithi046.stderr: 88700K .......... .......... .......... .......... .......... 95% 52.8M 0s 2024-03-09T14:41:49.139 INFO:teuthology.orchestra.run.smithi046.stderr: 88750K .......... .......... .......... .......... .......... 95% 30.8M 0s 2024-03-09T14:41:49.141 INFO:teuthology.orchestra.run.smithi046.stderr: 88800K .......... .......... .......... .......... .......... 95% 29.6M 0s 2024-03-09T14:41:49.142 INFO:teuthology.orchestra.run.smithi046.stderr: 88850K .......... .......... .......... .......... .......... 95% 27.4M 0s 2024-03-09T14:41:49.144 INFO:teuthology.orchestra.run.smithi046.stderr: 88900K .......... .......... .......... .......... .......... 95% 39.9M 0s 2024-03-09T14:41:49.144 INFO:teuthology.orchestra.run.smithi046.stderr: 88950K .......... .......... .......... .......... .......... 95% 57.1M 0s 2024-03-09T14:41:49.147 INFO:teuthology.orchestra.run.smithi046.stderr: 89000K .......... .......... .......... .......... .......... 95% 30.7M 0s 2024-03-09T14:41:49.147 INFO:teuthology.orchestra.run.smithi046.stderr: 89050K .......... .......... .......... .......... .......... 95% 40.6M 0s 2024-03-09T14:41:49.148 INFO:teuthology.orchestra.run.smithi046.stderr: 89100K .......... .......... .......... .......... .......... 95% 44.2M 0s 2024-03-09T14:41:49.149 INFO:teuthology.orchestra.run.smithi046.stderr: 89150K .......... .......... .......... .......... .......... 96% 62.8M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89200K .......... .......... .......... .......... .......... 96% 35.6M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89250K .......... .......... .......... .......... .......... 96% 53.5M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89300K .......... .......... .......... .......... .......... 96% 47.9M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89350K .......... .......... .......... .......... .......... 96% 84.7M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89400K .......... .......... .......... .......... .......... 96% 69.7M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89450K .......... .......... .......... .......... .......... 96% 82.2M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89500K .......... .......... .......... .......... .......... 96% 38.9M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89550K .......... .......... .......... .......... .......... 96% 58.3M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89600K .......... .......... .......... .......... .......... 96% 36.3M 0s 2024-03-09T14:41:49.160 INFO:teuthology.orchestra.run.smithi046.stderr: 89650K .......... .......... .......... .......... .......... 96% 34.8M 0s 2024-03-09T14:41:49.162 INFO:teuthology.orchestra.run.smithi046.stderr: 89700K .......... .......... .......... .......... .......... 96% 30.4M 0s 2024-03-09T14:41:49.162 INFO:teuthology.orchestra.run.smithi046.stderr: 89750K .......... .......... .......... .......... .......... 96% 45.1M 0s 2024-03-09T14:41:49.162 INFO:teuthology.orchestra.run.smithi046.stderr: 89800K .......... .......... .......... .......... .......... 96% 70.0M 0s 2024-03-09T14:41:49.164 INFO:teuthology.orchestra.run.smithi046.stderr: 89850K .......... .......... .......... .......... .......... 96% 68.0M 0s 2024-03-09T14:41:49.164 INFO:teuthology.orchestra.run.smithi046.stderr: 89900K .......... .......... .......... .......... .......... 96% 61.4M 0s 2024-03-09T14:41:49.165 INFO:teuthology.orchestra.run.smithi046.stderr: 89950K .......... .......... .......... .......... .......... 96% 49.8M 0s 2024-03-09T14:41:49.167 INFO:teuthology.orchestra.run.smithi046.stderr: 90000K .......... .......... .......... .......... .......... 96% 27.6M 0s 2024-03-09T14:41:49.167 INFO:teuthology.orchestra.run.smithi046.stderr: 90050K .......... .......... .......... .......... .......... 96% 64.8M 0s 2024-03-09T14:41:49.168 INFO:teuthology.orchestra.run.smithi046.stderr: 90100K .......... .......... .......... .......... .......... 97% 57.8M 0s 2024-03-09T14:41:49.169 INFO:teuthology.orchestra.run.smithi046.stderr: 90150K .......... .......... .......... .......... .......... 97% 49.7M 0s 2024-03-09T14:41:49.170 INFO:teuthology.orchestra.run.smithi046.stderr: 90200K .......... .......... .......... .......... .......... 97% 46.1M 0s 2024-03-09T14:41:49.173 INFO:teuthology.orchestra.run.smithi046.stderr: 90250K .......... .......... .......... .......... .......... 97% 25.6M 0s 2024-03-09T14:41:49.173 INFO:teuthology.orchestra.run.smithi046.stderr: 90300K .......... .......... .......... .......... .......... 97% 91.6M 0s 2024-03-09T14:41:49.174 INFO:teuthology.orchestra.run.smithi046.stderr: 90350K .......... .......... .......... .......... .......... 97% 37.7M 0s 2024-03-09T14:41:49.178 INFO:teuthology.orchestra.run.smithi046.stderr: 90400K .......... .......... .......... .......... .......... 97% 51.1M 0s 2024-03-09T14:41:49.178 INFO:teuthology.orchestra.run.smithi046.stderr: 90450K .......... .......... .......... .......... .......... 97% 71.7M 0s 2024-03-09T14:41:49.178 INFO:teuthology.orchestra.run.smithi046.stderr: 90500K .......... .......... .......... .......... .......... 97% 62.5M 0s 2024-03-09T14:41:49.178 INFO:teuthology.orchestra.run.smithi046.stderr: 90550K .......... .......... .......... .......... .......... 97% 125M 0s 2024-03-09T14:41:49.178 INFO:teuthology.orchestra.run.smithi046.stderr: 90600K .......... .......... .......... .......... .......... 97% 61.9M 0s 2024-03-09T14:41:49.179 INFO:teuthology.orchestra.run.smithi046.stderr: 90650K .......... .......... .......... .......... .......... 97% 39.9M 0s 2024-03-09T14:41:49.180 INFO:teuthology.orchestra.run.smithi046.stderr: 90700K .......... .......... .......... .......... .......... 97% 59.3M 0s 2024-03-09T14:41:49.181 INFO:teuthology.orchestra.run.smithi046.stderr: 90750K .......... .......... .......... .......... .......... 97% 40.8M 0s 2024-03-09T14:41:49.182 INFO:teuthology.orchestra.run.smithi046.stderr: 90800K .......... .......... .......... .......... .......... 97% 45.6M 0s 2024-03-09T14:41:49.183 INFO:teuthology.orchestra.run.smithi046.stderr: 90850K .......... .......... .......... .......... .......... 97% 48.1M 0s 2024-03-09T14:41:49.184 INFO:teuthology.orchestra.run.smithi046.stderr: 90900K .......... .......... .......... .......... .......... 97% 56.3M 0s 2024-03-09T14:41:49.185 INFO:teuthology.orchestra.run.smithi046.stderr: 90950K .......... .......... .......... .......... .......... 97% 44.1M 0s 2024-03-09T14:41:49.185 INFO:teuthology.orchestra.run.smithi046.stderr: 91000K .......... .......... .......... .......... .......... 98% 94.1M 0s 2024-03-09T14:41:49.188 INFO:teuthology.orchestra.run.smithi046.stderr: 91050K .......... .......... .......... .......... .......... 98% 48.7M 0s 2024-03-09T14:41:49.188 INFO:teuthology.orchestra.run.smithi046.stderr: 91100K .......... .......... .......... .......... .......... 98% 67.3M 0s 2024-03-09T14:41:49.188 INFO:teuthology.orchestra.run.smithi046.stderr: 91150K .......... .......... .......... .......... .......... 98% 89.0M 0s 2024-03-09T14:41:49.193 INFO:teuthology.orchestra.run.smithi046.stderr: 91200K .......... .......... .......... .......... .......... 98% 56.3M 0s 2024-03-09T14:41:49.193 INFO:teuthology.orchestra.run.smithi046.stderr: 91250K .......... .......... .......... .......... .......... 98% 84.2M 0s 2024-03-09T14:41:49.193 INFO:teuthology.orchestra.run.smithi046.stderr: 91300K .......... .......... .......... .......... .......... 98% 88.2M 0s 2024-03-09T14:41:49.193 INFO:teuthology.orchestra.run.smithi046.stderr: 91350K .......... .......... .......... .......... .......... 98% 78.1M 0s 2024-03-09T14:41:49.194 INFO:teuthology.orchestra.run.smithi046.stderr: 91400K .......... .......... .......... .......... .......... 98% 68.1M 0s 2024-03-09T14:41:49.194 INFO:teuthology.orchestra.run.smithi046.stderr: 91450K .......... .......... .......... .......... .......... 98% 124M 0s 2024-03-09T14:41:49.194 INFO:teuthology.orchestra.run.smithi046.stderr: 91500K .......... .......... .......... .......... .......... 98% 59.2M 0s 2024-03-09T14:41:49.194 INFO:teuthology.orchestra.run.smithi046.stderr: 91550K .......... .......... .......... .......... .......... 98% 62.7M 0s 2024-03-09T14:41:49.195 INFO:teuthology.orchestra.run.smithi046.stderr: 91600K .......... .......... .......... .......... .......... 98% 46.1M 0s 2024-03-09T14:41:49.196 INFO:teuthology.orchestra.run.smithi046.stderr: 91650K .......... .......... .......... .......... .......... 98% 30.7M 0s 2024-03-09T14:41:49.196 INFO:teuthology.orchestra.run.smithi046.stderr: 91700K .......... .......... .......... .......... .......... 98% 122M 0s 2024-03-09T14:41:49.199 INFO:teuthology.orchestra.run.smithi046.stderr: 91750K .......... .......... .......... .......... .......... 98% 56.7M 0s 2024-03-09T14:41:49.199 INFO:teuthology.orchestra.run.smithi046.stderr: 91800K .......... .......... .......... .......... .......... 98% 57.4M 0s 2024-03-09T14:41:49.200 INFO:teuthology.orchestra.run.smithi046.stderr: 91850K .......... .......... .......... .......... .......... 98% 48.4M 0s 2024-03-09T14:41:49.200 INFO:teuthology.orchestra.run.smithi046.stderr: 91900K .......... .......... .......... .......... .......... 98% 106M 0s 2024-03-09T14:41:49.201 INFO:teuthology.orchestra.run.smithi046.stderr: 91950K .......... .......... .......... .......... .......... 99% 46.8M 0s 2024-03-09T14:41:49.207 INFO:teuthology.orchestra.run.smithi046.stderr: 92000K .......... .......... .......... .......... .......... 99% 41.2M 0s 2024-03-09T14:41:49.207 INFO:teuthology.orchestra.run.smithi046.stderr: 92050K .......... .......... .......... .......... .......... 99% 81.5M 0s 2024-03-09T14:41:49.207 INFO:teuthology.orchestra.run.smithi046.stderr: 92100K .......... .......... .......... .......... .......... 99% 81.8M 0s 2024-03-09T14:41:49.207 INFO:teuthology.orchestra.run.smithi046.stderr: 92150K .......... .......... .......... .......... .......... 99% 102M 0s 2024-03-09T14:41:49.208 INFO:teuthology.orchestra.run.smithi046.stderr: 92200K .......... .......... .......... .......... .......... 99% 63.7M 0s 2024-03-09T14:41:49.208 INFO:teuthology.orchestra.run.smithi046.stderr: 92250K .......... .......... .......... .......... .......... 99% 60.4M 0s 2024-03-09T14:41:49.208 INFO:teuthology.orchestra.run.smithi046.stderr: 92300K .......... .......... .......... .......... .......... 99% 62.7M 0s 2024-03-09T14:41:49.208 INFO:teuthology.orchestra.run.smithi046.stderr: 92350K .......... .......... .......... .......... .......... 99% 106M 0s 2024-03-09T14:41:49.208 INFO:teuthology.orchestra.run.smithi046.stderr: 92400K .......... .......... .......... .......... .......... 99% 57.2M 0s 2024-03-09T14:41:49.213 INFO:teuthology.orchestra.run.smithi046.stderr: 92450K .......... .......... .......... .......... .......... 99% 44.6M 0s 2024-03-09T14:41:49.213 INFO:teuthology.orchestra.run.smithi046.stderr: 92500K .......... .......... .......... .......... .......... 99% 77.2M 0s 2024-03-09T14:41:49.213 INFO:teuthology.orchestra.run.smithi046.stderr: 92550K .......... .......... .......... .......... .......... 99% 47.8M 0s 2024-03-09T14:41:49.213 INFO:teuthology.orchestra.run.smithi046.stderr: 92600K .......... .......... .......... .......... .......... 99% 127M 0s 2024-03-09T14:41:49.214 INFO:teuthology.orchestra.run.smithi046.stderr: 92650K .......... .......... .......... .......... .......... 99% 45.6M 0s 2024-03-09T14:41:49.214 INFO:teuthology.orchestra.run.smithi046.stderr: 92700K .......... .......... .......... .......... .......... 99% 72.8M 0s 2024-03-09T14:41:49.214 INFO:teuthology.orchestra.run.smithi046.stderr: 92750K .......... .......... .......... .......... .......... 99% 41.9M 0s 2024-03-09T14:41:49.215 INFO:teuthology.orchestra.run.smithi046.stderr: 92800K .......... .......... .......... .......... .......... 99% 44.4M 0s 2024-03-09T14:41:49.215 INFO:teuthology.orchestra.run.smithi046.stderr: 92850K .......... .......... .......... .......... .......... 99% 145M 0s 2024-03-09T14:41:49.215 INFO:teuthology.orchestra.run.smithi046.stderr: 92900K 100% 134G=2.7s 2024-03-09T14:41:49.215 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-03-09T14:41:49.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09 14:41:49 (33.4 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-03-09T14:41:49.216 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-03-09T14:41:49.237 INFO:teuthology.orchestra.run.smithi046.stdout:Archive: gradle-6.0.1-bin.zip 2024-03-09T14:41:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-03-09T14:41:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-03-09T14:41:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-03-09T14:41:49.237 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-03-09T14:41:49.238 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-03-09T14:41:49.240 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-03-09T14:41:49.240 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-03-09T14:41:49.251 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-03-09T14:41:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-03-09T14:41:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-03-09T14:41:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-03-09T14:41:49.254 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-03-09T14:41:49.269 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-03-09T14:41:49.270 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-03-09T14:41:49.270 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-03-09T14:41:49.271 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-03-09T14:41:49.278 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-03-09T14:41:49.278 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-03-09T14:41:49.278 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-03-09T14:41:49.281 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-03-09T14:41:49.283 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-03-09T14:41:49.283 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-03-09T14:41:49.285 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-03-09T14:41:49.285 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-03-09T14:41:49.285 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-03-09T14:41:49.285 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-03-09T14:41:49.287 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-03-09T14:41:49.287 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-03-09T14:41:49.288 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-03-09T14:41:49.291 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-03-09T14:41:49.291 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-03-09T14:41:49.291 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-03-09T14:41:49.292 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-03-09T14:41:49.292 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-03-09T14:41:49.292 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-03-09T14:41:49.530 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-03-09T14:41:49.530 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-03-09T14:41:49.531 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-03-09T14:41:49.531 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-03-09T14:41:49.585 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-03-09T14:41:49.585 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-03-09T14:41:49.585 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-03-09T14:41:49.585 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-03-09T14:41:49.586 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-03-09T14:41:49.601 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-03-09T14:41:49.603 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-03-09T14:41:49.605 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-03-09T14:41:49.605 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-03-09T14:41:49.606 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-03-09T14:41:49.606 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-03-09T14:41:49.607 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-03-09T14:41:49.623 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-03-09T14:41:49.623 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-03-09T14:41:49.623 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-03-09T14:41:49.623 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-03-09T14:41:49.624 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-03-09T14:41:49.624 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-03-09T14:41:49.626 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-03-09T14:41:49.629 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-03-09T14:41:49.629 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-03-09T14:41:49.644 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-03-09T14:41:49.648 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-03-09T14:41:49.651 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-03-09T14:41:49.654 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-03-09T14:41:49.654 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-03-09T14:41:49.655 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-03-09T14:41:49.656 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-03-09T14:41:49.657 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-03-09T14:41:49.660 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-03-09T14:41:49.662 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-03-09T14:41:49.680 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-03-09T14:41:49.681 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-03-09T14:41:49.689 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-03-09T14:41:49.690 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-03-09T14:41:49.690 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-03-09T14:41:49.690 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-03-09T14:41:49.690 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-03-09T14:41:49.697 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-03-09T14:41:49.698 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-03-09T14:41:49.700 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-03-09T14:41:49.700 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-03-09T14:41:49.700 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-03-09T14:41:49.700 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-03-09T14:41:49.700 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-03-09T14:41:49.701 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-03-09T14:41:49.701 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-03-09T14:41:49.701 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-03-09T14:41:49.701 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-03-09T14:41:49.704 INFO:teuthology.orchestra.run.smithi046.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-03-09T14:41:49.705 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-03-09T14:41:49.705 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-03-09T14:41:49.705 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-03-09T14:41:49.705 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-03-09T14:41:49.707 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-03-09T14:41:49.707 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-03-09T14:41:49.709 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-03-09T14:41:49.710 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-03-09T14:41:49.710 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-03-09T14:41:49.713 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-03-09T14:41:49.713 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-03-09T14:41:49.715 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-03-09T14:41:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-03-09T14:41:49.716 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-03-09T14:41:49.717 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-03-09T14:41:49.718 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-03-09T14:41:49.719 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-03-09T14:41:49.719 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-03-09T14:41:49.721 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-03-09T14:41:49.722 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-03-09T14:41:49.724 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-03-09T14:41:49.724 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-03-09T14:41:49.725 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-03-09T14:41:49.725 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-03-09T14:41:49.726 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-03-09T14:41:49.726 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-03-09T14:41:49.727 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-03-09T14:41:49.729 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-03-09T14:41:49.729 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-03-09T14:41:49.730 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-03-09T14:41:49.734 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-03-09T14:41:49.735 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-03-09T14:41:49.736 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-03-09T14:41:49.738 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-03-09T14:41:49.739 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-03-09T14:41:49.739 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-03-09T14:41:49.745 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-03-09T14:41:49.746 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-03-09T14:41:49.760 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-03-09T14:41:49.761 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-03-09T14:41:49.762 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-03-09T14:41:49.762 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-03-09T14:41:49.762 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-03-09T14:41:49.762 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-03-09T14:41:49.763 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-03-09T14:41:49.763 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-03-09T14:41:49.763 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-03-09T14:41:49.763 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-03-09T14:41:49.782 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-03-09T14:41:49.782 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-03-09T14:41:49.782 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-03-09T14:41:49.783 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-03-09T14:41:49.784 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-03-09T14:41:49.785 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-03-09T14:41:49.792 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-03-09T14:41:49.794 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-03-09T14:41:49.798 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-03-09T14:41:49.798 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-03-09T14:41:49.799 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-03-09T14:41:49.799 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-03-09T14:41:49.800 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-03-09T14:41:49.801 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-03-09T14:41:49.803 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-03-09T14:41:49.811 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-03-09T14:41:49.813 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-03-09T14:41:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-03-09T14:41:49.814 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-03-09T14:41:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-03-09T14:41:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-03-09T14:41:49.815 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-03-09T14:41:49.818 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-03-09T14:41:49.822 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-03-09T14:41:49.824 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-03-09T14:41:49.824 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-03-09T14:41:49.826 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-03-09T14:41:49.829 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-03-09T14:41:49.830 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-03-09T14:41:49.836 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-03-09T14:41:49.840 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-03-09T14:41:49.846 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-03-09T14:41:49.851 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-03-09T14:41:49.854 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-03-09T14:41:49.855 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-03-09T14:41:49.864 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-03-09T14:41:49.866 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-03-09T14:41:49.872 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-03-09T14:41:49.873 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-03-09T14:41:49.881 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-03-09T14:41:49.883 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-03-09T14:41:49.884 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-03-09T14:41:49.888 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-03-09T14:41:49.894 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-03-09T14:41:49.924 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-03-09T14:41:49.927 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-03-09T14:41:49.927 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-03-09T14:41:49.929 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-03-09T14:41:49.929 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-03-09T14:41:49.930 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-03-09T14:41:49.930 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-03-09T14:41:49.930 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-03-09T14:41:49.931 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-03-09T14:41:49.932 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-03-09T14:41:49.932 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-03-09T14:41:49.933 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-03-09T14:41:49.934 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-03-09T14:41:49.935 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-03-09T14:41:49.935 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-03-09T14:41:49.935 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-03-09T14:41:49.937 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-03-09T14:41:49.937 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-03-09T14:41:49.937 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-03-09T14:41:49.937 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-03-09T14:41:49.937 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-03-09T14:41:49.938 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-03-09T14:41:49.938 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-03-09T14:41:49.939 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-03-09T14:41:49.940 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-03-09T14:41:49.944 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-03-09T14:41:49.945 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-03-09T14:41:49.946 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-03-09T14:41:49.946 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-03-09T14:41:49.946 INFO:teuthology.orchestra.run.smithi046.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-03-09T14:41:49.986 INFO:teuthology.orchestra.run.smithi046.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout:Welcome to Gradle 6.0.1! 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout:Here are the highlights of this release: 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout: - Substantial improvements in dependency management, including 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout: - Advanced control of transitive versions 2024-03-09T14:41:50.320 INFO:teuthology.orchestra.run.smithi046.stdout: - Support for optional features and dependencies 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: - Rules to tweak published metadata 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: - Support for Java 13 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: - Faster incremental Java and Groovy compilation 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: - New Zinc compiler for Scala 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: - VS2019 support 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: - Support for Gradle Enterprise plugin 3.0 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout:------------------------------------------------------------ 2024-03-09T14:41:50.321 INFO:teuthology.orchestra.run.smithi046.stdout:Gradle 6.0.1 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:------------------------------------------------------------ 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:Kotlin: 1.3.50 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:Groovy: 2.5.8 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:JVM: 11.0.18 (Red Hat, Inc. 11.0.18+10-LTS) 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout:OS: Linux 5.14.0-427.el9.x86_64 amd64 2024-03-09T14:41:50.322 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.323 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-03-09T14:41:50.324 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-09T14:41:50.324 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T14:41:50.324 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-09T14:41:50.324 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T14:41:50.324 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-03-09T14:41:50.575 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-03-09T14:41:50.576 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-03-09T14:41:50.576 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'YVTQFRZWIHVPQPOPINTG', 'access_secret': 'W7br4+whk+sQRPvgW60WnZogf632m8gMyBpiCPLZdMj53VIRiV1Ucg==', 'region': 'mexico', 'endpoint': 'smithi046.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi046.front.sepia.ceph.com'} 2024-03-09T14:41:50.576 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-03-09T14:41:50.576 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'YVTQFRZWIHVPQPOPINTG', '--secret', 'W7br4+whk+sQRPvgW60WnZogf632m8gMyBpiCPLZdMj53VIRiV1Ucg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-03-09T14:41:50.576 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key YVTQFRZWIHVPQPOPINTG --secret W7br4+whk+sQRPvgW60WnZogf632m8gMyBpiCPLZdMj53VIRiV1Ucg== --email tester.client.0_test@test.test --cluster ceph 2024-03-09T14:41:50.637 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:50.637 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:50.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.667+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.668+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.668+0000 7f4277921800 20 realm 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.668+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.668+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.668+0000 7f4277921800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.668+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.669+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.669+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.670+0000 7f4277921800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:50.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.670+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.670+0000 7f4277921800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:50.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.671+0000 7f4277921800 20 searching for the correct realm 2024-03-09T14:41:50.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.675+0000 7f4273eb5640 0 -- 172.21.15.46:0/3454084015 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f4268057050 msgr2=0x7f42680cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.881+0000 7f42736b4640 0 -- 172.21.15.46:0/3454084015 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55a8528d9500 msgr2=0x55a8528db950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.884+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 20 zone default found 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 4 Realm: () 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:50.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 20 zonegroup default 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.885+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 started sync module instance, tier type = 2024-03-09T14:41:50.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.886+0000 7f4277921800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=0 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=1 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=2 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=3 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=4 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=5 2024-03-09T14:41:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.896+0000 7f4277921800 20 add_watcher() i=6 2024-03-09T14:41:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.897+0000 7f4277921800 20 add_watcher() i=7 2024-03-09T14:41:50.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.897+0000 7f4277921800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.898+0000 7f4129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.898+0000 7f4277921800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.898+0000 7f4277921800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.898+0000 7f4277921800 5 note: GC not initialized 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.899+0000 7f4128fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.899+0000 7f4277921800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.899+0000 7f4277921800 20 Filter name: none 2024-03-09T14:41:50.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.899+0000 7f40a27fc640 20 reqs_thread_entry: start 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.899+0000 7f4277921800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.899+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache get: name=default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG : miss 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 20 rados->read ofs=0 len=0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache put: name=default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG info.flags=0x0 2024-03-09T14:41:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 adding default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG to cache LRU end 2024-03-09T14:41:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache get: name=default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG : hit (negative entry) 2024-03-09T14:41:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.900+0000 7f4277921800 10 cache get: name=default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG : hit (negative entry) 2024-03-09T14:41:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.902+0000 7f4277921800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-09T14:41:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.902+0000 7f4277921800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:41:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.902+0000 7f4277921800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-09T14:41:50.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.902+0000 7f4156ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595105 cookie 94181427939296 notifier 7320 bl.length()=670 2024-03-09T14:41:50.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.902+0000 7f4156ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-09T14:41:50.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.902+0000 7f4156ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:41:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.904+0000 7f4277921800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-09T14:41:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.904+0000 7f4277921800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:41:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.904+0000 7f4277921800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-09T14:41:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.905+0000 7f4156ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595121 cookie 94181427930112 notifier 7320 bl.length()=200 2024-03-09T14:41:50.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.905+0000 7f4156ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-09T14:41:50.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.905+0000 7f4156ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:41:50.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.907+0000 7f4277921800 10 cache put: name=default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG info.flags=0x7 2024-03-09T14:41:50.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.907+0000 7f4277921800 10 moving default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG to cache LRU end 2024-03-09T14:41:50.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.907+0000 7f4277921800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:YVTQFRZWIHVPQPOPINTG, ofs0, ns] 2024-03-09T14:41:50.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.908+0000 7f41567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595127 cookie 94181427880720 notifier 7320 bl.length()=189 2024-03-09T14:41:50.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.908+0000 7f41567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG info.flags=0x7 2024-03-09T14:41:50.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.908+0000 7f41567fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YVTQFRZWIHVPQPOPINTG to cache LRU end 2024-03-09T14:41:50.909 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:41:50.909 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "tester.client.0", 2024-03-09T14:41:50.909 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Ms. tester.client.0", 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "tester.client.0_test@test.test", 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "tester.client.0", 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "YVTQFRZWIHVPQPOPINTG", 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "W7br4+whk+sQRPvgW60WnZogf632m8gMyBpiCPLZdMj53VIRiV1Ucg==", 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:41:50.901455Z" 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:41:50.910 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:41:50.911 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:41:50.901444Z", 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:41:50.912 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:41:50.913 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:41:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.910+0000 7f4129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.912+0000 7f4277921800 20 remove_watcher() i=0 2024-03-09T14:41:50.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.912+0000 7f4277921800 2 removed watcher, disabling cache 2024-03-09T14:41:50.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.914+0000 7f4277921800 20 remove_watcher() i=1 2024-03-09T14:41:50.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.914+0000 7f4277921800 20 remove_watcher() i=2 2024-03-09T14:41:50.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.915+0000 7f4277921800 20 remove_watcher() i=3 2024-03-09T14:41:50.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.916+0000 7f4277921800 20 remove_watcher() i=4 2024-03-09T14:41:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.917+0000 7f4277921800 20 remove_watcher() i=5 2024-03-09T14:41:50.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.918+0000 7f4277921800 20 remove_watcher() i=6 2024-03-09T14:41:50.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:50.919+0000 7f4277921800 20 remove_watcher() i=7 2024-03-09T14:41:50.931 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:41:50.931 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-03-09T14:41:50.960 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-03-09T14:41:50.960 DEBUG:teuthology.orchestra.run.smithi046:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-03-09T14:41:51.027 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:41:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:51.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.149+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 realm 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.151+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.152+0000 7fa759342800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.152+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.153+0000 7fa759342800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:51.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.153+0000 7fa759342800 20 searching for the correct realm 2024-03-09T14:41:51.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.157+0000 7fa755842640 0 -- 172.21.15.46:0/1577765050 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7fa74c035070 msgr2=0x7fa74c025920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:51.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.363+0000 7fa755041640 0 -- 172.21.15.46:0/1577765050 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55af7f7476f0 msgr2=0x55af7f749ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.366+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 zone default found 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 4 Realm: () 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 zonegroup default 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.367+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.368+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.368+0000 7fa759342800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.368+0000 7fa759342800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.368+0000 7fa759342800 20 started sync module instance, tier type = 2024-03-09T14:41:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.368+0000 7fa759342800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=0 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=1 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=2 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=3 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=4 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=5 2024-03-09T14:41:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.377+0000 7fa759342800 20 add_watcher() i=6 2024-03-09T14:41:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.378+0000 7fa759342800 20 add_watcher() i=7 2024-03-09T14:41:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.378+0000 7fa759342800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.380+0000 7fa60b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.380+0000 7fa759342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.380+0000 7fa759342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.416+0000 7fa60a7e4640 20 reqs_thread_entry: start 2024-03-09T14:41:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.416+0000 7fa759342800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.416+0000 7fa759342800 20 Filter name: none 2024-03-09T14:41:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.416+0000 7fa57bfff640 20 reqs_thread_entry: start 2024-03-09T14:41:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.416+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:41:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.417+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2071830931742452883', time=2024-03-09T16:37:01.825747+0000, chain.objs.size()=4 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.1 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.2 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.3 2024-03-09T14:41:51.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.418+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11__multipart_foo.2~TtXxcUV0--uMRULHo2uD7mnfBc-0tOV.4 2024-03-09T14:41:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.421+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.423+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:41:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.425+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.425+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.426+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.427+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:41:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.428+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:41:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_9jZ9D-yyN5i95vEPmv_c0wII8akVaLZ', time=2024-03-09T16:37:01.936356+0000, chain.objs.size()=1 2024-03-09T14:41:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.03L_UkcKKmpx2AS95kiwR1xmp_S2RNl_0 2024-03-09T14:41:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12625374677161632846', time=2024-03-09T16:37:01.997035+0000, chain.objs.size()=3 2024-03-09T14:41:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.1 2024-03-09T14:41:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2 2024-03-09T14:41:51.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.429+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.3 2024-03-09T14:41:51.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.431+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.435+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:41:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.436+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.436+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.436+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.436+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11764159216046581226', time=2024-03-09T16:37:01.960499+0000, chain.objs.size()=3 2024-03-09T14:41:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.436+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.1 2024-03-09T14:41:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.436+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2 2024-03-09T14:41:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.437+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.3 2024-03-09T14:41:51.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.438+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.440+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:41:51.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17984277259094888824', time=2024-03-09T16:37:02.033210+0000, chain.objs.size()=3 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-STANDARD.2~uXH1YiThU4fk9fjK2lnzE3L_4_h8gJI.1 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-STANDARD.2~uXH1YiThU4fk9fjK2lnzE3L_4_h8gJI.2 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-STANDARD.2~uXH1YiThU4fk9fjK2lnzE3L_4_h8gJI.3 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3157115245801954621', time=2024-03-09T16:37:02.053345+0000, chain.objs.size()=2 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.442+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.pGCxIyf3TJiCf8_JgcdqER_131uZWdG_0 2024-03-09T14:41:51.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.443+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.pGCxIyf3TJiCf8_JgcdqER_131uZWdG_1 2024-03-09T14:41:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.445+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.448+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:41:51.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.449+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.450+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.450+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.451+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:41:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.453+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.453+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.453+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.454+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:41:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.456+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.456+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:41:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_3eUJYErNflZVMlSfiju3NCrqY07KSHi', time=2024-03-09T16:37:01.913531+0000, chain.objs.size()=1 2024-03-09T14:41:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.OqLDZfrxkeJZ3HfuHw4CqZD8QMMDQv2_1 2024-03-09T14:41:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11953286866513314774', time=2024-03-09T16:37:02.025126+0000, chain.objs.size()=3 2024-03-09T14:41:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-FROZEN.2~m4Ch-24qrRZmR9xhifPVW0imHB1hCd5.1 2024-03-09T14:41:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-FROZEN.2~m4Ch-24qrRZmR9xhifPVW0imHB1hCd5.2 2024-03-09T14:41:51.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.457+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-FROZEN.2~m4Ch-24qrRZmR9xhifPVW0imHB1hCd5.3 2024-03-09T14:41:51.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.459+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.461+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:41:51.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.463+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.463+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13880238533478140029', time=2024-03-09T16:37:01.842733+0000, chain.objs.size()=4 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.1 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.2 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.3 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12__multipart_foo.2~EDmX65kbgPaAll0Nv1XhANPDE_rlUP2.4 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14422522094439722390', time=2024-03-09T16:37:01.863609+0000, chain.objs.size()=4 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.1 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.2 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.3 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10__multipart_foo.2~W_6KLKRFK8hgIR5rUzEhBoNURLi74cQ.4 2024-03-09T14:41:51.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7967981293449726364', time=2024-03-09T16:37:01.884435+0000, chain.objs.size()=4 2024-03-09T14:41:51.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.1 2024-03-09T14:41:51.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.2 2024-03-09T14:41:51.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.3 2024-03-09T14:41:51.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.464+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9__multipart_foo.2~l5Y2PY_bUxCPhYTPTD6UN1fj3DS2CNu.4 2024-03-09T14:41:51.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.474+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.476+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:41:51.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.477+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.477+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.478+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.478+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:41:51.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.480+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.480+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.480+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.481+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:41:51.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2_6c7eb5076b3768172a7c1ae1b7ccd78a', time=2024-03-09T16:37:02.009485+0000, chain.objs.size()=3 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.1 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.2 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-STANDARD.2~pPU8ZDFe11Xdiv5hY8EwIp1lAzzBNr5.3 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14090868796742008213', time=2024-03-09T16:37:02.049187+0000, chain.objs.size()=2 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.2giuQYj79aP_WGXWx1NRx4wcVXvOdcl_0 2024-03-09T14:41:51.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.483+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13__shadow_.2giuQYj79aP_WGXWx1NRx4wcVXvOdcl_1 2024-03-09T14:41:51.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.486+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.489+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:41:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.490+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.490+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.490+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.491+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:41:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.493+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.493+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='__lM0mPjPsL6Ft_nE3TNmVizFa5cWTv3', time=2024-03-09T16:37:01.968443+0000, chain.objs.size()=2 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.V8eayp0e9hNbQV0-YOwAVhbfgdYbvfj_0 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.V8eayp0e9hNbQV0-YOwAVhbfgdYbvfj_1 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_vPxTV6msMuWHQoTgAFQ4_-CefcVs5qF', time=2024-03-09T16:37:01.991002+0000, chain.objs.size()=2 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.IH1VY9Kx61xzGS2AFtPUq8VGbvJvvTE_1 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.IH1VY9Kx61xzGS2AFtPUq8VGbvJvvTE_2 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15081334800321944512', time=2024-03-09T16:37:02.029291+0000, chain.objs.size()=3 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-LUKEWARM.2~3FySnrFosJ3i55NoKgvIxJ046PJI7uT.1 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-LUKEWARM.2~3FySnrFosJ3i55NoKgvIxJ046PJI7uT.2 2024-03-09T14:41:51.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.494+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14__multipart_foo-LUKEWARM.2~3FySnrFosJ3i55NoKgvIxJ046PJI7uT.3 2024-03-09T14:41:51.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.499+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.501+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:41:51.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.502+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_1_1043c18b72eee020a807a6e20f43fe5e', time=2024-03-09T16:37:01.925534+0000, chain.objs.size()=1 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_0 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2_f7d7bebb733afbfd0a9fd5da9408cbb4', time=2024-03-09T16:37:01.964486+0000, chain.objs.size()=3 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.1 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.2 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-FROZEN.2~_C5ZcoFvFBuKZVtNcX6QLdjkfEo553c.3 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_ANtXgmvymw3TdDaJcD_1uMa3-P5Ur40', time=2024-03-09T16:37:01.972560+0000, chain.objs.size()=2 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.Zrx91goMtuNXTz7KmbXFv0XEPgWrChD_1 2024-03-09T14:41:51.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.503+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.Zrx91goMtuNXTz7KmbXFv0XEPgWrChD_2 2024-03-09T14:41:51.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.507+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.509+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:41:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.511+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.511+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.511+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.513+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:41:51.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.514+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.514+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.515+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.515+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_WPXP2ZODWuTFTzsrp5uwEpn-02O3OeL', time=2024-03-09T16:37:01.929626+0000, chain.objs.size()=1 2024-03-09T14:41:51.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.515+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.ntqDCQ6NNoSG304DNO8ueqvl4AuNeqK_1 2024-03-09T14:41:51.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.516+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.518+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:41:51.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.519+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.520+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.520+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.520+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_fBA8xusIiillT_a8FprC0A7qBIN0Z3t', time=2024-03-09T16:37:01.921524+0000, chain.objs.size()=1 2024-03-09T14:41:51.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.520+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.pxVoHGVUkJqvpkOgqIvNOeebeaa0l7L_0 2024-03-09T14:41:51.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.523+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.524+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:41:51.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.526+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.526+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:41:51.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1347850688214617553', time=2024-03-09T16:37:01.976440+0000, chain.objs.size()=3 2024-03-09T14:41:51.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.1 2024-03-09T14:41:51.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2 2024-03-09T14:41:51.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.3 2024-03-09T14:41:51.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_g9CzRiPcz200j-G19CNaO6KVZPOwb6r', time=2024-03-09T16:37:02.005018+0000, chain.objs.size()=1 2024-03-09T14:41:51.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.527+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.BLyWxAvhJpQKfk5EVpske7SmgaJWM2Q_0 2024-03-09T14:41:51.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.528+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.530+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:41:51.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.531+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.532+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.532+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.532+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_L4IG0INldZT6D1YoRMZOXe27Hz8H0t1', time=2024-03-09T16:37:01.982626+0000, chain.objs.size()=2 2024-03-09T14:41:51.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.532+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.zAD7FIHpJhxKEqWvblP7tBCTTDsf9tY_0 2024-03-09T14:41:51.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.532+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.zAD7FIHpJhxKEqWvblP7tBCTTDsf9tY_1 2024-03-09T14:41:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.535+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.537+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:41:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.538+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.538+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.539+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.540+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:41:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.541+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.541+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.542+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.542+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2240626206833955503', time=2024-03-09T16:37:01.917664+0000, chain.objs.size()=1 2024-03-09T14:41:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.542+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.WS3aD4omW5A05vrVJWX7_aVFZ53dYpv_0 2024-03-09T14:41:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.543+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.545+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:41:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.546+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.547+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.547+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.548+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:41:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.550+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.550+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.551+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.551+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8531512067127068524', time=2024-03-09T16:37:01.900897+0000, chain.objs.size()=1 2024-03-09T14:41:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.551+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_0 2024-03-09T14:41:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.552+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.554+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:41:51.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.555+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.556+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.556+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.556+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2_9f4849f4bd213398ca3563665a03dd3d', time=2024-03-09T16:37:01.986781+0000, chain.objs.size()=3 2024-03-09T14:41:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.556+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.1 2024-03-09T14:41:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.556+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.2 2024-03-09T14:41:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.556+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__multipart_foo-LUKEWARM.2~yhEnXPwjfsATV76bDLFbDHlZWwt3qsv.3 2024-03-09T14:41:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.557+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.559+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:41:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.560+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.561+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.561+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.561+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_8whfGe3oUscNMLFn93rDBE6tpvTP9Pc', time=2024-03-09T16:37:02.001116+0000, chain.objs.size()=1 2024-03-09T14:41:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.561+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16__shadow_.ExXn83I_37o9LPdSR4525vp55Lkzsps_0 2024-03-09T14:41:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.562+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.564+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:41:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.566+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.566+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.566+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.567+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:41:51.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.569+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.570+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.570+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.570+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_ojbNS3eFzUGlenmNQ8N6ho7dUwevhNg', time=2024-03-09T16:37:01.940461+0000, chain.objs.size()=1 2024-03-09T14:41:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.570+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.qnlifbXYQxU73oVThrfqQGu76OXD2Tc_0 2024-03-09T14:41:51.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.571+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.574+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:41:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.575+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.575+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.576+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.576+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:41:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.578+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.578+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.579+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.579+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:41:51.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.581+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.581+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.582+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.582+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_1_b126cc325d6c1e6de4304956701536cf', time=2024-03-09T16:37:01.905303+0000, chain.objs.size()=1 2024-03-09T14:41:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.582+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.CjmT4fl8aDnxOWI2EXhrvL7FftOJ38i_0 2024-03-09T14:41:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.583+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.585+0000 7fa759342800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:41:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.587+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.588+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.588+0000 7fa759342800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:41:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.588+0000 7fa759342800 20 garbage collection: RGWGC::process iterating over entry tag='_4uROoVhZ5hI42qq7hILCP7u-4ZU2HnL', time=2024-03-09T16:37:01.909400+0000, chain.objs.size()=1 2024-03-09T14:41:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.588+0000 7fa759342800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15__shadow_.XTuuZZptYFBfxPczLpSfkx2i6od2pE7_0 2024-03-09T14:41:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.590+0000 7fa759342800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:41:51.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.593+0000 7fa60b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.595+0000 7fa759342800 20 remove_watcher() i=0 2024-03-09T14:41:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.595+0000 7fa759342800 2 removed watcher, disabling cache 2024-03-09T14:41:51.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.596+0000 7fa759342800 20 remove_watcher() i=1 2024-03-09T14:41:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.597+0000 7fa759342800 20 remove_watcher() i=2 2024-03-09T14:41:51.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.598+0000 7fa759342800 20 remove_watcher() i=3 2024-03-09T14:41:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.599+0000 7fa759342800 20 remove_watcher() i=4 2024-03-09T14:41:51.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.600+0000 7fa759342800 20 remove_watcher() i=5 2024-03-09T14:41:51.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.601+0000 7fa759342800 20 remove_watcher() i=6 2024-03-09T14:41:51.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.602+0000 7fa759342800 20 remove_watcher() i=7 2024-03-09T14:41:51.612 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:41:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:51.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.693+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.694+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.694+0000 7f0b78020800 20 realm 2024-03-09T14:41:51.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.694+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.694+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.694+0000 7f0b78020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.694+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.695+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.695+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.695+0000 7f0b78020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.695+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.696+0000 7f0b78020800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:51.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.696+0000 7f0b78020800 20 searching for the correct realm 2024-03-09T14:41:51.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.699+0000 7f0b7631d640 0 -- 172.21.15.46:0/3625882933 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x560a0bd61530 msgr2=0x560a0bd639f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:41:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.703+0000 7f0b75b1c640 0 -- 172.21.15.46:0/3625882933 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f0b6c066450 msgr2=0x7f0b6c0668d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:41:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:41:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 zone default found 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 4 Realm: () 2024-03-09T14:41:51.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 zonegroup default 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.708+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.709+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.709+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.709+0000 7f0b78020800 20 rados->read ofs=0 len=0 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.709+0000 7f0b78020800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:51.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.709+0000 7f0b78020800 20 started sync module instance, tier type = 2024-03-09T14:41:51.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.709+0000 7f0b78020800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=0 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=1 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=2 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=3 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=4 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=5 2024-03-09T14:41:51.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.717+0000 7f0b78020800 20 add_watcher() i=6 2024-03-09T14:41:51.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.718+0000 7f0b78020800 20 add_watcher() i=7 2024-03-09T14:41:51.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.718+0000 7f0b78020800 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.720+0000 7f0a2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.720+0000 7f0b78020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:51.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.720+0000 7f0b78020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:51.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.753+0000 7f0a2afe5640 20 reqs_thread_entry: start 2024-03-09T14:41:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.753+0000 7f0b78020800 20 init_complete bucket index max shards: 1 2024-03-09T14:41:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.753+0000 7f0b78020800 20 Filter name: none 2024-03-09T14:41:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.753+0000 7f0a28fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.753+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:41:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.754+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.755+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.755+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.756+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:41:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.757+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.758+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.758+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.759+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:41:51.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.760+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.761+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.761+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.762+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:41:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.763+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.764+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.764+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.765+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:41:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.766+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.767+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.767+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.768+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:41:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.770+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.770+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.771+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.772+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:41:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.773+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.774+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.774+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.775+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:41:51.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.776+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.777+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.777+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.778+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:41:51.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.780+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.780+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.780+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.781+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:41:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.783+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.783+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.783+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.785+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:41:51.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.786+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.787+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.787+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.788+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:41:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.789+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.790+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.790+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.791+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:41:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.792+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.792+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.793+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.794+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:41:51.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.795+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.796+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.796+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.797+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:41:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.798+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.799+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.799+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.800+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:41:51.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.801+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.802+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.802+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.803+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:41:51.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.804+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.805+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.805+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.806+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:41:51.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.807+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.808+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.808+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.809+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:41:51.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.810+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.811+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.811+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.812+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:41:51.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.813+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.814+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.814+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.815+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:41:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.817+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.817+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.817+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.818+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:41:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.820+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.820+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.821+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.821+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:41:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.823+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.824+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.824+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.825+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:41:51.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.826+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.827+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.827+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.828+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:41:51.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.829+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.830+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.830+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.832+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:41:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.833+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.833+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.834+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.834+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:41:51.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.836+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.836+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.836+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.837+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:41:51.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.838+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.839+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.839+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.840+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:41:51.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.841+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.842+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.842+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.843+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:41:51.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.844+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.845+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.845+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.846+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:41:51.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.847+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.848+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.848+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.849+0000 7f0b78020800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:41:51.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.850+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.851+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:41:51.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.851+0000 7f0b78020800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:41:51.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.853+0000 7f0a2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.855+0000 7f0b78020800 20 remove_watcher() i=0 2024-03-09T14:41:51.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.855+0000 7f0b78020800 2 removed watcher, disabling cache 2024-03-09T14:41:51.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.856+0000 7f0b78020800 20 remove_watcher() i=1 2024-03-09T14:41:51.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.857+0000 7f0b78020800 20 remove_watcher() i=2 2024-03-09T14:41:51.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.858+0000 7f0b78020800 20 remove_watcher() i=3 2024-03-09T14:41:51.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.859+0000 7f0b78020800 20 remove_watcher() i=4 2024-03-09T14:41:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.860+0000 7f0b78020800 20 remove_watcher() i=5 2024-03-09T14:41:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.861+0000 7f0b78020800 20 remove_watcher() i=6 2024-03-09T14:41:51.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:41:51.862+0000 7f0b78020800 20 remove_watcher() i=7 2024-03-09T14:41:51.872 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-03-09T14:41:52.378 INFO:teuthology.orchestra.run.smithi046.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-03-09T14:41:56.279 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :clean UP-TO-DATE 2024-03-09T14:42:15.377 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :compileJava 2024-03-09T14:42:15.477 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :processResources 2024-03-09T14:42:15.477 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :classes 2024-03-09T14:42:16.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:16.278 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :compileTestJava 2024-03-09T14:42:16.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:16.278 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:42:16.278 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :testClasses 2024-03-09T14:42:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:42:16.279 INFO:teuthology.orchestra.run.smithi046.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:42:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:22.378 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :test 2024-03-09T14:42:22.378 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:22.378 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-03-09T14:42:27.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:27.678 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-03-09T14:42:27.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:27.977 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-03-09T14:42:28.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:28.077 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-03-09T14:42:28.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:28.377 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-03-09T14:42:37.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:37.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-03-09T14:42:37.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:37.977 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-03-09T14:42:37.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:37.978 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-03-09T14:42:38.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:38.178 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-03-09T14:42:38.178 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:38.178 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-03-09T14:42:38.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:38.477 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-03-09T14:42:53.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:53.177 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-03-09T14:42:53.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:53.777 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-03-09T14:42:53.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:42:53.977 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-03-09T14:42:53.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:42:53,944 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:43:38.978 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:38.979 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-03-09T14:43:39.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:39.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:39.677 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-03-09T14:43:39.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:39.977 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-03-09T14:43:40.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:40.077 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-03-09T14:43:40.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:40.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-03-09T14:43:46.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:46.077 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-03-09T14:43:46.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:46.377 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-03-09T14:43:46.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:46.477 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-03-09T14:43:46.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:46.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-03-09T14:43:54.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:54.777 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-03-09T14:43:55.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:55.977 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests STANDARD_OUT 2024-03-09T14:43:55.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:43:55,958 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-09T14:43:56.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:43:56.377 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-03-09T14:44:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:44:07.078 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-03-09T14:44:07.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:44:07.477 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-03-09T14:44:10.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:44:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-03-09T14:44:10.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:44:10.377 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-03-09T14:45:21.878 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:21.878 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-03-09T14:45:22.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:22.277 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-03-09T14:45:30.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:30.977 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-03-09T14:45:31.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:31.277 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-03-09T14:45:36.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:36.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-03-09T14:45:36.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:36.877 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-03-09T14:45:38.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:38.777 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-03-09T14:45:41.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:41.877 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-03-09T14:45:42.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:42.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-03-09T14:45:43.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:43.077 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-03-09T14:45:43.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:43.077 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-03-09T14:45:43.477 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:43.477 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-03-09T14:45:43.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:43.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-03-09T14:45:43.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:43.878 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-03-09T14:45:43.977 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:43.978 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-03-09T14:45:44.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:44.278 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-03-09T14:45:44.377 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:44.377 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-03-09T14:45:44.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-03-09T14:45:44.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:44.777 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-03-09T14:45:45.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:45.177 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-03-09T14:45:45.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:45.278 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-03-09T14:45:45.577 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:45.577 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-03-09T14:45:58.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:58.878 INFO:teuthology.orchestra.run.smithi046.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-03-09T14:45:59.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:59.276 INFO:teuthology.orchestra.run.smithi046.stdout:---------------------------------------------------------------------- 2024-03-09T14:45:59.277 INFO:teuthology.orchestra.run.smithi046.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-03-09T14:45:59.277 INFO:teuthology.orchestra.run.smithi046.stdout:---------------------------------------------------------------------- 2024-03-09T14:45:59.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:59.277 INFO:teuthology.orchestra.run.smithi046.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:45:59.277 INFO:teuthology.orchestra.run.smithi046.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:45:59.277 INFO:teuthology.orchestra.run.smithi046.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:45:59.278 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:45:59.278 INFO:teuthology.orchestra.run.smithi046.stdout:BUILD SUCCESSFUL in 4m 7s 2024-03-09T14:45:59.278 INFO:teuthology.orchestra.run.smithi046.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-03-09T14:45:59.590 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:45:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:59.641 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:59.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.674+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.675+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.675+0000 7f74d432f800 20 realm 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.675+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.675+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.675+0000 7f74d432f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.675+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.676+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.676+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.677+0000 7f74d432f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:59.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.677+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.678+0000 7f74d432f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:59.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.678+0000 7f74d432f800 20 searching for the correct realm 2024-03-09T14:45:59.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.681+0000 7f74d07d4640 0 -- 172.21.15.46:0/1147698628 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x56412354aeb0 msgr2=0x56412354d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:45:59.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.685+0000 7f74cffd3640 0 -- 172.21.15.46:0/1147698628 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f74c405c930 msgr2=0x7f74c4062a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:45:59.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 zone default found 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 4 Realm: () 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:59.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 zonegroup default 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.892+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 rados->read ofs=0 len=0 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 started sync module instance, tier type = 2024-03-09T14:45:59.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.893+0000 7f74d432f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:45:59.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=0 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=1 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=2 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=3 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=4 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=5 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.903+0000 7f74d432f800 20 add_watcher() i=6 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.904+0000 7f74d432f800 20 add_watcher() i=7 2024-03-09T14:45:59.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.904+0000 7f74d432f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.905+0000 7f7385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:59.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.906+0000 7f74d432f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:59.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.906+0000 7f74d432f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:59.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.942+0000 7f7384fe1640 20 reqs_thread_entry: start 2024-03-09T14:45:59.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.942+0000 7f74d432f800 20 init_complete bucket index max shards: 1 2024-03-09T14:45:59.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.943+0000 7f74d432f800 20 Filter name: none 2024-03-09T14:45:59.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.943+0000 7f72fe7fc640 20 reqs_thread_entry: start 2024-03-09T14:45:59.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.943+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:45:59.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.944+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.944+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.945+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.946+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:45:59.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.947+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2573136028644914595', time=2024-03-09T16:45:21.772738+0000, chain.objs.size()=11 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.1 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.1_1 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.2 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.2_1 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.3 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.3_1 2024-03-09T14:45:59.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.948+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.4 2024-03-09T14:45:59.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.949+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.4_1 2024-03-09T14:45:59.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.949+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.5 2024-03-09T14:45:59.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.950+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.5_1 2024-03-09T14:45:59.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.950+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~rNF2VruMOaz4px221hDw3613L8u2de7.6 2024-03-09T14:45:59.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.950+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4', time=2024-03-09T16:45:40.282837+0000, chain.objs.size()=20 2024-03-09T14:45:59.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.950+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.1 2024-03-09T14:45:59.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.951+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.2 2024-03-09T14:45:59.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.951+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.3 2024-03-09T14:45:59.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.951+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.4 2024-03-09T14:45:59.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.951+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.5 2024-03-09T14:45:59.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.953+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.6 2024-03-09T14:45:59.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.953+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.7 2024-03-09T14:45:59.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.953+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.8 2024-03-09T14:45:59.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.955+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.9 2024-03-09T14:45:59.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.955+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.10 2024-03-09T14:45:59.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.955+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.11 2024-03-09T14:45:59.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.955+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.12 2024-03-09T14:45:59.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.956+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.13 2024-03-09T14:45:59.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.958+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.14 2024-03-09T14:45:59.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.958+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.15 2024-03-09T14:45:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.960+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.16 2024-03-09T14:45:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.960+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.17 2024-03-09T14:45:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.960+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.18 2024-03-09T14:45:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.960+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.19 2024-03-09T14:45:59.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.960+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.47__multipart_key1.2~c-S8-T0H63DlIF-0AnsWKHP1pa5K7i4.20 2024-03-09T14:45:59.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.964+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:45:59.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.967+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:45:59.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.968+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.968+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.969+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.970+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:45:59.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.971+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.972+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.972+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.973+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:45:59.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.974+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.974+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:45:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3800110788354200302', time=2024-03-09T16:43:32.258420+0000, chain.objs.size()=5 2024-03-09T14:45:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~TywefIiY8ppGfS78FWSHglsBHiCHGVi.1 2024-03-09T14:45:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~TywefIiY8ppGfS78FWSHglsBHiCHGVi.2 2024-03-09T14:45:59.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~TywefIiY8ppGfS78FWSHglsBHiCHGVi.3 2024-03-09T14:45:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~TywefIiY8ppGfS78FWSHglsBHiCHGVi.4 2024-03-09T14:45:59.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.975+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~TywefIiY8ppGfS78FWSHglsBHiCHGVi.5 2024-03-09T14:45:59.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.978+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:45:59.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.980+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:45:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.981+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.981+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:45:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15968585923418131067', time=2024-03-09T16:43:24.726140+0000, chain.objs.size()=5 2024-03-09T14:45:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~_-QrkvQKazAFlH18jzg0Tdn8kN8Xj5e.1 2024-03-09T14:45:59.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~_-QrkvQKazAFlH18jzg0Tdn8kN8Xj5e.2 2024-03-09T14:45:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~_-QrkvQKazAFlH18jzg0Tdn8kN8Xj5e.3 2024-03-09T14:45:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~_-QrkvQKazAFlH18jzg0Tdn8kN8Xj5e.4 2024-03-09T14:45:59.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.982+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~_-QrkvQKazAFlH18jzg0Tdn8kN8Xj5e.5 2024-03-09T14:45:59.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.985+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:45:59.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.987+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:45:59.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.989+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.989+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.989+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.990+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:45:59.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.991+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:45:59.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12712211091384469662', time=2024-03-09T16:43:28.802231+0000, chain.objs.size()=5 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~pSFZ2t6_G_Fk4AhMj3BH8PVm17Lv2PN.1 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~pSFZ2t6_G_Fk4AhMj3BH8PVm17Lv2PN.2 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~pSFZ2t6_G_Fk4AhMj3BH8PVm17Lv2PN.3 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~pSFZ2t6_G_Fk4AhMj3BH8PVm17Lv2PN.4 2024-03-09T14:45:59.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.992+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~pSFZ2t6_G_Fk4AhMj3BH8PVm17Lv2PN.5 2024-03-09T14:45:59.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.995+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:45:59.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.997+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:45:59.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.998+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11593296817148915848', time=2024-03-09T16:42:37.737387+0000, chain.objs.size()=5 2024-03-09T14:46:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.31__multipart_key1.2~NHolDwUez2cSgbrHZW-cYOhufKgIF7f.1 2024-03-09T14:46:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.31__multipart_key1.2~NHolDwUez2cSgbrHZW-cYOhufKgIF7f.2 2024-03-09T14:46:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.31__multipart_key1.2~NHolDwUez2cSgbrHZW-cYOhufKgIF7f.3 2024-03-09T14:46:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.31__multipart_key1.2~NHolDwUez2cSgbrHZW-cYOhufKgIF7f.4 2024-03-09T14:46:00.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:45:59.999+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.31__multipart_key1.2~NHolDwUez2cSgbrHZW-cYOhufKgIF7f.5 2024-03-09T14:46:00.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.002+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.004+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10245652211667786793', time=2024-03-09T16:43:39.128700+0000, chain.objs.size()=5 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~R-WQbq7Rp2LtJIUjXb0eJJD4kxLPENC.1 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__shadow_key1.2~R-WQbq7Rp2LtJIUjXb0eJJD4kxLPENC.1_1 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~R-WQbq7Rp2LtJIUjXb0eJJD4kxLPENC.2 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__shadow_key1.2~R-WQbq7Rp2LtJIUjXb0eJJD4kxLPENC.2_1 2024-03-09T14:46:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.006+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~R-WQbq7Rp2LtJIUjXb0eJJD4kxLPENC.3 2024-03-09T14:46:00.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.010+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.012+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:00.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.014+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.014+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.014+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.015+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:00.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.017+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.018+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.018+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.019+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:00.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.020+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.021+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.021+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.021+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='2~RcFvOMrgxPg83fJn8LkfyVMgMwYQHlk', time=2024-03-09T16:42:27.567003+0000, chain.objs.size()=5 2024-03-09T14:46:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.022+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.29__multipart_key1.2~RcFvOMrgxPg83fJn8LkfyVMgMwYQHlk.1 2024-03-09T14:46:00.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.022+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.29__multipart_key1.2~RcFvOMrgxPg83fJn8LkfyVMgMwYQHlk.2 2024-03-09T14:46:00.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.022+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.29__multipart_key1.2~RcFvOMrgxPg83fJn8LkfyVMgMwYQHlk.3 2024-03-09T14:46:00.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.022+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.29__multipart_key1.2~RcFvOMrgxPg83fJn8LkfyVMgMwYQHlk.4 2024-03-09T14:46:00.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.022+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.29__multipart_key1.2~RcFvOMrgxPg83fJn8LkfyVMgMwYQHlk.5 2024-03-09T14:46:00.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.024+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.027+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.028+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.028+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3539650188718433951', time=2024-03-09T16:43:35.525809+0000, chain.objs.size()=5 2024-03-09T14:46:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~nsAjFnHAG5n0k9ujBYo5mrGyMtOqV2-.1 2024-03-09T14:46:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__shadow_key1.2~nsAjFnHAG5n0k9ujBYo5mrGyMtOqV2-.1_1 2024-03-09T14:46:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~nsAjFnHAG5n0k9ujBYo5mrGyMtOqV2-.2 2024-03-09T14:46:00.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__shadow_key1.2~nsAjFnHAG5n0k9ujBYo5mrGyMtOqV2-.2_1 2024-03-09T14:46:00.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.029+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~nsAjFnHAG5n0k9ujBYo5mrGyMtOqV2-.3 2024-03-09T14:46:00.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.031+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.034+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:00.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.035+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:46:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1097715416787527828', time=2024-03-09T16:42:53.509225+0000, chain.objs.size()=5 2024-03-09T14:46:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.1 2024-03-09T14:46:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.2 2024-03-09T14:46:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.3 2024-03-09T14:46:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.4 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.5 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14034690526340655010', time=2024-03-09T16:44:46.880403+0000, chain.objs.size()=11 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.1 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.2 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.3 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.4 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.5 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.6 2024-03-09T14:46:00.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.036+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.7 2024-03-09T14:46:00.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.039+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.8 2024-03-09T14:46:00.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.039+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.9 2024-03-09T14:46:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.039+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.10 2024-03-09T14:46:00.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.040+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~DT3f-AOStuaFG5mlCkim_6TYeuANG-W.11 2024-03-09T14:46:00.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.050+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.054+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:00.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.055+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.055+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:46:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12392977437352347561', time=2024-03-09T16:43:39.355844+0000, chain.objs.size()=4 2024-03-09T14:46:00.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.35__shadow_.nKMHQqzK8xp5C9cH1x9tUyCJ8s_zNyj_1 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.35__shadow_.nKMHQqzK8xp5C9cH1x9tUyCJ8s_zNyj_2 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.35__shadow_.nKMHQqzK8xp5C9cH1x9tUyCJ8s_zNyj_3 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.35__shadow_.nKMHQqzK8xp5C9cH1x9tUyCJ8s_zNyj_4 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8964971673991353891', time=2024-03-09T16:45:36.654346+0000, chain.objs.size()=5 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.46__multipart_key1.2~FDmEct26ZrMK6P7nwqyT6XUdpzl2JSF.1 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.46__multipart_key1.2~FDmEct26ZrMK6P7nwqyT6XUdpzl2JSF.2 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.46__multipart_key1.2~FDmEct26ZrMK6P7nwqyT6XUdpzl2JSF.3 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.46__multipart_key1.2~FDmEct26ZrMK6P7nwqyT6XUdpzl2JSF.4 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.46__multipart_key1.2~FDmEct26ZrMK6P7nwqyT6XUdpzl2JSF.5 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10538251162762376903', time=2024-03-09T16:45:58.965190+0000, chain.objs.size()=11 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.1 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.2 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.056+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.3 2024-03-09T14:46:00.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.058+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.4 2024-03-09T14:46:00.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.060+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.5 2024-03-09T14:46:00.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.060+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.6 2024-03-09T14:46:00.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.060+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.7 2024-03-09T14:46:00.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.061+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.8 2024-03-09T14:46:00.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.061+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.9 2024-03-09T14:46:00.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.061+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.10 2024-03-09T14:46:00.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.062+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.55__multipart_key1.2~aqMLE4DBjNL7rrAyUe52kP3-X6Nue-E.11 2024-03-09T14:46:00.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.068+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.070+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:00.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.071+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9322785925289165995', time=2024-03-09T16:44:34.343821+0000, chain.objs.size()=11 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.1 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.2 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.3 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.4 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.5 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.6 2024-03-09T14:46:00.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.7 2024-03-09T14:46:00.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.8 2024-03-09T14:46:00.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.9 2024-03-09T14:46:00.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.10 2024-03-09T14:46:00.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.072+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~HyOEARM9K8RbWbdSElKI3gmdXfmS_Kq.11 2024-03-09T14:46:00.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.077+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.079+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:00.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.134+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.135+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.135+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.136+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:00.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.137+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.139+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.139+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.139+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:00.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.140+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.141+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.141+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.142+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:00.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.143+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.144+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.144+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.145+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.147+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.147+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.147+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.149+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:00.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.150+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18184002149982673758', time=2024-03-09T16:45:09.397844+0000, chain.objs.size()=11 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.1 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.1_1 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.2 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.2_1 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.3 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.3_1 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.4 2024-03-09T14:46:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.4_1 2024-03-09T14:46:00.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.5 2024-03-09T14:46:00.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.5_1 2024-03-09T14:46:00.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.151+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~GV2nnQOZz0KKVFJfSvHZiB_jeYZrUms.6 2024-03-09T14:46:00.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.157+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.159+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:00.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.160+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13983540604627815638', time=2024-03-09T16:43:55.972710+0000, chain.objs.size()=5 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.41__multipart_key1.2~hjPsYhYN1RJM9QeWzABDT-kcpxQV-Uf.1 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.41__multipart_key1.2~hjPsYhYN1RJM9QeWzABDT-kcpxQV-Uf.2 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.41__multipart_key1.2~hjPsYhYN1RJM9QeWzABDT-kcpxQV-Uf.3 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.41__multipart_key1.2~hjPsYhYN1RJM9QeWzABDT-kcpxQV-Uf.4 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.41__multipart_key1.2~hjPsYhYN1RJM9QeWzABDT-kcpxQV-Uf.5 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13314024299069572786', time=2024-03-09T16:44:07.137120+0000, chain.objs.size()=5 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file.mpg.2~WENCrzdzzG7PaQpJlZG0GuJ7SE7PoGW.1 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file.mpg.2~WENCrzdzzG7PaQpJlZG0GuJ7SE7PoGW.2 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file.mpg.2~WENCrzdzzG7PaQpJlZG0GuJ7SE7PoGW.3 2024-03-09T14:46:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file.mpg.2~WENCrzdzzG7PaQpJlZG0GuJ7SE7PoGW.4 2024-03-09T14:46:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file.mpg.2~WENCrzdzzG7PaQpJlZG0GuJ7SE7PoGW.5 2024-03-09T14:46:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8227308287726299475', time=2024-03-09T16:44:57.947498+0000, chain.objs.size()=10 2024-03-09T14:46:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.1 2024-03-09T14:46:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.161+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.2 2024-03-09T14:46:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.164+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.3 2024-03-09T14:46:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.165+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.4 2024-03-09T14:46:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.166+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.5 2024-03-09T14:46:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.166+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.6 2024-03-09T14:46:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.166+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.7 2024-03-09T14:46:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.166+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.8 2024-03-09T14:46:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.166+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.9 2024-03-09T14:46:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.166+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~oSZYfjFKq0rSNlrobhVGlroG7MA3UnF.10 2024-03-09T14:46:00.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.172+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.174+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.176+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.176+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.177+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.177+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.179+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.179+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.179+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.180+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.181+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.182+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.182+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.183+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.184+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7436057843761674676', time=2024-03-09T16:44:07.208610+0000, chain.objs.size()=5 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file2.mpg.2~odvtuwMqINnDLJBqFsLIBShEEW5mViS.1 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file2.mpg.2~odvtuwMqINnDLJBqFsLIBShEEW5mViS.2 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file2.mpg.2~odvtuwMqINnDLJBqFsLIBShEEW5mViS.3 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file2.mpg.2~odvtuwMqINnDLJBqFsLIBShEEW5mViS.4 2024-03-09T14:46:00.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.185+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.42__multipart_file2.mpg.2~odvtuwMqINnDLJBqFsLIBShEEW5mViS.5 2024-03-09T14:46:00.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.188+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.192+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:00.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.192+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.192+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4654501185936649800', time=2024-03-09T16:43:38.910578+0000, chain.objs.size()=5 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~7YfITu-1gew55V9szv-IRvTQq69Ux9v.1 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__shadow_key1.2~7YfITu-1gew55V9szv-IRvTQq69Ux9v.1_1 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~7YfITu-1gew55V9szv-IRvTQq69Ux9v.2 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__shadow_key1.2~7YfITu-1gew55V9szv-IRvTQq69Ux9v.2_1 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.36__multipart_key1.2~7YfITu-1gew55V9szv-IRvTQq69Ux9v.3 2024-03-09T14:46:00.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14960904585535683234', time=2024-03-09T16:45:21.991108+0000, chain.objs.size()=11 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.1 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.1_1 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.2 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.2_1 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.3 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.3_1 2024-03-09T14:46:00.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.193+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.4 2024-03-09T14:46:00.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.196+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.4_1 2024-03-09T14:46:00.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.196+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.5 2024-03-09T14:46:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.229+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__shadow_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.5_1 2024-03-09T14:46:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.229+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.44__multipart_key1.2~uZG2xzuoGbpXuerQTOheNI5PfQKCRmk.6 2024-03-09T14:46:00.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.232+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.235+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.236+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.2_9aaa677daa06aaedc90fd9fd59ad25fe', time=2024-03-09T16:42:53.281031+0000, chain.objs.size()=5 2024-03-09T14:46:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.1 2024-03-09T14:46:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.2 2024-03-09T14:46:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.3 2024-03-09T14:46:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.4 2024-03-09T14:46:00.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.237+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.33__multipart_key1.2~E7thS-1MI0ECVU-Aqgcd_xHTE5Qpml4.5 2024-03-09T14:46:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.239+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.241+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:00.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.242+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.242+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15140019815789729074', time=2024-03-09T16:45:31.023355+0000, chain.objs.size()=5 2024-03-09T14:46:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.45__multipart_key1.2~iabn5tPZMHQMG-RyQU5qXBAutljIXWJ.1 2024-03-09T14:46:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.45__multipart_key1.2~iabn5tPZMHQMG-RyQU5qXBAutljIXWJ.2 2024-03-09T14:46:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.45__multipart_key1.2~iabn5tPZMHQMG-RyQU5qXBAutljIXWJ.3 2024-03-09T14:46:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.45__multipart_key1.2~iabn5tPZMHQMG-RyQU5qXBAutljIXWJ.4 2024-03-09T14:46:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.243+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.45__multipart_key1.2~iabn5tPZMHQMG-RyQU5qXBAutljIXWJ.5 2024-03-09T14:46:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.246+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.248+0000 7f74d432f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.249+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:46:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9117558051605212916', time=2024-03-09T16:43:46.158044+0000, chain.objs.size()=5 2024-03-09T14:46:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.40__multipart_key1.2~kwHTbUpzhvoph3V7SAQRELj1UTuACcG.1 2024-03-09T14:46:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.40__multipart_key1.2~kwHTbUpzhvoph3V7SAQRELj1UTuACcG.2 2024-03-09T14:46:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.40__multipart_key1.2~kwHTbUpzhvoph3V7SAQRELj1UTuACcG.3 2024-03-09T14:46:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.40__multipart_key1.2~kwHTbUpzhvoph3V7SAQRELj1UTuACcG.4 2024-03-09T14:46:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.250+0000 7f74d432f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.40__multipart_key1.2~kwHTbUpzhvoph3V7SAQRELj1UTuACcG.5 2024-03-09T14:46:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.253+0000 7f74d432f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:46:00.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.256+0000 7f7385fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.259+0000 7f74d432f800 20 remove_watcher() i=0 2024-03-09T14:46:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.259+0000 7f74d432f800 2 removed watcher, disabling cache 2024-03-09T14:46:00.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.260+0000 7f74d432f800 20 remove_watcher() i=1 2024-03-09T14:46:00.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.261+0000 7f74d432f800 20 remove_watcher() i=2 2024-03-09T14:46:00.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.262+0000 7f74d432f800 20 remove_watcher() i=3 2024-03-09T14:46:00.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.263+0000 7f74d432f800 20 remove_watcher() i=4 2024-03-09T14:46:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.264+0000 7f74d432f800 20 remove_watcher() i=5 2024-03-09T14:46:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.264+0000 7f74d432f800 20 remove_watcher() i=6 2024-03-09T14:46:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.265+0000 7f74d432f800 20 remove_watcher() i=7 2024-03-09T14:46:00.277 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:00.326 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:00.327 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:00.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.358+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 realm 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.360+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.361+0000 7f98c23a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:00.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.361+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.362+0000 7f98c23a2800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:00.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.362+0000 7f98c23a2800 20 searching for the correct realm 2024-03-09T14:46:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.364+0000 7f98b769d640 0 -- 172.21.15.46:0/2640101873 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f98b007c070 msgr2=0x7f98b009a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.368+0000 7f98bfe9e640 0 -- 172.21.15.46:0/2640101873 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f98a8003c20 msgr2=0x7f98a80710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:00.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.574+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 20 zone default found 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 4 Realm: () 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 20 zonegroup default 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.575+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.576+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.576+0000 7f98c23a2800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.576+0000 7f98c23a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.576+0000 7f98c23a2800 20 started sync module instance, tier type = 2024-03-09T14:46:00.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.576+0000 7f98c23a2800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:00.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=0 2024-03-09T14:46:00.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=1 2024-03-09T14:46:00.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=2 2024-03-09T14:46:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=3 2024-03-09T14:46:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=4 2024-03-09T14:46:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=5 2024-03-09T14:46:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.585+0000 7f98c23a2800 20 add_watcher() i=6 2024-03-09T14:46:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.586+0000 7f98c23a2800 20 add_watcher() i=7 2024-03-09T14:46:00.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.586+0000 7f98c23a2800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:00.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.588+0000 7f9775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:00.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.588+0000 7f98c23a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:00.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.588+0000 7f98c23a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.622+0000 7f9774fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.623+0000 7f98c23a2800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.623+0000 7f98c23a2800 20 Filter name: none 2024-03-09T14:46:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.623+0000 7f96ee7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.623+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.624+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.625+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.625+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.626+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:00.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.627+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.628+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.628+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.629+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:00.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.630+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.631+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.631+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.632+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:00.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.633+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.634+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.634+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.635+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:00.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.636+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.637+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.637+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.638+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:00.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.639+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.639+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.640+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.641+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:00.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.642+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.642+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.642+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.643+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:00.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.645+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.645+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.645+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.646+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:00.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.648+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.648+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.649+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.650+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:00.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.651+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.652+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.652+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.653+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:00.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.654+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.655+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.655+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.656+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.657+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.657+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.658+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.659+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:00.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.660+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.660+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.661+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.661+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:00.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.663+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.663+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.664+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.666+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:00.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.666+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.666+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.666+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.667+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:00.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.669+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.669+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.670+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.671+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:00.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.673+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.673+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.673+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.674+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:00.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.676+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.676+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.677+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.678+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:00.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.679+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.680+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.680+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.681+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:00.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.682+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.683+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.683+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.684+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:00.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.685+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.686+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.686+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.687+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:00.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.689+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.689+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.689+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.690+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.692+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.692+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.692+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.693+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:00.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.695+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.695+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.695+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.696+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:00.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.698+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.698+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.698+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.699+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:00.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.701+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.701+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.701+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.702+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.704+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.704+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.705+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.706+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:00.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.707+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.708+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.708+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.709+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:00.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.710+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.711+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.711+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.712+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.714+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.714+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.714+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.715+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:00.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.717+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.717+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.717+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.718+0000 7f98c23a2800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:00.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.720+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.720+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.721+0000 7f98c23a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.722+0000 7f9775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:00.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.725+0000 7f98c23a2800 20 remove_watcher() i=0 2024-03-09T14:46:00.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.725+0000 7f98c23a2800 2 removed watcher, disabling cache 2024-03-09T14:46:00.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.726+0000 7f98c23a2800 20 remove_watcher() i=1 2024-03-09T14:46:00.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.727+0000 7f98c23a2800 20 remove_watcher() i=2 2024-03-09T14:46:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.728+0000 7f98c23a2800 20 remove_watcher() i=3 2024-03-09T14:46:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.729+0000 7f98c23a2800 20 remove_watcher() i=4 2024-03-09T14:46:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.729+0000 7f98c23a2800 20 remove_watcher() i=5 2024-03-09T14:46:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.730+0000 7f98c23a2800 20 remove_watcher() i=6 2024-03-09T14:46:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.731+0000 7f98c23a2800 20 remove_watcher() i=7 2024-03-09T14:46:00.743 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:00.791 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:00.791 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:00.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.824+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 realm 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.825+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.826+0000 7f9bb1f31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.826+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.827+0000 7f9bb1f31800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:00.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.827+0000 7f9bb1f31800 20 searching for the correct realm 2024-03-09T14:46:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.830+0000 7f9bad437640 0 -- 172.21.15.46:0/145330691 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x559f4c5a5c70 msgr2=0x559f4c5a8060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.834+0000 7f9bae439640 0 -- 172.21.15.46:0/145330691 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f9ba40b0070 msgr2=0x7f9ba40cf290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:00.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.838+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 zone default found 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 4 Realm: () 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 zonegroup default 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.839+0000 7f9bb1f31800 20 rados->read ofs=0 len=0 2024-03-09T14:46:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.840+0000 7f9bb1f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.840+0000 7f9bb1f31800 20 started sync module instance, tier type = 2024-03-09T14:46:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.840+0000 7f9bb1f31800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=0 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=1 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=2 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=3 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=4 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=5 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.848+0000 7f9bb1f31800 20 add_watcher() i=6 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.849+0000 7f9bb1f31800 20 add_watcher() i=7 2024-03-09T14:46:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.849+0000 7f9bb1f31800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.850+0000 7f9a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.851+0000 7f9bb1f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.851+0000 7f9bb1f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:00.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.884+0000 7f9a5e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:00.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.884+0000 7f9bb1f31800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:00.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.884+0000 7f9bb1f31800 20 Filter name: none 2024-03-09T14:46:00.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.884+0000 7f99cffff640 20 reqs_thread_entry: start 2024-03-09T14:46:00.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.884+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:00.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.885+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.886+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.886+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.887+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:00.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.888+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.889+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.889+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.890+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:00.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.891+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.892+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.892+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.893+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:00.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.894+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.894+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.895+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.895+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:00.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.897+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.897+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.897+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.898+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:00.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.899+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.900+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.900+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.901+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:00.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.902+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.903+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.903+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.904+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:00.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.905+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.906+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.906+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.907+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:00.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.908+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.909+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.909+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.910+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.912+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.912+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.912+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.913+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:00.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.915+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.915+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.915+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.916+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.917+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.918+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.918+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.919+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.920+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.921+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.921+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.922+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:00.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.923+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.924+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.924+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.925+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:00.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.926+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.927+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.927+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.928+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:00.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.929+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.930+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.930+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.931+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:00.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.933+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.933+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.934+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.934+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.936+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.936+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.937+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.938+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:00.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.939+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.940+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.940+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.941+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:00.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.943+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.943+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.943+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.944+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.946+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.946+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.946+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.947+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:00.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.948+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.949+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.949+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.950+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:00.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.952+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.952+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.952+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.953+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:00.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.954+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.955+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.955+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.957+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.958+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.958+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.958+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.959+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:00.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.961+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.961+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.962+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.964+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:00.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.964+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.964+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.965+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.966+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:00.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.967+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.967+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.967+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.968+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:00.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.970+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.970+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.971+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.971+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:00.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.973+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.973+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.974+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.976+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:00.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.976+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.976+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.977+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.978+0000 7f9bb1f31800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.979+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.979+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:00.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.980+0000 7f9bb1f31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:00.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.981+0000 7f9a5f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:00.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.984+0000 7f9bb1f31800 20 remove_watcher() i=0 2024-03-09T14:46:00.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.984+0000 7f9bb1f31800 2 removed watcher, disabling cache 2024-03-09T14:46:00.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.985+0000 7f9bb1f31800 20 remove_watcher() i=1 2024-03-09T14:46:00.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.986+0000 7f9bb1f31800 20 remove_watcher() i=2 2024-03-09T14:46:00.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.987+0000 7f9bb1f31800 20 remove_watcher() i=3 2024-03-09T14:46:00.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.988+0000 7f9bb1f31800 20 remove_watcher() i=4 2024-03-09T14:46:00.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.989+0000 7f9bb1f31800 20 remove_watcher() i=5 2024-03-09T14:46:00.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.990+0000 7f9bb1f31800 20 remove_watcher() i=6 2024-03-09T14:46:00.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:00.991+0000 7f9bb1f31800 20 remove_watcher() i=7 2024-03-09T14:46:01.002 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:01.052 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:01.052 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:01.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.084+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 realm 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.086+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.087+0000 7fad95733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.087+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.088+0000 7fad95733800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.088+0000 7fad95733800 20 searching for the correct realm 2024-03-09T14:46:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.089+0000 7fad9146b640 0 -- 172.21.15.46:0/1812487029 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fad8c011b70 msgr2=0x7fad8c018940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:01.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.093+0000 7fad9146b640 0 -- 172.21.15.46:0/1812487029 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7fac5c082690 msgr2=0x7fac5c084aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:01.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:01.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.098+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 zone default found 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 4 Realm: () 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 zonegroup default 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.099+0000 7fad95733800 20 rados->read ofs=0 len=0 2024-03-09T14:46:01.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.100+0000 7fad95733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:01.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.100+0000 7fad95733800 20 started sync module instance, tier type = 2024-03-09T14:46:01.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.100+0000 7fad95733800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=0 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=1 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=2 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=3 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=4 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=5 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.108+0000 7fad95733800 20 add_watcher() i=6 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.109+0000 7fad95733800 20 add_watcher() i=7 2024-03-09T14:46:01.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.109+0000 7fad95733800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:01.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.111+0000 7fac47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:01.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.111+0000 7fad95733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:01.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.111+0000 7fad95733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.144+0000 7fac46fe5640 20 reqs_thread_entry: start 2024-03-09T14:46:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.144+0000 7fad95733800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.144+0000 7fad95733800 20 Filter name: none 2024-03-09T14:46:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.145+0000 7fac44fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:01.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.145+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:01.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.146+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.146+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.146+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.147+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:01.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.149+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.149+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.149+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.150+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:01.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.151+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.152+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.152+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.153+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:01.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.154+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.155+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.155+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.156+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:01.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.157+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.158+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.158+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.159+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.160+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.161+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.161+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.162+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:01.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.163+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.164+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.164+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.165+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.166+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.167+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.167+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.168+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.169+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.170+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.170+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.171+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:01.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.172+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.173+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.173+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.174+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:01.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.175+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.176+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.176+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.177+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:01.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.178+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.178+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.178+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.179+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:01.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.181+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.181+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.181+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.183+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.184+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.184+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.184+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.186+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:01.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.187+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.188+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.188+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.189+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.190+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.191+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.191+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.192+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:01.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.194+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.194+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.194+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.195+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:01.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.196+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.197+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.197+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.198+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:01.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.200+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.200+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.201+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.202+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:01.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.204+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.204+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.204+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.205+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:01.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.207+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.207+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.207+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.208+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:01.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.209+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.210+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.210+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.211+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:01.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.212+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.213+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.213+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.214+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:01.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.216+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.216+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.216+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.217+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:01.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.219+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.219+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.219+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.220+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.222+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.222+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.222+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.223+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.224+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.225+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.225+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.226+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:01.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.227+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.228+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.228+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.229+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:01.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.230+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.231+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.231+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.232+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.233+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.234+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.234+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.235+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.236+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.237+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.237+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.238+0000 7fad95733800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:01.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.239+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.240+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:01.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.240+0000 7fad95733800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:01.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.242+0000 7fac47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:01.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.244+0000 7fad95733800 20 remove_watcher() i=0 2024-03-09T14:46:01.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.244+0000 7fad95733800 2 removed watcher, disabling cache 2024-03-09T14:46:01.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.245+0000 7fad95733800 20 remove_watcher() i=1 2024-03-09T14:46:01.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.246+0000 7fad95733800 20 remove_watcher() i=2 2024-03-09T14:46:01.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.248+0000 7fad95733800 20 remove_watcher() i=3 2024-03-09T14:46:01.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.249+0000 7fad95733800 20 remove_watcher() i=4 2024-03-09T14:46:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.251+0000 7fad95733800 20 remove_watcher() i=5 2024-03-09T14:46:01.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.252+0000 7fad95733800 20 remove_watcher() i=6 2024-03-09T14:46:01.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:01.253+0000 7fad95733800 20 remove_watcher() i=7 2024-03-09T14:46:01.264 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-03-09T14:46:01.786 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :clean 2024-03-09T14:46:02.782 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :compileJava 2024-03-09T14:46:02.782 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :processResources 2024-03-09T14:46:02.783 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :classes 2024-03-09T14:46:03.182 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:03.182 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :compileTestJava 2024-03-09T14:46:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:46:03.183 INFO:teuthology.orchestra.run.smithi046.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:46:03.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:03.184 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:46:03.184 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :testClasses 2024-03-09T14:46:05.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.183 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :test 2024-03-09T14:46:05.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.183 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests STANDARD_OUT 2024-03-09T14:46:05.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:46:04,373 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.184 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-03-09T14:46:05.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.382 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-03-09T14:46:05.482 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.482 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-03-09T14:46:05.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.682 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-03-09T14:46:05.881 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.881 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-03-09T14:46:05.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:05.981 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-03-09T14:46:06.081 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:06.082 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-03-09T14:46:06.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:06.381 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-03-09T14:46:06.481 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:06.482 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-03-09T14:46:06.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:06.581 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-03-09T14:46:06.681 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:06.681 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-03-09T14:46:07.181 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.182 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-03-09T14:46:07.281 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.282 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-03-09T14:46:07.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.582 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-03-09T14:46:07.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.582 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------- 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------- 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:46:07.683 INFO:teuthology.orchestra.run.smithi046.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:46:07.684 INFO:teuthology.orchestra.run.smithi046.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:46:07.684 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:07.684 INFO:teuthology.orchestra.run.smithi046.stdout:BUILD SUCCESSFUL in 6s 2024-03-09T14:46:07.684 INFO:teuthology.orchestra.run.smithi046.stdout:5 actionable tasks: 5 executed 2024-03-09T14:46:07.704 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:07.755 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:07.755 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:07.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.790+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 realm 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.792+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.793+0000 7f5fc928c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:07.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.793+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.794+0000 7f5fc928c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:07.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.794+0000 7f5fc928c800 20 searching for the correct realm 2024-03-09T14:46:07.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:07.798+0000 7f5fc7589640 0 -- 172.21.15.46:0/3374494640 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f5fbc0c00b0 msgr2=0x7f5fbc0a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.004+0000 7f5fc6d88640 0 -- 172.21.15.46:0/3374494640 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55de25dfbbc0 msgr2=0x55de25dfdff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.007+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 zone default found 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 4 Realm: () 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 zonegroup default 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.008+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 started sync module instance, tier type = 2024-03-09T14:46:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.009+0000 7f5fc928c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=0 2024-03-09T14:46:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=1 2024-03-09T14:46:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=2 2024-03-09T14:46:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=3 2024-03-09T14:46:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=4 2024-03-09T14:46:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=5 2024-03-09T14:46:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.019+0000 7f5fc928c800 20 add_watcher() i=6 2024-03-09T14:46:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.020+0000 7f5fc928c800 20 add_watcher() i=7 2024-03-09T14:46:08.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.020+0000 7f5fc928c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.022+0000 7f5e7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.022+0000 7f5fc928c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:08.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.022+0000 7f5fc928c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.061+0000 7f5df7fff640 20 reqs_thread_entry: start 2024-03-09T14:46:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.061+0000 7f5fc928c800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.061+0000 7f5fc928c800 20 Filter name: none 2024-03-09T14:46:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.061+0000 7f5df5ffb640 20 reqs_thread_entry: start 2024-03-09T14:46:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.061+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.062+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.063+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.063+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.064+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.065+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.066+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.066+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.067+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.069+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.070+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.070+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.071+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.073+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.073+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.073+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.075+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:08.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.077+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.077+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.078+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.079+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:08.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.080+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.080+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.081+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.082+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:08.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.083+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.083+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.084+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.085+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:08.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.086+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.087+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.087+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.088+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:08.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.090+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.090+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.090+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.091+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:08.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.093+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.093+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.094+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.095+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:08.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.096+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.097+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.098+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.099+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:08.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.100+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.100+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.101+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.102+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:08.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.103+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.104+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.104+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.105+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:08.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.106+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.107+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.107+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.108+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:08.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.110+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.111+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.111+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.112+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:08.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.114+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.114+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.114+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.115+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:08.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.117+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.117+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.117+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.118+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:08.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.120+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.120+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.121+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.122+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:08.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.123+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.124+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.124+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.125+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:08.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.127+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.127+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.128+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.129+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.130+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.131+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.131+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.132+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.133+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.134+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.134+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.135+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.137+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.137+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.137+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.138+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.140+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.140+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.140+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.141+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:08.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.143+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.143+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.143+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.144+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:08.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.146+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.147+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.147+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.148+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:08.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.149+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.150+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.150+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.151+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.152+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.153+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.153+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.154+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.155+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.156+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.156+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.157+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.158+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.159+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.159+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.160+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:08.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.161+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.162+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.162+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.163+0000 7f5fc928c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.165+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.165+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.165+0000 7f5fc928c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.167+0000 7f5e7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.169+0000 7f5fc928c800 20 remove_watcher() i=0 2024-03-09T14:46:08.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.169+0000 7f5fc928c800 2 removed watcher, disabling cache 2024-03-09T14:46:08.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.170+0000 7f5fc928c800 20 remove_watcher() i=1 2024-03-09T14:46:08.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.171+0000 7f5fc928c800 20 remove_watcher() i=2 2024-03-09T14:46:08.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.173+0000 7f5fc928c800 20 remove_watcher() i=3 2024-03-09T14:46:08.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.174+0000 7f5fc928c800 20 remove_watcher() i=4 2024-03-09T14:46:08.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.175+0000 7f5fc928c800 20 remove_watcher() i=5 2024-03-09T14:46:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.176+0000 7f5fc928c800 20 remove_watcher() i=6 2024-03-09T14:46:08.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.177+0000 7f5fc928c800 20 remove_watcher() i=7 2024-03-09T14:46:08.188 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:08.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.269+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 realm 2024-03-09T14:46:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.271+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.272+0000 7fd6a7c44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.272+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.273+0000 7fd6a7c44800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:08.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.273+0000 7fd6a7c44800 20 searching for the correct realm 2024-03-09T14:46:08.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.276+0000 7fd6a5f41640 0 -- 172.21.15.46:0/1946172358 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x5653c1593850 msgr2=0x5653c1595cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.280+0000 7fd6a4f3f640 0 -- 172.21.15.46:0/1946172358 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5653c159b3e0 msgr2=0x5653c159d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.283+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:08.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 zone default found 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 4 Realm: () 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 zonegroup default 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.284+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 started sync module instance, tier type = 2024-03-09T14:46:08.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.285+0000 7fd6a7c44800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=0 2024-03-09T14:46:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=1 2024-03-09T14:46:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=2 2024-03-09T14:46:08.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=3 2024-03-09T14:46:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=4 2024-03-09T14:46:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=5 2024-03-09T14:46:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.295+0000 7fd6a7c44800 20 add_watcher() i=6 2024-03-09T14:46:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.296+0000 7fd6a7c44800 20 add_watcher() i=7 2024-03-09T14:46:08.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.296+0000 7fd6a7c44800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:08.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.298+0000 7fd55b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.298+0000 7fd6a7c44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:08.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.298+0000 7fd6a7c44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.333+0000 7fd55a7e4640 20 reqs_thread_entry: start 2024-03-09T14:46:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.333+0000 7fd6a7c44800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:08.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.333+0000 7fd6a7c44800 20 Filter name: none 2024-03-09T14:46:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.334+0000 7fd4cbfff640 20 reqs_thread_entry: start 2024-03-09T14:46:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.334+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:08.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.335+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.336+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.336+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.337+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:08.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.339+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.339+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.340+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.341+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.342+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.342+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.343+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.344+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.345+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.345+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.346+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.346+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.348+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.348+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.348+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.349+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.351+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.351+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.351+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.352+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.353+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.354+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.354+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.355+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:08.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.357+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.357+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.357+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.358+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:08.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.360+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.360+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.361+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.361+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:08.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.363+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.363+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.364+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.365+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:08.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.366+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.366+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.366+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.367+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.369+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.369+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.369+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.370+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:08.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.372+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.372+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.373+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.374+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:08.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.375+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.376+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.376+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.377+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.378+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.379+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.379+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.380+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.381+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.382+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.382+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.383+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:08.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.384+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.384+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.385+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.386+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:08.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.387+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.387+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.388+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.389+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:08.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.390+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.390+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.391+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.391+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:08.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.393+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.393+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.394+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.394+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:08.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.396+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.396+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.396+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.397+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:08.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.398+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.399+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.399+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.400+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:08.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.401+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.402+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.402+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.403+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:08.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.404+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.405+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.405+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.406+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.407+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.408+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.408+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.409+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.410+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.411+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.411+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.412+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.414+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.414+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.414+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.415+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:08.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.416+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.417+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.417+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.418+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:08.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.420+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.421+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.421+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.422+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:08.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.423+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.424+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.424+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.425+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:08.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.426+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.427+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.427+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.428+0000 7fd6a7c44800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:08.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.429+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.430+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.430+0000 7fd6a7c44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.432+0000 7fd55b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.434+0000 7fd6a7c44800 20 remove_watcher() i=0 2024-03-09T14:46:08.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.434+0000 7fd6a7c44800 2 removed watcher, disabling cache 2024-03-09T14:46:08.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.435+0000 7fd6a7c44800 20 remove_watcher() i=1 2024-03-09T14:46:08.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.436+0000 7fd6a7c44800 20 remove_watcher() i=2 2024-03-09T14:46:08.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.437+0000 7fd6a7c44800 20 remove_watcher() i=3 2024-03-09T14:46:08.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.438+0000 7fd6a7c44800 20 remove_watcher() i=4 2024-03-09T14:46:08.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.439+0000 7fd6a7c44800 20 remove_watcher() i=5 2024-03-09T14:46:08.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.440+0000 7fd6a7c44800 20 remove_watcher() i=6 2024-03-09T14:46:08.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.441+0000 7fd6a7c44800 20 remove_watcher() i=7 2024-03-09T14:46:08.452 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:08.501 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:08.501 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:08.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.534+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 realm 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.536+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.537+0000 7f9e73d30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.537+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.538+0000 7f9e73d30800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:08.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.538+0000 7f9e73d30800 20 searching for the correct realm 2024-03-09T14:46:08.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.539+0000 7f9e6faef640 0 -- 172.21.15.46:0/1442435467 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f9e68026040 msgr2=0x7f9e68026930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:08.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.744+0000 7f9e6f2ee640 0 -- 172.21.15.46:0/1442435467 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f9e6009ec20 msgr2=0x7f9e60098a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:08.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.751+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 zone default found 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 4 Realm: () 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:08.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 zonegroup default 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.752+0000 7f9e73d30800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.753+0000 7f9e73d30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.753+0000 7f9e73d30800 20 started sync module instance, tier type = 2024-03-09T14:46:08.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.753+0000 7f9e73d30800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:08.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=0 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=1 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=2 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=3 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=4 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=5 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.761+0000 7f9e73d30800 20 add_watcher() i=6 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.762+0000 7f9e73d30800 20 add_watcher() i=7 2024-03-09T14:46:08.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.762+0000 7f9e73d30800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:08.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.764+0000 7f9d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.764+0000 7f9e73d30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:08.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.764+0000 7f9e73d30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:08.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.797+0000 7f9d24fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.797+0000 7f9e73d30800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.797+0000 7f9e73d30800 20 Filter name: none 2024-03-09T14:46:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.797+0000 7f9c9e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.797+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:08.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.798+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.799+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.799+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.800+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:08.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.802+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.803+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.803+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.804+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.805+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.806+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.806+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.807+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.808+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.808+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.809+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.809+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.811+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.811+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.811+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.813+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.814+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.814+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.815+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.815+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.817+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.817+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.817+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.818+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:08.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.820+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.820+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.821+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.822+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.823+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.823+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.824+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.825+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:08.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.826+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.826+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.827+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.828+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:08.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.829+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.830+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.830+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.831+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:08.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.832+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.833+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.833+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.834+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.835+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.836+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.836+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.837+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:08.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.838+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.839+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.839+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.840+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.841+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.841+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.842+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.843+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:08.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.844+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.844+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.844+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.845+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.846+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.847+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.847+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.848+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:08.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.849+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.850+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.850+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.851+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:08.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.852+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.853+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.853+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.854+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:08.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.855+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.856+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.856+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.857+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:08.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.859+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.859+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.860+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.861+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:08.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.862+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.862+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.863+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.864+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:08.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.865+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.866+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.866+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.867+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:08.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.868+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.868+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.869+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.870+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.871+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.871+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.872+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.872+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:08.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.874+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.874+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.874+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.875+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:08.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.877+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.877+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.877+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.879+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:08.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.880+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.881+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.881+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.882+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:08.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.884+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.884+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.884+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.885+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.887+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.887+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.887+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.888+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.889+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.890+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.890+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.891+0000 7f9e73d30800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:08.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.892+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.893+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:08.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.893+0000 7f9e73d30800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:08.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.895+0000 7f9d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.897+0000 7f9e73d30800 20 remove_watcher() i=0 2024-03-09T14:46:08.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.897+0000 7f9e73d30800 2 removed watcher, disabling cache 2024-03-09T14:46:08.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.898+0000 7f9e73d30800 20 remove_watcher() i=1 2024-03-09T14:46:08.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.899+0000 7f9e73d30800 20 remove_watcher() i=2 2024-03-09T14:46:08.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.900+0000 7f9e73d30800 20 remove_watcher() i=3 2024-03-09T14:46:08.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.901+0000 7f9e73d30800 20 remove_watcher() i=4 2024-03-09T14:46:08.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.902+0000 7f9e73d30800 20 remove_watcher() i=5 2024-03-09T14:46:08.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.903+0000 7f9e73d30800 20 remove_watcher() i=6 2024-03-09T14:46:08.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.904+0000 7f9e73d30800 20 remove_watcher() i=7 2024-03-09T14:46:08.915 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:46:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:08.964 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:08.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.998+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 realm 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:08.999+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.000+0000 7f379753c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:09.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.000+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.001+0000 7f379753c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:09.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.001+0000 7f379753c800 20 searching for the correct realm 2024-03-09T14:46:09.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.005+0000 7f3793afb640 0 -- 172.21.15.46:0/2551010256 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f3788031040 msgr2=0x7f378803c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:09.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.211+0000 7f37932fa640 0 -- 172.21.15.46:0/2551010256 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55ac5434eb10 msgr2=0x55ac54350f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.213+0000 7f379753c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.213+0000 7f379753c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.213+0000 7f379753c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.213+0000 7f379753c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.213+0000 7f379753c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.213+0000 7f379753c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 zone default found 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 4 Realm: () 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 zonegroup default 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.214+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 started sync module instance, tier type = 2024-03-09T14:46:09.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.215+0000 7f379753c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=0 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=1 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=2 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=3 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=4 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=5 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.224+0000 7f379753c800 20 add_watcher() i=6 2024-03-09T14:46:09.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.225+0000 7f379753c800 20 add_watcher() i=7 2024-03-09T14:46:09.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.225+0000 7f379753c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:09.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.227+0000 7f3649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:09.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.227+0000 7f379753c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:09.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.227+0000 7f379753c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:09.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.262+0000 7f3648fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.262+0000 7f379753c800 20 init_complete bucket index max shards: 1 2024-03-09T14:46:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.262+0000 7f379753c800 20 Filter name: none 2024-03-09T14:46:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.262+0000 7f35c27fc640 20 reqs_thread_entry: start 2024-03-09T14:46:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.262+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:46:09.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.263+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.264+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.264+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.265+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:46:09.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.266+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.267+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.267+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.268+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:46:09.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.269+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.270+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.270+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.271+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:46:09.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.272+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.273+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.273+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.274+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:46:09.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.275+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.276+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.276+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.277+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:46:09.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.278+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.279+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.279+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.280+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:46:09.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.281+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.282+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.282+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.284+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:46:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.285+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.285+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.286+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.287+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:46:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.288+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.288+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.289+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.289+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:46:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.291+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.291+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.291+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.292+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:46:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.294+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.294+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.295+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.295+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:46:09.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.297+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.297+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.298+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.299+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:46:09.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.300+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.301+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.301+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.302+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:46:09.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.304+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.304+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.305+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.305+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:46:09.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.307+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.307+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.307+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.308+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:46:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.310+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.310+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.310+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.311+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:46:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.313+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.313+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.313+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.314+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:46:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.316+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.316+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.317+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.317+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:46:09.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.319+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.319+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.320+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.321+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:46:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.322+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.323+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.323+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.324+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:46:09.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.325+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.326+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.326+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.327+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:46:09.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.328+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.328+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.328+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.329+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:46:09.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.330+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.331+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.331+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.332+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:46:09.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.334+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.334+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.335+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.336+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:46:09.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.337+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.337+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.337+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.338+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:46:09.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.340+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.340+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.340+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.341+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:46:09.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.342+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.343+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.343+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.344+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:46:09.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.345+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.346+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.346+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.347+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:46:09.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.349+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.349+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.350+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.351+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:46:09.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.352+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.352+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.353+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.353+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:46:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.355+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.355+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.355+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.356+0000 7f379753c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:46:09.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.358+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.358+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:46:09.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.358+0000 7f379753c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:46:09.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.360+0000 7f3649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.363+0000 7f379753c800 20 remove_watcher() i=0 2024-03-09T14:46:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.363+0000 7f379753c800 2 removed watcher, disabling cache 2024-03-09T14:46:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.364+0000 7f379753c800 20 remove_watcher() i=1 2024-03-09T14:46:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.365+0000 7f379753c800 20 remove_watcher() i=2 2024-03-09T14:46:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.366+0000 7f379753c800 20 remove_watcher() i=3 2024-03-09T14:46:09.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.368+0000 7f379753c800 20 remove_watcher() i=4 2024-03-09T14:46:09.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.369+0000 7f379753c800 20 remove_watcher() i=5 2024-03-09T14:46:09.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.370+0000 7f379753c800 20 remove_watcher() i=6 2024-03-09T14:46:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:46:09.371+0000 7f379753c800 20 remove_watcher() i=7 2024-03-09T14:46:09.382 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-03-09T14:46:09.912 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :clean 2024-03-09T14:46:10.808 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :compileJava 2024-03-09T14:46:10.808 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :processResources 2024-03-09T14:46:10.809 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :classes 2024-03-09T14:46:11.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:11.208 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :compileTestJava 2024-03-09T14:46:11.209 INFO:teuthology.orchestra.run.smithi046.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:46:11.209 INFO:teuthology.orchestra.run.smithi046.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:46:11.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:11.210 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:46:11.210 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :testClasses 2024-03-09T14:46:13.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.209 INFO:teuthology.orchestra.run.smithi046.stdout:> Task :test 2024-03-09T14:46:13.209 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.209 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests STANDARD_OUT 2024-03-09T14:46:13.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:46:12,492 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:46:13.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.210 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-03-09T14:46:13.210 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.210 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-03-09T14:46:13.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-03-09T14:46:13.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-03-09T14:46:13.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-03-09T14:46:13.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:13.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-03-09T14:46:14.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:14.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-03-09T14:46:19.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:19.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-03-09T14:46:20.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-03-09T14:46:20.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:20.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-03-09T14:46:20.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:20.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-03-09T14:46:20.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:20.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-03-09T14:46:20.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:20.909 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-03-09T14:46:20.909 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:20.909 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-03-09T14:46:21.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:21.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-03-09T14:46:21.009 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:21.009 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-03-09T14:46:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:21.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-03-09T14:46:26.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:26.809 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-03-09T14:46:27.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:27.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-03-09T14:46:27.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:27.310 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-03-09T14:46:27.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:27.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-03-09T14:46:27.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:27.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-03-09T14:46:28.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:28.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-03-09T14:46:28.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:28.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-03-09T14:46:28.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:28.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-03-09T14:46:28.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:28.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-03-09T14:46:28.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:28.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-03-09T14:46:28.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:28.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-03-09T14:46:29.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:29.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-03-09T14:46:29.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:29.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-03-09T14:46:29.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:29.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-03-09T14:46:29.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:29.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-03-09T14:46:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:29.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-03-09T14:46:35.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:35.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-03-09T14:46:36.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:46:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-03-09T14:47:30.109 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:30.110 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-03-09T14:47:30.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:30.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-03-09T14:47:30.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:30.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-03-09T14:47:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:30.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-03-09T14:47:31.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:31.009 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-03-09T14:47:31.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:31.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-03-09T14:47:45.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:45.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-03-09T14:47:46.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:46.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-03-09T14:47:46.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:46.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-03-09T14:47:46.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:46.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-03-09T14:47:53.410 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:53.410 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-03-09T14:47:55.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:55.509 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests STANDARD_OUT 2024-03-09T14:47:55.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:47:55,484 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-09T14:47:55.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:47:55,486 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-09T14:47:55.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09 14:47:55,490 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-03-09T14:47:55.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:47:55.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-03-09T14:48:15.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:48:15.309 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-03-09T14:48:15.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:48:15.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-03-09T14:48:21.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:48:21.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-03-09T14:48:21.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:48:21.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-03-09T14:49:00.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:00.509 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-03-09T14:49:00.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:00.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-03-09T14:49:09.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:09.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-03-09T14:49:09.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:09.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-03-09T14:49:14.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:14.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-03-09T14:49:15.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:15.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-03-09T14:49:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:17.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-03-09T14:49:19.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:19.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-03-09T14:49:19.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:19.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-03-09T14:49:19.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:19.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-03-09T14:49:19.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:19.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-03-09T14:49:20.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:20.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-03-09T14:49:21.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:21.709 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-03-09T14:49:22.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:22.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-03-09T14:49:22.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:22.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-03-09T14:49:22.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:22.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-03-09T14:49:22.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:22.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-03-09T14:49:22.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:22.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-03-09T14:49:22.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:22.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-03-09T14:49:23.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:23.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-03-09T14:49:23.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:23.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-03-09T14:49:23.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:23.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-03-09T14:49:23.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:23.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-03-09T14:49:24.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:24.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-03-09T14:49:24.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:24.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-03-09T14:49:24.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:24.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-03-09T14:49:24.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:24.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-03-09T14:49:25.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:25.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-03-09T14:49:25.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:25.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-03-09T14:49:25.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:25.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-03-09T14:49:26.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:26.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-03-09T14:49:26.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:26.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-03-09T14:49:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:26.509 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-03-09T14:49:26.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:26.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-03-09T14:49:27.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:27.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-03-09T14:49:27.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:27.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-03-09T14:49:27.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:27.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-03-09T14:49:28.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:28.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-03-09T14:49:28.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:28.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-03-09T14:49:28.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:28.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-03-09T14:49:28.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:28.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-03-09T14:49:29.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:29.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-03-09T14:49:29.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:29.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-03-09T14:49:29.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:29.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-03-09T14:49:29.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:29.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-03-09T14:49:30.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:30.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-03-09T14:49:30.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:30.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-03-09T14:49:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:30.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-03-09T14:49:31.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:31.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-03-09T14:49:31.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:31.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-03-09T14:49:31.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:31.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-03-09T14:49:31.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:31.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-03-09T14:49:32.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:32.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-03-09T14:49:32.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:32.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-03-09T14:49:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:32.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-03-09T14:49:33.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:33.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-03-09T14:49:33.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:33.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-03-09T14:49:33.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:33.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-03-09T14:49:33.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-03-09T14:49:34.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:34.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-03-09T14:49:34.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:34.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-03-09T14:49:34.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:34.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-03-09T14:49:34.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:34.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-03-09T14:49:35.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:35.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-03-09T14:49:35.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:35.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-03-09T14:49:35.708 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:35.708 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-03-09T14:49:35.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:35.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-03-09T14:49:36.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:36.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-03-09T14:49:36.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:36.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-03-09T14:49:36.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:36.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-03-09T14:49:36.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:36.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-03-09T14:49:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:36.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-03-09T14:49:36.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:36.908 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-03-09T14:49:37.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:37.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-03-09T14:49:37.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:37.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-03-09T14:49:37.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:37.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-03-09T14:49:37.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:37.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-03-09T14:49:38.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:38.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-03-09T14:49:38.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:38.108 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-03-09T14:49:38.408 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:38.408 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-03-09T14:49:38.508 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:38.508 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-03-09T14:49:38.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:38.808 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-03-09T14:49:39.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-03-09T14:49:39.208 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:39.208 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-03-09T14:49:39.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:39.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-03-09T14:49:39.608 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:39.608 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-03-09T14:49:54.008 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:54.009 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-03-09T14:49:54.308 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:54.308 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-03-09T14:49:59.709 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:49:59.709 INFO:teuthology.orchestra.run.smithi046.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout:---------------------------------------------------------------------- 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout:---------------------------------------------------------------------- 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:50:00.059 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:00.060 INFO:teuthology.orchestra.run.smithi046.stdout:BUILD SUCCESSFUL in 3m 50s 2024-03-09T14:50:00.060 INFO:teuthology.orchestra.run.smithi046.stdout:5 actionable tasks: 5 executed 2024-03-09T14:50:00.064 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:50:00.112 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:00.113 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:00.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.146+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.147+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.147+0000 7f0513c83800 20 realm 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.147+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.148+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.148+0000 7f0513c83800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.148+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.148+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.148+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.149+0000 7f0513c83800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:00.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.149+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.150+0000 7f0513c83800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:00.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.150+0000 7f0513c83800 20 searching for the correct realm 2024-03-09T14:50:00.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.155+0000 7f0511f80640 0 -- 172.21.15.46:0/36951519 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x5616b6280e30 msgr2=0x5616b62832f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:00.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.159+0000 7f051177f640 0 -- 172.21.15.46:0/36951519 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f0508053030 msgr2=0x7f05080a7960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:00.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:00.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.164+0000 7f0513c83800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 zone default found 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 4 Realm: () 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 zonegroup default 2024-03-09T14:50:00.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 started sync module instance, tier type = 2024-03-09T14:50:00.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.165+0000 7f0513c83800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=0 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=1 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=2 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=3 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=4 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=5 2024-03-09T14:50:00.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.174+0000 7f0513c83800 20 add_watcher() i=6 2024-03-09T14:50:00.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.175+0000 7f0513c83800 20 add_watcher() i=7 2024-03-09T14:50:00.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.175+0000 7f0513c83800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.177+0000 7f03c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.178+0000 7f0513c83800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:00.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.178+0000 7f0513c83800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.214+0000 7f03c6fe5640 20 reqs_thread_entry: start 2024-03-09T14:50:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.214+0000 7f0513c83800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.214+0000 7f0513c83800 20 Filter name: none 2024-03-09T14:50:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.214+0000 7f03c4fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:00.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.214+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:50:00.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.215+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.216+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.216+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.217+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:50:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.219+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.219+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9468360522796002747', time=2024-03-09T16:46:26.914598+0000, chain.objs.size()=2 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.72__shadow_.MCJ9vocDaAPok6S-_sHSJQFI6AVI5f3_1 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.72__shadow_.MCJ9vocDaAPok6S-_sHSJQFI6AVI5f3_2 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.211839325346495291', time=2024-03-09T16:47:30.340525+0000, chain.objs.size()=5 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~_81KwtqzZ0c-yO9b20jbyue_hWcsoS2.1 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__shadow_key1.2~_81KwtqzZ0c-yO9b20jbyue_hWcsoS2.1_1 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~_81KwtqzZ0c-yO9b20jbyue_hWcsoS2.2 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__shadow_key1.2~_81KwtqzZ0c-yO9b20jbyue_hWcsoS2.2_1 2024-03-09T14:50:00.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.220+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~_81KwtqzZ0c-yO9b20jbyue_hWcsoS2.3 2024-03-09T14:50:00.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.224+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.227+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:50:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.229+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.229+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='2~G1CqD7W-laoETRnla6MYA5typkpZuPB', time=2024-03-09T16:46:19.677402+0000, chain.objs.size()=5 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.68__multipart_key1.2~G1CqD7W-laoETRnla6MYA5typkpZuPB.1 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.68__multipart_key1.2~G1CqD7W-laoETRnla6MYA5typkpZuPB.2 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.68__multipart_key1.2~G1CqD7W-laoETRnla6MYA5typkpZuPB.3 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.68__multipart_key1.2~G1CqD7W-laoETRnla6MYA5typkpZuPB.4 2024-03-09T14:50:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.68__multipart_key1.2~G1CqD7W-laoETRnla6MYA5typkpZuPB.5 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10928875228780686793', time=2024-03-09T16:48:45.715794+0000, chain.objs.size()=5 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~uwAIerABZnDPZ3Ktm833QvpkVpjRdWq.1 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~uwAIerABZnDPZ3Ktm833QvpkVpjRdWq.2 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~uwAIerABZnDPZ3Ktm833QvpkVpjRdWq.3 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~uwAIerABZnDPZ3Ktm833QvpkVpjRdWq.4 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~uwAIerABZnDPZ3Ktm833QvpkVpjRdWq.5 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14068077597772971427', time=2024-03-09T16:49:09.695157+0000, chain.objs.size()=5 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.92__multipart_key1.2~h_nX6qEMpDdeLkRdZQ_pJ4yD9v6y937.1 2024-03-09T14:50:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.230+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.92__multipart_key1.2~h_nX6qEMpDdeLkRdZQ_pJ4yD9v6y937.2 2024-03-09T14:50:00.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.234+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.92__multipart_key1.2~h_nX6qEMpDdeLkRdZQ_pJ4yD9v6y937.3 2024-03-09T14:50:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.236+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.92__multipart_key1.2~h_nX6qEMpDdeLkRdZQ_pJ4yD9v6y937.4 2024-03-09T14:50:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.236+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.92__multipart_key1.2~h_nX6qEMpDdeLkRdZQ_pJ4yD9v6y937.5 2024-03-09T14:50:00.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.239+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.241+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:50:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.242+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.243+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.244+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.245+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:50:00.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.246+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.247+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.247+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.248+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:50:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.250+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.251+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.252+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.253+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:50:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.254+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16760937045117520063', time=2024-03-09T16:48:50.632042+0000, chain.objs.size()=5 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~tugYuo3cYp2eQ7dgPf52fEGio2cO00L.1 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~tugYuo3cYp2eQ7dgPf52fEGio2cO00L.2 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~tugYuo3cYp2eQ7dgPf52fEGio2cO00L.3 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~tugYuo3cYp2eQ7dgPf52fEGio2cO00L.4 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~tugYuo3cYp2eQ7dgPf52fEGio2cO00L.5 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7047849198205531867', time=2024-03-09T16:49:00.540334+0000, chain.objs.size()=5 2024-03-09T14:50:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~S0QCenF06YW0thOTgydbGokqXUGu1fw.1 2024-03-09T14:50:00.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__shadow_key1.2~S0QCenF06YW0thOTgydbGokqXUGu1fw.1_1 2024-03-09T14:50:00.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~S0QCenF06YW0thOTgydbGokqXUGu1fw.2 2024-03-09T14:50:00.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__shadow_key1.2~S0QCenF06YW0thOTgydbGokqXUGu1fw.2_1 2024-03-09T14:50:00.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.255+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~S0QCenF06YW0thOTgydbGokqXUGu1fw.3 2024-03-09T14:50:00.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.260+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.263+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:50:00.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.264+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.266+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.266+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.267+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:50:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.269+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.269+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.269+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.270+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.271+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.272+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.272+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.273+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:50:00.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.274+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.275+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.275+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.276+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:50:00.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.278+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.278+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.279+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.280+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:50:00.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.281+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.281+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10344070317026921926', time=2024-03-09T16:47:10.923729+0000, chain.objs.size()=5 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~frE4OtMCGvBMi0L1ilxV5pEPh7GSsyp.1 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~frE4OtMCGvBMi0L1ilxV5pEPh7GSsyp.2 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~frE4OtMCGvBMi0L1ilxV5pEPh7GSsyp.3 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~frE4OtMCGvBMi0L1ilxV5pEPh7GSsyp.4 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~frE4OtMCGvBMi0L1ilxV5pEPh7GSsyp.5 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4714341893805786707', time=2024-03-09T16:47:29.956800+0000, chain.objs.size()=5 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q86pVLKpxJrC2ibs5NbndrrN6cTgLHX.1 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__shadow_key1.2~Q86pVLKpxJrC2ibs5NbndrrN6cTgLHX.1_1 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q86pVLKpxJrC2ibs5NbndrrN6cTgLHX.2 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__shadow_key1.2~Q86pVLKpxJrC2ibs5NbndrrN6cTgLHX.2_1 2024-03-09T14:50:00.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q86pVLKpxJrC2ibs5NbndrrN6cTgLHX.3 2024-03-09T14:50:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3063522037085899746', time=2024-03-09T16:49:00.349910+0000, chain.objs.size()=5 2024-03-09T14:50:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~6qMvF2ga_o88AN83dj_LSsePvvouyq4.1 2024-03-09T14:50:00.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.282+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__shadow_key1.2~6qMvF2ga_o88AN83dj_LSsePvvouyq4.1_1 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.284+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~6qMvF2ga_o88AN83dj_LSsePvvouyq4.2 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.285+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__shadow_key1.2~6qMvF2ga_o88AN83dj_LSsePvvouyq4.2_1 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.285+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~6qMvF2ga_o88AN83dj_LSsePvvouyq4.3 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.285+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11297916064834839621', time=2024-03-09T16:49:54.096524+0000, chain.objs.size()=5 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.285+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.132__multipart_key1.2~xM1Wxmfwk1QT4zguxRhmU3tR4vfcYxw.1 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.286+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.132__multipart_key1.2~xM1Wxmfwk1QT4zguxRhmU3tR4vfcYxw.2 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.287+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.132__multipart_key1.2~xM1Wxmfwk1QT4zguxRhmU3tR4vfcYxw.3 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.287+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.132__multipart_key1.2~xM1Wxmfwk1QT4zguxRhmU3tR4vfcYxw.4 2024-03-09T14:50:00.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.287+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.132__multipart_key1.2~xM1Wxmfwk1QT4zguxRhmU3tR4vfcYxw.5 2024-03-09T14:50:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.291+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.294+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:50:00.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.295+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2182336114552010800', time=2024-03-09T16:48:31.703158+0000, chain.objs.size()=5 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~e_G3LLiUHx0vul9oTl84UEVHUm0tC8-.1 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~e_G3LLiUHx0vul9oTl84UEVHUm0tC8-.2 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~e_G3LLiUHx0vul9oTl84UEVHUm0tC8-.3 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~e_G3LLiUHx0vul9oTl84UEVHUm0tC8-.4 2024-03-09T14:50:00.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.296+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~e_G3LLiUHx0vul9oTl84UEVHUm0tC8-.5 2024-03-09T14:50:00.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.299+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.301+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:50:00.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.302+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.303+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.303+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.304+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:50:00.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.306+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.306+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.306+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.307+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.309+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.309+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:00.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2927273097736815890', time=2024-03-09T16:48:55.496746+0000, chain.objs.size()=5 2024-03-09T14:50:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~ont5nNq8-Tysyd4DyfndCiWdvXmws7l.1 2024-03-09T14:50:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__shadow_key1.2~ont5nNq8-Tysyd4DyfndCiWdvXmws7l.1_1 2024-03-09T14:50:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~ont5nNq8-Tysyd4DyfndCiWdvXmws7l.2 2024-03-09T14:50:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__shadow_key1.2~ont5nNq8-Tysyd4DyfndCiWdvXmws7l.2_1 2024-03-09T14:50:00.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.310+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.91__multipart_key1.2~ont5nNq8-Tysyd4DyfndCiWdvXmws7l.3 2024-03-09T14:50:00.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.312+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.315+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:50:00.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.316+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.316+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.316+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.316+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16802876049621827135', time=2024-03-09T16:47:45.928617+0000, chain.objs.size()=5 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.316+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.87__multipart_key1.2~zoPR0GCipZN12kVD9gpCLzOA74Z--GJ.1 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.87__multipart_key1.2~zoPR0GCipZN12kVD9gpCLzOA74Z--GJ.2 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.87__multipart_key1.2~zoPR0GCipZN12kVD9gpCLzOA74Z--GJ.3 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.87__multipart_key1.2~zoPR0GCipZN12kVD9gpCLzOA74Z--GJ.4 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.87__multipart_key1.2~zoPR0GCipZN12kVD9gpCLzOA74Z--GJ.5 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17337868874462526623', time=2024-03-09T16:48:15.418863+0000, chain.objs.size()=5 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file2.mpg.2~ijM94piy6txd5CTB2Iro_CWFfC8HnPq.1 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file2.mpg.2~ijM94piy6txd5CTB2Iro_CWFfC8HnPq.2 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file2.mpg.2~ijM94piy6txd5CTB2Iro_CWFfC8HnPq.3 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file2.mpg.2~ijM94piy6txd5CTB2Iro_CWFfC8HnPq.4 2024-03-09T14:50:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.317+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file2.mpg.2~ijM94piy6txd5CTB2Iro_CWFfC8HnPq.5 2024-03-09T14:50:00.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.321+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.323+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:50:00.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.325+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.326+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.326+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.327+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:50:00.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.328+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.328+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10590780486293792148', time=2024-03-09T16:47:26.784853+0000, chain.objs.size()=5 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~bYtw0DYSXWjiqS4pf_XaXk3Nz9vAZnD.1 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__shadow_key1.2~bYtw0DYSXWjiqS4pf_XaXk3Nz9vAZnD.1_1 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~bYtw0DYSXWjiqS4pf_XaXk3Nz9vAZnD.2 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__shadow_key1.2~bYtw0DYSXWjiqS4pf_XaXk3Nz9vAZnD.2_1 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~bYtw0DYSXWjiqS4pf_XaXk3Nz9vAZnD.3 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16304700595324726215', time=2024-03-09T16:48:15.365353+0000, chain.objs.size()=5 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file.mpg.2~wK4fYcnCOwufa8aIBqBRUW-qrR_6sfP.1 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file.mpg.2~wK4fYcnCOwufa8aIBqBRUW-qrR_6sfP.2 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file.mpg.2~wK4fYcnCOwufa8aIBqBRUW-qrR_6sfP.3 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file.mpg.2~wK4fYcnCOwufa8aIBqBRUW-qrR_6sfP.4 2024-03-09T14:50:00.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.329+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.89__multipart_file.mpg.2~wK4fYcnCOwufa8aIBqBRUW-qrR_6sfP.5 2024-03-09T14:50:00.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.333+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.336+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:50:00.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.337+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.337+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.338+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.339+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:50:00.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.340+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.340+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.340+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:00.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.340+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.2_071d439e16d20f4e47a9ed1d9bef60fb', time=2024-03-09T16:46:35.882754+0000, chain.objs.size()=5 2024-03-09T14:50:00.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.340+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.1 2024-03-09T14:50:00.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.340+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.2 2024-03-09T14:50:00.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.341+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.3 2024-03-09T14:50:00.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.341+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.4 2024-03-09T14:50:00.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.341+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.5 2024-03-09T14:50:00.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.342+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.345+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:50:00.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.347+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3636961906139100360', time=2024-03-09T16:47:06.927697+0000, chain.objs.size()=5 2024-03-09T14:50:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~sg6F8BBK0w9XOSTUDS8NKSgMhg3Thz3.1 2024-03-09T14:50:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~sg6F8BBK0w9XOSTUDS8NKSgMhg3Thz3.2 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~sg6F8BBK0w9XOSTUDS8NKSgMhg3Thz3.3 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~sg6F8BBK0w9XOSTUDS8NKSgMhg3Thz3.4 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~sg6F8BBK0w9XOSTUDS8NKSgMhg3Thz3.5 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n', time=2024-03-09T16:49:18.085562+0000, chain.objs.size()=20 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.1 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.2 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.3 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.4 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.349+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.5 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.350+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.6 2024-03-09T14:50:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.350+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.7 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.8 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.9 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.10 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.11 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.12 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.13 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.14 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.15 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.16 2024-03-09T14:50:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.17 2024-03-09T14:50:00.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.354+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.18 2024-03-09T14:50:00.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.358+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.19 2024-03-09T14:50:00.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.358+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.94__multipart_key1.2~8Ywenzp-wn7Taf9EhDewA5kqS7C2K2n.20 2024-03-09T14:50:00.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.360+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.363+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:50:00.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.364+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.364+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.365+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.366+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:50:00.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.367+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.367+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4730007179461225629', time=2024-03-09T16:47:30.149056+0000, chain.objs.size()=4 2024-03-09T14:50:00.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.82__shadow_.FY-1wKgNc2jmiW9LH-1CdUaXOB_dPAh_1 2024-03-09T14:50:00.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.82__shadow_.FY-1wKgNc2jmiW9LH-1CdUaXOB_dPAh_2 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.82__shadow_.FY-1wKgNc2jmiW9LH-1CdUaXOB_dPAh_3 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.82__shadow_.FY-1wKgNc2jmiW9LH-1CdUaXOB_dPAh_4 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10389500659047903574', time=2024-03-09T16:49:15.028434+0000, chain.objs.size()=5 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.93__multipart_key1.2~HI-HXHLFkb6ojoP_XvvNDcYJFC6isa-.1 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.93__multipart_key1.2~HI-HXHLFkb6ojoP_XvvNDcYJFC6isa-.2 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.93__multipart_key1.2~HI-HXHLFkb6ojoP_XvvNDcYJFC6isa-.3 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.93__multipart_key1.2~HI-HXHLFkb6ojoP_XvvNDcYJFC6isa-.4 2024-03-09T14:50:00.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.368+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.93__multipart_key1.2~HI-HXHLFkb6ojoP_XvvNDcYJFC6isa-.5 2024-03-09T14:50:00.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.372+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.374+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:50:00.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.376+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.376+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1478506894281117842', time=2024-03-09T16:47:55.449818+0000, chain.objs.size()=5 2024-03-09T14:50:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.88__multipart_key1.2~u_WbPkThHBaw8g4YHyGKXJCiqG9-i5d.1 2024-03-09T14:50:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.88__multipart_key1.2~u_WbPkThHBaw8g4YHyGKXJCiqG9-i5d.2 2024-03-09T14:50:00.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.88__multipart_key1.2~u_WbPkThHBaw8g4YHyGKXJCiqG9-i5d.3 2024-03-09T14:50:00.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.88__multipart_key1.2~u_WbPkThHBaw8g4YHyGKXJCiqG9-i5d.4 2024-03-09T14:50:00.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.377+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.88__multipart_key1.2~u_WbPkThHBaw8g4YHyGKXJCiqG9-i5d.5 2024-03-09T14:50:00.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.380+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.382+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:50:00.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.383+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:50:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.688134990604348502', time=2024-03-09T16:47:23.349485+0000, chain.objs.size()=5 2024-03-09T14:50:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q2GsmF7YV5Y_yqu-a7dJKnr8QYFBeHX.1 2024-03-09T14:50:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q2GsmF7YV5Y_yqu-a7dJKnr8QYFBeHX.2 2024-03-09T14:50:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q2GsmF7YV5Y_yqu-a7dJKnr8QYFBeHX.3 2024-03-09T14:50:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q2GsmF7YV5Y_yqu-a7dJKnr8QYFBeHX.4 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.83__multipart_key1.2~Q2GsmF7YV5Y_yqu-a7dJKnr8QYFBeHX.5 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12025638186167232837', time=2024-03-09T16:49:59.813697+0000, chain.objs.size()=5 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.133__multipart_key1/data/file.mpg.2~DFU4ulqfuleRfkqJVI-2p6nfGO6zCjK.1 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.133__multipart_key1/data/file.mpg.2~DFU4ulqfuleRfkqJVI-2p6nfGO6zCjK.2 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.133__multipart_key1/data/file.mpg.2~DFU4ulqfuleRfkqJVI-2p6nfGO6zCjK.3 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.133__multipart_key1/data/file.mpg.2~DFU4ulqfuleRfkqJVI-2p6nfGO6zCjK.4 2024-03-09T14:50:00.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.384+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.133__multipart_key1/data/file.mpg.2~DFU4ulqfuleRfkqJVI-2p6nfGO6zCjK.5 2024-03-09T14:50:00.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.390+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.392+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:50:00.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.393+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.394+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.394+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.395+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:50:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.396+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.397+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.397+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.398+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:50:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.399+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.400+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.400+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.401+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:50:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.402+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.402+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:50:00.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6336626672897119850', time=2024-03-09T16:46:35.689955+0000, chain.objs.size()=5 2024-03-09T14:50:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.1 2024-03-09T14:50:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.2 2024-03-09T14:50:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.3 2024-03-09T14:50:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.4 2024-03-09T14:50:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.403+0000 7f0513c83800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.80__multipart_key1.2~zRc8lK8rS2hfo1K2r9hLEwdbpGry1FR.5 2024-03-09T14:50:00.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.404+0000 7f0513c83800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:50:00.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.407+0000 7f0513c83800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:50:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.409+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.409+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.409+0000 7f0513c83800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.411+0000 7f03c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.413+0000 7f0513c83800 20 remove_watcher() i=0 2024-03-09T14:50:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.413+0000 7f0513c83800 2 removed watcher, disabling cache 2024-03-09T14:50:00.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.414+0000 7f0513c83800 20 remove_watcher() i=1 2024-03-09T14:50:00.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.415+0000 7f0513c83800 20 remove_watcher() i=2 2024-03-09T14:50:00.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.416+0000 7f0513c83800 20 remove_watcher() i=3 2024-03-09T14:50:00.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.417+0000 7f0513c83800 20 remove_watcher() i=4 2024-03-09T14:50:00.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.418+0000 7f0513c83800 20 remove_watcher() i=5 2024-03-09T14:50:00.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.419+0000 7f0513c83800 20 remove_watcher() i=6 2024-03-09T14:50:00.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.420+0000 7f0513c83800 20 remove_watcher() i=7 2024-03-09T14:50:00.431 DEBUG:teuthology.orchestra.run.smithi046:> radosgw-admin gc process --include-all 2024-03-09T14:50:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:00.480 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:00.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.513+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 realm 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.515+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.516+0000 7f3d20ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.516+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.516+0000 7f3d20ac0800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:00.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.516+0000 7f3d20ac0800 20 searching for the correct realm 2024-03-09T14:50:00.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.520+0000 7f3d1edc4640 0 -- 172.21.15.46:0/2238394957 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7f3d0805b050 msgr2=0x7f3d080c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:00.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.726+0000 7f3d1e5c3640 0 -- 172.21.15.46:0/2238394957 >> [v2:172.21.15.159:6808/2219836914,v1:172.21.15.159:6809/2219836914] conn(0x55ccd7572b00 msgr2=0x55ccd7574f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:00.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.729+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 zone default found 2024-03-09T14:50:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 4 Realm: () 2024-03-09T14:50:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:00.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 zonegroup default 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados->read ofs=0 len=0 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 started sync module instance, tier type = 2024-03-09T14:50:00.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.730+0000 7f3d20ac0800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=0 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=1 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=2 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=3 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=4 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=5 2024-03-09T14:50:00.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.739+0000 7f3d20ac0800 20 add_watcher() i=6 2024-03-09T14:50:00.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.740+0000 7f3d20ac0800 20 add_watcher() i=7 2024-03-09T14:50:00.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.740+0000 7f3d20ac0800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.742+0000 7f3bd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.742+0000 7f3d20ac0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.742+0000 7f3d20ac0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.776+0000 7f3b4f7fe640 20 reqs_thread_entry: start 2024-03-09T14:50:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.776+0000 7f3d20ac0800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.776+0000 7f3d20ac0800 20 Filter name: none 2024-03-09T14:50:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.776+0000 7f3b4d7fa640 20 reqs_thread_entry: start 2024-03-09T14:50:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.776+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:50:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.777+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.778+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.778+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.779+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:50:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.780+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.781+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.781+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.782+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:50:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.783+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.784+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.784+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.785+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:50:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.786+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.787+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.787+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.788+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:50:00.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.789+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.790+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.790+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.791+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:50:00.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.792+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.793+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.793+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.794+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:50:00.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.795+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.796+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.796+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.797+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:50:00.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.798+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.798+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.799+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.800+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:50:00.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.801+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.802+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.802+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.803+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:50:00.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.804+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.805+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.805+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.806+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:50:00.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.807+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.808+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.808+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.809+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:50:00.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.810+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.811+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.811+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.812+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:50:00.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.813+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.814+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.814+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.815+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:50:00.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.817+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.818+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.818+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.819+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:50:00.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.821+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.821+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.821+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.822+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:50:00.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.823+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.824+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.824+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.825+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:50:00.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.826+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.827+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.827+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.828+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:50:00.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.829+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.829+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.830+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.830+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:50:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.832+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.832+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.832+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.833+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:50:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.835+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.835+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.835+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.836+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:50:00.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.837+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.838+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.838+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.839+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:50:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.840+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.841+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.841+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.842+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:50:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.843+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.844+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.844+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.845+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:50:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.847+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.847+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.848+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.849+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:50:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.850+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.850+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.851+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.852+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:50:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.853+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.853+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.854+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.854+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:50:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.855+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.856+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.856+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.857+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:50:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.858+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.859+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.859+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.860+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:50:00.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.861+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.862+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.862+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.863+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:50:00.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.864+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.865+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.865+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.866+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:50:00.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.867+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.868+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.868+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.869+0000 7f3d20ac0800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:50:00.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.870+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.871+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:50:00.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.871+0000 7f3d20ac0800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:50:00.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.873+0000 7f3bd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:00.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.875+0000 7f3d20ac0800 20 remove_watcher() i=0 2024-03-09T14:50:00.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.875+0000 7f3d20ac0800 2 removed watcher, disabling cache 2024-03-09T14:50:00.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.876+0000 7f3d20ac0800 20 remove_watcher() i=1 2024-03-09T14:50:00.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.877+0000 7f3d20ac0800 20 remove_watcher() i=2 2024-03-09T14:50:00.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.878+0000 7f3d20ac0800 20 remove_watcher() i=3 2024-03-09T14:50:00.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.879+0000 7f3d20ac0800 20 remove_watcher() i=4 2024-03-09T14:50:00.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.880+0000 7f3d20ac0800 20 remove_watcher() i=5 2024-03-09T14:50:00.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.881+0000 7f3d20ac0800 20 remove_watcher() i=6 2024-03-09T14:50:00.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:00.882+0000 7f3d20ac0800 20 remove_watcher() i=7 2024-03-09T14:50:00.893 INFO:teuthology.run_tasks:Running task s3tests... 2024-03-09T14:50:00.911 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'wip-iam-user-apis', 'git_remote': 'https://github.com/cbodley/', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-03-09T14:50:00.911 INFO:tasks.s3tests:Downloading s3-tests... 2024-03-09T14:50:00.911 INFO:tasks.s3tests:Using branch 'wip-iam-user-apis' for s3tests 2024-03-09T14:50:00.912 DEBUG:teuthology.orchestra.run.smithi046:> git clone -b wip-iam-user-apis https://github.com/cbodley/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T14:50:00.938 INFO:teuthology.orchestra.run.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-03-09T14:50:01.599 INFO:tasks.s3tests:Creating rgw users... 2024-03-09T14:50:01.600 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-03-09T14:50:01.600 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key BCRVVFMVDOVEJXMYNKDV --secret 17ZbNhQcS5rm8PKNhtrYMU5qGfkStzdq9jSowXcVT8Vs0fYaJXkjFg== --cluster ceph 2024-03-09T14:50:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:01.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.729+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 realm 2024-03-09T14:50:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.731+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.732+0000 7f68b0933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:01.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.732+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.733+0000 7f68b0933800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:01.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.733+0000 7f68b0933800 20 searching for the correct realm 2024-03-09T14:50:01.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.736+0000 7f68acdd4640 0 -- 172.21.15.46:0/4288636630 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x555c78d53170 msgr2=0x555c78d55630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:01.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.739+0000 7f68ac5d3640 0 -- 172.21.15.46:0/4288636630 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f68a00ba430 msgr2=0x7f68a00ac990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:01.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:01.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 zone default found 2024-03-09T14:50:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 4 Realm: () 2024-03-09T14:50:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 zonegroup default 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.744+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 started sync module instance, tier type = 2024-03-09T14:50:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.745+0000 7f68b0933800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=0 2024-03-09T14:50:01.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=1 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=2 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=3 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=4 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=5 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.754+0000 7f68b0933800 20 add_watcher() i=6 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.755+0000 7f68b0933800 20 add_watcher() i=7 2024-03-09T14:50:01.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.755+0000 7f68b0933800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.756+0000 7f6762fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.756+0000 7f68b0933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.756+0000 7f68b0933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.756+0000 7f68b0933800 5 note: GC not initialized 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f6761fdb640 20 reqs_thread_entry: start 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 20 Filter name: none 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f66d37fe640 20 reqs_thread_entry: start 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.757+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 cache get: name=default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV : miss 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 cache put: name=default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV info.flags=0x0 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 adding default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV to cache LRU end 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 cache get: name=default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV : hit (negative entry) 2024-03-09T14:50:01.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.758+0000 7f68b0933800 10 cache get: name=default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV : hit (negative entry) 2024-03-09T14:50:01.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.759+0000 7f68b0933800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:01.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.759+0000 7f68b0933800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:01.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.759+0000 7f68b0933800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-09T14:50:01.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.760+0000 7f67837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595236 cookie 93855652595664 notifier 7551 bl.length()=645 2024-03-09T14:50:01.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.760+0000 7f67837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:01.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.760+0000 7f67837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:01.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.762+0000 7f68b0933800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-03-09T14:50:01.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.762+0000 7f68b0933800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:50:01.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.762+0000 7f68b0933800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-03-09T14:50:01.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.763+0000 7f67837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595237 cookie 93855652610752 notifier 7551 bl.length()=185 2024-03-09T14:50:01.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.763+0000 7f67837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-03-09T14:50:01.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.763+0000 7f67837fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:50:01.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.765+0000 7f68b0933800 10 cache put: name=default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV info.flags=0x7 2024-03-09T14:50:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.765+0000 7f68b0933800 10 moving default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV to cache LRU end 2024-03-09T14:50:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.765+0000 7f68b0933800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:BCRVVFMVDOVEJXMYNKDV, ofs0, ns] 2024-03-09T14:50:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.765+0000 7f67837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595139 cookie 93855652620128 notifier 7551 bl.length()=186 2024-03-09T14:50:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.765+0000 7f67837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV info.flags=0x7 2024-03-09T14:50:01.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.765+0000 7f67837fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BCRVVFMVDOVEJXMYNKDV to cache LRU end 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "foo.client.0", 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.foo.client.0", 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "foo+test@test.test", 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "foo.client.0", 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "BCRVVFMVDOVEJXMYNKDV", 2024-03-09T14:50:01.767 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "17ZbNhQcS5rm8PKNhtrYMU5qGfkStzdq9jSowXcVT8Vs0fYaJXkjFg==", 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:01.759134Z" 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:01.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:50:01.769 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:01.759120Z", 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.767+0000 7f6762fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:01.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.770+0000 7f68b0933800 20 remove_watcher() i=0 2024-03-09T14:50:01.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.770+0000 7f68b0933800 2 removed watcher, disabling cache 2024-03-09T14:50:01.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.771+0000 7f68b0933800 20 remove_watcher() i=1 2024-03-09T14:50:01.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.772+0000 7f68b0933800 20 remove_watcher() i=2 2024-03-09T14:50:01.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.773+0000 7f68b0933800 20 remove_watcher() i=3 2024-03-09T14:50:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.775+0000 7f68b0933800 20 remove_watcher() i=4 2024-03-09T14:50:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.776+0000 7f68b0933800 20 remove_watcher() i=5 2024-03-09T14:50:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.777+0000 7f68b0933800 20 remove_watcher() i=6 2024-03-09T14:50:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.778+0000 7f68b0933800 20 remove_watcher() i=7 2024-03-09T14:50:01.789 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3156481959 --totp-seed 5O4SQ56UILOCK5CUIIQDY5GGD4HK2WOZS2G7R2IVM5SIWZXRSG55NLN4XE6IUD6E --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:01.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.882+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.883+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.883+0000 7fba06c1b800 20 realm 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.883+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.883+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.883+0000 7fba06c1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.883+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.884+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.884+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.884+0000 7fba06c1b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:01.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.884+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.885+0000 7fba06c1b800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:01.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.885+0000 7fba06c1b800 20 searching for the correct realm 2024-03-09T14:50:01.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.888+0000 7fba04f18640 0 -- 172.21.15.46:0/260421040 >> [v2:172.21.15.46:6810/222930770,v1:172.21.15.46:6813/222930770] conn(0x5591d77e7b60 msgr2=0x5591d77e9ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:01.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.892+0000 7fba03f16640 0 -- 172.21.15.46:0/260421040 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5591d77ef750 msgr2=0x5591d77f1b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:01.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:01.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.897+0000 7fba06c1b800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 zone default found 2024-03-09T14:50:01.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 4 Realm: () 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 zonegroup default 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 started sync module instance, tier type = 2024-03-09T14:50:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.898+0000 7fba06c1b800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=0 2024-03-09T14:50:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=1 2024-03-09T14:50:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=2 2024-03-09T14:50:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=3 2024-03-09T14:50:01.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=4 2024-03-09T14:50:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=5 2024-03-09T14:50:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.907+0000 7fba06c1b800 20 add_watcher() i=6 2024-03-09T14:50:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.908+0000 7fba06c1b800 20 add_watcher() i=7 2024-03-09T14:50:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.908+0000 7fba06c1b800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.909+0000 7fb8ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.909+0000 7fba06c1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.909+0000 7fba06c1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.909+0000 7fba06c1b800 5 note: GC not initialized 2024-03-09T14:50:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fb8b97e2640 20 reqs_thread_entry: start 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 20 Filter name: none 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fb82affd640 20 reqs_thread_entry: start 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 20 rados->read ofs=0 len=0 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 20 rados_obj.operate() r=0 bl.length=460 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-03-09T14:50:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:01.910+0000 7fba06c1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.665+0000 7fba06c1b800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.665+0000 7fba06c1b800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.665+0000 7fba06c1b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-09T14:50:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.666+0000 7fb8daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529830 cookie 94084874046800 notifier 7572 bl.length()=659 2024-03-09T14:50:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.666+0000 7fb8daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:50:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.666+0000 7fb8daffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:50:03.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.668+0000 7fb8ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:03.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.671+0000 7fba06c1b800 20 remove_watcher() i=0 2024-03-09T14:50:03.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.671+0000 7fba06c1b800 2 removed watcher, disabling cache 2024-03-09T14:50:03.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.672+0000 7fba06c1b800 20 remove_watcher() i=1 2024-03-09T14:50:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.673+0000 7fba06c1b800 20 remove_watcher() i=2 2024-03-09T14:50:03.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.675+0000 7fba06c1b800 20 remove_watcher() i=3 2024-03-09T14:50:03.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.676+0000 7fba06c1b800 20 remove_watcher() i=4 2024-03-09T14:50:03.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.677+0000 7fba06c1b800 20 remove_watcher() i=5 2024-03-09T14:50:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.678+0000 7fba06c1b800 20 remove_watcher() i=6 2024-03-09T14:50:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.679+0000 7fba06c1b800 20 remove_watcher() i=7 2024-03-09T14:50:03.692 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-03-09T14:50:03.693 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key PXTUGICGYYDHZEFFXUBN --secret ++0HgC9Zjmd4TfVbkecBPmr7Pc8gAFfcrHUW3onSyLel8p0+RKRoVQ== --cluster ceph 2024-03-09T14:50:03.757 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:03.757 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:03.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.992+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.994+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.994+0000 7f9e7dc44800 20 realm 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.994+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.994+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.994+0000 7f9e7dc44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.994+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.995+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:03.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.995+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:03.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.996+0000 7f9e7dc44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:03.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.996+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:03.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.997+0000 7f9e7dc44800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:03.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.997+0000 7f9e7dc44800 20 searching for the correct realm 2024-03-09T14:50:03.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:03.999+0000 7f9e7af3f640 0 -- 172.21.15.46:0/3747268487 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f9e6c03d040 msgr2=0x7f9e6c03c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:04.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.206+0000 7f9e7b740640 0 -- 172.21.15.46:0/3747268487 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9e70016bb0 msgr2=0x7f9e7000e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:04.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.414+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 zone default found 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 4 Realm: () 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 zonegroup default 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.415+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.416+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.416+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.416+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.416+0000 7f9e7dc44800 20 started sync module instance, tier type = 2024-03-09T14:50:04.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.416+0000 7f9e7dc44800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=0 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=1 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=2 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=3 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=4 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=5 2024-03-09T14:50:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.428+0000 7f9e7dc44800 20 add_watcher() i=6 2024-03-09T14:50:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.429+0000 7f9e7dc44800 20 add_watcher() i=7 2024-03-09T14:50:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.429+0000 7f9e7dc44800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.431+0000 7f9d31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.431+0000 7f9e7dc44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.431+0000 7f9e7dc44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.431+0000 7f9e7dc44800 5 note: GC not initialized 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.431+0000 7f9d30fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 20 Filter name: none 2024-03-09T14:50:04.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9caa7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:04.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-09T14:50:04.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.432+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 cache get: name=default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN : miss 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 cache put: name=default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN info.flags=0x0 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 adding default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN to cache LRU end 2024-03-09T14:50:04.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 cache get: name=default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN : hit (negative entry) 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.433+0000 7f9e7dc44800 10 cache get: name=default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN : hit (negative entry) 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.434+0000 7f9e7dc44800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.434+0000 7f9e7dc44800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.434+0000 7f9e7dc44800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.435+0000 7f9d5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529829 cookie 94731768234096 notifier 7590 bl.length()=645 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.435+0000 7f9d5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:04.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.435+0000 7f9d5effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:04.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.438+0000 7f9e7dc44800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-03-09T14:50:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.438+0000 7f9e7dc44800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:50:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.438+0000 7f9e7dc44800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-03-09T14:50:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.439+0000 7f9d5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529792 cookie 94731768245168 notifier 7590 bl.length()=185 2024-03-09T14:50:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.439+0000 7f9d5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-03-09T14:50:04.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.439+0000 7f9d5effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:50:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.441+0000 7f9e7dc44800 10 cache put: name=default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN info.flags=0x7 2024-03-09T14:50:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.441+0000 7f9e7dc44800 10 moving default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN to cache LRU end 2024-03-09T14:50:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.441+0000 7f9e7dc44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:PXTUGICGYYDHZEFFXUBN, ofs0, ns] 2024-03-09T14:50:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.442+0000 7f9d5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529793 cookie 94731768246224 notifier 7590 bl.length()=186 2024-03-09T14:50:04.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.442+0000 7f9d5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN info.flags=0x7 2024-03-09T14:50:04.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.442+0000 7f9d5effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PXTUGICGYYDHZEFFXUBN to cache LRU end 2024-03-09T14:50:04.443 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "bar.client.0", 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.bar.client.0", 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "bar+test@test.test", 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "bar.client.0", 2024-03-09T14:50:04.444 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "PXTUGICGYYDHZEFFXUBN", 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "++0HgC9Zjmd4TfVbkecBPmr7Pc8gAFfcrHUW3onSyLel8p0+RKRoVQ==", 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:04.434190Z" 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:04.445 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:50:04.446 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:04.434167Z", 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:04.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.444+0000 7f9d31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:04.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.447+0000 7f9e7dc44800 20 remove_watcher() i=0 2024-03-09T14:50:04.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.447+0000 7f9e7dc44800 2 removed watcher, disabling cache 2024-03-09T14:50:04.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.449+0000 7f9e7dc44800 20 remove_watcher() i=1 2024-03-09T14:50:04.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.450+0000 7f9e7dc44800 20 remove_watcher() i=2 2024-03-09T14:50:04.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.451+0000 7f9e7dc44800 20 remove_watcher() i=3 2024-03-09T14:50:04.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.452+0000 7f9e7dc44800 20 remove_watcher() i=4 2024-03-09T14:50:04.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.453+0000 7f9e7dc44800 20 remove_watcher() i=5 2024-03-09T14:50:04.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.455+0000 7f9e7dc44800 20 remove_watcher() i=6 2024-03-09T14:50:04.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.456+0000 7f9e7dc44800 20 remove_watcher() i=7 2024-03-09T14:50:04.469 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 6428181238 --totp-seed GYEKW5SBHIFOINVINSREHRKJ5QB6TLF6GV62XYTNWHJVT4NVS3AB4ALE7OUY7BLR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:04.535 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.567+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.568+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.568+0000 7f37cbb31800 20 realm 2024-03-09T14:50:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.568+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.569+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.569+0000 7f37cbb31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.569+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.569+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.569+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.570+0000 7f37cbb31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.570+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.571+0000 7f37cbb31800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:04.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.571+0000 7f37cbb31800 20 searching for the correct realm 2024-03-09T14:50:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.574+0000 7f37c7831640 0 -- 172.21.15.46:0/359615271 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f37c001e060 msgr2=0x7f37c007cfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.578+0000 7f37c7831640 0 -- 172.21.15.46:0/359615271 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f37bc00b040 msgr2=0x7f37bc03d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:04.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:04.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:04.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.583+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 zone default found 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 4 Realm: () 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:04.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 zonegroup default 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 started sync module instance, tier type = 2024-03-09T14:50:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.584+0000 7f37cbb31800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=0 2024-03-09T14:50:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=1 2024-03-09T14:50:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=2 2024-03-09T14:50:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=3 2024-03-09T14:50:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=4 2024-03-09T14:50:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=5 2024-03-09T14:50:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.594+0000 7f37cbb31800 20 add_watcher() i=6 2024-03-09T14:50:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.595+0000 7f37cbb31800 20 add_watcher() i=7 2024-03-09T14:50:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.595+0000 7f37cbb31800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:04.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.596+0000 7f367dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:04.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.596+0000 7f37cbb31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:04.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.596+0000 7f37cbb31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:04.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.596+0000 7f37cbb31800 5 note: GC not initialized 2024-03-09T14:50:04.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.596+0000 7f367cfe1640 20 reqs_thread_entry: start 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 20 Filter name: none 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f35f67fc640 20 reqs_thread_entry: start 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 20 rados_obj.operate() r=0 bl.length=460 2024-03-09T14:50:04.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-03-09T14:50:04.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:04.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.597+0000 7f37cbb31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:04.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.600+0000 7f37cbb31800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.600+0000 7f37cbb31800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.600+0000 7f37cbb31800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-09T14:50:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.600+0000 7f36a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529830 cookie 93962832086704 notifier 7211 bl.length()=659 2024-03-09T14:50:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.600+0000 7f36a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:50:04.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.600+0000 7f36a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:50:04.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.603+0000 7f367dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.605+0000 7f37cbb31800 20 remove_watcher() i=0 2024-03-09T14:50:04.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.605+0000 7f37cbb31800 2 removed watcher, disabling cache 2024-03-09T14:50:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.606+0000 7f37cbb31800 20 remove_watcher() i=1 2024-03-09T14:50:04.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.607+0000 7f37cbb31800 20 remove_watcher() i=2 2024-03-09T14:50:04.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.608+0000 7f37cbb31800 20 remove_watcher() i=3 2024-03-09T14:50:04.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.609+0000 7f37cbb31800 20 remove_watcher() i=4 2024-03-09T14:50:04.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.610+0000 7f37cbb31800 20 remove_watcher() i=5 2024-03-09T14:50:04.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.611+0000 7f37cbb31800 20 remove_watcher() i=6 2024-03-09T14:50:04.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.612+0000 7f37cbb31800 20 remove_watcher() i=7 2024-03-09T14:50:04.623 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-03-09T14:50:04.623 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key FEOTEZFSRHBBECMHVBAB --secret xrm5U2WKPK2AO7iQAfo3BGBw5Ar03ynI/l/G3ikwblRwFddYUHtC/Q== --cluster ceph 2024-03-09T14:50:04.686 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:04.686 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:04.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.726+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 realm 2024-03-09T14:50:04.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.728+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.729+0000 7f029e40f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:04.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.729+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.730+0000 7f029e40f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:04.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.730+0000 7f029e40f800 20 searching for the correct realm 2024-03-09T14:50:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.736+0000 7f0299b5e640 0 -- 172.21.15.46:0/1616836887 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f029402a040 msgr2=0x7f029401a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.739+0000 7f0299b5e640 0 -- 172.21.15.46:0/1616836887 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f0284057050 msgr2=0x7f0284066ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.945+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 zone default found 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 4 Realm: () 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 zonegroup default 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.946+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 started sync module instance, tier type = 2024-03-09T14:50:04.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.947+0000 7f029e40f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=0 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=1 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=2 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=3 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=4 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=5 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.957+0000 7f029e40f800 20 add_watcher() i=6 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.958+0000 7f029e40f800 20 add_watcher() i=7 2024-03-09T14:50:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.958+0000 7f029e40f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.959+0000 7f014b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 5 note: GC not initialized 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f014a7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 Filter name: none 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f00bbfff640 20 reqs_thread_entry: start 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-03-09T14:50:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-03-09T14:50:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.960+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 cache get: name=default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB : miss 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 cache put: name=default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB info.flags=0x0 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 adding default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB to cache LRU end 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 cache get: name=default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB : hit (negative entry) 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.961+0000 7f029e40f800 10 cache get: name=default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB : hit (negative entry) 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.962+0000 7f029e40f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.962+0000 7f029e40f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:04.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.962+0000 7f029e40f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-09T14:50:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.963+0000 7f017d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497090 cookie 94613946562512 notifier 7629 bl.length()=719 2024-03-09T14:50:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.963+0000 7f017d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.963+0000 7f017d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.966+0000 7f029e40f800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-03-09T14:50:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.966+0000 7f029e40f800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:50:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.966+0000 7f029e40f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-03-09T14:50:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.966+0000 7f017d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 94613946564768 notifier 7629 bl.length()=215 2024-03-09T14:50:04.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.966+0000 7f017d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-03-09T14:50:04.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.966+0000 7f017d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:50:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.969+0000 7f029e40f800 10 cache put: name=default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB info.flags=0x7 2024-03-09T14:50:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.969+0000 7f029e40f800 10 moving default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB to cache LRU end 2024-03-09T14:50:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.969+0000 7f029e40f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:FEOTEZFSRHBBECMHVBAB, ofs0, ns] 2024-03-09T14:50:04.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.969+0000 7f017cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497127 cookie 94613946543808 notifier 7629 bl.length()=201 2024-03-09T14:50:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.969+0000 7f017cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB info.flags=0x7 2024-03-09T14:50:04.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.969+0000 7f017cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FEOTEZFSRHBBECMHVBAB to cache LRU end 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "testx$tenanteduser.client.0", 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "testx$tenanteduser+test@test.test", 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "testx$tenanteduser.client.0", 2024-03-09T14:50:04.971 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "FEOTEZFSRHBBECMHVBAB", 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "xrm5U2WKPK2AO7iQAfo3BGBw5Ar03ynI/l/G3ikwblRwFddYUHtC/Q==", 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:04.962549Z" 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:04.972 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:04.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:04.962539Z", 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:04.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.971+0000 7f014b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.973+0000 7f029e40f800 20 remove_watcher() i=0 2024-03-09T14:50:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.973+0000 7f029e40f800 2 removed watcher, disabling cache 2024-03-09T14:50:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.975+0000 7f029e40f800 20 remove_watcher() i=1 2024-03-09T14:50:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.976+0000 7f029e40f800 20 remove_watcher() i=2 2024-03-09T14:50:04.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.977+0000 7f029e40f800 20 remove_watcher() i=3 2024-03-09T14:50:04.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.978+0000 7f029e40f800 20 remove_watcher() i=4 2024-03-09T14:50:04.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.979+0000 7f029e40f800 20 remove_watcher() i=5 2024-03-09T14:50:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.980+0000 7f029e40f800 20 remove_watcher() i=6 2024-03-09T14:50:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:04.981+0000 7f029e40f800 20 remove_watcher() i=7 2024-03-09T14:50:04.991 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 7639572454 --totp-seed TRDJ6TOKQPQ2HQRR4PIFDSBSPKVAUD6ELXXAKT4PUFKPV2JXFRD4Y5FYBOOWIWA4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:05.054 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.084+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.085+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.085+0000 7fd36108c800 20 realm 2024-03-09T14:50:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.085+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.085+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.085+0000 7fd36108c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.085+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.086+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.086+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.087+0000 7fd36108c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.087+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.087+0000 7fd36108c800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.087+0000 7fd36108c800 20 searching for the correct realm 2024-03-09T14:50:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.090+0000 7fd35e387640 0 -- 172.21.15.46:0/387126263 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x5595a342b5b0 msgr2=0x5595a342d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.093+0000 7fd35eb88640 0 -- 172.21.15.46:0/387126263 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fd35408b390 msgr2=0x7fd354087ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:05.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.299+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.300+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.300+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.300+0000 7fd36108c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.300+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.300+0000 7fd36108c800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:05.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 zone default found 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 4 Realm: () 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 zonegroup default 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 started sync module instance, tier type = 2024-03-09T14:50:05.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.301+0000 7fd36108c800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:05.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.310+0000 7fd36108c800 20 add_watcher() i=0 2024-03-09T14:50:05.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=1 2024-03-09T14:50:05.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=2 2024-03-09T14:50:05.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=3 2024-03-09T14:50:05.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=4 2024-03-09T14:50:05.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=5 2024-03-09T14:50:05.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=6 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 20 add_watcher() i=7 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.311+0000 7fd36108c800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.313+0000 7fd2157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.313+0000 7fd36108c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.313+0000 7fd36108c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.313+0000 7fd36108c800 5 note: GC not initialized 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.313+0000 7fd18ffff640 20 reqs_thread_entry: start 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.313+0000 7fd36108c800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:05.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 20 Filter name: none 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd18dffb640 20 reqs_thread_entry: start 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 20 rados_obj.operate() r=0 bl.length=519 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:05.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.314+0000 7fd36108c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:05.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.317+0000 7fd36108c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:05.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.317+0000 7fd36108c800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:05.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.317+0000 7fd36108c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-09T14:50:05.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.317+0000 7fd2427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94101177590560 notifier 7241 bl.length()=733 2024-03-09T14:50:05.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.317+0000 7fd2427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:50:05.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.317+0000 7fd2427fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:50:05.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.319+0000 7fd2157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.321+0000 7fd36108c800 20 remove_watcher() i=0 2024-03-09T14:50:05.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.321+0000 7fd36108c800 2 removed watcher, disabling cache 2024-03-09T14:50:05.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.323+0000 7fd36108c800 20 remove_watcher() i=1 2024-03-09T14:50:05.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.324+0000 7fd36108c800 20 remove_watcher() i=2 2024-03-09T14:50:05.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.325+0000 7fd36108c800 20 remove_watcher() i=3 2024-03-09T14:50:05.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.326+0000 7fd36108c800 20 remove_watcher() i=4 2024-03-09T14:50:05.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.327+0000 7fd36108c800 20 remove_watcher() i=5 2024-03-09T14:50:05.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.328+0000 7fd36108c800 20 remove_watcher() i=6 2024-03-09T14:50:05.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.329+0000 7fd36108c800 20 remove_watcher() i=7 2024-03-09T14:50:05.340 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-03-09T14:50:05.341 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key LTAUPRXVSJUEYNSFHWQJ --secret NJFunjE6CWjZSBXxhIEAh8Fi4789KXLQSc+2AbQoRSUseh25iV+BQw== --cluster ceph 2024-03-09T14:50:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:05.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.432+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 realm 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.433+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.434+0000 7f7673624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.434+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.435+0000 7f7673624800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.435+0000 7f7673624800 20 searching for the correct realm 2024-03-09T14:50:05.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.438+0000 7f7671120640 0 -- 172.21.15.46:0/2250126191 >> [v2:172.21.15.159:6816/3641282602,v1:172.21.15.159:6817/3641282602] conn(0x7f766c027910 msgr2=0x7f766c017430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.442+0000 7f7671120640 0 -- 172.21.15.46:0/2250126191 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f76680d30b0 msgr2=0x7f76680a4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:05.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.447+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 zone default found 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 4 Realm: () 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 zonegroup default 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.448+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.449+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.449+0000 7f7673624800 20 started sync module instance, tier type = 2024-03-09T14:50:05.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.449+0000 7f7673624800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=0 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=1 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=2 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=3 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=4 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=5 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.457+0000 7f7673624800 20 add_watcher() i=6 2024-03-09T14:50:05.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.458+0000 7f7673624800 20 add_watcher() i=7 2024-03-09T14:50:05.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.458+0000 7f7673624800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:05.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f75277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:05.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 5 note: GC not initialized 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f75267e4640 20 reqs_thread_entry: start 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 20 Filter name: none 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7497fff640 20 reqs_thread_entry: start 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.460+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-03-09T14:50:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:50:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache get: name=default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ : miss 2024-03-09T14:50:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache put: name=default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ info.flags=0x0 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 adding default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ to cache LRU end 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache get: name=default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ : hit (negative entry) 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.461+0000 7f7673624800 10 cache get: name=default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ : hit (negative entry) 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.463+0000 7f7673624800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.463+0000 7f7673624800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.463+0000 7f7673624800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:50:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.463+0000 7f7554ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94049020071968 notifier 7668 bl.length()=660 2024-03-09T14:50:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.463+0000 7f7554ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:05.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.463+0000 7f7554ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.466+0000 7f7673624800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-03-09T14:50:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.466+0000 7f7673624800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:50:05.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.466+0000 7f7673624800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-03-09T14:50:05.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.466+0000 7f7554ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497127 cookie 94049020049760 notifier 7668 bl.length()=191 2024-03-09T14:50:05.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.466+0000 7f7554ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-03-09T14:50:05.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.466+0000 7f7554ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:50:05.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.469+0000 7f7673624800 10 cache put: name=default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ info.flags=0x7 2024-03-09T14:50:05.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.469+0000 7f7673624800 10 moving default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ to cache LRU end 2024-03-09T14:50:05.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.469+0000 7f7673624800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:LTAUPRXVSJUEYNSFHWQJ, ofs0, ns] 2024-03-09T14:50:05.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.469+0000 7f7554ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94049020059584 notifier 7668 bl.length()=189 2024-03-09T14:50:05.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.469+0000 7f7554ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ info.flags=0x7 2024-03-09T14:50:05.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.469+0000 7f7554ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTAUPRXVSJUEYNSFHWQJ to cache LRU end 2024-03-09T14:50:05.470 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "foobar.client.0", 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.foobar.client.0", 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "foobar+test@test.test", 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:05.471 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "foobar.client.0", 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "LTAUPRXVSJUEYNSFHWQJ", 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "NJFunjE6CWjZSBXxhIEAh8Fi4789KXLQSc+2AbQoRSUseh25iV+BQw==", 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:05.462728Z" 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:05.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:05.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:05.462717Z", 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:05.474 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.471+0000 7f75277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.474+0000 7f7673624800 20 remove_watcher() i=0 2024-03-09T14:50:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.474+0000 7f7673624800 2 removed watcher, disabling cache 2024-03-09T14:50:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.475+0000 7f7673624800 20 remove_watcher() i=1 2024-03-09T14:50:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.476+0000 7f7673624800 20 remove_watcher() i=2 2024-03-09T14:50:05.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.477+0000 7f7673624800 20 remove_watcher() i=3 2024-03-09T14:50:05.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.478+0000 7f7673624800 20 remove_watcher() i=4 2024-03-09T14:50:05.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.479+0000 7f7673624800 20 remove_watcher() i=5 2024-03-09T14:50:05.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.480+0000 7f7673624800 20 remove_watcher() i=6 2024-03-09T14:50:05.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.481+0000 7f7673624800 20 remove_watcher() i=7 2024-03-09T14:50:05.492 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6831324923 --totp-seed X6ATWQQW3OQBQIUZ6JXXYF6JDEYG7VHSQ6EDKUDERTHCT7XOWWTGJVUSZHPN7SSC --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:05.554 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:05.555 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:05.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.584+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 realm 2024-03-09T14:50:05.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:05.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.586+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.587+0000 7f2a9dc9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.587+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.588+0000 7f2a9dc9d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:05.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.588+0000 7f2a9dc9d800 20 searching for the correct realm 2024-03-09T14:50:05.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.591+0000 7f2a9bf9a640 0 -- 172.21.15.46:0/2455531868 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x56025646ab40 msgr2=0x56025646d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.594+0000 7f2a9b799640 0 -- 172.21.15.46:0/2455531868 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f2a900b0150 msgr2=0x7f2a900c6ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.599+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 zone default found 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 4 Realm: () 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:05.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 zonegroup default 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.600+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 started sync module instance, tier type = 2024-03-09T14:50:05.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.601+0000 7f2a9dc9d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:05.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=0 2024-03-09T14:50:05.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=1 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=2 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=3 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=4 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=5 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.610+0000 7f2a9dc9d800 20 add_watcher() i=6 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.611+0000 7f2a9dc9d800 20 add_watcher() i=7 2024-03-09T14:50:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.611+0000 7f2a9dc9d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.612+0000 7f2951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 5 note: GC not initialized 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2950fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 20 Filter name: none 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f28ca7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:50:05.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.613+0000 7f2a9dc9d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.614+0000 7f2a9dc9d800 20 rados_obj.operate() r=0 bl.length=472 2024-03-09T14:50:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.614+0000 7f2a9dc9d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-09T14:50:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.614+0000 7f2a9dc9d800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.614+0000 7f2a9dc9d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.616+0000 7f2a9dc9d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.616+0000 7f2a9dc9d800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.616+0000 7f2a9dc9d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.616+0000 7f297effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94568037417696 notifier 7686 bl.length()=674 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.616+0000 7f297effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.616+0000 7f297effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.619+0000 7f2951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.621+0000 7f2a9dc9d800 20 remove_watcher() i=0 2024-03-09T14:50:05.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.621+0000 7f2a9dc9d800 2 removed watcher, disabling cache 2024-03-09T14:50:05.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.622+0000 7f2a9dc9d800 20 remove_watcher() i=1 2024-03-09T14:50:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.623+0000 7f2a9dc9d800 20 remove_watcher() i=2 2024-03-09T14:50:05.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.624+0000 7f2a9dc9d800 20 remove_watcher() i=3 2024-03-09T14:50:05.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.625+0000 7f2a9dc9d800 20 remove_watcher() i=4 2024-03-09T14:50:05.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.626+0000 7f2a9dc9d800 20 remove_watcher() i=5 2024-03-09T14:50:05.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.627+0000 7f2a9dc9d800 20 remove_watcher() i=6 2024-03-09T14:50:05.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.628+0000 7f2a9dc9d800 20 remove_watcher() i=7 2024-03-09T14:50:05.639 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-03-09T14:50:05.693 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:05.694 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:05.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.723+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 realm 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.725+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.726+0000 7fc20fb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.726+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.727+0000 7fc20fb2d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:05.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.727+0000 7fc20fb2d800 20 searching for the correct realm 2024-03-09T14:50:05.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.730+0000 7fc20af79640 0 -- 172.21.15.46:0/103270553 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55fef6680f10 msgr2=0x55fef6683300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.733+0000 7fc20af79640 0 -- 172.21.15.46:0/103270553 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x7fc0d407ba40 msgr2=0x7fc0d407de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.737+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:05.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 zone default found 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 4 Realm: () 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 zonegroup default 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.738+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.935+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.935+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.936+0000 7fc20fb2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.936+0000 7fc20fb2d800 20 started sync module instance, tier type = 2024-03-09T14:50:05.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.936+0000 7fc20fb2d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:05.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=0 2024-03-09T14:50:05.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=1 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=2 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=3 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=4 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=5 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.945+0000 7fc20fb2d800 20 add_watcher() i=6 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.946+0000 7fc20fb2d800 20 add_watcher() i=7 2024-03-09T14:50:05.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.946+0000 7fc20fb2d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc0c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 5 note: GC not initialized 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc0c0fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 20 Filter name: none 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc03a7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:50:05.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.948+0000 7fc20fb2d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.949+0000 7fc20fb2d800 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:50:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.949+0000 7fc20fb2d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-09T14:50:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.949+0000 7fc20fb2d800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.949+0000 7fc20fb2d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:05.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.950+0000 7fc20fb2d800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:05.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.950+0000 7fc20fb2d800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.950+0000 7fc20fb2d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:50:05.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.950+0000 7fc0eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94553544126448 notifier 7704 bl.length()=727 2024-03-09T14:50:05.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.950+0000 7fc0eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:50:05.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.950+0000 7fc0eeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:50:05.953 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:05.953 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "foobar.client.0", 2024-03-09T14:50:05.953 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.foobar.client.0", 2024-03-09T14:50:05.953 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "foobar+test@test.test", 2024-03-09T14:50:05.953 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:05.954 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:05.954 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:05.954 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:05.954 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:05.954 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "foobar.client.0", 2024-03-09T14:50:05.954 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "LTAUPRXVSJUEYNSFHWQJ", 2024-03-09T14:50:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "NJFunjE6CWjZSBXxhIEAh8Fi4789KXLQSc+2AbQoRSUseh25iV+BQw==", 2024-03-09T14:50:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:05.462728Z" 2024-03-09T14:50:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:05.955 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:05.956 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [ 2024-03-09T14:50:05.956 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:05.956 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "oidc-provider", 2024-03-09T14:50:05.956 INFO:teuthology.orchestra.run.smithi046.stdout: "perm": "*" 2024-03-09T14:50:05.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:05.956 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "roles", 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: "perm": "*" 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "user-policy", 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: "perm": "*" 2024-03-09T14:50:05.957 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:05.958 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:05.958 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:05.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:05.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:05.958 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:05.958 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:05.959 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:05.959 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:05.959 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:05.959 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:05.959 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:05.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:05.960 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:05.960 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:05.960 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:05.960 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:05.960 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "rgw", 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [ 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: "6831324923" 2024-03-09T14:50:05.961 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:05.962 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "", 2024-03-09T14:50:05.962 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:05.962 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:05.462717Z", 2024-03-09T14:50:05.962 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:05.962 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:05.963 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:05.963 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.953+0000 7fc0c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.955+0000 7fc20fb2d800 20 remove_watcher() i=0 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.955+0000 7fc20fb2d800 2 removed watcher, disabling cache 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.957+0000 7fc20fb2d800 20 remove_watcher() i=1 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.958+0000 7fc20fb2d800 20 remove_watcher() i=2 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.959+0000 7fc20fb2d800 20 remove_watcher() i=3 2024-03-09T14:50:05.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.960+0000 7fc20fb2d800 20 remove_watcher() i=4 2024-03-09T14:50:05.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.961+0000 7fc20fb2d800 20 remove_watcher() i=5 2024-03-09T14:50:05.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.962+0000 7fc20fb2d800 20 remove_watcher() i=6 2024-03-09T14:50:05.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:05.963+0000 7fc20fb2d800 20 remove_watcher() i=7 2024-03-09T14:50:05.975 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name 'Mr. RGW88888888888888888' --email RGW88888888888888888+test@test.test 2024-03-09T14:50:06.032 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:06.032 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:06.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.248+0000 7f54eb7a8640 0 --2- 172.21.15.46:0/4183180258 >> [v2:172.21.15.46:3301/0,v1:172.21.15.46:6790/0] conn(0x56204b27bec0 0x56204b36ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:50:06.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.263+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.264+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.264+0000 7f54f0c2e800 20 realm 2024-03-09T14:50:06.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.264+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.264+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.264+0000 7f54f0c2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.264+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.265+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.265+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.266+0000 7f54f0c2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:06.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.266+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.267+0000 7f54f0c2e800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:06.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.267+0000 7f54f0c2e800 20 searching for the correct realm 2024-03-09T14:50:06.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.269+0000 7f54eb7a8640 0 -- 172.21.15.46:0/3418220797 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f54dc08f040 msgr2=0x7f54dc0b6120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:06.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.475+0000 7f54ebfa9640 0 -- 172.21.15.46:0/3418220797 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f54e005d980 msgr2=0x7f54e00473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:06.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:06.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:06.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:06.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.682+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.683+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.683+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.683+0000 7f54f0c2e800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.683+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 20 zone default found 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 4 Realm: () 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 20 zonegroup default 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.684+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.685+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.685+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.685+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.685+0000 7f54f0c2e800 20 started sync module instance, tier type = 2024-03-09T14:50:06.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.685+0000 7f54f0c2e800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=0 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=1 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=2 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=3 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=4 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=5 2024-03-09T14:50:06.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.696+0000 7f54f0c2e800 20 add_watcher() i=6 2024-03-09T14:50:06.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.697+0000 7f54f0c2e800 20 add_watcher() i=7 2024-03-09T14:50:06.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.697+0000 7f54f0c2e800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:06.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.698+0000 7f53a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:06.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.698+0000 7f54f0c2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.698+0000 7f54f0c2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 5 note: GC not initialized 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f53a0fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 20 Filter name: none 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f531a7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 : miss 2024-03-09T14:50:06.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x0 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 10 adding default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 20 failed to read name.$Mr. RGW88888888888888888 with: (2) No such file or directory 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.699+0000 7f54f0c2e800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.700+0000 7f54f0c2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.700+0000 7f54f0c2e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-03-09T14:50:06.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.700+0000 7f54f0c2e800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:50:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.700+0000 7f54f0c2e800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-03-09T14:50:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.701+0000 7f54f0c2e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.701+0000 7f54f0c2e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:50:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.701+0000 7f54f0c2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-03-09T14:50:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.702+0000 7f53caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497128 cookie 94696701241936 notifier 7725 bl.length()=353 2024-03-09T14:50:06.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.702+0000 7f53caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:06.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.702+0000 7f53caffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:50:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.705+0000 7f54f0c2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.705+0000 7f54f0c2e800 10 moving default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:50:06.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.705+0000 7f54f0c2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW88888888888888888, ofs0, ns] 2024-03-09T14:50:06.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.705+0000 7f53caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497128 cookie 94696701251536 notifier 7725 bl.length()=226 2024-03-09T14:50:06.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.705+0000 7f53caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:06.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.705+0000 7f53caffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:50:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.708+0000 7f54f0c2e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-03-09T14:50:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.708+0000 7f54f0c2e800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:50:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.708+0000 7f54f0c2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-03-09T14:50:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.709+0000 7f53ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94696701248560 notifier 7725 bl.length()=234 2024-03-09T14:50:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.709+0000 7f53ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-03-09T14:50:06.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.709+0000 7f53ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:50:06.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.711+0000 7f53a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.713+0000 7f54f0c2e800 20 remove_watcher() i=0 2024-03-09T14:50:06.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.713+0000 7f54f0c2e800 2 removed watcher, disabling cache 2024-03-09T14:50:06.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.715+0000 7f54f0c2e800 20 remove_watcher() i=1 2024-03-09T14:50:06.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.716+0000 7f54f0c2e800 20 remove_watcher() i=2 2024-03-09T14:50:06.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.717+0000 7f54f0c2e800 20 remove_watcher() i=3 2024-03-09T14:50:06.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.718+0000 7f54f0c2e800 20 remove_watcher() i=4 2024-03-09T14:50:06.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.719+0000 7f54f0c2e800 20 remove_watcher() i=5 2024-03-09T14:50:06.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.720+0000 7f54f0c2e800 20 remove_watcher() i=6 2024-03-09T14:50:06.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.721+0000 7f54f0c2e800 20 remove_watcher() i=7 2024-03-09T14:50:06.730 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "id": "RGW88888888888888888", 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "tenant": "", 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "Mr. RGW88888888888888888", 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "RGW88888888888888888+test@test.test", 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "quota": { 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:06.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max_users": 1000, 2024-03-09T14:50:06.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max_roles": 1000, 2024-03-09T14:50:06.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max_groups": 1000, 2024-03-09T14:50:06.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:06.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max_access_keys": 4 2024-03-09T14:50:06.732 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:06.733 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-03-09T14:50:06.733 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key AZFVQARWMLPZCMPIUPME --secret jwnibTh07LaXUIHpRaObbhxQ8VsQu3QRPPgnB++9rJ87SMePUvSBiw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-03-09T14:50:06.798 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:06.799 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:06.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.830+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 realm 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.831+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.832+0000 7f9e0b613800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:06.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.832+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.833+0000 7f9e0b613800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:06.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.833+0000 7f9e0b613800 20 searching for the correct realm 2024-03-09T14:50:06.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.837+0000 7f9dfffff640 0 -- 172.21.15.46:0/3342809499 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7f9df8042430 msgr2=0x7f9df8042850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:06.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:06.841+0000 7f9e06d49640 0 -- 172.21.15.46:0/3342809499 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f9df00a9af0 msgr2=0x7f9df00c0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:07.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.047+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 zone default found 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 4 Realm: () 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 zonegroup default 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.048+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 started sync module instance, tier type = 2024-03-09T14:50:07.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.049+0000 7f9e0b613800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:07.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=0 2024-03-09T14:50:07.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=1 2024-03-09T14:50:07.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=2 2024-03-09T14:50:07.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=3 2024-03-09T14:50:07.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=4 2024-03-09T14:50:07.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=5 2024-03-09T14:50:07.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.059+0000 7f9e0b613800 20 add_watcher() i=6 2024-03-09T14:50:07.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.060+0000 7f9e0b613800 20 add_watcher() i=7 2024-03-09T14:50:07.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.060+0000 7f9e0b613800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9cbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 5 note: GC not initialized 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9c37fff640 20 reqs_thread_entry: start 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 20 Filter name: none 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9c35ffb640 20 reqs_thread_entry: start 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.062+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-03-09T14:50:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-03-09T14:50:07.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 cache get: name=default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME : miss 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME info.flags=0x0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 adding default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME to cache LRU end 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.063+0000 7f9e0b613800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.064+0000 7f9e0b613800 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:50:07.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.064+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.064+0000 7f9e0b613800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.064+0000 7f9e0b613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.064+0000 7f9e0b613800 10 cache get: name=default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME : hit (negative entry) 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.064+0000 7f9e0b613800 10 cache get: name=default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME : hit (negative entry) 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.065+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.065+0000 7f9e0b613800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:07.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.065+0000 7f9e0b613800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-03-09T14:50:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.066+0000 7f9cea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497129 cookie 94302711794336 notifier 7325 bl.length()=681 2024-03-09T14:50:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.066+0000 7f9cea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:07.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.066+0000 7f9cea7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.069+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-03-09T14:50:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.069+0000 7f9e0b613800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:50:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.069+0000 7f9e0b613800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-03-09T14:50:07.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.069+0000 7f9ce9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94302711809232 notifier 7325 bl.length()=189 2024-03-09T14:50:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.069+0000 7f9ce9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-03-09T14:50:07.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.069+0000 7f9ce9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:50:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.072+0000 7f9e0b613800 10 cache put: name=default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME info.flags=0x7 2024-03-09T14:50:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.072+0000 7f9e0b613800 10 moving default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME to cache LRU end 2024-03-09T14:50:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.072+0000 7f9e0b613800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:AZFVQARWMLPZCMPIUPME, ofs0, ns] 2024-03-09T14:50:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.072+0000 7f9ce9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497130 cookie 94302711794336 notifier 7325 bl.length()=188 2024-03-09T14:50:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.072+0000 7f9ce9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME info.flags=0x7 2024-03-09T14:50:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.072+0000 7f9ce9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AZFVQARWMLPZCMPIUPME to cache LRU end 2024-03-09T14:50:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.075+0000 7f9e0b613800 20 linked user root1.client.0 to account RGW88888888888888888 2024-03-09T14:50:07.075 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:07.075 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "root1.client.0", 2024-03-09T14:50:07.075 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.RGW88888888888888888", 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "root1+test@test.test", 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "root1.client.0", 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "AZFVQARWMLPZCMPIUPME", 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "jwnibTh07LaXUIHpRaObbhxQ8VsQu3QRPPgnB++9rJ87SMePUvSBiw==", 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:07.065194Z" 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:07.076 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:07.077 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "root", 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "RGW88888888888888888", 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:07.065182Z", 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:07.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:07.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.076+0000 7f9cbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.078+0000 7f9e0b613800 20 remove_watcher() i=0 2024-03-09T14:50:07.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.078+0000 7f9e0b613800 2 removed watcher, disabling cache 2024-03-09T14:50:07.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.079+0000 7f9e0b613800 20 remove_watcher() i=1 2024-03-09T14:50:07.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.081+0000 7f9e0b613800 20 remove_watcher() i=2 2024-03-09T14:50:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.082+0000 7f9e0b613800 20 remove_watcher() i=3 2024-03-09T14:50:07.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.083+0000 7f9e0b613800 20 remove_watcher() i=4 2024-03-09T14:50:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.084+0000 7f9e0b613800 20 remove_watcher() i=5 2024-03-09T14:50:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.085+0000 7f9e0b613800 20 remove_watcher() i=6 2024-03-09T14:50:07.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.086+0000 7f9e0b613800 20 remove_watcher() i=7 2024-03-09T14:50:07.098 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 7836100220 --totp-seed 6A3KURWIILQ344OM5XVXBLEMASHCKI34CJ2OYBZQTFF33O2WHTE5WBPM7GYWGLQE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:07.161 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:07.161 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:07.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.191+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 realm 2024-03-09T14:50:07.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.192+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.193+0000 7fe423d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.193+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.194+0000 7fe423d2f800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:07.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.194+0000 7fe423d2f800 20 searching for the correct realm 2024-03-09T14:50:07.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.198+0000 7fe41f1af640 0 -- 172.21.15.46:0/752170159 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x562726f87680 msgr2=0x562726f89a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:07.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.202+0000 7fe4201b1640 0 -- 172.21.15.46:0/752170159 >> [v2:172.21.15.159:6824/4253518115,v1:172.21.15.159:6825/4253518115] conn(0x7fe414052c20 msgr2=0x7fe41405ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.205+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 zone default found 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 4 Realm: () 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 zonegroup default 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.206+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.207+0000 7fe423d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.207+0000 7fe423d2f800 20 started sync module instance, tier type = 2024-03-09T14:50:07.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.207+0000 7fe423d2f800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:07.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=0 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=1 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=2 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=3 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=4 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=5 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=6 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 20 add_watcher() i=7 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.216+0000 7fe423d2f800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe423d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe423d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe423d2f800 5 note: GC not initialized 2024-03-09T14:50:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe2d4fe1640 20 reqs_thread_entry: start 2024-03-09T14:50:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe423d2f800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.218+0000 7fe423d2f800 20 Filter name: none 2024-03-09T14:50:07.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe24e7fc640 20 reqs_thread_entry: start 2024-03-09T14:50:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe423d2f800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-03-09T14:50:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe423d2f800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe423d2f800 20 rados_obj.operate() r=0 bl.length=494 2024-03-09T14:50:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe423d2f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-03-09T14:50:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe423d2f800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:07.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.219+0000 7fe423d2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.221+0000 7fe423d2f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.221+0000 7fe423d2f800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.221+0000 7fe423d2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-03-09T14:50:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.222+0000 7fe2feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497131 cookie 94726157535392 notifier 7343 bl.length()=695 2024-03-09T14:50:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.222+0000 7fe2feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:50:07.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.222+0000 7fe2feffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:50:07.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.224+0000 7fe2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.226+0000 7fe423d2f800 20 remove_watcher() i=0 2024-03-09T14:50:07.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.226+0000 7fe423d2f800 2 removed watcher, disabling cache 2024-03-09T14:50:07.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.228+0000 7fe423d2f800 20 remove_watcher() i=1 2024-03-09T14:50:07.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.229+0000 7fe423d2f800 20 remove_watcher() i=2 2024-03-09T14:50:07.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.230+0000 7fe423d2f800 20 remove_watcher() i=3 2024-03-09T14:50:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.231+0000 7fe423d2f800 20 remove_watcher() i=4 2024-03-09T14:50:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.232+0000 7fe423d2f800 20 remove_watcher() i=5 2024-03-09T14:50:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.233+0000 7fe423d2f800 20 remove_watcher() i=6 2024-03-09T14:50:07.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.234+0000 7fe423d2f800 20 remove_watcher() i=7 2024-03-09T14:50:07.245 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name 'Mr. RGW99999999999999999' --email RGW99999999999999999+test@test.test 2024-03-09T14:50:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:07.301 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:07.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.331+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.332+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.332+0000 7fe774733800 20 realm 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.332+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.333+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.333+0000 7fe774733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.333+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.333+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.333+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.334+0000 7fe774733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.334+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.335+0000 7fe774733800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:07.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.335+0000 7fe774733800 20 searching for the correct realm 2024-03-09T14:50:07.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.338+0000 7fe76fc6a640 0 -- 172.21.15.46:0/1118735986 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x560857e8b220 msgr2=0x560857e8d630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:07.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.341+0000 7fe76fc6a640 0 -- 172.21.15.46:0/1118735986 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x7fe64007ba40 msgr2=0x7fe64007de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.345+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 zone default found 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 4 Realm: () 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 zonegroup default 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.346+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.347+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.347+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.347+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.347+0000 7fe774733800 20 started sync module instance, tier type = 2024-03-09T14:50:07.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.347+0000 7fe774733800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:07.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=0 2024-03-09T14:50:07.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=1 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=2 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=3 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=4 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=5 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.356+0000 7fe774733800 20 add_watcher() i=6 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.357+0000 7fe774733800 20 add_watcher() i=7 2024-03-09T14:50:07.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.357+0000 7fe774733800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.358+0000 7fe6267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.358+0000 7fe774733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:07.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.358+0000 7fe774733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.358+0000 7fe774733800 5 note: GC not initialized 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe6257e2640 20 reqs_thread_entry: start 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 20 Filter name: none 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe596ffd640 20 reqs_thread_entry: start 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 : miss 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x0 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 10 adding default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 20 failed to read name.$Mr. RGW99999999999999999 with: (2) No such file or directory 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-03-09T14:50:07.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.359+0000 7fe774733800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.360+0000 7fe774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.360+0000 7fe774733800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.360+0000 7fe774733800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.360+0000 7fe774733800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.361+0000 7fe774733800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.361+0000 7fe774733800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:50:07.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.361+0000 7fe774733800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-03-09T14:50:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.362+0000 7fe64f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497132 cookie 94593834600432 notifier 7779 bl.length()=353 2024-03-09T14:50:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.362+0000 7fe64f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:07.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.362+0000 7fe64f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:50:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.364+0000 7fe774733800 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:07.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.364+0000 7fe774733800 10 moving default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:50:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.364+0000 7fe774733800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW99999999999999999, ofs0, ns] 2024-03-09T14:50:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.364+0000 7fe64f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497129 cookie 94593834638592 notifier 7779 bl.length()=226 2024-03-09T14:50:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.364+0000 7fe64f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:07.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.364+0000 7fe64f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:50:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.367+0000 7fe774733800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-03-09T14:50:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.367+0000 7fe774733800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:50:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.367+0000 7fe774733800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-03-09T14:50:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.368+0000 7fe64f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94593834634864 notifier 7779 bl.length()=234 2024-03-09T14:50:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.368+0000 7fe64f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-03-09T14:50:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.368+0000 7fe64f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:50:07.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.370+0000 7fe6267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.372+0000 7fe774733800 20 remove_watcher() i=0 2024-03-09T14:50:07.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.372+0000 7fe774733800 2 removed watcher, disabling cache 2024-03-09T14:50:07.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.373+0000 7fe774733800 20 remove_watcher() i=1 2024-03-09T14:50:07.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.374+0000 7fe774733800 20 remove_watcher() i=2 2024-03-09T14:50:07.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.375+0000 7fe774733800 20 remove_watcher() i=3 2024-03-09T14:50:07.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.377+0000 7fe774733800 20 remove_watcher() i=4 2024-03-09T14:50:07.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.378+0000 7fe774733800 20 remove_watcher() i=5 2024-03-09T14:50:07.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.379+0000 7fe774733800 20 remove_watcher() i=6 2024-03-09T14:50:07.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.380+0000 7fe774733800 20 remove_watcher() i=7 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "id": "RGW99999999999999999", 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "tenant": "", 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "Mr. RGW99999999999999999", 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "RGW99999999999999999+test@test.test", 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "quota": { 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:07.389 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max_users": 1000, 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max_roles": 1000, 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max_groups": 1000, 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max_access_keys": 4 2024-03-09T14:50:07.390 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:07.391 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-03-09T14:50:07.391 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key LKFZDGQGBRXDVDJHYRUR --secret qtagfxhXOQLYFxZHZvgXchdvq+2dXFGX89oEwNnvFa1/1n01E5kn/A== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-03-09T14:50:07.454 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:07.455 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:07.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.487+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.488+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.488+0000 7ff8c1128800 20 realm 2024-03-09T14:50:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.488+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.488+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.488+0000 7ff8c1128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.488+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.489+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.489+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.490+0000 7ff8c1128800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.490+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.491+0000 7ff8c1128800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:07.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.491+0000 7ff8c1128800 20 searching for the correct realm 2024-03-09T14:50:07.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.494+0000 7ff8bc6ba640 0 -- 172.21.15.46:0/4124569210 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x562e1bae30a0 msgr2=0x562e1bae54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:07.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.498+0000 7ff8bc6ba640 0 -- 172.21.15.46:0/4124569210 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x7ff78807ba40 msgr2=0x7ff78807de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.502+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 zone default found 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 4 Realm: () 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:07.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 zonegroup default 2024-03-09T14:50:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.503+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.504+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.504+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.504+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.504+0000 7ff8c1128800 20 started sync module instance, tier type = 2024-03-09T14:50:07.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.504+0000 7ff8c1128800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=0 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=1 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=2 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=3 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=4 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=5 2024-03-09T14:50:07.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.513+0000 7ff8c1128800 20 add_watcher() i=6 2024-03-09T14:50:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.514+0000 7ff8c1128800 20 add_watcher() i=7 2024-03-09T14:50:07.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.514+0000 7ff8c1128800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.515+0000 7ff772fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.515+0000 7ff8c1128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.515+0000 7ff8c1128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.515+0000 7ff8c1128800 5 note: GC not initialized 2024-03-09T14:50:07.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff771fe3640 20 reqs_thread_entry: start 2024-03-09T14:50:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 20 Filter name: none 2024-03-09T14:50:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff6e37fe640 20 reqs_thread_entry: start 2024-03-09T14:50:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-03-09T14:50:07.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.516+0000 7ff8c1128800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:50:07.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 cache get: name=default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR : miss 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR info.flags=0x0 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 adding default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR to cache LRU end 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:50:07.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:50:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.517+0000 7ff8c1128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.518+0000 7ff8c1128800 10 cache get: name=default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR : hit (negative entry) 2024-03-09T14:50:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.518+0000 7ff8c1128800 10 cache get: name=default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR : hit (negative entry) 2024-03-09T14:50:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.519+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.519+0000 7ff8c1128800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:07.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.519+0000 7ff8c1128800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-03-09T14:50:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.520+0000 7ff793fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497133 cookie 94756032917200 notifier 7794 bl.length()=681 2024-03-09T14:50:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.520+0000 7ff793fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:07.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.520+0000 7ff793fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.522+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-03-09T14:50:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.522+0000 7ff8c1128800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:50:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.522+0000 7ff8c1128800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-03-09T14:50:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.523+0000 7ff793fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497093 cookie 94756032930368 notifier 7794 bl.length()=189 2024-03-09T14:50:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.523+0000 7ff793fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-03-09T14:50:07.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.523+0000 7ff793fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:50:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.525+0000 7ff8c1128800 10 cache put: name=default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR info.flags=0x7 2024-03-09T14:50:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.525+0000 7ff8c1128800 10 moving default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR to cache LRU end 2024-03-09T14:50:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.525+0000 7ff8c1128800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LKFZDGQGBRXDVDJHYRUR, ofs0, ns] 2024-03-09T14:50:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.526+0000 7ff793fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497094 cookie 94756032932992 notifier 7794 bl.length()=188 2024-03-09T14:50:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.526+0000 7ff793fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR info.flags=0x7 2024-03-09T14:50:07.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.526+0000 7ff793fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LKFZDGQGBRXDVDJHYRUR to cache LRU end 2024-03-09T14:50:07.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.528+0000 7ff8c1128800 20 linked user root2.client.0 to account RGW99999999999999999 2024-03-09T14:50:07.528 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "user_id": "root2.client.0", 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "display_name": "Mr.RGW99999999999999999", 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "email": "root2+test@test.test", 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "suspended": 0, 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "max_buckets": 1000, 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "subusers": [], 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "keys": [ 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "user": "root2.client.0", 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "access_key": "LKFZDGQGBRXDVDJHYRUR", 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "secret_key": "qtagfxhXOQLYFxZHZvgXchdvq+2dXFGX89oEwNnvFa1/1n01E5kn/A==", 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "active": true, 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:07.518887Z" 2024-03-09T14:50:07.529 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "swift_keys": [], 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": [], 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "op_mask": "read, write, delete", 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "default_placement": "", 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "default_storage_class": "", 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "placement_tags": [], 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "bucket_quota": { 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:07.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "user_quota": { 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": false, 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "check_on_raw": false, 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size": -1, 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max_size_kb": 0, 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max_objects": -1 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "temp_url_keys": [], 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "root", 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "mfa_ids": [], 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "account_id": "RGW99999999999999999", 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "create_date": "2024-03-09T14:50:07.518874Z", 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-03-09T14:50:07.531 INFO:teuthology.orchestra.run.smithi046.stdout: "group_ids": [] 2024-03-09T14:50:07.532 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T14:50:07.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:50:07.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.529+0000 7ff772fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.531+0000 7ff8c1128800 20 remove_watcher() i=0 2024-03-09T14:50:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.531+0000 7ff8c1128800 2 removed watcher, disabling cache 2024-03-09T14:50:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.532+0000 7ff8c1128800 20 remove_watcher() i=1 2024-03-09T14:50:07.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.533+0000 7ff8c1128800 20 remove_watcher() i=2 2024-03-09T14:50:07.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.534+0000 7ff8c1128800 20 remove_watcher() i=3 2024-03-09T14:50:07.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.535+0000 7ff8c1128800 20 remove_watcher() i=4 2024-03-09T14:50:07.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.536+0000 7ff8c1128800 20 remove_watcher() i=5 2024-03-09T14:50:07.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.537+0000 7ff8c1128800 20 remove_watcher() i=6 2024-03-09T14:50:07.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.538+0000 7ff8c1128800 20 remove_watcher() i=7 2024-03-09T14:50:07.549 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 7458736364 --totp-seed NB42UBBEMT4MAWEMOPAVSAC3VHLFDXJ2LPQ53LOWJR4LYRMYVIBEYH3VSAK4SO7A --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:50:07.612 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:50:07.612 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:50:07.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.645+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.646+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.646+0000 7f556202d800 20 realm 2024-03-09T14:50:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.646+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.646+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.646+0000 7f556202d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:50:07.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.646+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.647+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.647+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.648+0000 7f556202d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.648+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.648+0000 7f556202d800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:50:07.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.648+0000 7f556202d800 20 searching for the correct realm 2024-03-09T14:50:07.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.651+0000 7f555da3d640 0 -- 172.21.15.46:0/1595098298 >> [v2:172.21.15.46:6808/2698338376,v1:172.21.15.46:6811/2698338376] conn(0x563ed972f230 msgr2=0x563ed97316f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:07.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.655+0000 7f555d23c640 0 -- 172.21.15.46:0/1595098298 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f555405b040 msgr2=0x7f555405e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:50:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:50:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T14:50:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T14:50:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:50:07.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:50:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:50:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.861+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:50:07.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 zone default found 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 4 Realm: () 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 zonegroup default 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.862+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.863+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.863+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.863+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.863+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.864+0000 7f556202d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:50:07.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.864+0000 7f556202d800 20 started sync module instance, tier type = 2024-03-09T14:50:07.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.864+0000 7f556202d800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T14:50:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=0 2024-03-09T14:50:07.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=1 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=2 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=3 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=4 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=5 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.873+0000 7f556202d800 20 add_watcher() i=6 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.874+0000 7f556202d800 20 add_watcher() i=7 2024-03-09T14:50:07.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.874+0000 7f556202d800 2 all 8 watchers are set, enabling cache 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.876+0000 7f54137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.876+0000 7f556202d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.876+0000 7f556202d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.876+0000 7f556202d800 5 note: GC not initialized 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.876+0000 7f54127e4640 20 reqs_thread_entry: start 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.876+0000 7f556202d800 20 init_complete bucket index max shards: 1 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 20 Filter name: none 2024-03-09T14:50:07.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f5383fff640 20 reqs_thread_entry: start 2024-03-09T14:50:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-03-09T14:50:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 20 rados->read ofs=0 len=0 2024-03-09T14:50:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 20 rados_obj.operate() r=0 bl.length=494 2024-03-09T14:50:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-03-09T14:50:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.877+0000 7f556202d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:50:07.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.880+0000 7f556202d800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:07.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.880+0000 7f556202d800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:07.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.880+0000 7f556202d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-03-09T14:50:07.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.880+0000 7f5440ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497134 cookie 94827936166288 notifier 7815 bl.length()=695 2024-03-09T14:50:07.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.880+0000 7f5440ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:50:07.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.880+0000 7f5440ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:50:07.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.883+0000 7f54137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:50:07.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.885+0000 7f556202d800 20 remove_watcher() i=0 2024-03-09T14:50:07.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.885+0000 7f556202d800 2 removed watcher, disabling cache 2024-03-09T14:50:07.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.886+0000 7f556202d800 20 remove_watcher() i=1 2024-03-09T14:50:07.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.887+0000 7f556202d800 20 remove_watcher() i=2 2024-03-09T14:50:07.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.888+0000 7f556202d800 20 remove_watcher() i=3 2024-03-09T14:50:07.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.889+0000 7f556202d800 20 remove_watcher() i=4 2024-03-09T14:50:07.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.890+0000 7f556202d800 20 remove_watcher() i=5 2024-03-09T14:50:07.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.891+0000 7f556202d800 20 remove_watcher() i=6 2024-03-09T14:50:07.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T14:50:07.892+0000 7f556202d800 20 remove_watcher() i=7 2024-03-09T14:50:07.903 INFO:tasks.s3tests:Configuring s3-tests... 2024-03-09T14:50:07.905 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:50:07.905 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-03-09T14:50:07.932 INFO:tasks.s3tests:Configuring boto... 2024-03-09T14:50:07.932 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-03-09T14:50:07.932 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-03-09T14:50:08.000 DEBUG:teuthology.orchestra.run.smithi046:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-09T14:50:08.171 INFO:teuthology.orchestra.run.smithi046.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-03-09T14:50:08.362 INFO:teuthology.orchestra.run.smithi046.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-03-09T14:50:08.610 INFO:teuthology.orchestra.run.smithi046.stdout:py installdeps: -rrequirements.txt 2024-03-09T14:51:52.688 INFO:teuthology.orchestra.run.smithi046.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-03-09T14:51:54.410 INFO:teuthology.orchestra.run.smithi046.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.2.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.0,filelock==3.13.1,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.1.0,munch==4.0.0,packaging==23.2,platformdirs==4.2.0,pluggy==1.4.0,pyparsing==3.1.2,pyproject-api==1.6.1,pytest==8.1.1,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=828ee058aa3d610d5d5cb5bfc9cdbd341a6ec8c8222f401548ad2ea8f7b9f117,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.14.1,urllib3==1.26.18,virtualenv==20.25.1,zope.event==5.0,zope.interface==6.2 2024-03-09T14:51:54.411 INFO:teuthology.orchestra.run.smithi046.stdout:py run-test-pre: PYTHONHASHSEED='3589580310' 2024-03-09T14:51:54.411 INFO:teuthology.orchestra.run.smithi046.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-09T14:51:54.562 INFO:teuthology.orchestra.run.smithi046.stdout:============================= test session starts ============================== 2024-03-09T14:51:54.562 INFO:teuthology.orchestra.run.smithi046.stdout:platform linux -- Python 3.9.17, pytest-8.1.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-03-09T14:51:54.563 INFO:teuthology.orchestra.run.smithi046.stdout:cachedir: .tox/py/.pytest_cache 2024-03-09T14:51:54.563 INFO:teuthology.orchestra.run.smithi046.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T14:51:54.563 INFO:teuthology.orchestra.run.smithi046.stdout:configfile: pytest.ini 2024-03-09T14:51:56.391 INFO:teuthology.orchestra.run.smithi046.stdout:collecting ... collected 850 items / 124 deselected / 726 selected 2024-03-09T14:51:56.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T14:51:57.058 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none FAILED [ 0%] 2024-03-09T14:51:57.364 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty FAILED [ 0%] 2024-03-09T14:51:57.661 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-03-09T14:51:57.961 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-03-09T14:51:58.284 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none FAILED [ 0%] 2024-03-09T14:51:58.507 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-03-09T14:51:58.856 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-03-09T14:51:59.084 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-03-09T14:51:59.325 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty FAILED [ 1%] 2024-03-09T14:51:59.558 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none FAILED [ 1%] 2024-03-09T14:51:59.866 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 FAILED [ 1%] 2024-03-09T14:52:00.172 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 FAILED [ 1%] 2024-03-09T14:52:00.476 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 FAILED [ 1%] 2024-03-09T14:52:00.783 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 FAILED [ 1%] 2024-03-09T14:52:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 FAILED [ 2%] 2024-03-09T14:52:01.463 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-09T14:52:01.544 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-03-09T14:52:01.626 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-03-09T14:52:01.709 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-03-09T14:52:01.790 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-03-09T14:52:01.873 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-03-09T14:52:01.955 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.037 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.121 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.203 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.286 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.368 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.450 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.531 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-03-09T14:52:02.613 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-03-09T14:52:02.694 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-03-09T14:52:02.777 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-03-09T14:52:02.875 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-09T14:52:02.959 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-09T14:52:03.042 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-03-09T14:52:03.125 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-03-09T14:52:03.208 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.290 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.373 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.455 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.539 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.621 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.704 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:52:03.787 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-03-09T14:52:03.871 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-03-09T14:52:03.955 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-03-09T14:52:04.038 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-03-09T14:52:04.121 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-03-09T14:52:04.205 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-03-09T14:52:04.294 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-03-09T14:52:04.374 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2024-03-09T14:52:04.458 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-09T14:52:04.541 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-09T14:52:05.353 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-03-09T14:52:14.442 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-03-09T14:52:22.233 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-03-09T14:52:39.425 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-03-09T14:53:01.127 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-03-09T14:53:07.644 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-03-09T14:53:13.445 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-03-09T14:53:15.067 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-03-09T14:53:15.376 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-03-09T14:53:16.308 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-03-09T14:53:17.543 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-03-09T14:53:18.667 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-03-09T14:53:19.281 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-03-09T14:53:19.851 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-03-09T14:53:19.852 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-03-09T14:53:19.852 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-03-09T14:53:19.853 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-03-09T14:53:19.855 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-03-09T14:53:19.856 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-03-09T14:53:19.857 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 10%] 2024-03-09T14:53:19.858 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:53:19.859 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:53:19.860 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:53:19.861 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:53:19.862 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-03-09T14:53:19.863 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-03-09T14:53:19.864 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.865 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.866 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.867 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.868 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.870 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.871 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:53:19.873 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-03-09T14:53:19.874 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 12%] 2024-03-09T14:53:19.876 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 12%] 2024-03-09T14:53:19.877 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-03-09T14:53:19.878 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-03-09T14:53:19.879 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-03-09T14:53:19.880 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-03-09T14:53:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-03-09T14:53:19.984 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 13%] 2024-03-09T14:53:20.000 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 13%] 2024-03-09T14:53:21.308 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-03-09T14:53:27.090 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-03-09T14:53:28.176 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-03-09T14:53:29.477 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-03-09T14:53:30.716 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-03-09T14:53:31.974 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 14%] 2024-03-09T14:53:33.222 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 14%] 2024-03-09T14:53:34.318 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 14%] 2024-03-09T14:53:35.568 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-03-09T14:53:36.716 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-03-09T14:53:37.916 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-03-09T14:53:39.014 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-03-09T14:53:40.000 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 15%] 2024-03-09T14:53:40.982 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 15%] 2024-03-09T14:53:41.854 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 15%] 2024-03-09T14:53:42.940 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-03-09T14:53:44.158 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-03-09T14:53:45.335 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-03-09T14:53:46.421 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-03-09T14:53:47.509 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-03-09T14:53:48.604 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-03-09T14:53:49.729 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-03-09T14:53:50.801 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 16%] 2024-03-09T14:53:51.778 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-03-09T14:53:52.757 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-03-09T14:53:53.650 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-03-09T14:53:54.507 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-03-09T14:53:55.368 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 17%] 2024-03-09T14:53:56.260 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 17%] 2024-03-09T14:53:57.138 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-03-09T14:53:58.127 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-03-09T14:53:58.986 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-03-09T14:53:59.876 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-03-09T14:54:00.906 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-03-09T14:54:01.939 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 18%] 2024-03-09T14:54:02.803 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:54:03.815 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 18%] 2024-03-09T14:54:04.825 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:54:05.988 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-03-09T14:54:06.932 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-03-09T14:54:07.935 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:54:08.994 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 19%] 2024-03-09T14:54:10.327 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 19%] 2024-03-09T14:54:11.571 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:54:12.729 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:54:14.019 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:54:15.414 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:54:17.715 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:54:20.003 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:54:21.409 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 20%] 2024-03-09T14:54:22.773 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 20%] 2024-03-09T14:54:24.011 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 20%] 2024-03-09T14:54:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 20%] 2024-03-09T14:54:26.467 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-03-09T14:54:28.451 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-03-09T14:54:29.928 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-03-09T14:54:31.577 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 21%] 2024-03-09T14:54:34.464 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 21%] 2024-03-09T14:54:38.069 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 21%] 2024-03-09T14:54:40.295 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 21%] 2024-03-09T14:54:42.393 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-03-09T14:54:44.098 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-03-09T14:54:45.412 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-03-09T14:54:47.356 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 22%] 2024-03-09T14:54:48.872 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 22%] 2024-03-09T14:54:50.726 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 22%] 2024-03-09T14:54:52.157 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 22%] 2024-03-09T14:54:54.413 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 22%] 2024-03-09T14:54:56.307 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-03-09T14:54:58.726 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-03-09T14:55:01.142 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 23%] 2024-03-09T14:55:02.999 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 23%] 2024-03-09T14:55:04.713 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 23%] 2024-03-09T14:55:06.183 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 23%] 2024-03-09T14:55:09.058 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 23%] 2024-03-09T14:55:11.248 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-03-09T14:55:13.701 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-03-09T14:55:16.035 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-03-09T14:55:18.290 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 24%] 2024-03-09T14:55:20.588 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 24%] 2024-03-09T14:55:22.509 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 24%] 2024-03-09T14:55:24.021 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 24%] 2024-03-09T14:55:25.675 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 24%] 2024-03-09T14:55:28.288 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-03-09T14:55:31.558 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-03-09T14:55:33.307 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 25%] 2024-03-09T14:55:35.603 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 25%] 2024-03-09T14:55:37.876 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 25%] 2024-03-09T14:55:40.142 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:55:42.582 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:55:45.160 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:55:47.599 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-03-09T14:55:49.946 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 26%] 2024-03-09T14:55:51.592 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 26%] 2024-03-09T14:55:53.816 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-03-09T14:55:56.079 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-03-09T14:55:58.324 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-03-09T14:56:00.516 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-03-09T14:56:02.781 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-03-09T14:56:04.972 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-03-09T14:56:07.157 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 27%] 2024-03-09T14:56:09.429 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 27%] 2024-03-09T14:56:11.666 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-03-09T14:56:13.909 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-03-09T14:56:16.092 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-03-09T14:56:18.342 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-03-09T14:56:20.074 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-03-09T14:56:21.760 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 28%] 2024-03-09T14:56:23.361 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 28%] 2024-03-09T14:56:24.973 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-03-09T14:56:26.051 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-03-09T14:56:27.412 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-03-09T14:56:28.712 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-03-09T14:56:30.033 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-03-09T14:56:31.321 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 29%] 2024-03-09T14:56:32.593 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 29%] 2024-03-09T14:56:33.905 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 29%] 2024-03-09T14:56:35.179 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-03-09T14:56:36.469 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-03-09T14:56:38.464 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-03-09T14:56:40.505 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-03-09T14:56:41.677 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 30%] 2024-03-09T14:56:42.854 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 30%] 2024-03-09T14:56:44.149 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 30%] 2024-03-09T14:56:45.463 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-03-09T14:56:47.459 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-03-09T14:56:49.482 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-03-09T14:56:50.754 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-03-09T14:56:52.043 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-03-09T14:56:53.369 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 31%] 2024-03-09T14:56:54.662 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 31%] 2024-03-09T14:56:55.934 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 31%] 2024-03-09T14:56:57.222 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-03-09T14:56:58.498 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-03-09T14:56:59.830 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-03-09T14:57:01.115 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-03-09T14:57:02.406 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 32%] 2024-03-09T14:57:03.684 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 32%] 2024-03-09T14:57:04.975 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 32%] 2024-03-09T14:57:06.258 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-03-09T14:57:07.513 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-03-09T14:57:08.753 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-03-09T14:57:10.046 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-03-09T14:57:11.342 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 33%] 2024-03-09T14:57:57.187 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 33%] 2024-03-09T14:57:58.428 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 33%] 2024-03-09T14:57:59.716 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 33%] 2024-03-09T14:58:00.968 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-03-09T14:58:02.218 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-03-09T14:58:03.451 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-03-09T14:58:04.719 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 34%] 2024-03-09T14:58:05.991 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 34%] 2024-03-09T14:58:07.237 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 34%] 2024-03-09T14:58:08.480 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 34%] 2024-03-09T14:58:09.738 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-03-09T14:58:10.979 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-03-09T14:58:12.255 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-03-09T14:58:13.534 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-03-09T14:58:14.821 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 35%] 2024-03-09T14:58:16.095 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 35%] 2024-03-09T14:58:17.407 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 35%] 2024-03-09T14:58:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-03-09T14:58:19.988 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-03-09T14:58:21.267 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-03-09T14:58:22.540 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-03-09T14:58:23.874 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 36%] 2024-03-09T14:58:25.168 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 36%] 2024-03-09T14:58:26.511 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 36%] 2024-03-09T14:58:27.857 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 36%] 2024-03-09T14:58:29.139 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-03-09T14:58:30.442 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-03-09T14:58:31.757 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-03-09T14:58:33.046 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 37%] 2024-03-09T14:58:33.936 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 37%] 2024-03-09T14:58:35.116 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 37%] 2024-03-09T14:58:37.600 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 37%] 2024-03-09T14:58:40.112 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 37%] 2024-03-09T14:58:41.382 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-03-09T14:58:42.655 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-03-09T14:58:43.979 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 38%] 2024-03-09T14:58:45.265 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 38%] 2024-03-09T14:58:46.606 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 38%] 2024-03-09T14:58:47.953 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 38%] 2024-03-09T14:58:49.247 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 38%] 2024-03-09T14:58:50.548 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-03-09T14:58:51.860 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-03-09T14:58:53.156 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-03-09T14:58:54.426 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 39%] 2024-03-09T14:58:55.718 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 39%] 2024-03-09T14:58:57.304 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 39%] 2024-03-09T14:58:59.204 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 39%] 2024-03-09T14:59:00.397 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-03-09T14:59:01.575 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-03-09T14:59:02.657 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-03-09T14:59:03.733 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 40%] 2024-03-09T14:59:04.629 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 40%] 2024-03-09T14:59:05.493 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 40%] 2024-03-09T14:59:06.369 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 40%] 2024-03-09T14:59:07.541 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 40%] 2024-03-09T14:59:12.326 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-03-09T14:59:13.189 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-03-09T14:59:14.354 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 41%] 2024-03-09T14:59:15.409 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 41%] 2024-03-09T14:59:16.483 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 41%] 2024-03-09T14:59:17.557 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 41%] 2024-03-09T14:59:20.539 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 41%] 2024-03-09T14:59:21.993 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-03-09T14:59:23.406 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-03-09T15:00:10.102 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 42%] 2024-03-09T15:00:55.883 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 42%] 2024-03-09T15:00:57.034 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 42%] 2024-03-09T15:00:58.180 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 42%] 2024-03-09T15:00:59.367 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 42%] 2024-03-09T15:01:00.554 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 42%] 2024-03-09T15:01:01.872 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-03-09T15:01:03.046 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-03-09T15:01:04.230 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 43%] 2024-03-09T15:01:05.563 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 43%] 2024-03-09T15:01:06.773 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 43%] 2024-03-09T15:01:08.006 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 43%] 2024-03-09T15:01:09.289 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 43%] 2024-03-09T15:01:10.656 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-03-09T15:01:11.858 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-03-09T15:01:12.959 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 44%] 2024-03-09T15:01:14.112 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 44%] 2024-03-09T15:01:15.259 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 44%] 2024-03-09T15:01:17.391 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 44%] 2024-03-09T15:01:18.641 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 44%] 2024-03-09T15:01:19.795 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 44%] 2024-03-09T15:01:21.043 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-03-09T15:01:22.284 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 45%] 2024-03-09T15:01:23.518 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 45%] 2024-03-09T15:01:24.657 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 45%] 2024-03-09T15:01:25.779 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 45%] 2024-03-09T15:01:26.876 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 45%] 2024-03-09T15:01:27.977 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 45%] 2024-03-09T15:01:29.095 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-03-09T15:01:30.195 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 46%] 2024-03-09T15:01:31.498 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 46%] 2024-03-09T15:01:32.596 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 46%] 2024-03-09T15:01:33.713 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 46%] 2024-03-09T15:01:34.832 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 46%] 2024-03-09T15:01:35.934 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 46%] 2024-03-09T15:01:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 46%] 2024-03-09T15:01:38.399 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-03-09T15:01:39.493 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 47%] 2024-03-09T15:01:40.593 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 47%] 2024-03-09T15:01:41.728 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 47%] 2024-03-09T15:01:42.832 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 47%] 2024-03-09T15:01:43.936 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 47%] 2024-03-09T15:01:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 47%] 2024-03-09T15:01:47.321 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-03-09T15:01:48.430 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 48%] 2024-03-09T15:01:49.646 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 48%] 2024-03-09T15:01:50.891 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 48%] 2024-03-09T15:01:52.064 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 48%] 2024-03-09T15:01:53.311 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 48%] 2024-03-09T15:01:54.525 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 48%] 2024-03-09T15:01:56.808 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 48%] 2024-03-09T15:01:58.021 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 49%] 2024-03-09T15:01:59.233 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 49%] 2024-03-09T15:02:00.600 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 49%] 2024-03-09T15:02:01.946 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 49%] 2024-03-09T15:02:03.259 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 49%] 2024-03-09T15:02:04.453 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 49%] 2024-03-09T15:02:05.770 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 49%] 2024-03-09T15:02:07.138 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 50%] 2024-03-09T15:02:08.397 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 50%] 2024-03-09T15:02:09.755 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 50%] 2024-03-09T15:02:10.946 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 50%] 2024-03-09T15:02:12.070 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 50%] 2024-03-09T15:02:13.227 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 50%] 2024-03-09T15:02:14.470 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 50%] 2024-03-09T15:02:15.546 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-03-09T15:02:16.428 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 51%] 2024-03-09T15:02:17.802 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 51%] 2024-03-09T15:02:18.967 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 51%] 2024-03-09T15:02:20.144 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 51%] 2024-03-09T15:02:23.862 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 51%] 2024-03-09T15:02:25.029 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 51%] 2024-03-09T15:02:26.219 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 51%] 2024-03-09T15:02:27.392 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 52%] 2024-03-09T15:02:28.571 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 52%] 2024-03-09T15:02:29.717 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 52%] 2024-03-09T15:02:30.888 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 52%] 2024-03-09T15:02:32.263 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 52%] 2024-03-09T15:02:33.599 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 52%] 2024-03-09T15:02:34.795 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 52%] 2024-03-09T15:02:35.996 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 53%] 2024-03-09T15:02:37.264 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 53%] 2024-03-09T15:02:38.488 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 53%] 2024-03-09T15:02:39.740 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 53%] 2024-03-09T15:02:40.895 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 53%] 2024-03-09T15:02:42.197 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 53%] 2024-03-09T15:02:43.475 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 53%] 2024-03-09T15:02:44.788 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 53%] 2024-03-09T15:02:45.656 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 54%] 2024-03-09T15:02:46.537 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 54%] 2024-03-09T15:02:47.395 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 54%] 2024-03-09T15:02:48.391 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 54%] 2024-03-09T15:02:49.372 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 54%] 2024-03-09T15:02:50.348 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 54%] 2024-03-09T15:02:51.395 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 54%] 2024-03-09T15:02:52.461 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 55%] 2024-03-09T15:02:53.320 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 55%] 2024-03-09T15:02:54.170 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 55%] 2024-03-09T15:02:55.145 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 55%] 2024-03-09T15:02:56.016 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 55%] 2024-03-09T15:02:56.896 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 55%] 2024-03-09T15:02:57.796 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 55%] 2024-03-09T15:02:58.654 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 56%] 2024-03-09T15:02:59.689 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 56%] 2024-03-09T15:03:00.742 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 56%] 2024-03-09T15:03:01.836 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 56%] 2024-03-09T15:03:02.876 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 56%] 2024-03-09T15:03:03.967 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 56%] 2024-03-09T15:03:05.042 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 56%] 2024-03-09T15:03:06.083 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 57%] 2024-03-09T15:03:07.241 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 57%] 2024-03-09T15:03:08.299 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 57%] 2024-03-09T15:03:09.343 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 57%] 2024-03-09T15:03:10.590 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 57%] 2024-03-09T15:03:11.819 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 57%] 2024-03-09T15:03:13.133 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 57%] 2024-03-09T15:03:14.338 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 57%] 2024-03-09T15:03:15.545 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 58%] 2024-03-09T15:03:16.857 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 58%] 2024-03-09T15:03:18.124 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 58%] 2024-03-09T15:03:19.445 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 58%] 2024-03-09T15:03:20.768 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 58%] 2024-03-09T15:03:21.881 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 58%] 2024-03-09T15:03:23.185 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 58%] 2024-03-09T15:03:24.484 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 59%] 2024-03-09T15:03:25.847 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 59%] 2024-03-09T15:03:27.184 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 59%] 2024-03-09T15:03:28.488 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 59%] 2024-03-09T15:03:30.262 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 59%] 2024-03-09T15:03:31.906 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 59%] 2024-03-09T15:03:33.563 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 59%] 2024-03-09T15:03:35.261 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 60%] 2024-03-09T15:03:36.903 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 60%] 2024-03-09T15:03:38.088 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 60%] 2024-03-09T15:03:39.306 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 60%] 2024-03-09T15:03:40.546 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 60%] 2024-03-09T15:03:41.863 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 60%] 2024-03-09T15:03:43.036 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 60%] 2024-03-09T15:03:44.350 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 61%] 2024-03-09T15:03:46.049 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 61%] 2024-03-09T15:03:47.834 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 61%] 2024-03-09T15:03:49.534 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 61%] 2024-03-09T15:03:51.249 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 61%] 2024-03-09T15:03:52.979 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 61%] 2024-03-09T15:03:54.717 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 61%] 2024-03-09T15:03:56.434 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 61%] 2024-03-09T15:03:58.143 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 62%] 2024-03-09T15:03:59.840 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 62%] 2024-03-09T15:04:01.414 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 62%] 2024-03-09T15:04:03.038 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 62%] 2024-03-09T15:04:04.616 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 62%] 2024-03-09T15:04:06.422 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 62%] 2024-03-09T15:04:08.129 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 62%] 2024-03-09T15:04:08.991 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 63%] 2024-03-09T15:04:09.896 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 63%] 2024-03-09T15:04:10.765 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 63%] 2024-03-09T15:04:11.968 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 63%] 2024-03-09T15:04:13.138 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 63%] 2024-03-09T15:04:14.131 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 63%] 2024-03-09T15:04:15.107 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 63%] 2024-03-09T15:04:16.504 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 64%] 2024-03-09T15:04:19.383 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 64%] 2024-03-09T15:04:20.817 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 64%] 2024-03-09T15:04:22.150 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 64%] 2024-03-09T15:04:26.236 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 64%] 2024-03-09T15:04:27.625 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 64%] 2024-03-09T15:04:28.948 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 64%] 2024-03-09T15:04:30.186 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 65%] 2024-03-09T15:04:31.430 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 65%] 2024-03-09T15:04:33.054 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 65%] 2024-03-09T15:04:34.427 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 65%] 2024-03-09T15:04:36.070 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 65%] 2024-03-09T15:04:37.574 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 65%] 2024-03-09T15:04:39.663 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 65%] 2024-03-09T15:04:41.603 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 65%] 2024-03-09T15:04:42.751 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 66%] 2024-03-09T15:04:43.839 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 66%] 2024-03-09T15:04:46.657 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 66%] 2024-03-09T15:04:48.115 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 66%] 2024-03-09T15:05:13.204 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 66%] 2024-03-09T15:05:14.395 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 66%] 2024-03-09T15:05:15.857 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 66%] 2024-03-09T15:05:19.715 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 67%] 2024-03-09T15:05:21.078 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 67%] 2024-03-09T15:05:23.061 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 67%] 2024-03-09T15:05:33.796 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 67%] 2024-03-09T15:05:54.479 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 67%] 2024-03-09T15:06:25.068 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 67%] 2024-03-09T15:08:22.038 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 67%] 2024-03-09T15:08:34.728 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 68%] 2024-03-09T15:09:00.254 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 68%] 2024-03-09T15:09:01.906 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 68%] 2024-03-09T15:09:09.108 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 68%] 2024-03-09T15:09:14.695 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 68%] 2024-03-09T15:09:17.968 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 68%] 2024-03-09T15:09:19.198 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 68%] 2024-03-09T15:09:23.995 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 69%] 2024-03-09T15:09:25.424 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 69%] 2024-03-09T15:09:26.624 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 69%] 2024-03-09T15:09:27.831 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 69%] 2024-03-09T15:09:47.776 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 69%] 2024-03-09T15:09:49.048 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 69%] 2024-03-09T15:09:50.252 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 69%] 2024-03-09T15:09:51.550 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 69%] 2024-03-09T15:09:59.522 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 70%] 2024-03-09T15:10:03.885 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 70%] 2024-03-09T15:10:08.171 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 70%] 2024-03-09T15:10:09.522 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 70%] 2024-03-09T15:10:10.883 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 70%] 2024-03-09T15:10:12.231 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 70%] 2024-03-09T15:10:13.561 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 70%] 2024-03-09T15:10:14.886 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 71%] 2024-03-09T15:10:16.285 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 71%] 2024-03-09T15:10:17.545 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 71%] 2024-03-09T15:10:19.672 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 71%] 2024-03-09T15:10:23.640 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 71%] 2024-03-09T15:10:30.668 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 71%] 2024-03-09T15:10:33.208 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 71%] 2024-03-09T15:10:38.257 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 72%] 2024-03-09T15:10:47.490 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 72%] 2024-03-09T15:10:49.698 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 72%] 2024-03-09T15:10:54.101 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 72%] 2024-03-09T15:11:01.152 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 72%] 2024-03-09T15:11:03.420 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 72%] 2024-03-09T15:11:04.806 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 72%] 2024-03-09T15:11:06.593 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 73%] 2024-03-09T15:11:07.860 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 73%] 2024-03-09T15:11:15.638 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 73%] 2024-03-09T15:11:16.858 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 73%] 2024-03-09T15:11:18.078 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 73%] 2024-03-09T15:11:19.293 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 73%] 2024-03-09T15:11:20.551 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 73%] 2024-03-09T15:11:22.259 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 73%] 2024-03-09T15:11:33.979 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 74%] 2024-03-09T15:11:35.717 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 74%] 2024-03-09T15:11:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 74%] 2024-03-09T15:11:38.991 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 74%] 2024-03-09T15:11:40.900 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 74%] 2024-03-09T15:11:46.335 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 74%] 2024-03-09T15:11:48.117 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 74%] 2024-03-09T15:11:54.451 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 75%] 2024-03-09T15:12:16.099 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 75%] 2024-03-09T15:12:55.038 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 75%] 2024-03-09T15:12:57.900 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 75%] 2024-03-09T15:13:00.794 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 75%] 2024-03-09T15:13:02.409 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 75%] 2024-03-09T15:13:04.115 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 75%] 2024-03-09T15:13:05.466 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 76%] 2024-03-09T15:13:07.292 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 76%] 2024-03-09T15:13:09.003 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 76%] 2024-03-09T15:13:11.918 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 76%] 2024-03-09T15:13:13.125 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 76%] 2024-03-09T15:13:14.277 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 76%] 2024-03-09T15:13:15.427 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 76%] 2024-03-09T15:13:16.498 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 76%] 2024-03-09T15:13:17.581 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 77%] 2024-03-09T15:13:18.784 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 77%] 2024-03-09T15:13:19.905 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 77%] 2024-03-09T15:13:20.996 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 77%] 2024-03-09T15:13:22.244 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 77%] 2024-03-09T15:13:23.329 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 77%] 2024-03-09T15:13:24.412 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 77%] 2024-03-09T15:13:25.500 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 78%] 2024-03-09T15:13:26.662 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 78%] 2024-03-09T15:13:27.734 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 78%] 2024-03-09T15:13:28.962 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 78%] 2024-03-09T15:13:30.183 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 78%] 2024-03-09T15:13:31.873 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 78%] 2024-03-09T15:13:33.086 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 78%] 2024-03-09T15:13:34.356 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 79%] 2024-03-09T15:13:35.596 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 79%] 2024-03-09T15:13:36.845 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 79%] 2024-03-09T15:13:37.919 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 79%] 2024-03-09T15:13:39.005 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 79%] 2024-03-09T15:13:40.089 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 79%] 2024-03-09T15:13:41.212 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 79%] 2024-03-09T15:14:32.180 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 80%] 2024-03-09T15:15:23.196 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 80%] 2024-03-09T15:15:33.926 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 80%] 2024-03-09T15:15:35.227 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 80%] 2024-03-09T15:15:36.497 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 80%] 2024-03-09T15:15:37.714 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 80%] 2024-03-09T15:15:38.799 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 80%] 2024-03-09T15:15:39.925 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 80%] 2024-03-09T15:16:12.775 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 81%] 2024-03-09T15:16:22.401 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 81%] 2024-03-09T15:16:32.052 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 81%] 2024-03-09T15:16:33.293 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 81%] 2024-03-09T15:16:34.512 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 81%] 2024-03-09T15:16:35.764 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 81%] 2024-03-09T15:16:37.433 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 81%] 2024-03-09T15:16:38.681 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 82%] 2024-03-09T15:16:39.895 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 82%] 2024-03-09T15:16:41.210 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 82%] 2024-03-09T15:16:42.494 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 82%] 2024-03-09T15:16:43.866 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 82%] 2024-03-09T15:16:45.289 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 82%] 2024-03-09T15:16:47.086 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 82%] 2024-03-09T15:16:48.844 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 83%] 2024-03-09T15:16:51.651 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 83%] 2024-03-09T15:16:54.320 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 83%] 2024-03-09T15:16:57.146 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 83%] 2024-03-09T15:16:59.888 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 83%] 2024-03-09T15:17:02.582 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 83%] 2024-03-09T15:17:05.308 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 83%] 2024-03-09T15:17:08.216 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 84%] 2024-03-09T15:17:11.539 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 84%] 2024-03-09T15:17:14.869 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 84%] 2024-03-09T15:17:16.152 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 84%] 2024-03-09T15:17:17.423 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 84%] 2024-03-09T15:17:18.695 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 84%] 2024-03-09T15:17:21.519 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 84%] 2024-03-09T15:17:24.343 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 84%] 2024-03-09T15:17:27.239 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 85%] 2024-03-09T15:17:29.364 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 85%] 2024-03-09T15:17:50.831 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 85%] 2024-03-09T15:17:52.529 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 85%] 2024-03-09T15:17:54.206 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 85%] 2024-03-09T15:17:55.811 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 85%] 2024-03-09T15:17:57.792 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 85%] 2024-03-09T15:17:59.571 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 86%] 2024-03-09T15:18:00.926 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 86%] 2024-03-09T15:18:02.669 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 86%] 2024-03-09T15:18:03.750 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 86%] 2024-03-09T15:18:04.837 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 86%] 2024-03-09T15:18:05.917 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 86%] 2024-03-09T15:18:07.021 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 86%] 2024-03-09T15:18:08.312 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 87%] 2024-03-09T15:18:09.445 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 87%] 2024-03-09T15:18:11.114 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 87%] 2024-03-09T15:18:12.271 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 87%] 2024-03-09T15:18:13.329 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 87%] 2024-03-09T15:18:14.422 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 87%] 2024-03-09T15:18:15.467 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 87%] 2024-03-09T15:18:16.510 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 88%] 2024-03-09T15:18:17.665 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 88%] 2024-03-09T15:18:18.706 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 88%] 2024-03-09T15:18:19.752 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 88%] 2024-03-09T15:18:20.820 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 88%] 2024-03-09T15:18:21.956 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 88%] 2024-03-09T15:18:23.156 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 88%] 2024-03-09T15:18:24.300 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-09T15:18:25.531 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 89%] 2024-03-09T15:18:26.776 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 89%] 2024-03-09T15:18:27.935 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 89%] 2024-03-09T15:18:29.120 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 89%] 2024-03-09T15:18:30.412 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 89%] 2024-03-09T15:18:31.644 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 89%] 2024-03-09T15:18:32.917 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 89%] 2024-03-09T15:18:34.102 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 90%] 2024-03-09T15:18:35.327 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 90%] 2024-03-09T15:18:36.567 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 90%] 2024-03-09T15:18:37.926 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 90%] 2024-03-09T15:18:39.178 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 90%] 2024-03-09T15:18:40.349 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 90%] 2024-03-09T15:18:41.516 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-09T15:18:42.689 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 91%] 2024-03-09T15:18:43.981 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 91%] 2024-03-09T15:18:45.169 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 91%] 2024-03-09T15:18:46.414 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 91%] 2024-03-09T15:18:47.585 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 91%] 2024-03-09T15:18:48.825 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-03-09T15:18:49.977 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-03-09T15:19:00.918 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 92%] 2024-03-09T15:19:02.171 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 92%] 2024-03-09T15:19:12.586 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 92%] 2024-03-09T15:19:13.881 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 92%] 2024-03-09T15:19:15.183 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 92%] 2024-03-09T15:19:16.260 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-03-09T15:19:17.476 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-03-09T15:19:18.620 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-03-09T15:19:19.795 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 93%] 2024-03-09T15:19:20.974 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 93%] 2024-03-09T15:19:22.150 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 93%] 2024-03-09T15:19:23.338 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 93%] 2024-03-09T15:19:24.618 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 93%] 2024-03-09T15:19:25.745 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-03-09T15:19:27.076 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-03-09T15:19:28.362 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 94%] 2024-03-09T15:19:29.493 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 94%] 2024-03-09T15:19:30.974 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 94%] 2024-03-09T15:19:43.323 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 94%] 2024-03-09T15:19:44.394 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:19:45.561 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:19:46.774 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:19:48.065 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 95%] 2024-03-09T15:19:50.597 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 95%] 2024-03-09T15:20:01.712 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 95%] 2024-03-09T15:20:12.611 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-03-09T15:20:14.071 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-03-09T15:20:15.784 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-03-09T15:20:31.018 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-03-09T15:20:52.928 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 96%] 2024-03-09T15:20:57.030 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 96%] 2024-03-09T15:21:01.891 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 96%] 2024-03-09T15:21:04.654 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 96%] 2024-03-09T15:21:07.164 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-03-09T15:21:08.532 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-03-09T15:21:13.255 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-03-09T15:21:18.760 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-03-09T15:22:32.487 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 97%] 2024-03-09T15:22:36.477 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 97%] 2024-03-09T15:22:39.180 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 97%] 2024-03-09T15:22:41.751 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-03-09T15:22:43.515 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-03-09T15:22:50.569 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-03-09T15:22:54.572 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-03-09T15:22:56.408 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 98%] 2024-03-09T15:22:58.450 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 98%] 2024-03-09T15:23:04.809 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 98%] 2024-03-09T15:23:08.985 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 98%] 2024-03-09T15:23:15.569 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-03-09T15:23:18.093 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-03-09T15:23:18.890 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-03-09T15:23:23.542 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 99%] 2024-03-09T15:23:33.282 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 99%] 2024-03-09T15:23:38.367 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 99%] 2024-03-09T15:23:42.784 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 99%] 2024-03-09T15:23:44.808 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-03-09T15:24:28.773 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-03-09T15:24:29.533 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-03-09T15:24:29.561 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-03-09T15:24:29.561 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout:=================================== FAILURES =================================== 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout:__________________ test_object_create_bad_contentlength_none ___________________ 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_common 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_contentlength_none(): 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object(remove=('Content-Length',)) 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:180: 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.562 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.563 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.564 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.565 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:__________________ test_object_create_bad_authorization_empty __________________ 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_common 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_authorization_empty(): 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object({'Authorization': ''}) 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:210: 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.567 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.568 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.569 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.569 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.569 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.569 INFO:teuthology.orchestra.run.smithi046.stdout:__________________ test_object_create_bad_authorization_none ___________________ 2024-03-09T15:24:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.569 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_common 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_authorization_none(): 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object(remove=('Authorization',)) 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:236: 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.570 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.571 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.572 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout:__________________ test_bucket_create_bad_authorization_empty __________________ 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_common 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.573 INFO:teuthology.orchestra.run.smithi046.stdout: def test_bucket_create_bad_authorization_empty(): 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: _add_custom_headers({'Authorization': ''}) 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:294: 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = , args = () 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.574 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.575 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout:__________________ test_bucket_create_bad_authorization_none ___________________ 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.576 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_common 2024-03-09T15:24:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: def test_bucket_create_bad_authorization_none(): 2024-03-09T15:24:29.577 INFO:teuthology.orchestra.run.smithi046.stdout: _add_custom_headers(remove=('Authorization',)) 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:305: 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = , args = () 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.578 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.579 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.580 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.580 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.580 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.580 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.580 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout:___________ test_object_create_bad_contentlength_mismatch_below_aws2 ___________ 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_aws2 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_contentlength_mismatch_below_aws2(): 2024-03-09T15:24:29.581 INFO:teuthology.orchestra.run.smithi046.stdout: check_aws2_support() 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: content = 'bar' 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: length = len(content) - 1 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object({'Content-Length': length}) 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, content) 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:321: 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.582 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.583 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.584 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout:_____________ test_object_create_bad_authorization_incorrect_aws2 ______________ 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_aws2 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_authorization_incorrect_aws2(): 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: check_aws2_support() 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object({'Authorization': 'AWS AKIAIGR7ZNNBHC5BKSUB:FWeDfwojDSdS2Ztmpfeubhd9isU='}) 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:332: 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.586 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.587 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout:______________ test_object_create_bad_authorization_invalid_aws2 _______________ 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_aws2 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_authorization_invalid_aws2(): 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: check_aws2_support() 2024-03-09T15:24:29.588 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object({'Authorization': 'AWS HAHAHA'}) 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:343: 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.589 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.590 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout:____________________ test_object_create_bad_date_none_aws2 _____________________ 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_aws2 2024-03-09T15:24:29.591 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: def test_object_create_bad_date_none_aws2(): 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: check_aws2_support() 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: key = _setup_bad_object(remove=('Date',)) 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:353: 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = > 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.592 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.593 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket key 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.594 INFO:teuthology.orchestra.run.smithi046.stdout:______________ test_bucket_create_bad_authorization_invalid_aws2 _______________ 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_aws2 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: def test_bucket_create_bad_authorization_invalid_aws2(): 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: check_aws2_support() 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: _add_custom_headers({'Authorization': 'AWS HAHAHA'}) 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:363: 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = , args = () 2024-03-09T15:24:29.595 INFO:teuthology.orchestra.run.smithi046.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.596 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.597 INFO:teuthology.orchestra.run.smithi046.stdout:____________________ test_bucket_create_bad_date_none_aws2 _____________________ 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.auth_aws2 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: def test_bucket_create_bad_date_none_aws2(): 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: check_aws2_support() 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: _add_custom_headers(remove=('Date',)) 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:373: 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout:excClass = 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout:callableObj = , args = () 2024-03-09T15:24:29.598 INFO:teuthology.orchestra.run.smithi046.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: """ 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: try: 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: callableObj(*args, **kwargs) 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: except excClass as e: 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: return e 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: excName = excClass.__name__ 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: else: 2024-03-09T15:24:29.599 INFO:teuthology.orchestra.run.smithi046.stdout: excName = str(excClass) 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on main 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection main prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:prefix= test-client.0-x8fwiz1uawf297x- 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning bucket 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on alt 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting buckets on tenant 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x8fwiz1uawf297x-'. 2024-03-09T15:24:29.600 INFO:teuthology.orchestra.run.smithi046.stdout:Done with cleanup of test buckets. 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout:=============================== warnings summary =============================== 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: import imp 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:124 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: if boto_type is 'S3Connection': 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_headers.py:129 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: elif boto_type is 'HTTPRequest': 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.601 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3.py:359 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py:176 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: if k is 'BucketName': 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py:253 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.timeout(10) 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.602 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests/functional/test_s3_website.py:1077 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: @pytest.mark.s3website_routing_rules 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2212 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2227 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2233 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.603 INFO:teuthology.orchestra.run.smithi046.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2290 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2305 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2323 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:24:29.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2338 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2356 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2371 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.605 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2421 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py:2453 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_iam.py: 79 warnings 2024-03-09T15:24:29.606 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3.py: 484 warnings 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi046.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: warnings.warn( 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:=========================== short test summary info ============================ 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_none 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 2024-03-09T15:24:29.607 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 2024-03-09T15:24:29.608 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 2024-03-09T15:24:29.608 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 2024-03-09T15:24:29.608 INFO:teuthology.orchestra.run.smithi046.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 2024-03-09T15:24:29.608 INFO:teuthology.orchestra.run.smithi046.stdout:= 11 failed, 649 passed, 65 skipped, 124 deselected, 1 xfailed, 643 warnings in 1955.01s (0:32:35) = 2024-03-09T15:24:29.699 INFO:teuthology.orchestra.run.smithi046.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-03-09T15:24:29.699 INFO:teuthology.orchestra.run.smithi046.stdout:___________________________________ summary ____________________________________ 2024-03-09T15:24:29.699 INFO:teuthology.orchestra.run.smithi046.stdout:ERROR: py: commands failed 2024-03-09T15:24:29.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:24:29.713 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi046 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:24:29.715 INFO:tasks.s3tests:Cleaning up boto... 2024-03-09T15:24:29.715 DEBUG:teuthology.orchestra.run.smithi046:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-03-09T15:24:29.743 INFO:tasks.s3tests:Removing s3-tests... 2024-03-09T15:24:29.743 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T15:24:29.936 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi046 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:24:30.180 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e9bcf2424e3e428cad6114c635bf8440 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi046 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:24:30.183 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-03-09T15:24:30.195 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-03-09T15:24:30.236 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-03-09T15:24:30.236 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-03-09T15:24:30.237 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-03-09T15:24:30.303 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-03-09T15:24:30.303 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-03-09T15:24:30.357 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T15:24:30.357 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T15:24:30.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.388+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 realm 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.390+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.391+0000 7fcf06644800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:24:30.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.391+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.392+0000 7fcf06644800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T15:24:30.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.392+0000 7fcf06644800 20 searching for the correct realm 2024-03-09T15:24:30.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.394+0000 7fcf03946640 0 -- 172.21.15.46:0/2234383669 >> [v2:172.21.15.46:6800/4147138312,v1:172.21.15.46:6801/4147138312] conn(0x7fcef405b040 msgr2=0x7fcef4067ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:24:30.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.600+0000 7fcf04147640 0 -- 172.21.15.46:0/2234383669 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7fcef8051040 msgr2=0x7fcef806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T15:24:30.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T15:24:30.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T15:24:30.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T15:24:30.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T15:24:30.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T15:24:30.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T15:24:30.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.807+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:24:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T15:24:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 zone default found 2024-03-09T15:24:30.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 4 Realm: () 2024-03-09T15:24:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T15:24:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T15:24:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T15:24:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 zonegroup default 2024-03-09T15:24:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.808+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.809+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.809+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.809+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.809+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.810+0000 7fcf06644800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.810+0000 7fcf06644800 20 started sync module instance, tier type = 2024-03-09T15:24:30.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.810+0000 7fcf06644800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T15:24:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=0 2024-03-09T15:24:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=1 2024-03-09T15:24:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=2 2024-03-09T15:24:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=3 2024-03-09T15:24:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=4 2024-03-09T15:24:30.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=5 2024-03-09T15:24:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.820+0000 7fcf06644800 20 add_watcher() i=6 2024-03-09T15:24:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.821+0000 7fcf06644800 20 add_watcher() i=7 2024-03-09T15:24:30.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.821+0000 7fcf06644800 2 all 8 watchers are set, enabling cache 2024-03-09T15:24:30.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.823+0000 7fcdbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:24:30.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.824+0000 7fcf06644800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T15:24:30.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.824+0000 7fcf06644800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T15:24:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.865+0000 7fcdb9fdb640 20 reqs_thread_entry: start 2024-03-09T15:24:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.865+0000 7fcf06644800 20 init_complete bucket index max shards: 1 2024-03-09T15:24:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.865+0000 7fcf06644800 20 Filter name: none 2024-03-09T15:24:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.865+0000 7fcd2b7fe640 20 reqs_thread_entry: start 2024-03-09T15:24:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.865+0000 7fcf06644800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-09T15:24:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.865+0000 7fcf06644800 20 rados->read ofs=0 len=0 2024-03-09T15:24:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.866+0000 7fcf06644800 20 rados_obj.operate() r=0 bl.length=482 2024-03-09T15:24:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.866+0000 7fcf06644800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-03-09T15:24:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.866+0000 7fcf06644800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T15:24:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.866+0000 7fcf06644800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T15:24:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.866+0000 7fcf06644800 10 removing key index: YVTQFRZWIHVPQPOPINTG 2024-03-09T15:24:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.868+0000 7fcf06644800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:YVTQFRZWIHVPQPOPINTG, ofs0, ns] 2024-03-09T15:24:30.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.868+0000 7fcddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497434 cookie 93863591807904 notifier 7833 bl.length()=170 2024-03-09T15:24:30.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.870+0000 7fcf06644800 10 removing email index: tester.client.0_test@test.test 2024-03-09T15:24:30.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.871+0000 7fcf06644800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-09T15:24:30.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.871+0000 7fcddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498238 cookie 93863591814960 notifier 7833 bl.length()=181 2024-03-09T15:24:30.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.872+0000 7fcf06644800 10 removing user buckets index 2024-03-09T15:24:30.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.874+0000 7fcf06644800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-03-09T15:24:30.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.874+0000 7fcddb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497150 cookie 93863591828544 notifier 7833 bl.length()=172 2024-03-09T15:24:30.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.875+0000 7fcf06644800 10 removing user index: tester.client.0 2024-03-09T15:24:30.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.877+0000 7fcf06644800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-03-09T15:24:30.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.877+0000 7fcf06644800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-09T15:24:30.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.877+0000 7fcddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691498415 cookie 93863591819984 notifier 7833 bl.length()=164 2024-03-09T15:24:30.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.879+0000 7fcdbafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:24:30.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.882+0000 7fcf06644800 20 remove_watcher() i=0 2024-03-09T15:24:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.882+0000 7fcf06644800 2 removed watcher, disabling cache 2024-03-09T15:24:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.883+0000 7fcf06644800 20 remove_watcher() i=1 2024-03-09T15:24:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.884+0000 7fcf06644800 20 remove_watcher() i=2 2024-03-09T15:24:30.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.885+0000 7fcf06644800 20 remove_watcher() i=3 2024-03-09T15:24:30.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.886+0000 7fcf06644800 20 remove_watcher() i=4 2024-03-09T15:24:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.887+0000 7fcf06644800 20 remove_watcher() i=5 2024-03-09T15:24:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.888+0000 7fcf06644800 20 remove_watcher() i=6 2024-03-09T15:24:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:30.889+0000 7fcf06644800 20 remove_watcher() i=7 2024-03-09T15:24:30.899 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-03-09T15:24:30.944 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-03-09T15:24:30.954 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-03-09T15:24:31.007 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-09T15:24:31.017 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-09T15:24:31.018 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:24:31.023 INFO:tasks.rgw.client.0.smithi046.stdout:2024-03-09T15:24:31.022+0000 f6f0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45887) UID: 0 2024-03-09T15:24:31.026 INFO:tasks.rgw.client.0.smithi046.stdout:2024-03-09T15:24:31.024+0000 a03a0c0 -1 shutting down 2024-03-09T15:24:35.238 INFO:tasks.rgw.client.0.smithi046.stderr:==00:01:02:28.094 45891== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45891-by-root-on-??? 2024-03-09T15:24:35.238 INFO:tasks.rgw.client.0.smithi046.stderr:==00:01:02:28.094 45891== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45891-by-root-on-??? 2024-03-09T15:24:35.239 INFO:tasks.rgw.client.0.smithi046.stderr:==00:01:02:28.094 45891== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45891-by-root-on-??? 2024-03-09T15:24:35.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-09T15:24:37.121 INFO:tasks.rgw.client.0:Stopped 2024-03-09T15:24:37.122 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-09T15:24:37.155 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/vault-root-token 2024-03-09T15:24:37.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-03-09T15:24:37.287 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-09T15:24:37.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-09T15:24:37.287 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-09T15:24:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setuser ceph since I am not root 2024-03-09T15:24:37.384 INFO:teuthology.orchestra.run.smithi046.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T15:24:37.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.617+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 realm 2024-03-09T15:24:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T15:24:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.618+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.619+0000 7f1a65a44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:24:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.619+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.620+0000 7f1a65a44800 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T15:24:37.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.620+0000 7f1a65a44800 20 searching for the correct realm 2024-03-09T15:24:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.623+0000 7f1a62d3f640 0 -- 172.21.15.46:0/215540070 >> [v2:172.21.15.159:6800/405397884,v1:172.21.15.159:6801/405397884] conn(0x55555b2d13b0 msgr2=0x55555b2d37a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T15:24:37.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.628+0000 7f1a63540640 0 -- 172.21.15.46:0/215540070 >> [v2:172.21.15.46:6809/3412775629,v1:172.21.15.46:6812/3412775629] conn(0x7f1a5802b410 msgr2=0x7f1a5802b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:24:37.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T15:24:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 RGWRados::pool_iterate: got zone_info.9d9fb811-cdaf-478b-a06b-5596cde59126 2024-03-09T15:24:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 RGWRados::pool_iterate: got zonegroup_info.7cc6bf67-e47b-440e-954a-d44499b68b52 2024-03-09T15:24:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T15:24:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T15:24:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T15:24:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.835+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:24:37.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T15:24:37.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 zone default found 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 4 Realm: () 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 4 ZoneGroup: default (7cc6bf67-e47b-440e-954a-d44499b68b52) 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 4 Zone: default (9d9fb811-cdaf-478b-a06b-5596cde59126) 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 zonegroup default 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.836+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.837+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.837+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.837+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.837+0000 7f1a65a44800 20 rados->read ofs=0 len=0 2024-03-09T15:24:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.838+0000 7f1a65a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:24:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.838+0000 7f1a65a44800 20 started sync module instance, tier type = 2024-03-09T15:24:37.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.838+0000 7f1a65a44800 20 started zone id=9d9fb811-cdaf-478b-a06b-5596cde59126 (name=default) with tier type = 2024-03-09T15:24:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=0 2024-03-09T15:24:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=1 2024-03-09T15:24:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=2 2024-03-09T15:24:37.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=3 2024-03-09T15:24:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=4 2024-03-09T15:24:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=5 2024-03-09T15:24:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.848+0000 7f1a65a44800 20 add_watcher() i=6 2024-03-09T15:24:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.849+0000 7f1a65a44800 20 add_watcher() i=7 2024-03-09T15:24:37.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.849+0000 7f1a65a44800 2 all 8 watchers are set, enabling cache 2024-03-09T15:24:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.851+0000 7f1919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:24:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.851+0000 7f1a65a44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T15:24:37.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.851+0000 7f1a65a44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T15:24:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.891+0000 7f1918fe1640 20 reqs_thread_entry: start 2024-03-09T15:24:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.891+0000 7f1a65a44800 20 init_complete bucket index max shards: 1 2024-03-09T15:24:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.891+0000 7f1a65a44800 20 Filter name: none 2024-03-09T15:24:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.891+0000 7f18927fc640 20 reqs_thread_entry: start 2024-03-09T15:24:37.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.891+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T15:24:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.893+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T15:24:37.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1673490681845998125', time=2024-03-09T16:52:57.683437+0000, chain.objs.size()=3 2024-03-09T15:24:37.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-FROZEN.2~nj36pfc9Z2-VrT7IL9xp2xaVKXe10U_.1 2024-03-09T15:24:37.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-FROZEN.2~nj36pfc9Z2-VrT7IL9xp2xaVKXe10U_.2 2024-03-09T15:24:37.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-FROZEN.2~nj36pfc9Z2-VrT7IL9xp2xaVKXe10U_.3 2024-03-09T15:24:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5090037193809054885', time=2024-03-09T17:05:54.025992+0000, chain.objs.size()=6 2024-03-09T15:24:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.512__multipart_mymultipart.2~PBOeobQeQ2BeNJq491VyZ1f0GqrU8c-.1 2024-03-09T15:24:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.512__multipart_mymultipart.2~PBOeobQeQ2BeNJq491VyZ1f0GqrU8c-.2 2024-03-09T15:24:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.512__multipart_mymultipart.2~PBOeobQeQ2BeNJq491VyZ1f0GqrU8c-.3 2024-03-09T15:24:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.512__multipart_mymultipart.2~PBOeobQeQ2BeNJq491VyZ1f0GqrU8c-.4 2024-03-09T15:24:37.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.894+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.512__multipart_mymultipart.2~PBOeobQeQ2BeNJq491VyZ1f0GqrU8c-.5 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.512__multipart_mymultipart.2~PBOeobQeQ2BeNJq491VyZ1f0GqrU8c-.6 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d', time=2024-03-09T17:07:39.453145+0000, chain.objs.size()=1 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d.2 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d', time=2024-03-09T17:07:39.457065+0000, chain.objs.size()=1 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d.3 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11187241611744575338', time=2024-03-09T17:12:54.423719+0000, chain.objs.size()=4 2024-03-09T15:24:37.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.895+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~7v5kqd4Il5tCx0uTUJ3VJX_ED-yvSeS.1 2024-03-09T15:24:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.898+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~7v5kqd4Il5tCx0uTUJ3VJX_ED-yvSeS.2 2024-03-09T15:24:37.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.898+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~7v5kqd4Il5tCx0uTUJ3VJX_ED-yvSeS.3 2024-03-09T15:24:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~7v5kqd4Il5tCx0uTUJ3VJX_ED-yvSeS.4 2024-03-09T15:24:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17354745996771177928', time=2024-03-09T17:15:22.747408+0000, chain.objs.size()=6 2024-03-09T15:24:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.606__multipart_multipart_enc.2~AGp8NTMfc1qDMG20Zm4EwKQN0CqCw5y.1 2024-03-09T15:24:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.606__multipart_multipart_enc.2~AGp8NTMfc1qDMG20Zm4EwKQN0CqCw5y.2 2024-03-09T15:24:37.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.606__multipart_multipart_enc.2~AGp8NTMfc1qDMG20Zm4EwKQN0CqCw5y.3 2024-03-09T15:24:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.606__multipart_multipart_enc.2~AGp8NTMfc1qDMG20Zm4EwKQN0CqCw5y.4 2024-03-09T15:24:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.606__multipart_multipart_enc.2~AGp8NTMfc1qDMG20Zm4EwKQN0CqCw5y.5 2024-03-09T15:24:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.606__multipart_multipart_enc.2~AGp8NTMfc1qDMG20Zm4EwKQN0CqCw5y.6 2024-03-09T15:24:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm', time=2024-03-09T17:16:31.628778+0000, chain.objs.size()=6 2024-03-09T15:24:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.615__multipart_multipart_enc.2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm.1 2024-03-09T15:24:37.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.899+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.615__multipart_multipart_enc.2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm.2 2024-03-09T15:24:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.902+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.615__multipart_multipart_enc.2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm.3 2024-03-09T15:24:37.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.902+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.615__multipart_multipart_enc.2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm.4 2024-03-09T15:24:37.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.903+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.615__multipart_multipart_enc.2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm.5 2024-03-09T15:24:37.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.903+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.615__multipart_multipart_enc.2~DCJC85cKuBLxAeqav5fRTNScttQl_Gm.6 2024-03-09T15:24:37.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.904+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8018124574325171568', time=2024-03-09T17:17:50.199614+0000, chain.objs.size()=6 2024-03-09T15:24:37.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.904+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.649__multipart_baz.2~wXDysw1BSIzEkqLWRow5D6m97BCNL2w.1 2024-03-09T15:24:37.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.905+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.649__multipart_baz.2~wXDysw1BSIzEkqLWRow5D6m97BCNL2w.2 2024-03-09T15:24:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.906+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.649__multipart_baz.2~wXDysw1BSIzEkqLWRow5D6m97BCNL2w.3 2024-03-09T15:24:37.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.906+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.649__multipart_baz.2~wXDysw1BSIzEkqLWRow5D6m97BCNL2w.4 2024-03-09T15:24:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.906+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.649__multipart_baz.2~wXDysw1BSIzEkqLWRow5D6m97BCNL2w.5 2024-03-09T15:24:37.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.907+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.649__multipart_baz.2~wXDysw1BSIzEkqLWRow5D6m97BCNL2w.6 2024-03-09T15:24:37.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.911+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.914+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T15:24:37.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.915+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T15:24:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_gs7v6WlC-3dPDXfr8SxljXFiVWxKgEN', time=2024-03-09T16:52:59.408359+0000, chain.objs.size()=2 2024-03-09T15:24:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.pLisT3nDd1PKxSCxQn_PsYfDdYSxBWx_1 2024-03-09T15:24:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.pLisT3nDd1PKxSCxQn_PsYfDdYSxBWx_2 2024-03-09T15:24:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2943312619706214116', time=2024-03-09T17:07:39.481140+0000, chain.objs.size()=6 2024-03-09T15:24:37.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~3z62hDghFZyt670saE7oFOuB3crFW63.1 2024-03-09T15:24:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~3z62hDghFZyt670saE7oFOuB3crFW63.2 2024-03-09T15:24:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.5xVx7YyaJC8gZWZpZQUI3b48VEVJs5uE.3 2024-03-09T15:24:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~3z62hDghFZyt670saE7oFOuB3crFW63.4 2024-03-09T15:24:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~3z62hDghFZyt670saE7oFOuB3crFW63.5 2024-03-09T15:24:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~3z62hDghFZyt670saE7oFOuB3crFW63.6 2024-03-09T15:24:37.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2950012052314832092', time=2024-03-09T17:08:31.840495+0000, chain.objs.size()=3 2024-03-09T15:24:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~1tvGMpLvpyc-7X3wDx5OU7JcR5Agz7P.1 2024-03-09T15:24:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~1tvGMpLvpyc-7X3wDx5OU7JcR5Agz7P.2 2024-03-09T15:24:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~1tvGMpLvpyc-7X3wDx5OU7JcR5Agz7P.3 2024-03-09T15:24:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.434197380644963935', time=2024-03-09T17:08:42.236458+0000, chain.objs.size()=1 2024-03-09T15:24:37.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.916+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~AbXzv7zuLMWKeLEKT82BaLYtXp2J1uT.1 2024-03-09T15:24:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.919+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14328702240673358348', time=2024-03-09T17:14:31.720689+0000, chain.objs.size()=6 2024-03-09T15:24:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.920+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.605__multipart_multipart_enc.2~Z0EM2TS6xEtQT-g-5F3Z5sHn0_vS-Z9.1 2024-03-09T15:24:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.920+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.605__multipart_multipart_enc.2~Z0EM2TS6xEtQT-g-5F3Z5sHn0_vS-Z9.2 2024-03-09T15:24:37.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.920+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.605__multipart_multipart_enc.2~Z0EM2TS6xEtQT-g-5F3Z5sHn0_vS-Z9.3 2024-03-09T15:24:37.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.921+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.605__multipart_multipart_enc.2~Z0EM2TS6xEtQT-g-5F3Z5sHn0_vS-Z9.4 2024-03-09T15:24:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.922+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.605__multipart_multipart_enc.2~Z0EM2TS6xEtQT-g-5F3Z5sHn0_vS-Z9.5 2024-03-09T15:24:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.922+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.605__multipart_multipart_enc.2~Z0EM2TS6xEtQT-g-5F3Z5sHn0_vS-Z9.6 2024-03-09T15:24:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.922+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15986748142210431591', time=2024-03-09T17:16:59.416733+0000, chain.objs.size()=1 2024-03-09T15:24:37.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.922+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.633__shadow_._nt6RBfdPiq3DjEgGuqVKaC7WKGmFyO_1 2024-03-09T15:24:37.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.927+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.930+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T15:24:37.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.931+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe', time=2024-03-09T17:16:21.983817+0000, chain.objs.size()=6 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.614__multipart_multipart_enc.2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe.1 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.614__multipart_multipart_enc.2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe.2 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.614__multipart_multipart_enc.2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe.3 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.614__multipart_multipart_enc.2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe.4 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.614__multipart_multipart_enc.2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe.5 2024-03-09T15:24:37.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.614__multipart_multipart_enc.2~YTO5SvyVSOI4edZwhF8SUaruCN6ftKe.6 2024-03-09T15:24:37.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11574487560765076912', time=2024-03-09T17:16:53.863440+0000, chain.objs.size()=1 2024-03-09T15:24:37.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.932+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.631__shadow_.e1p0cG4GWfsAD-akm3E6nOhqwftj1lo_1 2024-03-09T15:24:37.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.936+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.939+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T15:24:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.940+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2_2135dd08b076741055941a1a84eee4f9', time=2024-03-09T17:05:12.764211+0000, chain.objs.size()=6 2024-03-09T15:24:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.1 2024-03-09T15:24:37.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.3 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.4 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.5 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.6 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2829158277424173394', time=2024-03-09T17:08:34.268609+0000, chain.objs.size()=2 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~pwstmteIJmmr-6ccD1N-3ywGGiMi-os.1 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~pwstmteIJmmr-6ccD1N-3ywGGiMi-os.2 2024-03-09T15:24:37.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3158715363422088928', time=2024-03-09T17:09:47.317136+0000, chain.objs.size()=4 2024-03-09T15:24:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.528__multipart_mymultipart.2~DQb10QySstGdu0CHys31vkr1uWhcsPe.1 2024-03-09T15:24:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.528__multipart_mymultipart.2~DQb10QySstGdu0CHys31vkr1uWhcsPe.2 2024-03-09T15:24:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.528__multipart_mymultipart.WYi6YjXyThSiM_IIwEMykHR_YZEiTwCV.3 2024-03-09T15:24:37.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.941+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.528__multipart_mymultipart.2~DQb10QySstGdu0CHys31vkr1uWhcsPe.4 2024-03-09T15:24:37.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.947+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.950+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T15:24:37.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.951+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T15:24:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_lAuXA1BO8ZGj_l3J122Mh5Ngh8F9zMS', time=2024-03-09T16:52:31.865804+0000, chain.objs.size()=1 2024-03-09T15:24:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.1ARqZknr-tZNTV6NIQ1CNWqUIfZh_RF_1 2024-03-09T15:24:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_3hloBRv_KLkjxfJ_3YdxoCx7JsYBY5F', time=2024-03-09T16:52:39.290113+0000, chain.objs.size()=2 2024-03-09T15:24:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.SrZU_VX1kcSZGBcsjKIj2jifgnhn88u_0 2024-03-09T15:24:37.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.SrZU_VX1kcSZGBcsjKIj2jifgnhn88u_1 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8114348919923914180', time=2024-03-09T17:05:29.927963+0000, chain.objs.size()=1 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.511__multipart_mymultipart.2~jtOgwR0qfQpJ0owPzz3b6yGulvBbsBv.1 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M', time=2024-03-09T17:06:33.248801+0000, chain.objs.size()=1 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M.1 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5631435196451284577', time=2024-03-09T17:06:55.377748+0000, chain.objs.size()=6 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.5Dwq7E9fRnv9RmMr0S4pPLXfReqoxvbV.1 2024-03-09T15:24:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M.2 2024-03-09T15:24:37.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M.3 2024-03-09T15:24:37.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M.4 2024-03-09T15:24:37.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M.5 2024-03-09T15:24:37.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~_VU-FqtHCsZtlp_yqWCudZ7xY_uZp9M.6 2024-03-09T15:24:37.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11627090492022019185', time=2024-03-09T17:11:05.451836+0000, chain.objs.size()=1 2024-03-09T15:24:37.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.952+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.553__multipart_mymultipart.2~dFDF7qBcyaMJncR4rZEvEfY5QxS2cLe.1 2024-03-09T15:24:37.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.956+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5481361641330138901', time=2024-03-09T17:17:50.030966+0000, chain.objs.size()=6 2024-03-09T15:24:37.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.956+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.648__multipart_bar.2~CwHijklRat7l2RNd1YrYrIKc3RiC3Rs.1 2024-03-09T15:24:37.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.956+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.648__multipart_bar.2~CwHijklRat7l2RNd1YrYrIKc3RiC3Rs.2 2024-03-09T15:24:37.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.956+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.648__multipart_bar.2~CwHijklRat7l2RNd1YrYrIKc3RiC3Rs.3 2024-03-09T15:24:37.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.956+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.648__multipart_bar.2~CwHijklRat7l2RNd1YrYrIKc3RiC3Rs.4 2024-03-09T15:24:37.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.956+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.648__multipart_bar.2~CwHijklRat7l2RNd1YrYrIKc3RiC3Rs.5 2024-03-09T15:24:37.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.958+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.648__multipart_bar.2~CwHijklRat7l2RNd1YrYrIKc3RiC3Rs.6 2024-03-09T15:24:37.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.960+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.962+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T15:24:37.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2937612290208417084', time=2024-03-09T16:52:22.093472+0000, chain.objs.size()=3 2024-03-09T15:24:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-FROZEN.2~D03Tp95Gfo2JjWsnQ_u_Z34s-pVvsah.1 2024-03-09T15:24:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-FROZEN.2~D03Tp95Gfo2JjWsnQ_u_Z34s-pVvsah.2 2024-03-09T15:24:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-FROZEN.2~D03Tp95Gfo2JjWsnQ_u_Z34s-pVvsah.3 2024-03-09T15:24:37.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_frIIbmu8idWZBfbksACLbFQNFnRwtBz', time=2024-03-09T16:53:00.994897+0000, chain.objs.size()=2 2024-03-09T15:24:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.xcgvMV-vzwakLj6Y9ZxK8WV3K4Pc1Nr_0 2024-03-09T15:24:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.xcgvMV-vzwakLj6Y9ZxK8WV3K4Pc1Nr_1 2024-03-09T15:24:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5829054976397376830', time=2024-03-09T17:08:28.672811+0000, chain.objs.size()=2 2024-03-09T15:24:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~ucM1aNYbGrUPK8jPaPZf0AuLwhQkJo4.1 2024-03-09T15:24:37.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.964+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~ucM1aNYbGrUPK8jPaPZf0AuLwhQkJo4.2 2024-03-09T15:24:37.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.968+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.970+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T15:24:37.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.971+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T15:24:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2938814632762126754', time=2024-03-09T17:06:13.755361+0000, chain.objs.size()=3 2024-03-09T15:24:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~iKX5MORLnvv_rG8LvLNVhxkU6YAiEhy.1 2024-03-09T15:24:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~iKX5MORLnvv_rG8LvLNVhxkU6YAiEhy.2 2024-03-09T15:24:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~iKX5MORLnvv_rG8LvLNVhxkU6YAiEhy.3 2024-03-09T15:24:37.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.18296550651555872928', time=2024-03-09T17:08:06.656181+0000, chain.objs.size()=6 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d.1 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.YE1IYD--t0uK9JGiK3Hz6sP4rsLBZnZe.2 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.g-5Bpb_KaZ3empmYipat687XGcOBBFph.3 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d.4 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d.5 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~o7d2v9cig7p_1GzQ0rTPf0jdl6YAq6d.6 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2293580421920015416', time=2024-03-09T17:09:12.777254+0000, chain.objs.size()=1 2024-03-09T15:24:37.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.521__shadow_.QVMWDsLf1PtkoLwajAtUHCPi7hhYfmZ_1 2024-03-09T15:24:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~npJR89gK1IYnn3mipTaR4UJp4yY--Tv', time=2024-03-09T17:11:05.703347+0000, chain.objs.size()=1 2024-03-09T15:24:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.553__multipart_mymultipart.2~npJR89gK1IYnn3mipTaR4UJp4yY--Tv.1 2024-03-09T15:24:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9044077318512969063', time=2024-03-09T17:24:28.324744+0000, chain.objs.size()=4 2024-03-09T15:24:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.972+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.759__shadow_.gvxzWgrlToMIwodQwmMNLK_fIEuIpNv_1 2024-03-09T15:24:37.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.976+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.759__shadow_.gvxzWgrlToMIwodQwmMNLK_fIEuIpNv_2 2024-03-09T15:24:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.976+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.759__shadow_.gvxzWgrlToMIwodQwmMNLK_fIEuIpNv_3 2024-03-09T15:24:37.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.976+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.759__shadow_.gvxzWgrlToMIwodQwmMNLK_fIEuIpNv_4 2024-03-09T15:24:37.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.979+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.981+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T15:24:37.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.983+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.983+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T15:24:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6111380162916667297', time=2024-03-09T16:52:50.415746+0000, chain.objs.size()=3 2024-03-09T15:24:37.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-LUKEWARM.2~B6b61O8x-ZEZY8v4m2z31GXVRo8Rr89.1 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-LUKEWARM.2~B6b61O8x-ZEZY8v4m2z31GXVRo8Rr89.2 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-LUKEWARM.2~B6b61O8x-ZEZY8v4m2z31GXVRo8Rr89.3 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2_d77dbe3cda521ffcebc39ae77f6555a6', time=2024-03-09T17:05:12.576991+0000, chain.objs.size()=6 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.1 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.3 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.4 2024-03-09T15:24:37.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.5 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.6 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3003657266474186974', time=2024-03-09T17:05:22.605688+0000, chain.objs.size()=1 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.509__multipart_mymultipartcopy.2~h05r1U0pWBz2TOg_9lCRK6O9ur4bwAV.1 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14189720783092684272', time=2024-03-09T17:05:27.623015+0000, chain.objs.size()=1 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.511__multipart_mymultipart.2~99v6aMiDSflLGsGL-iW_CReBDryyUID.1 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8259876115653251863', time=2024-03-09T17:05:33.172568+0000, chain.objs.size()=1 2024-03-09T15:24:37.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.984+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.510__shadow_.yXM397KNZVatCoD7fW0ToG3ZdeDOvsK_1 2024-03-09T15:24:37.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12834402653829909193', time=2024-03-09T17:08:44.736982+0000, chain.objs.size()=2 2024-03-09T15:24:37.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~17GAyinBRTiWUVg8m0OrsZOvSb2Be3v.1 2024-03-09T15:24:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~17GAyinBRTiWUVg8m0OrsZOvSb2Be3v.2 2024-03-09T15:24:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4613271807924567019', time=2024-03-09T17:09:08.655462+0000, chain.objs.size()=4 2024-03-09T15:24:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.520__multipart_mymultipart.2~8Eww_6YAlKX9k8DHd_4vgLYl6f5H85I.1 2024-03-09T15:24:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.520__multipart_mymultipart.2~8Eww_6YAlKX9k8DHd_4vgLYl6f5H85I.2 2024-03-09T15:24:37.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.520__multipart_mymultipart.2~8Eww_6YAlKX9k8DHd_4vgLYl6f5H85I.3 2024-03-09T15:24:37.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.988+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.520__multipart_mymultipart.2~8Eww_6YAlKX9k8DHd_4vgLYl6f5H85I.4 2024-03-09T15:24:37.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.991+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:37.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.994+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T15:24:37.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.995+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:37.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:37.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_JwcBWHRJ0RgCP6GXmsYzwaqH3juX3q2', time=2024-03-09T16:53:07.533092+0000, chain.objs.size()=1 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.156__shadow_.IGAZTW-64hVVlyI-IJYPrTp4AYkrLTz_0 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17594873226739020418', time=2024-03-09T17:06:24.425024+0000, chain.objs.size()=2 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.513__shadow:Z3skLF-ZdFxG0zHHsbJkPbPKNDrBtbu_.D0SOPxOF3dyTmrLVbwhlVtLPAI1Y8FM_1 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.513__shadow:Z3skLF-ZdFxG0zHHsbJkPbPKNDrBtbu_.D0SOPxOF3dyTmrLVbwhlVtLPAI1Y8FM_2 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10946048025394225303', time=2024-03-09T17:06:24.607746+0000, chain.objs.size()=3 2024-03-09T15:24:37.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~mw1KpB0Tc5riJaPjsbnlvKgiBG0LLkh.1 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~mw1KpB0Tc5riJaPjsbnlvKgiBG0LLkh.2 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~mw1KpB0Tc5riJaPjsbnlvKgiBG0LLkh.3 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4422733941155274306', time=2024-03-09T17:08:48.014784+0000, chain.objs.size()=2 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~fcJyHoulcKQG1Ec4IHa7auE8kUWvMtY.1 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~fcJyHoulcKQG1Ec4IHa7auE8kUWvMtY.2 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9205032359362659270', time=2024-03-09T17:08:52.418133+0000, chain.objs.size()=3 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~F8YO_11Zq8XYhIwFHLVi7NBlw560Y5V.1 2024-03-09T15:24:37.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~F8YO_11Zq8XYhIwFHLVi7NBlw560Y5V.2 2024-03-09T15:24:37.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~F8YO_11Zq8XYhIwFHLVi7NBlw560Y5V.3 2024-03-09T15:24:37.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.12043643540788943976', time=2024-03-09T17:16:12.323609+0000, chain.objs.size()=6 2024-03-09T15:24:37.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.996+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.613__multipart_multipart_enc.2~m4Sjm0VSUGP2RfJwM1qw4y1mbmy9JBa.1 2024-03-09T15:24:37.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:37.998+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.613__multipart_multipart_enc.2~m4Sjm0VSUGP2RfJwM1qw4y1mbmy9JBa.2 2024-03-09T15:24:38.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.000+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.613__multipart_multipart_enc.2~m4Sjm0VSUGP2RfJwM1qw4y1mbmy9JBa.3 2024-03-09T15:24:38.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.000+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.613__multipart_multipart_enc.2~m4Sjm0VSUGP2RfJwM1qw4y1mbmy9JBa.4 2024-03-09T15:24:38.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.001+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.613__multipart_multipart_enc.2~m4Sjm0VSUGP2RfJwM1qw4y1mbmy9JBa.5 2024-03-09T15:24:38.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.001+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.613__multipart_multipart_enc.2~m4Sjm0VSUGP2RfJwM1qw4y1mbmy9JBa.6 2024-03-09T15:24:38.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.002+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.5511838566178395656', time=2024-03-09T17:17:21.075149+0000, chain.objs.size()=1 2024-03-09T15:24:38.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.002+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.642__shadow_.pafHeDy7shATqaK0w1-JNtoKxbmHViv_1 2024-03-09T15:24:38.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.005+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.008+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T15:24:38.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.009+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.009+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:38.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10313062399069122326', time=2024-03-09T17:05:32.429546+0000, chain.objs.size()=1 2024-03-09T15:24:38.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.511__multipart_mymultipart.2~17CG-2GejzNSOXgKItXlxUjJtU72tpX.1 2024-03-09T15:24:38.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~DQb10QySstGdu0CHys31vkr1uWhcsPe', time=2024-03-09T17:09:32.988680+0000, chain.objs.size()=1 2024-03-09T15:24:38.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.528__multipart_mymultipart.2~DQb10QySstGdu0CHys31vkr1uWhcsPe.3 2024-03-09T15:24:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8345051225673064302', time=2024-03-09T17:12:50.142255+0000, chain.objs.size()=4 2024-03-09T15:24:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~9jW3GExO6gC1HGvhSKASTWRU9JZy2H1.1 2024-03-09T15:24:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~9jW3GExO6gC1HGvhSKASTWRU9JZy2H1.2 2024-03-09T15:24:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~9jW3GExO6gC1HGvhSKASTWRU9JZy2H1.3 2024-03-09T15:24:38.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.010+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~9jW3GExO6gC1HGvhSKASTWRU9JZy2H1.4 2024-03-09T15:24:38.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.013+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.015+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T15:24:38.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.016+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:24:38.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13480561786674676690', time=2024-03-09T16:52:22.151169+0000, chain.objs.size()=3 2024-03-09T15:24:38.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-STANDARD.2~p9bF-89uLE1N0STgjR4vdGQIFZedy5h.1 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-STANDARD.2~p9bF-89uLE1N0STgjR4vdGQIFZedy5h.2 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-STANDARD.2~p9bF-89uLE1N0STgjR4vdGQIFZedy5h.3 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~6RoVVIPqCdIf05Xc1ZnYl8f_cn2Ob36', time=2024-03-09T16:54:17.126400+0000, chain.objs.size()=1 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.194__multipart_mymultipart.2~6RoVVIPqCdIf05Xc1ZnYl8f_cn2Ob36.1 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2_6b2abc982bc5bac7b77fabd07c1ba4f5', time=2024-03-09T17:05:12.381373+0000, chain.objs.size()=6 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.1 2024-03-09T15:24:38.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2 2024-03-09T15:24:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.3 2024-03-09T15:24:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.4 2024-03-09T15:24:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.5 2024-03-09T15:24:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.6 2024-03-09T15:24:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9006311397019196365', time=2024-03-09T17:08:24.922710+0000, chain.objs.size()=1 2024-03-09T15:24:38.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.017+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~3ENIRF8ny50YdRzajMFikMrEnFDvTVe.1 2024-03-09T15:24:38.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.022+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.024+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T15:24:38.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.025+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16247593032757294998', time=2024-03-09T17:08:34.053448+0000, chain.objs.size()=3 2024-03-09T15:24:38.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~Prtvxt3lPi0sd5o-O73hvgHhIWYrX7-.1 2024-03-09T15:24:38.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~Prtvxt3lPi0sd5o-O73hvgHhIWYrX7-.2 2024-03-09T15:24:38.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~Prtvxt3lPi0sd5o-O73hvgHhIWYrX7-.3 2024-03-09T15:24:38.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~Y2-GDU1aKZQ_K5sLdn7gqXKi5co5Q9D', time=2024-03-09T17:09:17.285654+0000, chain.objs.size()=2 2024-03-09T15:24:38.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.522__multipart_mymultipart.2~Y2-GDU1aKZQ_K5sLdn7gqXKi5co5Q9D.1 2024-03-09T15:24:38.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.026+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.522__multipart_mymultipart.2~Y2-GDU1aKZQ_K5sLdn7gqXKi5co5Q9D.2 2024-03-09T15:24:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.028+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.031+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T15:24:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.032+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_yM3oadZP6ulInX6Y2TAxN4INnioz3uN', time=2024-03-09T16:53:01.048569+0000, chain.objs.size()=1 2024-03-09T15:24:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.mCWhJ1-vv1hYXtzcj4zFmwsGIMV1JMU_0 2024-03-09T15:24:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2_4ce8b266bb83c2f9726ccbf0326eeb62', time=2024-03-09T17:05:12.385857+0000, chain.objs.size()=6 2024-03-09T15:24:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.1 2024-03-09T15:24:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2 2024-03-09T15:24:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.3 2024-03-09T15:24:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.4 2024-03-09T15:24:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.5 2024-03-09T15:24:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.6 2024-03-09T15:24:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1135096693032628725', time=2024-03-09T17:05:33.178875+0000, chain.objs.size()=1 2024-03-09T15:24:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.033+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.510__shadow_.jCHGhi5IE5oYZrBIkNrWZ02EWf1iiLo_1 2024-03-09T15:24:38.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.036+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.038+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T15:24:38.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:24:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='__ttOPcq7rA-8uhWWjavGlrViaWVEfPc', time=2024-03-09T16:53:07.560278+0000, chain.objs.size()=1 2024-03-09T15:24:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.156__shadow_.CcTbhDPvCIT0VdzYjxpuFpe84bkBu7D_0 2024-03-09T15:24:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj', time=2024-03-09T17:06:55.352837+0000, chain.objs.size()=1 2024-03-09T15:24:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj.2 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8459634200455538818', time=2024-03-09T17:07:17.739891+0000, chain.objs.size()=6 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj.1 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.1yBAFJPc9f0-si9b72U_-0NbO2at_dML.2 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj.3 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj.4 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj.5 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~d9BJsmGlou0lTu-2LuUTNofqogsaHrj.6 2024-03-09T15:24:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~9EF_oVxcpnaPTsXVYfSJlM5VxW7e0i9', time=2024-03-09T17:09:23.375522+0000, chain.objs.size()=1 2024-03-09T15:24:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.040+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.524__multipart_mymultipart2.2~9EF_oVxcpnaPTsXVYfSJlM5VxW7e0i9.1 2024-03-09T15:24:38.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.044+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.047+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T15:24:38.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.048+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.048+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8174521755918127967', time=2024-03-09T16:52:22.122237+0000, chain.objs.size()=3 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-LUKEWARM.2~0qscv_KheNq3u0c6gIzkTGezn2QWr6d.1 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-LUKEWARM.2~0qscv_KheNq3u0c6gIzkTGezn2QWr6d.2 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.152__multipart_mymultipart-LUKEWARM.2~0qscv_KheNq3u0c6gIzkTGezn2QWr6d.3 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.11250749556745008404', time=2024-03-09T16:52:43.449344+0000, chain.objs.size()=3 2024-03-09T15:24:38.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-STANDARD.2~M2MbdtcKHgFuXd5OQypjKQFpEzvNbtg.1 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-STANDARD.2~M2MbdtcKHgFuXd5OQypjKQFpEzvNbtg.2 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__multipart_foo-STANDARD.2~M2MbdtcKHgFuXd5OQypjKQFpEzvNbtg.3 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10941353460553654421', time=2024-03-09T17:12:43.806549+0000, chain.objs.size()=4 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~uFSKd3rl3DCGKOlDs7rFgmlaPcCim9h.1 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~uFSKd3rl3DCGKOlDs7rFgmlaPcCim9h.2 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~uFSKd3rl3DCGKOlDs7rFgmlaPcCim9h.3 2024-03-09T15:24:38.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.049+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.570__multipart_testobj.2~uFSKd3rl3DCGKOlDs7rFgmlaPcCim9h.4 2024-03-09T15:24:38.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.052+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.054+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T15:24:38.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2746131052260093296', time=2024-03-09T16:52:30.368729+0000, chain.objs.size()=2 2024-03-09T15:24:38.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.EGTSExgCr1MU5gDtt79-j08jXBPfadk_0 2024-03-09T15:24:38.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.EGTSExgCr1MU5gDtt79-j08jXBPfadk_1 2024-03-09T15:24:38.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9818042909290451425', time=2024-03-09T17:15:33.479620+0000, chain.objs.size()=6 2024-03-09T15:24:38.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.607__multipart_multipart_enc.2~-XUGTR-tRc1mkldzOdmIy4w070Uk2pq.1 2024-03-09T15:24:38.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.607__multipart_multipart_enc.2~-XUGTR-tRc1mkldzOdmIy4w070Uk2pq.2 2024-03-09T15:24:38.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.607__multipart_multipart_enc.2~-XUGTR-tRc1mkldzOdmIy4w070Uk2pq.3 2024-03-09T15:24:38.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.607__multipart_multipart_enc.2~-XUGTR-tRc1mkldzOdmIy4w070Uk2pq.4 2024-03-09T15:24:38.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.056+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.607__multipart_multipart_enc.2~-XUGTR-tRc1mkldzOdmIy4w070Uk2pq.5 2024-03-09T15:24:38.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.057+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.607__multipart_multipart_enc.2~-XUGTR-tRc1mkldzOdmIy4w070Uk2pq.6 2024-03-09T15:24:38.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.061+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.063+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T15:24:38.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.064+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.065+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.065+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.065+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~CIiUzz21iEviBeMkynOveqaMBhNBl68', time=2024-03-09T16:54:19.439663+0000, chain.objs.size()=1 2024-03-09T15:24:38.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.065+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.195__multipart_mymultipart.2~CIiUzz21iEviBeMkynOveqaMBhNBl68.1 2024-03-09T15:24:38.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.065+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10493639608976663248', time=2024-03-09T17:11:15.134313+0000, chain.objs.size()=1 2024-03-09T15:24:38.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.065+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.555__shadow_.HAWLh3X5sv1e12agbGe9-ab6q9Rf4Cn_1 2024-03-09T15:24:38.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.067+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.069+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T15:24:38.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.070+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:38.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15517043989073397682', time=2024-03-09T17:08:26.302529+0000, chain.objs.size()=2 2024-03-09T15:24:38.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~1-V_xUfqQWbazHuWG9brGcqPg-Uj6Og.1 2024-03-09T15:24:38.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.516__multipart_mymultipart.2~1-V_xUfqQWbazHuWG9brGcqPg-Uj6Og.2 2024-03-09T15:24:38.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6953542806736485727', time=2024-03-09T17:08:56.641861+0000, chain.objs.size()=3 2024-03-09T15:24:38.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~zCxtpLEGwHMzKkuHi08ORU0SIVc0F3j.1 2024-03-09T15:24:38.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~zCxtpLEGwHMzKkuHi08ORU0SIVc0F3j.2 2024-03-09T15:24:38.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~zCxtpLEGwHMzKkuHi08ORU0SIVc0F3j.3 2024-03-09T15:24:38.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4711025324170978177', time=2024-03-09T17:11:06.129663+0000, chain.objs.size()=1 2024-03-09T15:24:38.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.071+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.553__multipart_mymultipart.i_WM97CBz5E1PyZh6XibOeEAm1u8efFO.1 2024-03-09T15:24:38.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.074+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.076+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T15:24:38.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.077+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.078+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.078+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T15:24:38.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.078+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_elUa4kT_ienCvoL4Z_yisEDyosd23_9', time=2024-03-09T16:52:44.915456+0000, chain.objs.size()=1 2024-03-09T15:24:38.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.078+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.dqX0PLxuTYcdNjKkcHu59VNjEnoYhKB_0 2024-03-09T15:24:38.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.080+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.082+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T15:24:38.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.083+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.083+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2_128c6b04817a3fa7778567b3ec5a55ac', time=2024-03-09T17:05:12.757161+0000, chain.objs.size()=6 2024-03-09T15:24:38.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.1 2024-03-09T15:24:38.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2 2024-03-09T15:24:38.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.3 2024-03-09T15:24:38.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.4 2024-03-09T15:24:38.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.5 2024-03-09T15:24:38.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.6 2024-03-09T15:24:38.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~QQ4SD7-8rqQ8Un2SGuDZr3Clx7NevVL', time=2024-03-09T17:09:23.340532+0000, chain.objs.size()=2 2024-03-09T15:24:38.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.524__multipart_mymultipart.2~QQ4SD7-8rqQ8Un2SGuDZr3Clx7NevVL.1 2024-03-09T15:24:38.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.084+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.524__multipart_mymultipart.2~QQ4SD7-8rqQ8Un2SGuDZr3Clx7NevVL.2 2024-03-09T15:24:38.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.087+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.089+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T15:24:38.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.091+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.091+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.091+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T15:24:38.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.091+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13724502550094692317', time=2024-03-09T17:05:19.266517+0000, chain.objs.size()=1 2024-03-09T15:24:38.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.091+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.506__multipart_mymultipart.2~J8Uk9-h7pouwbMwQjnRutTo6hP8FJ_V.1 2024-03-09T15:24:38.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.093+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.095+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T15:24:38.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.096+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_4z1tZlcCZNkDiBjkWq0pWOXy9JPtl7X', time=2024-03-09T16:52:39.343555+0000, chain.objs.size()=1 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.yTSNUQW5U2VFVLciq3VQ3WDi5ns1BZq_0 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.14713788783498214042', time=2024-03-09T16:53:13.191204+0000, chain.objs.size()=2 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.157__multipart_foo.2~BdE1y2pAfV-CPrEGCVbSZ9GWfaomcP1.1 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.157__multipart_foo.2~BdE1y2pAfV-CPrEGCVbSZ9GWfaomcP1.2 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.10820056866774569411', time=2024-03-09T17:08:59.792431+0000, chain.objs.size()=2 2024-03-09T15:24:38.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~LHux4DVjfomr1sV0-SymeT5oy4RTxML.1 2024-03-09T15:24:38.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.518__multipart_mymultipart.2~LHux4DVjfomr1sV0-SymeT5oy4RTxML.2 2024-03-09T15:24:38.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.9587891325737505859', time=2024-03-09T17:17:23.890734+0000, chain.objs.size()=1 2024-03-09T15:24:38.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.097+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.643__shadow_.XNZK3eKUp9hemo7uWkWZLS1levU_XXQ_1 2024-03-09T15:24:38.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.100+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.102+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T15:24:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.103+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:24:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.2862501533404747252', time=2024-03-09T16:52:14.331912+0000, chain.objs.size()=2 2024-03-09T15:24:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.151__shadow_.aCfuCK_P75rdDoM4WZCNxcJ2L1G5YbF_0 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.151__shadow_.aCfuCK_P75rdDoM4WZCNxcJ2L1G5YbF_1 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_Xpa4Ks4g0-Beq0MnqeGUO8dlNkpIoAi', time=2024-03-09T16:53:01.021619+0000, chain.objs.size()=2 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.QMrvO9DFCIW8gIiHAPSE1ZfsffDydnW_0 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.QMrvO9DFCIW8gIiHAPSE1ZfsffDydnW_1 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.16882605899510147617', time=2024-03-09T17:01:46.863151+0000, chain.objs.size()=1 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.360__shadow_.89J8DLCi00HYWat5gQOurDhT6rOkDBs_1 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4907739894021055552', time=2024-03-09T17:05:15.395974+0000, chain.objs.size()=1 2024-03-09T15:24:38.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.104+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.504__multipart_mymultipart.2~Hpow1B7Q9gpRv6LG1ZaJaMxXNiHIkEY.1 2024-03-09T15:24:38.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.107+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.109+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T15:24:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.111+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.111+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.112+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T15:24:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.112+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~3z62hDghFZyt670saE7oFOuB3crFW63', time=2024-03-09T17:07:17.716878+0000, chain.objs.size()=1 2024-03-09T15:24:38.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.112+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~3z62hDghFZyt670saE7oFOuB3crFW63.3 2024-03-09T15:24:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.113+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.115+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T15:24:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.116+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T15:24:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_kN0sgarPamOhT3bozlimbyaXAUz34WN', time=2024-03-09T16:53:13.321079+0000, chain.objs.size()=1 2024-03-09T15:24:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.158__shadow_.Fi-WXvQrVD3XLcPIjB6w96iazPYyZiK_0 2024-03-09T15:24:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6206165885076841655', time=2024-03-09T17:06:19.707997+0000, chain.objs.size()=3 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~x1zegpu2s-vUsEaP-9k_V4sJ-eFI3vM.1 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~x1zegpu2s-vUsEaP-9k_V4sJ-eFI3vM.2 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.514__multipart_mymultipart.2~x1zegpu2s-vUsEaP-9k_V4sJ-eFI3vM.3 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.15196391178694330578', time=2024-03-09T17:19:42.870998+0000, chain.objs.size()=10 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.1 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.2 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.3 2024-03-09T15:24:38.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.4 2024-03-09T15:24:38.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.117+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.5 2024-03-09T15:24:38.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.118+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.6 2024-03-09T15:24:38.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.118+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.7 2024-03-09T15:24:38.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.118+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.8 2024-03-09T15:24:38.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.119+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.9 2024-03-09T15:24:38.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.122+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.719__multipart_foo.2~yUbM9mQIN1k1V4B4vdnk8eDDzQdqKWV.10 2024-03-09T15:24:38.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.124+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.126+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T15:24:38.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.127+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.127+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.128+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.128+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.13187237055589438017', time=2024-03-09T16:52:36.492631+0000, chain.objs.size()=2 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.128+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.6ytN-5oO-glluV9SvrQmshJNNIrZJzI_0 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.128+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.6ytN-5oO-glluV9SvrQmshJNNIrZJzI_1 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.128+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_5WFUROUAhIl0xwSPxeBdQwlI-6twVRh', time=2024-03-09T16:52:37.989662+0000, chain.objs.size()=1 2024-03-09T15:24:38.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.128+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.c6DL4MITpRWfazvUeuxW4IDfHin3Ddv_1 2024-03-09T15:24:38.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.131+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.133+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T15:24:38.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_kPNIYs283CJ4YXaTm_hZWnUY49t5b_2', time=2024-03-09T16:52:52.128228+0000, chain.objs.size()=2 2024-03-09T15:24:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.r9f5iFMMMMy0aAIyS0I1-IUsC4UfW5s_1 2024-03-09T15:24:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.154__shadow_.r9f5iFMMMMy0aAIyS0I1-IUsC4UfW5s_2 2024-03-09T15:24:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.3032278662883415514', time=2024-03-09T17:09:14.224446+0000, chain.objs.size()=2 2024-03-09T15:24:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.521__multipart_mymultipart.2~O8xiqTOh9zVQrHlEmeLrMgg3Q_awg4A.1 2024-03-09T15:24:38.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.135+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.521__multipart_mymultipart.2~O8xiqTOh9zVQrHlEmeLrMgg3Q_awg4A.2 2024-03-09T15:24:38.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.138+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.140+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T15:24:38.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.141+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.6938262877152368549', time=2024-03-09T16:52:14.362849+0000, chain.objs.size()=1 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.151__shadow_.rqSoqxPMAiJB_IZcIJiBPe3WoDPHil4_1 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_quUjdTuER5D3XD8L8c15LWExuu522i2', time=2024-03-09T16:52:39.317086+0000, chain.objs.size()=2 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.eYGywGiSnd002lsPA-AOemn0u4yBeaz_0 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.eYGywGiSnd002lsPA-AOemn0u4yBeaz_1 2024-03-09T15:24:38.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_d03J9NWp0PnD5mMK70syO4ZBh6uzvLt', time=2024-03-09T16:53:13.357885+0000, chain.objs.size()=1 2024-03-09T15:24:38.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.158__shadow_.Zv8IKoF9iuiw_8zBn-YW6xSNEIyolFm_0 2024-03-09T15:24:38.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~Y7RGTJn6e5pzZUlciMybaNiC8l4lLDW', time=2024-03-09T17:09:23.303782+0000, chain.objs.size()=1 2024-03-09T15:24:38.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.142+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.524__multipart_mymultipart.2~Y7RGTJn6e5pzZUlciMybaNiC8l4lLDW.1 2024-03-09T15:24:38.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.145+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.147+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T15:24:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.148+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.148+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.1846314661345079476', time=2024-03-09T17:08:21.581695+0000, chain.objs.size()=6 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.ptxAwMP_ummtsiuEx-GEfeT-MRxw08HB.1 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.ZxP6rNyXDUcZa5ZECfnt5fzKipGEPibe.2 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.6oz2zPugGvs407KXGcyht6BTqj30OWj0.3 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.N6vA99Yc-qWan8zh0s5hHWL_-7o91wKW.4 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.O2_I9_LR1O6GV3GYaiwZQMHqfGmglKlJ.5 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.aItqI9Ehsp5SJdC6Li6XSRT04Fsha-7R.6 2024-03-09T15:24:38.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.17079289697826250761', time=2024-03-09T17:17:04.850846+0000, chain.objs.size()=1 2024-03-09T15:24:38.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.149+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.635__shadow_.JtLE77SuleOLYTGMFvGqWHtksHnkrzZ_1 2024-03-09T15:24:38.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.152+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.155+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T15:24:38.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.156+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.156+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.157+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T15:24:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.157+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.8358984970975629417', time=2024-03-09T16:52:14.304013+0000, chain.objs.size()=2 2024-03-09T15:24:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.157+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.151__shadow_.nJpcM04G5AKoLKNZEjh-xwMRyW1WI8Q_0 2024-03-09T15:24:38.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.157+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.151__shadow_.nJpcM04G5AKoLKNZEjh-xwMRyW1WI8Q_1 2024-03-09T15:24:38.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.159+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.161+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T15:24:38.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.162+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4326874704993582554', time=2024-03-09T17:05:12.381148+0000, chain.objs.size()=6 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.1 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.2 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.3 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.4 2024-03-09T15:24:38.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.5 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.500__multipart_srcmultipart.2~dmBXc2iJzabUGpHK7V7_0LJorCiZhyX.6 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.7676881353506426062', time=2024-03-09T17:05:33.340121+0000, chain.objs.size()=1 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.511__multipart_mymultipart.2~nEAaQnfktCrSwrSZmeq0lpDwzjK3rXb.1 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a', time=2024-03-09T17:08:06.616323+0000, chain.objs.size()=1 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a.1 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a', time=2024-03-09T17:08:06.619893+0000, chain.objs.size()=1 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a.2 2024-03-09T15:24:38.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a', time=2024-03-09T17:08:06.623585+0000, chain.objs.size()=1 2024-03-09T15:24:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a.3 2024-03-09T15:24:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a', time=2024-03-09T17:08:06.626950+0000, chain.objs.size()=1 2024-03-09T15:24:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a.4 2024-03-09T15:24:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a', time=2024-03-09T17:08:06.629898+0000, chain.objs.size()=1 2024-03-09T15:24:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.163+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a.5 2024-03-09T15:24:38.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.166+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a', time=2024-03-09T17:08:06.633454+0000, chain.objs.size()=1 2024-03-09T15:24:38.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.166+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.515__multipart_mymultipart.2~TwWur4kL_apxX9LipEsZxDcrR6Avu6a.6 2024-03-09T15:24:38.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.168+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.170+0000 7f1a65a44800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T15:24:38.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.172+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:24:38.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.172+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:24:38.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T15:24:38.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='_TaMRMmiYaweCClkM5N9kp5aC4lztauW', time=2024-03-09T16:52:26.165499+0000, chain.objs.size()=1 2024-03-09T15:24:38.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.153__shadow_.ThVddK1QnOyKD042srfT19GQno5oklR_0 2024-03-09T15:24:38.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 20 garbage collection: RGWGC::process iterating over entry tag='9d9fb811-cdaf-478b-a06b-5596cde59126.4593.4024648391255063513', time=2024-03-09T17:17:50.383467+0000, chain.objs.size()=6 2024-03-09T15:24:38.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.650__multipart_foo.2~iTDMKpRs-eHhkCnWvHGee0OOjOL7aJa.1 2024-03-09T15:24:38.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.650__multipart_foo.2~iTDMKpRs-eHhkCnWvHGee0OOjOL7aJa.2 2024-03-09T15:24:38.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.650__multipart_foo.2~iTDMKpRs-eHhkCnWvHGee0OOjOL7aJa.3 2024-03-09T15:24:38.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.650__multipart_foo.2~iTDMKpRs-eHhkCnWvHGee0OOjOL7aJa.4 2024-03-09T15:24:38.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.650__multipart_foo.2~iTDMKpRs-eHhkCnWvHGee0OOjOL7aJa.5 2024-03-09T15:24:38.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.173+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9d9fb811-cdaf-478b-a06b-5596cde59126.4593.650__multipart_foo.2~iTDMKpRs-eHhkCnWvHGee0OOjOL7aJa.6 2024-03-09T15:24:38.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.175+0000 7f1a65a44800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:24:38.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.179+0000 7f1919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:24:38.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.181+0000 7f1a65a44800 20 remove_watcher() i=0 2024-03-09T15:24:38.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.181+0000 7f1a65a44800 2 removed watcher, disabling cache 2024-03-09T15:24:38.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.182+0000 7f1a65a44800 20 remove_watcher() i=1 2024-03-09T15:24:38.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.183+0000 7f1a65a44800 20 remove_watcher() i=2 2024-03-09T15:24:38.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.184+0000 7f1a65a44800 20 remove_watcher() i=3 2024-03-09T15:24:38.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.185+0000 7f1a65a44800 20 remove_watcher() i=4 2024-03-09T15:24:38.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.186+0000 7f1a65a44800 20 remove_watcher() i=5 2024-03-09T15:24:38.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.187+0000 7f1a65a44800 20 remove_watcher() i=6 2024-03-09T15:24:38.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-03-09T15:24:38.188+0000 7f1a65a44800 20 remove_watcher() i=7 2024-03-09T15:24:38.199 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-03-09T15:24:38.211 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-03-09T15:24:38.238 DEBUG:teuthology.orchestra.run.smithi046:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-09T15:24:38.305 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-03-09T15:24:38.372 DEBUG:teuthology.orchestra.run.smithi046:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-09T15:24:38.440 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-03-09T15:24:38.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo update-ca-trust 2024-03-09T15:24:39.319 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-09T15:24:39.330 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-09T15:24:39.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:24:39.671 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:39.683 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:24:39.687 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2144,"stamp":"2024-03-09T15:24:39.149657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":795903647,"num_objects":792,"num_object_clones":0,"num_object_copies":2024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":150491,"num_read_kb":2743710,"num_write":128205,"num_write_kb":2398286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14411,"ondisk_log_size":14411,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2595404,"kb_used_data":1280012,"kb_used_omap":12,"kb_used_meta":1315315,"kb_avail":752379316,"statfs":{"total":773094113280,"available":770436419584,"internally_reserved":0,"allocated":1310732288,"data_stored":1295093658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1346883120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4194440,"num_objects":-8,"num_object_clones":0,"num_object_copies":-17,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":71,"num_read_kb":76,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004849"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.021041+0000","last_change":"2024-03-09T14:50:03.656802+0000","last_active":"2024-03-09T15:20:07.021041+0000","last_peered":"2024-03-09T15:20:07.021041+0000","last_clean":"2024-03-09T15:20:07.021041+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:20:07.021041+0000","last_undegraded":"2024-03-09T15:20:07.021041+0000","last_fullsized":"2024-03-09T15:20:07.021041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:04.962196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'7","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.028585+0000","last_change":"2024-03-09T14:35:55.601961+0000","last_active":"2024-03-09T15:20:57.028585+0000","last_peered":"2024-03-09T15:20:57.028585+0000","last_clean":"2024-03-09T15:20:57.028585+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:20:57.028585+0000","last_undegraded":"2024-03-09T15:20:57.028585+0000","last_fullsized":"2024-03-09T15:20:57.028585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:04:58.889343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009287+0000","last_change":"2024-03-09T14:35:50.589013+0000","last_active":"2024-03-09T15:20:52.009287+0000","last_peered":"2024-03-09T15:20:52.009287+0000","last_clean":"2024-03-09T15:20:52.009287+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:20:52.009287+0000","last_undegraded":"2024-03-09T15:20:52.009287+0000","last_fullsized":"2024-03-09T15:20:52.009287+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:23.606923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003320+0000","last_change":"2024-03-09T14:31:01.149135+0000","last_active":"2024-03-09T15:21:02.003320+0000","last_peered":"2024-03-09T15:21:02.003320+0000","last_clean":"2024-03-09T15:21:02.003320+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:21:02.003320+0000","last_undegraded":"2024-03-09T15:21:02.003320+0000","last_fullsized":"2024-03-09T15:21:02.003320+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:09.105678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.990155+0000","last_change":"2024-03-09T14:50:03.659762+0000","last_active":"2024-03-09T15:20:06.990155+0000","last_peered":"2024-03-09T15:20:06.990155+0000","last_clean":"2024-03-09T15:20:06.990155+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:20:06.990155+0000","last_undegraded":"2024-03-09T15:20:06.990155+0000","last_fullsized":"2024-03-09T15:20:06.990155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:14.705784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.151881+0000","last_change":"2024-03-09T14:35:55.598964+0000","last_active":"2024-03-09T15:20:57.151881+0000","last_peered":"2024-03-09T15:20:57.151881+0000","last_clean":"2024-03-09T15:20:57.151881+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:20:57.151881+0000","last_undegraded":"2024-03-09T15:20:57.151881+0000","last_fullsized":"2024-03-09T15:20:57.151881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:08.079908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.996523+0000","last_change":"2024-03-09T14:35:50.590196+0000","last_active":"2024-03-09T15:20:51.996523+0000","last_peered":"2024-03-09T15:20:51.996523+0000","last_clean":"2024-03-09T15:20:51.996523+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:20:51.996523+0000","last_undegraded":"2024-03-09T15:20:51.996523+0000","last_fullsized":"2024-03-09T15:20:51.996523+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:35.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":156,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:11.996933+0000","last_change":"2024-03-09T14:31:01.138966+0000","last_active":"2024-03-09T15:21:11.996933+0000","last_peered":"2024-03-09T15:21:11.996933+0000","last_clean":"2024-03-09T15:21:11.996933+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:21:11.996933+0000","last_undegraded":"2024-03-09T15:21:11.996933+0000","last_fullsized":"2024-03-09T15:21:11.996933+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:10.293011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.033437+0000","last_change":"2024-03-09T14:50:03.653730+0000","last_active":"2024-03-09T15:21:32.033437+0000","last_peered":"2024-03-09T15:21:32.033437+0000","last_clean":"2024-03-09T15:21:32.033437+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:21:32.033437+0000","last_undegraded":"2024-03-09T15:21:32.033437+0000","last_fullsized":"2024-03-09T15:21:32.033437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:21.654055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'1","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903377+0000","last_change":"2024-03-09T14:35:55.635024+0000","last_active":"2024-03-09T15:21:46.903377+0000","last_peered":"2024-03-09T15:21:46.903377+0000","last_clean":"2024-03-09T15:21:46.903377+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:21:46.903377+0000","last_undegraded":"2024-03-09T15:21:46.903377+0000","last_fullsized":"2024-03-09T15:21:46.903377+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:46.253263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'7","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.001931+0000","last_change":"2024-03-09T14:35:50.592237+0000","last_active":"2024-03-09T15:22:02.001931+0000","last_peered":"2024-03-09T15:22:02.001931+0000","last_clean":"2024-03-09T15:22:02.001931+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:22:02.001931+0000","last_undegraded":"2024-03-09T15:22:02.001931+0000","last_fullsized":"2024-03-09T15:22:02.001931+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:31.946306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003270+0000","last_change":"2024-03-09T14:31:01.144121+0000","last_active":"2024-03-09T15:21:02.003270+0000","last_peered":"2024-03-09T15:21:02.003270+0000","last_clean":"2024-03-09T15:21:02.003270+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:21:02.003270+0000","last_undegraded":"2024-03-09T15:21:02.003270+0000","last_fullsized":"2024-03-09T15:21:02.003270+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:07.901302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.015382+0000","last_change":"2024-03-09T14:50:03.664715+0000","last_active":"2024-03-09T15:21:42.015382+0000","last_peered":"2024-03-09T15:21:42.015382+0000","last_clean":"2024-03-09T15:21:42.015382+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:21:42.015382+0000","last_undegraded":"2024-03-09T15:21:42.015382+0000","last_fullsized":"2024-03-09T15:21:42.015382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:17.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018993+0000","last_change":"2024-03-09T14:35:55.633735+0000","last_active":"2024-03-09T15:22:12.018993+0000","last_peered":"2024-03-09T15:22:12.018993+0000","last_clean":"2024-03-09T15:22:12.018993+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:22:12.018993+0000","last_undegraded":"2024-03-09T15:22:12.018993+0000","last_fullsized":"2024-03-09T15:22:12.018993+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:58.258793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3194156,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":2,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.160281+0000","last_change":"2024-03-09T14:35:50.588633+0000","last_active":"2024-03-09T15:21:42.160281+0000","last_peered":"2024-03-09T15:21:42.160281+0000","last_clean":"2024-03-09T15:21:42.160281+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:21:42.160281+0000","last_undegraded":"2024-03-09T15:21:42.160281+0000","last_fullsized":"2024-03-09T15:21:42.160281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:47.842912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010493+0000","last_change":"2024-03-09T14:31:01.143564+0000","last_active":"2024-03-09T15:21:02.010493+0000","last_peered":"2024-03-09T15:21:02.010493+0000","last_clean":"2024-03-09T15:21:02.010493+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:21:02.010493+0000","last_undegraded":"2024-03-09T15:21:02.010493+0000","last_fullsized":"2024-03-09T15:21:02.010493+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:38.918335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019554+0000","last_change":"2024-03-09T14:50:03.656253+0000","last_active":"2024-03-09T15:22:17.019554+0000","last_peered":"2024-03-09T15:22:17.019554+0000","last_clean":"2024-03-09T15:22:17.019554+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:22:17.019554+0000","last_undegraded":"2024-03-09T15:22:17.019554+0000","last_fullsized":"2024-03-09T15:22:17.019554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:38.610391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'1","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.037997+0000","last_change":"2024-03-09T14:35:55.603890+0000","last_active":"2024-03-09T15:22:02.037997+0000","last_peered":"2024-03-09T15:22:02.037997+0000","last_clean":"2024-03-09T15:22:02.037997+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:22:02.037997+0000","last_undegraded":"2024-03-09T15:22:02.037997+0000","last_fullsized":"2024-03-09T15:22:02.037997+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:40.989711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903235+0000","last_change":"2024-03-09T14:35:50.586383+0000","last_active":"2024-03-09T15:21:46.903235+0000","last_peered":"2024-03-09T15:21:46.903235+0000","last_clean":"2024-03-09T15:21:46.903235+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:21:46.903235+0000","last_undegraded":"2024-03-09T15:21:46.903235+0000","last_fullsized":"2024-03-09T15:21:46.903235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:58.715378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":164,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010460+0000","last_change":"2024-03-09T14:31:01.141921+0000","last_active":"2024-03-09T15:21:02.010460+0000","last_peered":"2024-03-09T15:21:02.010460+0000","last_clean":"2024-03-09T15:21:02.010460+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:21:02.010460+0000","last_undegraded":"2024-03-09T15:21:02.010460+0000","last_fullsized":"2024-03-09T15:21:02.010460+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:28.572848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999640+0000","last_change":"2024-03-09T14:50:03.661504+0000","last_active":"2024-03-09T15:21:21.999640+0000","last_peered":"2024-03-09T15:21:21.999640+0000","last_clean":"2024-03-09T15:21:21.999640+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:21:21.999640+0000","last_undegraded":"2024-03-09T15:21:21.999640+0000","last_fullsized":"2024-03-09T15:21:21.999640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:16.731080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.036471+0000","last_change":"2024-03-09T14:35:55.603980+0000","last_active":"2024-03-09T15:21:52.036471+0000","last_peered":"2024-03-09T15:21:52.036471+0000","last_clean":"2024-03-09T15:21:52.036471+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:21:52.036471+0000","last_undegraded":"2024-03-09T15:21:52.036471+0000","last_fullsized":"2024-03-09T15:21:52.036471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:36.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'10","reported_seq":75,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161560+0000","last_change":"2024-03-09T14:35:50.584429+0000","last_active":"2024-03-09T15:21:52.161560+0000","last_peered":"2024-03-09T15:21:52.161560+0000","last_clean":"2024-03-09T15:21:52.161560+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:21:52.161560+0000","last_undegraded":"2024-03-09T15:21:52.161560+0000","last_fullsized":"2024-03-09T15:21:52.161560+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:35.785481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":37890,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029279+0000","last_change":"2024-03-09T14:31:01.137869+0000","last_active":"2024-03-09T15:21:02.029279+0000","last_peered":"2024-03-09T15:21:02.029279+0000","last_clean":"2024-03-09T15:21:02.029279+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:21:02.029279+0000","last_undegraded":"2024-03-09T15:21:02.029279+0000","last_fullsized":"2024-03-09T15:21:02.029279+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:00.440659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159481+0000","last_change":"2024-03-09T14:50:03.659706+0000","last_active":"2024-03-09T15:20:07.159481+0000","last_peered":"2024-03-09T15:20:07.159481+0000","last_clean":"2024-03-09T15:20:07.159481+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:20:07.159481+0000","last_undegraded":"2024-03-09T15:20:07.159481+0000","last_fullsized":"2024-03-09T15:20:07.159481+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:01.960769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.028566+0000","last_change":"2024-03-09T14:35:55.605449+0000","last_active":"2024-03-09T15:20:57.028566+0000","last_peered":"2024-03-09T15:20:57.028566+0000","last_clean":"2024-03-09T15:20:57.028566+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:20:57.028566+0000","last_undegraded":"2024-03-09T15:20:57.028566+0000","last_fullsized":"2024-03-09T15:20:57.028566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:08.518355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151137+0000","last_change":"2024-03-09T14:35:50.585219+0000","last_active":"2024-03-09T15:20:52.151137+0000","last_peered":"2024-03-09T15:20:52.151137+0000","last_clean":"2024-03-09T15:20:52.151137+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:20:52.151137+0000","last_undegraded":"2024-03-09T15:20:52.151137+0000","last_fullsized":"2024-03-09T15:20:52.151137+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:40.696301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905562+0000","last_change":"2024-03-09T14:31:01.146419+0000","last_active":"2024-03-09T15:22:06.905562+0000","last_peered":"2024-03-09T15:22:06.905562+0000","last_clean":"2024-03-09T15:22:06.905562+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:22:06.905562+0000","last_undegraded":"2024-03-09T15:22:06.905562+0000","last_fullsized":"2024-03-09T15:22:06.905562+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:26.233793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159538+0000","last_change":"2024-03-09T14:50:03.664828+0000","last_active":"2024-03-09T15:20:07.159538+0000","last_peered":"2024-03-09T15:20:07.159538+0000","last_clean":"2024-03-09T15:20:07.159538+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:20:07.159538+0000","last_undegraded":"2024-03-09T15:20:07.159538+0000","last_fullsized":"2024-03-09T15:20:07.159538+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:43:10.894912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009850+0000","last_change":"2024-03-09T14:35:55.606688+0000","last_active":"2024-03-09T15:20:57.009850+0000","last_peered":"2024-03-09T15:20:57.009850+0000","last_clean":"2024-03-09T15:20:57.009850+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:20:57.009850+0000","last_undegraded":"2024-03-09T15:20:57.009850+0000","last_fullsized":"2024-03-09T15:20:57.009850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:27.128463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002039+0000","last_change":"2024-03-09T14:35:50.593904+0000","last_active":"2024-03-09T15:20:52.002039+0000","last_peered":"2024-03-09T15:20:52.002039+0000","last_clean":"2024-03-09T15:20:52.002039+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:20:52.002039+0000","last_undegraded":"2024-03-09T15:20:52.002039+0000","last_fullsized":"2024-03-09T15:20:52.002039+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:03.967997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002072+0000","last_change":"2024-03-09T14:31:01.135095+0000","last_active":"2024-03-09T15:21:47.002072+0000","last_peered":"2024-03-09T15:21:47.002072+0000","last_clean":"2024-03-09T15:21:47.002072+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:21:47.002072+0000","last_undegraded":"2024-03-09T15:21:47.002072+0000","last_fullsized":"2024-03-09T15:21:47.002072+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:55.759399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993733+0000","last_change":"2024-03-09T14:50:03.657383+0000","last_active":"2024-03-09T15:20:26.993733+0000","last_peered":"2024-03-09T15:20:26.993733+0000","last_clean":"2024-03-09T15:20:26.993733+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:20:26.993733+0000","last_undegraded":"2024-03-09T15:20:26.993733+0000","last_fullsized":"2024-03-09T15:20:26.993733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:07.698784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"257'11","reported_seq":68,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016714+0000","last_change":"2024-03-09T14:35:55.634050+0000","last_active":"2024-03-09T15:21:52.016714+0000","last_peered":"2024-03-09T15:21:52.016714+0000","last_clean":"2024-03-09T15:21:52.016714+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:21:52.016714+0000","last_undegraded":"2024-03-09T15:21:52.016714+0000","last_fullsized":"2024-03-09T15:21:52.016714+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:35.953944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"257'10","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023348+0000","last_change":"2024-03-09T14:35:50.582640+0000","last_active":"2024-03-09T15:20:22.023348+0000","last_peered":"2024-03-09T15:20:22.023348+0000","last_clean":"2024-03-09T15:20:22.023348+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:20:22.023348+0000","last_undegraded":"2024-03-09T15:20:22.023348+0000","last_fullsized":"2024-03-09T15:20:22.023348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:34.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903407+0000","last_change":"2024-03-09T14:31:01.148885+0000","last_active":"2024-03-09T15:21:46.903407+0000","last_peered":"2024-03-09T15:21:46.903407+0000","last_clean":"2024-03-09T15:21:46.903407+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:21:46.903407+0000","last_undegraded":"2024-03-09T15:21:46.903407+0000","last_fullsized":"2024-03-09T15:21:46.903407+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:02.222592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992120+0000","last_change":"2024-03-09T14:50:03.655189+0000","last_active":"2024-03-09T15:20:26.992120+0000","last_peered":"2024-03-09T15:20:26.992120+0000","last_clean":"2024-03-09T15:20:26.992120+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:20:26.992120+0000","last_undegraded":"2024-03-09T15:20:26.992120+0000","last_fullsized":"2024-03-09T15:20:26.992120+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:03.341531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.007023+0000","last_change":"2024-03-09T14:35:55.633676+0000","last_active":"2024-03-09T15:20:32.007023+0000","last_peered":"2024-03-09T15:20:32.007023+0000","last_clean":"2024-03-09T15:20:32.007023+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:20:32.007023+0000","last_undegraded":"2024-03-09T15:20:32.007023+0000","last_fullsized":"2024-03-09T15:20:32.007023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:05:23.209750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.174264+0000","last_change":"2024-03-09T14:35:50.585080+0000","last_active":"2024-03-09T15:21:47.174264+0000","last_peered":"2024-03-09T15:21:47.174264+0000","last_clean":"2024-03-09T15:21:47.174264+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:21:47.174264+0000","last_undegraded":"2024-03-09T15:21:47.174264+0000","last_fullsized":"2024-03-09T15:21:47.174264+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.598130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":95,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.016119+0000","last_change":"2024-03-09T14:31:01.143022+0000","last_active":"2024-03-09T15:21:47.016119+0000","last_peered":"2024-03-09T15:21:47.016119+0000","last_clean":"2024-03-09T15:21:47.016119+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:21:47.016119+0000","last_undegraded":"2024-03-09T15:21:47.016119+0000","last_fullsized":"2024-03-09T15:21:47.016119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:37.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162669+0000","last_change":"2024-03-09T14:50:03.658035+0000","last_active":"2024-03-09T15:20:27.162669+0000","last_peered":"2024-03-09T15:20:27.162669+0000","last_clean":"2024-03-09T15:20:27.162669+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:20:27.162669+0000","last_undegraded":"2024-03-09T15:20:27.162669+0000","last_fullsized":"2024-03-09T15:20:27.162669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:02.499788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'4","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016749+0000","last_change":"2024-03-09T14:35:55.636071+0000","last_active":"2024-03-09T15:21:52.016749+0000","last_peered":"2024-03-09T15:21:52.016749+0000","last_clean":"2024-03-09T15:21:52.016749+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:21:52.016749+0000","last_undegraded":"2024-03-09T15:21:52.016749+0000","last_fullsized":"2024-03-09T15:21:52.016749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:26.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000382+0000","last_change":"2024-03-09T14:35:50.592957+0000","last_active":"2024-03-09T15:21:47.000382+0000","last_peered":"2024-03-09T15:21:47.000382+0000","last_clean":"2024-03-09T15:21:47.000382+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:21:47.000382+0000","last_undegraded":"2024-03-09T15:21:47.000382+0000","last_fullsized":"2024-03-09T15:21:47.000382+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:17.607559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000355+0000","last_change":"2024-03-09T14:31:01.134030+0000","last_active":"2024-03-09T15:21:47.000355+0000","last_peered":"2024-03-09T15:21:47.000355+0000","last_clean":"2024-03-09T15:21:47.000355+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:21:47.000355+0000","last_undegraded":"2024-03-09T15:21:47.000355+0000","last_fullsized":"2024-03-09T15:21:47.000355+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:28.544093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024030+0000","last_change":"2024-03-09T14:50:03.654352+0000","last_active":"2024-03-09T15:20:27.024030+0000","last_peered":"2024-03-09T15:20:27.024030+0000","last_clean":"2024-03-09T15:20:27.024030+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:20:27.024030+0000","last_undegraded":"2024-03-09T15:20:27.024030+0000","last_fullsized":"2024-03-09T15:20:27.024030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:36.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161653+0000","last_change":"2024-03-09T14:35:55.604280+0000","last_active":"2024-03-09T15:21:52.161653+0000","last_peered":"2024-03-09T15:21:52.161653+0000","last_clean":"2024-03-09T15:21:52.161653+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:21:52.161653+0000","last_undegraded":"2024-03-09T15:21:52.161653+0000","last_fullsized":"2024-03-09T15:21:52.161653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:34.983233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903393+0000","last_change":"2024-03-09T14:35:50.585309+0000","last_active":"2024-03-09T15:21:46.903393+0000","last_peered":"2024-03-09T15:21:46.903393+0000","last_clean":"2024-03-09T15:21:46.903393+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:21:46.903393+0000","last_undegraded":"2024-03-09T15:21:46.903393+0000","last_fullsized":"2024-03-09T15:21:46.903393+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:46:45.637003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.160203+0000","last_change":"2024-03-09T14:31:01.137671+0000","last_active":"2024-03-09T15:20:12.160203+0000","last_peered":"2024-03-09T15:20:12.160203+0000","last_clean":"2024-03-09T15:20:12.160203+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:20:12.160203+0000","last_undegraded":"2024-03-09T15:20:12.160203+0000","last_fullsized":"2024-03-09T15:20:12.160203+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:01.231496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014344+0000","last_change":"2024-03-09T14:50:03.655960+0000","last_active":"2024-03-09T15:21:32.014344+0000","last_peered":"2024-03-09T15:21:32.014344+0000","last_clean":"2024-03-09T15:21:32.014344+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:21:32.014344+0000","last_undegraded":"2024-03-09T15:21:32.014344+0000","last_fullsized":"2024-03-09T15:21:32.014344+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:11.272439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992699+0000","last_change":"2024-03-09T14:35:55.606840+0000","last_active":"2024-03-09T15:20:16.992699+0000","last_peered":"2024-03-09T15:20:16.992699+0000","last_clean":"2024-03-09T15:20:16.992699+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:20:16.992699+0000","last_undegraded":"2024-03-09T15:20:16.992699+0000","last_fullsized":"2024-03-09T15:20:16.992699+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.473637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.145659+0000","last_change":"2024-03-09T14:35:50.590700+0000","last_active":"2024-03-09T15:20:12.145659+0000","last_peered":"2024-03-09T15:20:12.145659+0000","last_clean":"2024-03-09T15:20:12.145659+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:20:12.145659+0000","last_undegraded":"2024-03-09T15:20:12.145659+0000","last_fullsized":"2024-03-09T15:20:12.145659+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:08.873263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":83,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158796+0000","last_change":"2024-03-09T14:31:01.137580+0000","last_active":"2024-03-09T15:20:02.158796+0000","last_peered":"2024-03-09T15:20:02.158796+0000","last_clean":"2024-03-09T15:20:02.158796+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:02.158796+0000","last_undegraded":"2024-03-09T15:20:02.158796+0000","last_fullsized":"2024-03-09T15:20:02.158796+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:12.605404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.006645+0000","last_change":"2024-03-09T14:50:03.660277+0000","last_active":"2024-03-09T15:21:32.006645+0000","last_peered":"2024-03-09T15:21:32.006645+0000","last_clean":"2024-03-09T15:21:32.006645+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:21:32.006645+0000","last_undegraded":"2024-03-09T15:21:32.006645+0000","last_fullsized":"2024-03-09T15:21:32.006645+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:40.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992671+0000","last_change":"2024-03-09T14:35:55.600712+0000","last_active":"2024-03-09T15:20:16.992671+0000","last_peered":"2024-03-09T15:20:16.992671+0000","last_clean":"2024-03-09T15:20:16.992671+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:20:16.992671+0000","last_undegraded":"2024-03-09T15:20:16.992671+0000","last_fullsized":"2024-03-09T15:20:16.992671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:03.894551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.004349+0000","last_change":"2024-03-09T14:35:50.590828+0000","last_active":"2024-03-09T15:20:12.004349+0000","last_peered":"2024-03-09T15:20:12.004349+0000","last_clean":"2024-03-09T15:20:12.004349+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:20:12.004349+0000","last_undegraded":"2024-03-09T15:20:12.004349+0000","last_fullsized":"2024-03-09T15:20:12.004349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:47.297475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996277+0000","last_change":"2024-03-09T14:31:01.144397+0000","last_active":"2024-03-09T15:20:01.996277+0000","last_peered":"2024-03-09T15:20:01.996277+0000","last_clean":"2024-03-09T15:20:01.996277+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:20:01.996277+0000","last_undegraded":"2024-03-09T15:20:01.996277+0000","last_fullsized":"2024-03-09T15:20:01.996277+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:38.797574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000514+0000","last_change":"2024-03-09T14:50:03.662986+0000","last_active":"2024-03-09T15:20:37.000514+0000","last_peered":"2024-03-09T15:20:37.000514+0000","last_clean":"2024-03-09T15:20:37.000514+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:20:37.000514+0000","last_undegraded":"2024-03-09T15:20:37.000514+0000","last_fullsized":"2024-03-09T15:20:37.000514+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:12.215808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.005063+0000","last_change":"2024-03-09T14:35:55.606971+0000","last_active":"2024-03-09T15:20:17.005063+0000","last_peered":"2024-03-09T15:20:17.005063+0000","last_clean":"2024-03-09T15:20:17.005063+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:20:17.005063+0000","last_undegraded":"2024-03-09T15:20:17.005063+0000","last_fullsized":"2024-03-09T15:20:17.005063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:59.770598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021829+0000","last_change":"2024-03-09T14:35:50.581340+0000","last_active":"2024-03-09T15:20:12.021829+0000","last_peered":"2024-03-09T15:20:12.021829+0000","last_clean":"2024-03-09T15:20:12.021829+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:20:12.021829+0000","last_undegraded":"2024-03-09T15:20:12.021829+0000","last_fullsized":"2024-03-09T15:20:12.021829+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:47.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'83","reported_seq":297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144192+0000","last_change":"2024-03-09T14:31:01.140501+0000","last_active":"2024-03-09T15:20:02.144192+0000","last_peered":"2024-03-09T15:20:02.144192+0000","last_clean":"2024-03-09T15:20:02.144192+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:20:02.144192+0000","last_undegraded":"2024-03-09T15:20:02.144192+0000","last_fullsized":"2024-03-09T15:20:02.144192+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:25.600781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014299+0000","last_change":"2024-03-09T14:50:03.654675+0000","last_active":"2024-03-09T15:21:32.014299+0000","last_peered":"2024-03-09T15:21:32.014299+0000","last_clean":"2024-03-09T15:21:32.014299+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:21:32.014299+0000","last_undegraded":"2024-03-09T15:21:32.014299+0000","last_fullsized":"2024-03-09T15:21:32.014299+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:16.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022667+0000","last_change":"2024-03-09T14:35:55.607431+0000","last_active":"2024-03-09T15:20:17.022667+0000","last_peered":"2024-03-09T15:20:17.022667+0000","last_clean":"2024-03-09T15:20:17.022667+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:20:17.022667+0000","last_undegraded":"2024-03-09T15:20:17.022667+0000","last_fullsized":"2024-03-09T15:20:17.022667+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021909+0000","last_change":"2024-03-09T14:35:50.592140+0000","last_active":"2024-03-09T15:20:12.021909+0000","last_peered":"2024-03-09T15:20:12.021909+0000","last_clean":"2024-03-09T15:20:12.021909+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:20:12.021909+0000","last_undegraded":"2024-03-09T15:20:12.021909+0000","last_fullsized":"2024-03-09T15:20:12.021909+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:08.154255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.002932+0000","last_change":"2024-03-09T14:31:01.141535+0000","last_active":"2024-03-09T15:20:02.002932+0000","last_peered":"2024-03-09T15:20:02.002932+0000","last_clean":"2024-03-09T15:20:02.002932+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:20:02.002932+0000","last_undegraded":"2024-03-09T15:20:02.002932+0000","last_fullsized":"2024-03-09T15:20:02.002932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:30.104908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993313+0000","last_change":"2024-03-09T14:50:03.655565+0000","last_active":"2024-03-09T15:20:36.993313+0000","last_peered":"2024-03-09T15:20:36.993313+0000","last_clean":"2024-03-09T15:20:36.993313+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:20:36.993313+0000","last_undegraded":"2024-03-09T15:20:36.993313+0000","last_fullsized":"2024-03-09T15:20:36.993313+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:49.229016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'6","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009911+0000","last_change":"2024-03-09T14:35:55.606305+0000","last_active":"2024-03-09T15:20:57.009911+0000","last_peered":"2024-03-09T15:20:57.009911+0000","last_clean":"2024-03-09T15:20:57.009911+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:20:57.009911+0000","last_undegraded":"2024-03-09T15:20:57.009911+0000","last_fullsized":"2024-03-09T15:20:57.009911+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:34.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20522,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'6","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.166560+0000","last_change":"2024-03-09T14:35:50.588195+0000","last_active":"2024-03-09T15:20:52.166560+0000","last_peered":"2024-03-09T15:20:52.166560+0000","last_clean":"2024-03-09T15:20:52.166560+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:20:52.166560+0000","last_undegraded":"2024-03-09T15:20:52.166560+0000","last_fullsized":"2024-03-09T15:20:52.166560+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:50:18.644010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":6842,"num_write":11,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008749+0000","last_change":"2024-03-09T14:31:01.145852+0000","last_active":"2024-03-09T15:20:47.008749+0000","last_peered":"2024-03-09T15:20:47.008749+0000","last_clean":"2024-03-09T15:20:47.008749+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:20:47.008749+0000","last_undegraded":"2024-03-09T15:20:47.008749+0000","last_fullsized":"2024-03-09T15:20:47.008749+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:57.994897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172868+0000","last_change":"2024-03-09T14:50:03.664102+0000","last_active":"2024-03-09T15:21:37.172868+0000","last_peered":"2024-03-09T15:21:37.172868+0000","last_clean":"2024-03-09T15:21:37.172868+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:21:37.172868+0000","last_undegraded":"2024-03-09T15:21:37.172868+0000","last_fullsized":"2024-03-09T15:21:37.172868+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:04.844692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.034355+0000","last_change":"2024-03-09T14:36:32.678035+0000","last_active":"2024-03-09T15:21:37.034355+0000","last_peered":"2024-03-09T15:21:37.034355+0000","last_clean":"2024-03-09T15:21:37.034355+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:21:37.034355+0000","last_undegraded":"2024-03-09T15:21:37.034355+0000","last_fullsized":"2024-03-09T15:21:37.034355+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:52.793827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.994913+0000","last_change":"2024-03-09T14:35:50.593689+0000","last_active":"2024-03-09T15:20:51.994913+0000","last_peered":"2024-03-09T15:20:51.994913+0000","last_clean":"2024-03-09T15:20:51.994913+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:20:51.994913+0000","last_undegraded":"2024-03-09T15:20:51.994913+0000","last_fullsized":"2024-03-09T15:20:51.994913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:17.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024819+0000","last_change":"2024-03-09T14:31:01.138384+0000","last_active":"2024-03-09T15:20:32.024819+0000","last_peered":"2024-03-09T15:20:32.024819+0000","last_clean":"2024-03-09T15:20:32.024819+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:20:32.024819+0000","last_undegraded":"2024-03-09T15:20:32.024819+0000","last_fullsized":"2024-03-09T15:20:32.024819+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:52.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023996+0000","last_change":"2024-03-09T14:50:03.658657+0000","last_active":"2024-03-09T15:20:27.023996+0000","last_peered":"2024-03-09T15:20:27.023996+0000","last_clean":"2024-03-09T15:20:27.023996+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:20:27.023996+0000","last_undegraded":"2024-03-09T15:20:27.023996+0000","last_fullsized":"2024-03-09T15:20:27.023996+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:18.812497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:06.998034+0000","last_change":"2024-03-09T14:35:55.635179+0000","last_active":"2024-03-09T15:21:06.998034+0000","last_peered":"2024-03-09T15:21:06.998034+0000","last_clean":"2024-03-09T15:21:06.998034+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:21:06.998034+0000","last_undegraded":"2024-03-09T15:21:06.998034+0000","last_fullsized":"2024-03-09T15:21:06.998034+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:57.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002095+0000","last_change":"2024-03-09T14:35:50.588159+0000","last_active":"2024-03-09T15:20:52.002095+0000","last_peered":"2024-03-09T15:20:52.002095+0000","last_clean":"2024-03-09T15:20:52.002095+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:20:52.002095+0000","last_undegraded":"2024-03-09T15:20:52.002095+0000","last_fullsized":"2024-03-09T15:20:52.002095+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:42.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024744+0000","last_change":"2024-03-09T14:31:01.139440+0000","last_active":"2024-03-09T15:20:32.024744+0000","last_peered":"2024-03-09T15:20:32.024744+0000","last_clean":"2024-03-09T15:20:32.024744+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:20:32.024744+0000","last_undegraded":"2024-03-09T15:20:32.024744+0000","last_fullsized":"2024-03-09T15:20:32.024744+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:05.382467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162719+0000","last_change":"2024-03-09T14:50:03.657344+0000","last_active":"2024-03-09T15:20:27.162719+0000","last_peered":"2024-03-09T15:20:27.162719+0000","last_clean":"2024-03-09T15:20:27.162719+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:20:27.162719+0000","last_undegraded":"2024-03-09T15:20:27.162719+0000","last_fullsized":"2024-03-09T15:20:27.162719+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:00.699350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009935+0000","last_change":"2024-03-09T14:35:55.603538+0000","last_active":"2024-03-09T15:20:57.009935+0000","last_peered":"2024-03-09T15:20:57.009935+0000","last_clean":"2024-03-09T15:20:57.009935+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:20:57.009935+0000","last_undegraded":"2024-03-09T15:20:57.009935+0000","last_fullsized":"2024-03-09T15:20:57.009935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:48.904849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'1","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997509+0000","last_change":"2024-03-09T14:35:50.587122+0000","last_active":"2024-03-09T15:21:01.997509+0000","last_peered":"2024-03-09T15:21:01.997509+0000","last_clean":"2024-03-09T15:21:01.997509+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:21:01.997509+0000","last_undegraded":"2024-03-09T15:21:01.997509+0000","last_fullsized":"2024-03-09T15:21:01.997509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:59.885398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992702+0000","last_change":"2024-03-09T14:31:01.142302+0000","last_active":"2024-03-09T15:20:31.992702+0000","last_peered":"2024-03-09T15:20:31.992702+0000","last_clean":"2024-03-09T15:20:31.992702+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:20:31.992702+0000","last_undegraded":"2024-03-09T15:20:31.992702+0000","last_fullsized":"2024-03-09T15:20:31.992702+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:40.401950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.014916+0000","last_change":"2024-03-09T14:50:03.656718+0000","last_active":"2024-03-09T15:21:37.014916+0000","last_peered":"2024-03-09T15:21:37.014916+0000","last_clean":"2024-03-09T15:21:37.014916+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:21:37.014916+0000","last_undegraded":"2024-03-09T15:21:37.014916+0000","last_fullsized":"2024-03-09T15:21:37.014916+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:52.066966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'7","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.157899+0000","last_change":"2024-03-09T14:35:55.603262+0000","last_active":"2024-03-09T15:21:27.157899+0000","last_peered":"2024-03-09T15:21:27.157899+0000","last_clean":"2024-03-09T15:21:27.157899+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:21:27.157899+0000","last_undegraded":"2024-03-09T15:21:27.157899+0000","last_fullsized":"2024-03-09T15:21:27.157899+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:45.193657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005483+0000","last_change":"2024-03-09T14:35:50.586279+0000","last_active":"2024-03-09T15:21:22.005483+0000","last_peered":"2024-03-09T15:21:22.005483+0000","last_clean":"2024-03-09T15:21:22.005483+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:21:22.005483+0000","last_undegraded":"2024-03-09T15:21:22.005483+0000","last_fullsized":"2024-03-09T15:21:22.005483+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:50.461301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999932+0000","last_change":"2024-03-09T14:31:01.148313+0000","last_active":"2024-03-09T15:20:31.999932+0000","last_peered":"2024-03-09T15:20:31.999932+0000","last_clean":"2024-03-09T15:20:31.999932+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:20:31.999932+0000","last_undegraded":"2024-03-09T15:20:31.999932+0000","last_fullsized":"2024-03-09T15:20:31.999932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:27.523628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173665+0000","last_change":"2024-03-09T14:50:03.659935+0000","last_active":"2024-03-09T15:21:42.173665+0000","last_peered":"2024-03-09T15:21:42.173665+0000","last_clean":"2024-03-09T15:21:42.173665+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:21:42.173665+0000","last_undegraded":"2024-03-09T15:21:42.173665+0000","last_fullsized":"2024-03-09T15:21:42.173665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:35.107226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171479+0000","last_change":"2024-03-09T14:35:55.633083+0000","last_active":"2024-03-09T15:21:27.171479+0000","last_peered":"2024-03-09T15:21:27.171479+0000","last_clean":"2024-03-09T15:21:27.171479+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:21:27.171479+0000","last_undegraded":"2024-03-09T15:21:27.171479+0000","last_fullsized":"2024-03-09T15:21:27.171479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:21.416130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999575+0000","last_change":"2024-03-09T14:35:50.583192+0000","last_active":"2024-03-09T15:21:21.999575+0000","last_peered":"2024-03-09T15:21:21.999575+0000","last_clean":"2024-03-09T15:21:21.999575+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:21:21.999575+0000","last_undegraded":"2024-03-09T15:21:21.999575+0000","last_fullsized":"2024-03-09T15:21:21.999575+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:36.010771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.167798+0000","last_change":"2024-03-09T14:31:01.138602+0000","last_active":"2024-03-09T15:21:02.167798+0000","last_peered":"2024-03-09T15:21:02.167798+0000","last_clean":"2024-03-09T15:21:02.167798+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:21:02.167798+0000","last_undegraded":"2024-03-09T15:21:02.167798+0000","last_fullsized":"2024-03-09T15:21:02.167798+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:22.514104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172891+0000","last_change":"2024-03-09T14:50:03.659514+0000","last_active":"2024-03-09T15:21:37.172891+0000","last_peered":"2024-03-09T15:21:37.172891+0000","last_clean":"2024-03-09T15:21:37.172891+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:21:37.172891+0000","last_undegraded":"2024-03-09T15:21:37.172891+0000","last_fullsized":"2024-03-09T15:21:37.172891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:41.947406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:56.996980+0000","last_change":"2024-03-09T14:35:55.605840+0000","last_active":"2024-03-09T15:20:56.996980+0000","last_peered":"2024-03-09T15:20:56.996980+0000","last_clean":"2024-03-09T15:20:56.996980+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:20:56.996980+0000","last_undegraded":"2024-03-09T15:20:56.996980+0000","last_fullsized":"2024-03-09T15:20:56.996980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:02.619502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'1","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:41.902673+0000","last_change":"2024-03-09T14:35:50.584614+0000","last_active":"2024-03-09T15:21:41.902673+0000","last_peered":"2024-03-09T15:21:41.902673+0000","last_clean":"2024-03-09T15:21:41.902673+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:21:41.902673+0000","last_undegraded":"2024-03-09T15:21:41.902673+0000","last_fullsized":"2024-03-09T15:21:41.902673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:53.029868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009230+0000","last_change":"2024-03-09T14:31:01.141879+0000","last_active":"2024-03-09T15:20:52.009230+0000","last_peered":"2024-03-09T15:20:52.009230+0000","last_clean":"2024-03-09T15:20:52.009230+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:20:52.009230+0000","last_undegraded":"2024-03-09T15:20:52.009230+0000","last_fullsized":"2024-03-09T15:20:52.009230+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:28.690709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:36.902107+0000","last_change":"2024-03-09T14:50:03.659852+0000","last_active":"2024-03-09T15:21:36.902107+0000","last_peered":"2024-03-09T15:21:36.902107+0000","last_clean":"2024-03-09T15:21:36.902107+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:21:36.902107+0000","last_undegraded":"2024-03-09T15:21:36.902107+0000","last_fullsized":"2024-03-09T15:21:36.902107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:56.267905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172839+0000","last_change":"2024-03-09T14:35:55.601630+0000","last_active":"2024-03-09T15:21:37.172839+0000","last_peered":"2024-03-09T15:21:37.172839+0000","last_clean":"2024-03-09T15:21:37.172839+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:21:37.172839+0000","last_undegraded":"2024-03-09T15:21:37.172839+0000","last_fullsized":"2024-03-09T15:21:37.172839+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:40.116666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'3","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151186+0000","last_change":"2024-03-09T14:35:50.593430+0000","last_active":"2024-03-09T15:20:52.151186+0000","last_peered":"2024-03-09T15:20:52.151186+0000","last_clean":"2024-03-09T15:20:52.151186+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:20:52.151186+0000","last_undegraded":"2024-03-09T15:20:52.151186+0000","last_fullsized":"2024-03-09T15:20:52.151186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:07.895578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":10280,"num_write":8,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027735+0000","last_change":"2024-03-09T14:31:01.140169+0000","last_active":"2024-03-09T15:20:52.027735+0000","last_peered":"2024-03-09T15:20:52.027735+0000","last_clean":"2024-03-09T15:20:52.027735+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:20:52.027735+0000","last_undegraded":"2024-03-09T15:20:52.027735+0000","last_fullsized":"2024-03-09T15:20:52.027735+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:33.984575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170878+0000","last_change":"2024-03-09T14:50:03.660084+0000","last_active":"2024-03-09T15:21:22.170878+0000","last_peered":"2024-03-09T15:21:22.170878+0000","last_clean":"2024-03-09T15:21:22.170878+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:21:22.170878+0000","last_undegraded":"2024-03-09T15:21:22.170878+0000","last_fullsized":"2024-03-09T15:21:22.170878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:00.134823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905652+0000","last_change":"2024-03-09T14:35:55.603484+0000","last_active":"2024-03-09T15:22:06.905652+0000","last_peered":"2024-03-09T15:22:06.905652+0000","last_clean":"2024-03-09T15:22:06.905652+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:22:06.905652+0000","last_undegraded":"2024-03-09T15:22:06.905652+0000","last_fullsized":"2024-03-09T15:22:06.905652+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:49.786326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173621+0000","last_change":"2024-03-09T14:35:50.584143+0000","last_active":"2024-03-09T15:21:42.173621+0000","last_peered":"2024-03-09T15:21:42.173621+0000","last_clean":"2024-03-09T15:21:42.173621+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:21:42.173621+0000","last_undegraded":"2024-03-09T15:21:42.173621+0000","last_fullsized":"2024-03-09T15:21:42.173621+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:51.754061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":182,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002119+0000","last_change":"2024-03-09T14:31:01.149003+0000","last_active":"2024-03-09T15:20:52.002119+0000","last_peered":"2024-03-09T15:20:52.002119+0000","last_clean":"2024-03-09T15:20:52.002119+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:20:52.002119+0000","last_undegraded":"2024-03-09T15:20:52.002119+0000","last_fullsized":"2024-03-09T15:20:52.002119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:24.001646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032229+0000","last_change":"2024-03-09T14:50:03.664606+0000","last_active":"2024-03-09T15:21:22.032229+0000","last_peered":"2024-03-09T15:21:22.032229+0000","last_clean":"2024-03-09T15:21:22.032229+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:21:22.032229+0000","last_undegraded":"2024-03-09T15:21:22.032229+0000","last_fullsized":"2024-03-09T15:21:22.032229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.328351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903317+0000","last_change":"2024-03-09T14:35:55.633776+0000","last_active":"2024-03-09T15:21:46.903317+0000","last_peered":"2024-03-09T15:21:46.903317+0000","last_clean":"2024-03-09T15:21:46.903317+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:21:46.903317+0000","last_undegraded":"2024-03-09T15:21:46.903317+0000","last_fullsized":"2024-03-09T15:21:46.903317+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:12:36.318597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.000932+0000","last_change":"2024-03-09T14:35:50.591618+0000","last_active":"2024-03-09T15:21:52.000932+0000","last_peered":"2024-03-09T15:21:52.000932+0000","last_clean":"2024-03-09T15:21:52.000932+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:21:52.000932+0000","last_undegraded":"2024-03-09T15:21:52.000932+0000","last_fullsized":"2024-03-09T15:21:52.000932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:28.323159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027822+0000","last_change":"2024-03-09T14:31:01.137572+0000","last_active":"2024-03-09T15:20:52.027822+0000","last_peered":"2024-03-09T15:20:52.027822+0000","last_clean":"2024-03-09T15:20:52.027822+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:52.027822+0000","last_undegraded":"2024-03-09T15:20:52.027822+0000","last_fullsized":"2024-03-09T15:20:52.027822+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:52.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.005314+0000","last_change":"2024-03-09T14:50:03.658082+0000","last_active":"2024-03-09T15:22:17.005314+0000","last_peered":"2024-03-09T15:22:17.005314+0000","last_clean":"2024-03-09T15:22:17.005314+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:22:17.005314+0000","last_undegraded":"2024-03-09T15:22:17.005314+0000","last_fullsized":"2024-03-09T15:22:17.005314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:47.239990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171609+0000","last_change":"2024-03-09T14:35:55.634847+0000","last_active":"2024-03-09T15:21:27.171609+0000","last_peered":"2024-03-09T15:21:27.171609+0000","last_clean":"2024-03-09T15:21:27.171609+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:21:27.171609+0000","last_undegraded":"2024-03-09T15:21:27.171609+0000","last_fullsized":"2024-03-09T15:21:27.171609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:24.831161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032308+0000","last_change":"2024-03-09T14:35:50.590046+0000","last_active":"2024-03-09T15:21:22.032308+0000","last_peered":"2024-03-09T15:21:22.032308+0000","last_clean":"2024-03-09T15:21:22.032308+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:21:22.032308+0000","last_undegraded":"2024-03-09T15:21:22.032308+0000","last_fullsized":"2024-03-09T15:21:22.032308+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:09.975491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169286+0000","last_change":"2024-03-09T14:31:01.145294+0000","last_active":"2024-03-09T15:21:12.169286+0000","last_peered":"2024-03-09T15:21:12.169286+0000","last_clean":"2024-03-09T15:21:12.169286+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:21:12.169286+0000","last_undegraded":"2024-03-09T15:21:12.169286+0000","last_fullsized":"2024-03-09T15:21:12.169286+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:45.565527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.157206+0000","last_change":"2024-03-09T14:50:03.664652+0000","last_active":"2024-03-09T15:21:22.157206+0000","last_peered":"2024-03-09T15:21:22.157206+0000","last_clean":"2024-03-09T15:21:22.157206+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:21:22.157206+0000","last_undegraded":"2024-03-09T15:21:22.157206+0000","last_fullsized":"2024-03-09T15:21:22.157206+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:30.997877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'4","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.157985+0000","last_change":"2024-03-09T14:35:55.606581+0000","last_active":"2024-03-09T15:21:27.157985+0000","last_peered":"2024-03-09T15:21:27.157985+0000","last_clean":"2024-03-09T15:21:27.157985+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:21:27.157985+0000","last_undegraded":"2024-03-09T15:21:27.157985+0000","last_fullsized":"2024-03-09T15:21:27.157985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:53:40.747872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":4,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'5","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170949+0000","last_change":"2024-03-09T14:35:50.588264+0000","last_active":"2024-03-09T15:21:22.170949+0000","last_peered":"2024-03-09T15:21:22.170949+0000","last_clean":"2024-03-09T15:21:22.170949+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:21:22.170949+0000","last_undegraded":"2024-03-09T15:21:22.170949+0000","last_fullsized":"2024-03-09T15:21:22.170949+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:37.262134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9232,"num_write":5,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":232,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997471+0000","last_change":"2024-03-09T14:31:01.140875+0000","last_active":"2024-03-09T15:21:01.997471+0000","last_peered":"2024-03-09T15:21:01.997471+0000","last_clean":"2024-03-09T15:21:01.997471+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:21:01.997471+0000","last_undegraded":"2024-03-09T15:21:01.997471+0000","last_fullsized":"2024-03-09T15:21:01.997471+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:48:41.613699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992174+0000","last_change":"2024-03-09T14:50:03.659231+0000","last_active":"2024-03-09T15:20:26.992174+0000","last_peered":"2024-03-09T15:20:26.992174+0000","last_clean":"2024-03-09T15:20:26.992174+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:20:26.992174+0000","last_undegraded":"2024-03-09T15:20:26.992174+0000","last_fullsized":"2024-03-09T15:20:26.992174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:29.158875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'4","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002102+0000","last_change":"2024-03-09T14:35:55.596692+0000","last_active":"2024-03-09T15:21:47.002102+0000","last_peered":"2024-03-09T15:21:47.002102+0000","last_clean":"2024-03-09T15:21:47.002102+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:21:47.002102+0000","last_undegraded":"2024-03-09T15:21:47.002102+0000","last_fullsized":"2024-03-09T15:21:47.002102+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:12.701527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'6","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.048034+0000","last_change":"2024-03-09T14:35:50.591561+0000","last_active":"2024-03-09T15:22:07.048034+0000","last_peered":"2024-03-09T15:22:07.048034+0000","last_clean":"2024-03-09T15:22:07.048034+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:22:07.048034+0000","last_undegraded":"2024-03-09T15:22:07.048034+0000","last_fullsized":"2024-03-09T15:22:07.048034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:32.145049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4138,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'95","reported_seq":333,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029266+0000","last_change":"2024-03-09T14:31:01.135715+0000","last_active":"2024-03-09T15:21:02.029266+0000","last_peered":"2024-03-09T15:21:02.029266+0000","last_clean":"2024-03-09T15:21:02.029266+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:21:02.029266+0000","last_undegraded":"2024-03-09T15:21:02.029266+0000","last_fullsized":"2024-03-09T15:21:02.029266+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999435+0000","last_change":"2024-03-09T14:50:03.655635+0000","last_active":"2024-03-09T15:20:26.999435+0000","last_peered":"2024-03-09T15:20:26.999435+0000","last_clean":"2024-03-09T15:20:26.999435+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:20:26.999435+0000","last_undegraded":"2024-03-09T15:20:26.999435+0000","last_fullsized":"2024-03-09T15:20:26.999435+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:27.965268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038744+0000","last_change":"2024-03-09T14:35:55.599321+0000","last_active":"2024-03-09T15:22:07.038744+0000","last_peered":"2024-03-09T15:22:07.038744+0000","last_clean":"2024-03-09T15:22:07.038744+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:22:07.038744+0000","last_undegraded":"2024-03-09T15:22:07.038744+0000","last_fullsized":"2024-03-09T15:22:07.038744+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:11.127875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'5","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173528+0000","last_change":"2024-03-09T14:35:50.590738+0000","last_active":"2024-03-09T15:21:42.173528+0000","last_peered":"2024-03-09T15:21:42.173528+0000","last_clean":"2024-03-09T15:21:42.173528+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:21:42.173528+0000","last_undegraded":"2024-03-09T15:21:42.173528+0000","last_fullsized":"2024-03-09T15:21:42.173528+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:21.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339884,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10288,"num_write":5,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":174,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.152669+0000","last_change":"2024-03-09T14:31:01.141681+0000","last_active":"2024-03-09T15:21:02.152669+0000","last_peered":"2024-03-09T15:21:02.152669+0000","last_clean":"2024-03-09T15:21:02.152669+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:21:02.152669+0000","last_undegraded":"2024-03-09T15:21:02.152669+0000","last_fullsized":"2024-03-09T15:21:02.152669+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:15.144703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005544+0000","last_change":"2024-03-09T14:50:03.658063+0000","last_active":"2024-03-09T15:21:22.005544+0000","last_peered":"2024-03-09T15:21:22.005544+0000","last_clean":"2024-03-09T15:21:22.005544+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:21:22.005544+0000","last_undegraded":"2024-03-09T15:21:22.005544+0000","last_fullsized":"2024-03-09T15:21:22.005544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:35.088953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.035791+0000","last_change":"2024-03-09T14:35:55.604413+0000","last_active":"2024-03-09T15:21:47.035791+0000","last_peered":"2024-03-09T15:21:47.035791+0000","last_clean":"2024-03-09T15:21:47.035791+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:21:47.035791+0000","last_undegraded":"2024-03-09T15:21:47.035791+0000","last_fullsized":"2024-03-09T15:21:47.035791+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:57.199079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'2","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.001611+0000","last_change":"2024-03-09T14:35:50.580849+0000","last_active":"2024-03-09T15:21:42.001611+0000","last_peered":"2024-03-09T15:21:42.001611+0000","last_clean":"2024-03-09T15:21:42.001611+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:21:42.001611+0000","last_undegraded":"2024-03-09T15:21:42.001611+0000","last_fullsized":"2024-03-09T15:21:42.001611+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:35.776820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029254+0000","last_change":"2024-03-09T14:31:01.141116+0000","last_active":"2024-03-09T15:21:02.029254+0000","last_peered":"2024-03-09T15:21:02.029254+0000","last_clean":"2024-03-09T15:21:02.029254+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:21:02.029254+0000","last_undegraded":"2024-03-09T15:21:02.029254+0000","last_fullsized":"2024-03-09T15:21:02.029254+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:23.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171561+0000","last_change":"2024-03-09T14:50:03.662160+0000","last_active":"2024-03-09T15:21:27.171561+0000","last_peered":"2024-03-09T15:21:27.171561+0000","last_clean":"2024-03-09T15:21:27.171561+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:21:27.171561+0000","last_undegraded":"2024-03-09T15:21:27.171561+0000","last_fullsized":"2024-03-09T15:21:27.171561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:05.477257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.160855+0000","last_change":"2024-03-09T14:35:55.603267+0000","last_active":"2024-03-09T15:21:47.160855+0000","last_peered":"2024-03-09T15:21:47.160855+0000","last_clean":"2024-03-09T15:21:47.160855+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:21:47.160855+0000","last_undegraded":"2024-03-09T15:21:47.160855+0000","last_fullsized":"2024-03-09T15:21:47.160855+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:33.336533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.034960+0000","last_change":"2024-03-09T14:35:50.579692+0000","last_active":"2024-03-09T15:21:42.034960+0000","last_peered":"2024-03-09T15:21:42.034960+0000","last_clean":"2024-03-09T15:21:42.034960+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:21:42.034960+0000","last_undegraded":"2024-03-09T15:21:42.034960+0000","last_fullsized":"2024-03-09T15:21:42.034960+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:53.022221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169202+0000","last_change":"2024-03-09T14:31:01.140181+0000","last_active":"2024-03-09T15:21:12.169202+0000","last_peered":"2024-03-09T15:21:12.169202+0000","last_clean":"2024-03-09T15:21:12.169202+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:21:12.169202+0000","last_undegraded":"2024-03-09T15:21:12.169202+0000","last_fullsized":"2024-03-09T15:21:12.169202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:06.660569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'216","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.103557+0000","last_change":"2024-03-09T14:21:54.364507+0000","last_active":"2024-03-09T15:23:15.103557+0000","last_peered":"2024-03-09T15:23:15.103557+0000","last_clean":"2024-03-09T15:23:15.103557+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:23:15.103557+0000","last_undegraded":"2024-03-09T15:23:15.103557+0000","last_fullsized":"2024-03-09T15:23:15.103557+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:02.602654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340141,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":32250,"num_write":1231,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'370","reported_seq":1077,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.361437+0000","last_change":"2024-03-09T14:21:56.357692+0000","last_active":"2024-03-09T15:22:36.361437+0000","last_peered":"2024-03-09T15:22:36.361437+0000","last_clean":"2024-03-09T15:22:36.361437+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:22:36.361437+0000","last_undegraded":"2024-03-09T15:22:36.361437+0000","last_fullsized":"2024-03-09T15:22:36.361437+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:59.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'181","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006074+0000","last_change":"2024-03-09T14:21:54.365933+0000","last_active":"2024-03-09T15:22:22.006074+0000","last_peered":"2024-03-09T15:22:22.006074+0000","last_clean":"2024-03-09T15:22:22.006074+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:22:22.006074+0000","last_undegraded":"2024-03-09T15:22:22.006074+0000","last_fullsized":"2024-03-09T15:22:22.006074+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:55:13.927594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16281911,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":348,"num_read_kb":33432,"num_write":990,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046256+0000","last_change":"2024-03-09T14:21:56.371109+0000","last_active":"2024-03-09T15:21:57.046256+0000","last_peered":"2024-03-09T15:21:57.046256+0000","last_clean":"2024-03-09T15:21:57.046256+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:21:57.046256+0000","last_undegraded":"2024-03-09T15:21:57.046256+0000","last_fullsized":"2024-03-09T15:21:57.046256+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:07.830191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.103341+0000","last_change":"2024-03-09T14:21:54.357346+0000","last_active":"2024-03-09T15:22:50.103341+0000","last_peered":"2024-03-09T15:22:50.103341+0000","last_clean":"2024-03-09T15:22:50.103341+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:22:50.103341+0000","last_undegraded":"2024-03-09T15:22:50.103341+0000","last_fullsized":"2024-03-09T15:22:50.103341+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:26.965320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162411+0000","last_change":"2024-03-09T14:21:56.366924+0000","last_active":"2024-03-09T15:21:57.162411+0000","last_peered":"2024-03-09T15:21:57.162411+0000","last_clean":"2024-03-09T15:21:57.162411+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:21:57.162411+0000","last_undegraded":"2024-03-09T15:21:57.162411+0000","last_fullsized":"2024-03-09T15:21:57.162411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:20.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'187","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038840+0000","last_change":"2024-03-09T14:21:54.371185+0000","last_active":"2024-03-09T15:22:07.038840+0000","last_peered":"2024-03-09T15:22:07.038840+0000","last_clean":"2024-03-09T15:22:07.038840+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:22:07.038840+0000","last_undegraded":"2024-03-09T15:22:07.038840+0000","last_fullsized":"2024-03-09T15:22:07.038840+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:56.928314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10859253,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":551,"num_read_kb":57961,"num_write":1116,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904523+0000","last_change":"2024-03-09T14:21:56.372686+0000","last_active":"2024-03-09T15:21:56.904523+0000","last_peered":"2024-03-09T15:21:56.904523+0000","last_clean":"2024-03-09T15:21:56.904523+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:21:56.904523+0000","last_undegraded":"2024-03-09T15:21:56.904523+0000","last_fullsized":"2024-03-09T15:21:56.904523+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:21.714174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'186","reported_seq":916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.741731+0000","last_change":"2024-03-09T14:21:54.361340+0000","last_active":"2024-03-09T15:24:14.741731+0000","last_peered":"2024-03-09T15:24:14.741731+0000","last_clean":"2024-03-09T15:24:14.741731+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:24:14.741731+0000","last_undegraded":"2024-03-09T15:24:14.741731+0000","last_fullsized":"2024-03-09T15:24:14.741731+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:38.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25832994,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":536,"num_read_kb":140946,"num_write":1098,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038703+0000","last_change":"2024-03-09T14:21:56.367286+0000","last_active":"2024-03-09T15:22:07.038703+0000","last_peered":"2024-03-09T15:22:07.038703+0000","last_clean":"2024-03-09T15:22:07.038703+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:22:07.038703+0000","last_undegraded":"2024-03-09T15:22:07.038703+0000","last_fullsized":"2024-03-09T15:22:07.038703+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:52.107232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'183","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.037192+0000","last_change":"2024-03-09T14:21:54.369817+0000","last_active":"2024-03-09T15:21:57.037192+0000","last_peered":"2024-03-09T15:21:57.037192+0000","last_clean":"2024-03-09T15:21:57.037192+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:21:57.037192+0000","last_undegraded":"2024-03-09T15:21:57.037192+0000","last_fullsized":"2024-03-09T15:21:57.037192+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:45.301805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11413170,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":389,"num_read_kb":13387,"num_write":1027,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166139+0000","last_change":"2024-03-09T14:21:56.359071+0000","last_active":"2024-03-09T15:22:22.166139+0000","last_peered":"2024-03-09T15:22:22.166139+0000","last_clean":"2024-03-09T15:22:22.166139+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:22:22.166139+0000","last_undegraded":"2024-03-09T15:22:22.166139+0000","last_fullsized":"2024-03-09T15:22:22.166139+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:29.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046242+0000","last_change":"2024-03-09T14:21:54.360895+0000","last_active":"2024-03-09T15:21:57.046242+0000","last_peered":"2024-03-09T15:21:57.046242+0000","last_clean":"2024-03-09T15:21:57.046242+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:21:57.046242+0000","last_undegraded":"2024-03-09T15:21:57.046242+0000","last_fullsized":"2024-03-09T15:21:57.046242+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:47.207849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:17.701829+0000","last_change":"2024-03-09T14:23:32.139848+0000","last_active":"2024-03-09T15:23:17.701829+0000","last_peered":"2024-03-09T15:23:17.701829+0000","last_clean":"2024-03-09T15:23:17.701829+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:23:17.701829+0000","last_undegraded":"2024-03-09T15:23:17.701829+0000","last_fullsized":"2024-03-09T15:23:17.701829+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:13:35.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'198","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.312186+0000","last_change":"2024-03-09T14:21:54.367692+0000","last_active":"2024-03-09T15:24:28.312186+0000","last_peered":"2024-03-09T15:24:28.312186+0000","last_clean":"2024-03-09T15:24:28.312186+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:24:28.312186+0000","last_undegraded":"2024-03-09T15:24:28.312186+0000","last_fullsized":"2024-03-09T15:24:28.312186+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:00:15.272460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505066,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":42906,"num_write":1254,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003815+0000","last_change":"2024-03-09T14:21:56.362728+0000","last_active":"2024-03-09T15:22:22.003815+0000","last_peered":"2024-03-09T15:22:22.003815+0000","last_clean":"2024-03-09T15:22:22.003815+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:22:22.003815+0000","last_undegraded":"2024-03-09T15:22:22.003815+0000","last_fullsized":"2024-03-09T15:22:22.003815+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:45.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'152","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.039856+0000","last_change":"2024-03-09T14:21:56.368382+0000","last_active":"2024-03-09T15:22:58.039856+0000","last_peered":"2024-03-09T15:22:58.039856+0000","last_clean":"2024-03-09T15:22:58.039856+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:22:58.039856+0000","last_undegraded":"2024-03-09T15:22:58.039856+0000","last_fullsized":"2024-03-09T15:22:58.039856+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:14.989000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'167","reported_seq":809,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.069704+0000","last_change":"2024-03-09T14:21:54.358160+0000","last_active":"2024-03-09T15:21:08.069704+0000","last_peered":"2024-03-09T15:21:08.069704+0000","last_clean":"2024-03-09T15:21:08.069704+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:21:08.069704+0000","last_undegraded":"2024-03-09T15:21:08.069704+0000","last_fullsized":"2024-03-09T15:21:08.069704+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:23:07.592095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5921421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":28832,"num_write":1014,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160954+0000","last_change":"2024-03-09T14:21:56.371113+0000","last_active":"2024-03-09T15:20:17.160954+0000","last_peered":"2024-03-09T15:20:17.160954+0000","last_clean":"2024-03-09T15:20:17.160954+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:20:17.160954+0000","last_undegraded":"2024-03-09T15:20:17.160954+0000","last_fullsized":"2024-03-09T15:20:17.160954+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:56.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'201","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019772+0000","last_change":"2024-03-09T14:21:54.366475+0000","last_active":"2024-03-09T15:19:57.019772+0000","last_peered":"2024-03-09T15:19:57.019772+0000","last_clean":"2024-03-09T15:19:57.019772+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:19:57.019772+0000","last_undegraded":"2024-03-09T15:19:57.019772+0000","last_fullsized":"2024-03-09T15:19:57.019772+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:47.826416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14711542,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":392,"num_read_kb":20924,"num_write":1100,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.378336+0000","last_change":"2024-03-09T14:21:56.362335+0000","last_active":"2024-03-09T15:24:28.378336+0000","last_peered":"2024-03-09T15:24:28.378336+0000","last_clean":"2024-03-09T15:24:28.378336+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:24:28.378336+0000","last_undegraded":"2024-03-09T15:24:28.378336+0000","last_fullsized":"2024-03-09T15:24:28.378336+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:04.650448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'190","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:55.883915+0000","last_change":"2024-03-09T14:21:54.369118+0000","last_active":"2024-03-09T15:20:55.883915+0000","last_peered":"2024-03-09T15:20:55.883915+0000","last_clean":"2024-03-09T15:20:55.883915+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:20:55.883915+0000","last_undegraded":"2024-03-09T15:20:55.883915+0000","last_fullsized":"2024-03-09T15:20:55.883915+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:23.759764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904028,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":640,"num_read_kb":129688,"num_write":1090,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'327","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.988967+0000","last_change":"2024-03-09T14:21:56.363364+0000","last_active":"2024-03-09T15:19:56.988967+0000","last_peered":"2024-03-09T15:19:56.988967+0000","last_clean":"2024-03-09T15:19:56.988967+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:19:56.988967+0000","last_undegraded":"2024-03-09T15:19:56.988967+0000","last_fullsized":"2024-03-09T15:19:56.988967+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:59.653300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'184","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:54.109866+0000","last_change":"2024-03-09T14:22:31.545671+0000","last_active":"2024-03-09T15:22:54.109866+0000","last_peered":"2024-03-09T15:22:54.109866+0000","last_clean":"2024-03-09T15:22:54.109866+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:22:54.109866+0000","last_undegraded":"2024-03-09T15:22:54.109866+0000","last_fullsized":"2024-03-09T15:22:54.109866+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:17.161201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397961,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":17983,"num_write":1106,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":687,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.338240+0000","last_change":"2024-03-09T14:21:56.360414+0000","last_active":"2024-03-09T15:22:41.338240+0000","last_peered":"2024-03-09T15:22:41.338240+0000","last_clean":"2024-03-09T15:22:41.338240+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:22:41.338240+0000","last_undegraded":"2024-03-09T15:22:41.338240+0000","last_fullsized":"2024-03-09T15:22:41.338240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:32.887159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'189","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.018393+0000","last_change":"2024-03-09T14:21:54.371479+0000","last_active":"2024-03-09T15:22:32.018393+0000","last_peered":"2024-03-09T15:22:32.018393+0000","last_clean":"2024-03-09T15:22:32.018393+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:22:32.018393+0000","last_undegraded":"2024-03-09T15:22:32.018393+0000","last_fullsized":"2024-03-09T15:22:32.018393+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:20.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":503,"num_read_kb":27148,"num_write":1012,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":733,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.143484+0000","last_change":"2024-03-09T14:21:56.360518+0000","last_active":"2024-03-09T15:19:57.143484+0000","last_peered":"2024-03-09T15:19:57.143484+0000","last_clean":"2024-03-09T15:19:57.143484+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:19:57.143484+0000","last_undegraded":"2024-03-09T15:19:57.143484+0000","last_fullsized":"2024-03-09T15:19:57.143484+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:16.918503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'243","reported_seq":981,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999917+0000","last_change":"2024-03-09T14:21:54.371089+0000","last_active":"2024-03-09T15:20:31.999917+0000","last_peered":"2024-03-09T15:20:31.999917+0000","last_clean":"2024-03-09T15:20:31.999917+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:20:31.999917+0000","last_undegraded":"2024-03-09T15:20:31.999917+0000","last_fullsized":"2024-03-09T15:20:31.999917+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:56.588140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599382,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1061,"num_read_kb":11712,"num_write":1252,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.145020+0000","last_change":"2024-03-09T14:22:04.407438+0000","last_active":"2024-03-09T15:20:07.145020+0000","last_peered":"2024-03-09T15:20:07.145020+0000","last_clean":"2024-03-09T15:20:07.145020+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:20:07.145020+0000","last_undegraded":"2024-03-09T15:20:07.145020+0000","last_fullsized":"2024-03-09T15:20:07.145020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:02.777937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'115","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.144676+0000","last_change":"2024-03-09T14:21:56.354345+0000","last_active":"2024-03-09T15:21:08.144676+0000","last_peered":"2024-03-09T15:21:08.144676+0000","last_clean":"2024-03-09T15:21:08.144676+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:21:08.144676+0000","last_undegraded":"2024-03-09T15:21:08.144676+0000","last_fullsized":"2024-03-09T15:21:08.144676+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:38.265091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'199","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.341742+0000","last_change":"2024-03-09T14:21:54.364329+0000","last_active":"2024-03-09T15:23:04.341742+0000","last_peered":"2024-03-09T15:23:04.341742+0000","last_clean":"2024-03-09T15:23:04.341742+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:23:04.341742+0000","last_undegraded":"2024-03-09T15:23:04.341742+0000","last_fullsized":"2024-03-09T15:23:04.341742+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:32.579399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":418,"num_read_kb":3002,"num_write":988,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020417+0000","last_change":"2024-03-09T14:21:58.369901+0000","last_active":"2024-03-09T15:20:02.020417+0000","last_peered":"2024-03-09T15:20:02.020417+0000","last_clean":"2024-03-09T15:20:02.020417+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:20:02.020417+0000","last_undegraded":"2024-03-09T15:20:02.020417+0000","last_fullsized":"2024-03-09T15:20:02.020417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:00.598181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'207","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.020490+0000","last_change":"2024-03-09T14:22:00.387965+0000","last_active":"2024-03-09T15:22:56.020490+0000","last_peered":"2024-03-09T15:22:56.020490+0000","last_clean":"2024-03-09T15:22:56.020490+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:22:56.020490+0000","last_undegraded":"2024-03-09T15:22:56.020490+0000","last_fullsized":"2024-03-09T15:22:56.020490+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:55.493455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":277,"num_read_kb":373,"num_write":168,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158882+0000","last_change":"2024-03-09T14:22:02.391044+0000","last_active":"2024-03-09T15:20:02.158882+0000","last_peered":"2024-03-09T15:20:02.158882+0000","last_clean":"2024-03-09T15:20:02.158882+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:20:02.158882+0000","last_undegraded":"2024-03-09T15:20:02.158882+0000","last_fullsized":"2024-03-09T15:20:02.158882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:46.242039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2478","reported_seq":4903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.846417+0000","last_change":"2024-03-09T14:22:04.401509+0000","last_active":"2024-03-09T15:24:28.846417+0000","last_peered":"2024-03-09T15:24:28.846417+0000","last_clean":"2024-03-09T15:24:28.846417+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:28.846417+0000","last_undegraded":"2024-03-09T15:24:28.846417+0000","last_fullsized":"2024-03-09T15:24:28.846417+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:21.913278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.084519+0000","last_change":"2024-03-09T14:21:56.360757+0000","last_active":"2024-03-09T15:22:32.084519+0000","last_peered":"2024-03-09T15:22:32.084519+0000","last_clean":"2024-03-09T15:22:32.084519+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:22:32.084519+0000","last_undegraded":"2024-03-09T15:22:32.084519+0000","last_fullsized":"2024-03-09T15:22:32.084519+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:11.828260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'185","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998070+0000","last_change":"2024-03-09T14:21:54.370606+0000","last_active":"2024-03-09T15:20:16.998070+0000","last_peered":"2024-03-09T15:20:16.998070+0000","last_clean":"2024-03-09T15:20:16.998070+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:20:16.998070+0000","last_undegraded":"2024-03-09T15:20:16.998070+0000","last_fullsized":"2024-03-09T15:20:16.998070+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:07.279208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5489185,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":36262,"num_write":1055,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.007681+0000","last_change":"2024-03-09T14:21:58.370142+0000","last_active":"2024-03-09T15:20:37.007681+0000","last_peered":"2024-03-09T15:20:37.007681+0000","last_clean":"2024-03-09T15:20:37.007681+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:20:37.007681+0000","last_undegraded":"2024-03-09T15:20:37.007681+0000","last_fullsized":"2024-03-09T15:20:37.007681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:26.942518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'108","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.364936+0000","last_change":"2024-03-09T14:22:00.383851+0000","last_active":"2024-03-09T15:22:36.364936+0000","last_peered":"2024-03-09T15:22:36.364936+0000","last_clean":"2024-03-09T15:22:36.364936+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:22:36.364936+0000","last_undegraded":"2024-03-09T15:22:36.364936+0000","last_fullsized":"2024-03-09T15:22:36.364936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:38.700465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144268+0000","last_change":"2024-03-09T14:22:02.401387+0000","last_active":"2024-03-09T15:20:02.144268+0000","last_peered":"2024-03-09T15:20:02.144268+0000","last_clean":"2024-03-09T15:20:02.144268+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:20:02.144268+0000","last_undegraded":"2024-03-09T15:20:02.144268+0000","last_fullsized":"2024-03-09T15:20:02.144268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:17:02.585085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'114","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.784543+0000","last_change":"2024-03-09T14:22:04.401757+0000","last_active":"2024-03-09T15:22:38.784543+0000","last_peered":"2024-03-09T15:22:38.784543+0000","last_clean":"2024-03-09T15:22:38.784543+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:22:38.784543+0000","last_undegraded":"2024-03-09T15:22:38.784543+0000","last_fullsized":"2024-03-09T15:22:38.784543+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:00.751890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.995723+0000","last_change":"2024-03-09T14:21:56.372711+0000","last_active":"2024-03-09T15:19:56.995723+0000","last_peered":"2024-03-09T15:19:56.995723+0000","last_clean":"2024-03-09T15:19:56.995723+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:19:56.995723+0000","last_undegraded":"2024-03-09T15:19:56.995723+0000","last_fullsized":"2024-03-09T15:19:56.995723+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'166","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160910+0000","last_change":"2024-03-09T14:21:54.365114+0000","last_active":"2024-03-09T15:20:17.160910+0000","last_peered":"2024-03-09T15:20:17.160910+0000","last_clean":"2024-03-09T15:20:17.160910+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:20:17.160910+0000","last_undegraded":"2024-03-09T15:20:17.160910+0000","last_fullsized":"2024-03-09T15:20:17.160910+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:25.691680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21590719,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":415,"num_read_kb":24289,"num_write":900,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.003117+0000","last_change":"2024-03-09T14:21:58.372340+0000","last_active":"2024-03-09T15:20:02.003117+0000","last_peered":"2024-03-09T15:20:02.003117+0000","last_clean":"2024-03-09T15:20:02.003117+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:20:02.003117+0000","last_undegraded":"2024-03-09T15:20:02.003117+0000","last_fullsized":"2024-03-09T15:20:02.003117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:20.284463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'131","reported_seq":673,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.440694+0000","last_change":"2024-03-09T14:22:00.384182+0000","last_active":"2024-03-09T15:22:36.440694+0000","last_peered":"2024-03-09T15:22:36.440694+0000","last_clean":"2024-03-09T15:22:36.440694+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:22:36.440694+0000","last_undegraded":"2024-03-09T15:22:36.440694+0000","last_fullsized":"2024-03-09T15:22:36.440694+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:22.730875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'502","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.885268+0000","last_change":"2024-03-09T14:22:02.394468+0000","last_active":"2024-03-09T15:24:30.885268+0000","last_peered":"2024-03-09T15:24:30.885268+0000","last_clean":"2024-03-09T15:24:30.885268+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:24:30.885268+0000","last_undegraded":"2024-03-09T15:24:30.885268+0000","last_fullsized":"2024-03-09T15:24:30.885268+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:21.183335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'198","reported_seq":1009,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.173166+0000","last_change":"2024-03-09T14:22:04.393662+0000","last_active":"2024-03-09T15:22:50.173166+0000","last_peered":"2024-03-09T15:22:50.173166+0000","last_clean":"2024-03-09T15:22:50.173166+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:22:50.173166+0000","last_undegraded":"2024-03-09T15:22:50.173166+0000","last_fullsized":"2024-03-09T15:22:50.173166+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:52.946807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":935,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002403+0000","last_change":"2024-03-09T14:21:56.366895+0000","last_active":"2024-03-09T15:19:57.002403+0000","last_peered":"2024-03-09T15:19:57.002403+0000","last_clean":"2024-03-09T15:19:57.002403+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:19:57.002403+0000","last_undegraded":"2024-03-09T15:19:57.002403+0000","last_fullsized":"2024-03-09T15:19:57.002403+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:26.788549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'328","reported_seq":1051,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022611+0000","last_change":"2024-03-09T14:21:54.366866+0000","last_active":"2024-03-09T15:20:17.022611+0000","last_peered":"2024-03-09T15:20:17.022611+0000","last_clean":"2024-03-09T15:20:17.022611+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:20:17.022611+0000","last_undegraded":"2024-03-09T15:20:17.022611+0000","last_fullsized":"2024-03-09T15:20:17.022611+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:51.068751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16819939,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":885,"num_read_kb":69587,"num_write":1464,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020448+0000","last_change":"2024-03-09T14:21:58.370760+0000","last_active":"2024-03-09T15:20:02.020448+0000","last_peered":"2024-03-09T15:20:02.020448+0000","last_clean":"2024-03-09T15:20:02.020448+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:20:02.020448+0000","last_undegraded":"2024-03-09T15:20:02.020448+0000","last_fullsized":"2024-03-09T15:20:02.020448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.151599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'135","reported_seq":704,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.984795+0000","last_change":"2024-03-09T14:22:00.494140+0000","last_active":"2024-03-09T15:23:37.984795+0000","last_peered":"2024-03-09T15:23:37.984795+0000","last_clean":"2024-03-09T15:23:37.984795+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:23:37.984795+0000","last_undegraded":"2024-03-09T15:23:37.984795+0000","last_fullsized":"2024-03-09T15:23:37.984795+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:56.507586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9949,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":234,"num_write":92,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'544","reported_seq":2339,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.889024+0000","last_change":"2024-03-09T14:22:02.399618+0000","last_active":"2024-03-09T15:24:30.889024+0000","last_peered":"2024-03-09T15:24:30.889024+0000","last_clean":"2024-03-09T15:24:30.889024+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:24:30.889024+0000","last_undegraded":"2024-03-09T15:24:30.889024+0000","last_fullsized":"2024-03-09T15:24:30.889024+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:16.944105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'167","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023997+0000","last_change":"2024-03-09T14:21:56.361954+0000","last_active":"2024-03-09T15:20:27.023997+0000","last_peered":"2024-03-09T15:20:27.023997+0000","last_clean":"2024-03-09T15:20:27.023997+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:20:27.023997+0000","last_undegraded":"2024-03-09T15:20:27.023997+0000","last_fullsized":"2024-03-09T15:20:27.023997+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:31.594273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'207","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.164406+0000","last_change":"2024-03-09T14:21:54.363733+0000","last_active":"2024-03-09T15:20:37.164406+0000","last_peered":"2024-03-09T15:20:37.164406+0000","last_clean":"2024-03-09T15:20:37.164406+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:20:37.164406+0000","last_undegraded":"2024-03-09T15:20:37.164406+0000","last_fullsized":"2024-03-09T15:20:37.164406+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:17.383801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103988,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":482,"num_read_kb":2825,"num_write":1213,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163560+0000","last_change":"2024-03-09T14:21:58.368654+0000","last_active":"2024-03-09T15:20:32.163560+0000","last_peered":"2024-03-09T15:20:32.163560+0000","last_clean":"2024-03-09T15:20:32.163560+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:20:32.163560+0000","last_undegraded":"2024-03-09T15:20:32.163560+0000","last_fullsized":"2024-03-09T15:20:32.163560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:21.594710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'228","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:52.045357+0000","last_change":"2024-03-09T14:22:00.493626+0000","last_active":"2024-03-09T15:22:52.045357+0000","last_peered":"2024-03-09T15:22:52.045357+0000","last_clean":"2024-03-09T15:22:52.045357+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:22:52.045357+0000","last_undegraded":"2024-03-09T15:22:52.045357+0000","last_fullsized":"2024-03-09T15:22:52.045357+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:35.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9908,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":384,"num_write":190,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994431+0000","last_change":"2024-03-09T14:22:02.394441+0000","last_active":"2024-03-09T15:20:31.994431+0000","last_peered":"2024-03-09T15:20:31.994431+0000","last_clean":"2024-03-09T15:20:31.994431+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:20:31.994431+0000","last_undegraded":"2024-03-09T15:20:31.994431+0000","last_fullsized":"2024-03-09T15:20:31.994431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:20.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'547","reported_seq":1355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.875337+0000","last_change":"2024-03-09T14:22:04.401516+0000","last_active":"2024-03-09T15:24:30.875337+0000","last_peered":"2024-03-09T15:24:30.875337+0000","last_clean":"2024-03-09T15:24:30.875337+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:30.875337+0000","last_undegraded":"2024-03-09T15:24:30.875337+0000","last_fullsized":"2024-03-09T15:24:30.875337+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:22.487334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'160","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.147996+0000","last_change":"2024-03-09T14:21:56.360517+0000","last_active":"2024-03-09T15:20:27.147996+0000","last_peered":"2024-03-09T15:20:27.147996+0000","last_clean":"2024-03-09T15:20:27.147996+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:20:27.147996+0000","last_undegraded":"2024-03-09T15:20:27.147996+0000","last_fullsized":"2024-03-09T15:20:27.147996+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:05.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162818+0000","last_change":"2024-03-09T14:21:54.361313+0000","last_active":"2024-03-09T15:20:27.162818+0000","last_peered":"2024-03-09T15:20:27.162818+0000","last_clean":"2024-03-09T15:20:27.162818+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:20:27.162818+0000","last_undegraded":"2024-03-09T15:20:27.162818+0000","last_fullsized":"2024-03-09T15:20:27.162818+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:49:23.800324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992640+0000","last_change":"2024-03-09T14:21:58.373445+0000","last_active":"2024-03-09T15:20:31.992640+0000","last_peered":"2024-03-09T15:20:31.992640+0000","last_clean":"2024-03-09T15:20:31.992640+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:20:31.992640+0000","last_undegraded":"2024-03-09T15:20:31.992640+0000","last_fullsized":"2024-03-09T15:20:31.992640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:12:36.728172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'133","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.023415+0000","last_change":"2024-03-09T14:22:00.387422+0000","last_active":"2024-03-09T15:22:47.023415+0000","last_peered":"2024-03-09T15:22:47.023415+0000","last_clean":"2024-03-09T15:22:47.023415+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:22:47.023415+0000","last_undegraded":"2024-03-09T15:22:47.023415+0000","last_fullsized":"2024-03-09T15:22:47.023415+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:44.158848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":174,"num_read_kb":233,"num_write":94,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008667+0000","last_change":"2024-03-09T14:22:02.399383+0000","last_active":"2024-03-09T15:20:47.008667+0000","last_peered":"2024-03-09T15:20:47.008667+0000","last_clean":"2024-03-09T15:20:47.008667+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:20:47.008667+0000","last_undegraded":"2024-03-09T15:20:47.008667+0000","last_fullsized":"2024-03-09T15:20:47.008667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:46.573953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'154","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.051056+0000","last_change":"2024-03-09T14:22:04.401728+0000","last_active":"2024-03-09T15:23:16.051056+0000","last_peered":"2024-03-09T15:23:16.051056+0000","last_clean":"2024-03-09T15:23:16.051056+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:23:16.051056+0000","last_undegraded":"2024-03-09T15:23:16.051056+0000","last_fullsized":"2024-03-09T15:23:16.051056+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:36.044586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025573+0000","last_change":"2024-03-09T14:21:56.363935+0000","last_active":"2024-03-09T15:20:37.025573+0000","last_peered":"2024-03-09T15:20:37.025573+0000","last_clean":"2024-03-09T15:20:37.025573+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:20:37.025573+0000","last_undegraded":"2024-03-09T15:20:37.025573+0000","last_fullsized":"2024-03-09T15:20:37.025573+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:22.924584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'198","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162790+0000","last_change":"2024-03-09T14:21:54.370752+0000","last_active":"2024-03-09T15:20:27.162790+0000","last_peered":"2024-03-09T15:20:27.162790+0000","last_clean":"2024-03-09T15:20:27.162790+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:20:27.162790+0000","last_undegraded":"2024-03-09T15:20:27.162790+0000","last_fullsized":"2024-03-09T15:20:27.162790+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:42.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6994754,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":99405,"num_write":1010,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992670+0000","last_change":"2024-03-09T14:21:58.373407+0000","last_active":"2024-03-09T15:20:31.992670+0000","last_peered":"2024-03-09T15:20:31.992670+0000","last_clean":"2024-03-09T15:20:31.992670+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:20:31.992670+0000","last_undegraded":"2024-03-09T15:20:31.992670+0000","last_fullsized":"2024-03-09T15:20:31.992670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:40.360322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'181","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:42.053222+0000","last_change":"2024-03-09T14:22:00.384337+0000","last_active":"2024-03-09T15:22:42.053222+0000","last_peered":"2024-03-09T15:22:42.053222+0000","last_clean":"2024-03-09T15:22:42.053222+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:22:42.053222+0000","last_undegraded":"2024-03-09T15:22:42.053222+0000","last_fullsized":"2024-03-09T15:22:42.053222+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:43.164450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8238,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":234,"num_read_kb":285,"num_write":134,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'508","reported_seq":2131,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.889951+0000","last_change":"2024-03-09T14:22:02.399057+0000","last_active":"2024-03-09T15:24:30.889951+0000","last_peered":"2024-03-09T15:24:30.889951+0000","last_clean":"2024-03-09T15:24:30.889951+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:24:30.889951+0000","last_undegraded":"2024-03-09T15:24:30.889951+0000","last_fullsized":"2024-03-09T15:24:30.889951+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:12.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'144","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.791883+0000","last_change":"2024-03-09T14:22:04.402136+0000","last_active":"2024-03-09T15:23:55.791883+0000","last_peered":"2024-03-09T15:23:55.791883+0000","last_clean":"2024-03-09T15:23:55.791883+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:23:55.791883+0000","last_undegraded":"2024-03-09T15:23:55.791883+0000","last_fullsized":"2024-03-09T15:23:55.791883+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:19.283035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.377637+0000","last_change":"2024-03-09T14:21:56.371534+0000","last_active":"2024-03-09T15:21:18.377637+0000","last_peered":"2024-03-09T15:21:18.377637+0000","last_clean":"2024-03-09T15:21:18.377637+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:21:18.377637+0000","last_undegraded":"2024-03-09T15:21:18.377637+0000","last_fullsized":"2024-03-09T15:21:18.377637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:24.972146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'163","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.968717+0000","last_change":"2024-03-09T14:21:54.369550+0000","last_active":"2024-03-09T15:22:57.968717+0000","last_peered":"2024-03-09T15:22:57.968717+0000","last_clean":"2024-03-09T15:22:57.968717+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:22:57.968717+0000","last_undegraded":"2024-03-09T15:22:57.968717+0000","last_fullsized":"2024-03-09T15:22:57.968717+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:28.659325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529210,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":41462,"num_write":959,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:41.993861+0000","last_change":"2024-03-09T14:21:58.372864+0000","last_active":"2024-03-09T15:20:41.993861+0000","last_peered":"2024-03-09T15:20:41.993861+0000","last_clean":"2024-03-09T15:20:41.993861+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:20:41.993861+0000","last_undegraded":"2024-03-09T15:20:41.993861+0000","last_fullsized":"2024-03-09T15:20:41.993861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:02.146801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'209","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.832771+0000","last_change":"2024-03-09T14:22:00.383682+0000","last_active":"2024-03-09T15:24:30.832771+0000","last_peered":"2024-03-09T15:24:30.832771+0000","last_clean":"2024-03-09T15:24:30.832771+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:24:30.832771+0000","last_undegraded":"2024-03-09T15:24:30.832771+0000","last_fullsized":"2024-03-09T15:24:30.832771+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:15.223090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18794,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":288,"num_read_kb":411,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992613+0000","last_change":"2024-03-09T14:22:02.391676+0000","last_active":"2024-03-09T15:20:31.992613+0000","last_peered":"2024-03-09T15:20:31.992613+0000","last_clean":"2024-03-09T15:20:31.992613+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:20:31.992613+0000","last_undegraded":"2024-03-09T15:20:31.992613+0000","last_fullsized":"2024-03-09T15:20:31.992613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:52.125960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'95","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995021+0000","last_change":"2024-03-09T14:22:04.407155+0000","last_active":"2024-03-09T15:20:36.995021+0000","last_peered":"2024-03-09T15:20:36.995021+0000","last_clean":"2024-03-09T15:20:36.995021+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:20:36.995021+0000","last_undegraded":"2024-03-09T15:20:36.995021+0000","last_fullsized":"2024-03-09T15:20:36.995021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:01.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148074+0000","last_change":"2024-03-09T14:21:56.352377+0000","last_active":"2024-03-09T15:20:27.148074+0000","last_peered":"2024-03-09T15:20:27.148074+0000","last_clean":"2024-03-09T15:20:27.148074+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:20:27.148074+0000","last_undegraded":"2024-03-09T15:20:27.148074+0000","last_fullsized":"2024-03-09T15:20:27.148074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:26.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'159","reported_seq":776,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995960+0000","last_change":"2024-03-09T14:22:31.502194+0000","last_active":"2024-03-09T15:21:01.995960+0000","last_peered":"2024-03-09T15:21:01.995960+0000","last_clean":"2024-03-09T15:21:01.995960+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:21:01.995960+0000","last_undegraded":"2024-03-09T15:21:01.995960+0000","last_fullsized":"2024-03-09T15:21:01.995960+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:07:53.358348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142213,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":87296,"num_write":880,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992720+0000","last_change":"2024-03-09T14:21:58.373193+0000","last_active":"2024-03-09T15:20:31.992720+0000","last_peered":"2024-03-09T15:20:31.992720+0000","last_clean":"2024-03-09T15:20:31.992720+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:20:31.992720+0000","last_undegraded":"2024-03-09T15:20:31.992720+0000","last_fullsized":"2024-03-09T15:20:31.992720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:54:43.726744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'165","reported_seq":751,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.108483+0000","last_change":"2024-03-09T14:22:00.383871+0000","last_active":"2024-03-09T15:23:23.108483+0000","last_peered":"2024-03-09T15:23:23.108483+0000","last_clean":"2024-03-09T15:23:23.108483+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:23:23.108483+0000","last_undegraded":"2024-03-09T15:23:23.108483+0000","last_fullsized":"2024-03-09T15:23:23.108483+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.715476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":290,"num_write":174,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.001564+0000","last_change":"2024-03-09T14:22:02.404397+0000","last_active":"2024-03-09T15:20:47.001564+0000","last_peered":"2024-03-09T15:20:47.001564+0000","last_clean":"2024-03-09T15:20:47.001564+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:20:47.001564+0000","last_undegraded":"2024-03-09T15:20:47.001564+0000","last_fullsized":"2024-03-09T15:20:47.001564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:30.954615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'103","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.585805+0000","last_change":"2024-03-09T14:22:04.407840+0000","last_active":"2024-03-09T15:23:08.585805+0000","last_peered":"2024-03-09T15:23:08.585805+0000","last_clean":"2024-03-09T15:23:08.585805+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:23:08.585805+0000","last_undegraded":"2024-03-09T15:23:08.585805+0000","last_fullsized":"2024-03-09T15:23:08.585805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:20:34.107387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148090+0000","last_change":"2024-03-09T14:21:56.363858+0000","last_active":"2024-03-09T15:20:27.148090+0000","last_peered":"2024-03-09T15:20:27.148090+0000","last_clean":"2024-03-09T15:20:27.148090+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:20:27.148090+0000","last_undegraded":"2024-03-09T15:20:27.148090+0000","last_fullsized":"2024-03-09T15:20:27.148090+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:13.291056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'173","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025557+0000","last_change":"2024-03-09T14:21:54.361281+0000","last_active":"2024-03-09T15:20:37.025557+0000","last_peered":"2024-03-09T15:20:37.025557+0000","last_clean":"2024-03-09T15:20:37.025557+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:20:37.025557+0000","last_undegraded":"2024-03-09T15:20:37.025557+0000","last_fullsized":"2024-03-09T15:20:37.025557+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:46.098501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567604,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":426,"num_read_kb":31184,"num_write":928,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994467+0000","last_change":"2024-03-09T14:21:58.376298+0000","last_active":"2024-03-09T15:20:31.994467+0000","last_peered":"2024-03-09T15:20:31.994467+0000","last_clean":"2024-03-09T15:20:31.994467+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:20:31.994467+0000","last_undegraded":"2024-03-09T15:20:31.994467+0000","last_fullsized":"2024-03-09T15:20:31.994467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:16:22.147321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'193","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.007290+0000","last_change":"2024-03-09T14:22:00.389792+0000","last_active":"2024-03-09T15:22:57.007290+0000","last_peered":"2024-03-09T15:22:57.007290+0000","last_clean":"2024-03-09T15:22:57.007290+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:22:57.007290+0000","last_undegraded":"2024-03-09T15:22:57.007290+0000","last_fullsized":"2024-03-09T15:22:57.007290+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:30.722738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10726,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":325,"num_write":148,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'487","reported_seq":4300,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.886002+0000","last_change":"2024-03-09T14:22:02.395597+0000","last_active":"2024-03-09T15:24:30.886002+0000","last_peered":"2024-03-09T15:24:30.886002+0000","last_clean":"2024-03-09T15:24:30.886002+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:30.886002+0000","last_undegraded":"2024-03-09T15:24:30.886002+0000","last_fullsized":"2024-03-09T15:24:30.886002+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:37.933532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'203","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.269247+0000","last_change":"2024-03-09T14:22:04.405779+0000","last_active":"2024-03-09T15:23:23.269247+0000","last_peered":"2024-03-09T15:23:23.269247+0000","last_clean":"2024-03-09T15:23:23.269247+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:23:23.269247+0000","last_undegraded":"2024-03-09T15:23:23.269247+0000","last_fullsized":"2024-03-09T15:23:23.269247+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:22:23.514316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148107+0000","last_change":"2024-03-09T14:21:56.356981+0000","last_active":"2024-03-09T15:20:27.148107+0000","last_peered":"2024-03-09T15:20:27.148107+0000","last_clean":"2024-03-09T15:20:27.148107+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:20:27.148107+0000","last_undegraded":"2024-03-09T15:20:27.148107+0000","last_fullsized":"2024-03-09T15:20:27.148107+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:14.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'166","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.515747+0000","last_change":"2024-03-09T14:21:54.363849+0000","last_active":"2024-03-09T15:23:08.515747+0000","last_peered":"2024-03-09T15:23:08.515747+0000","last_clean":"2024-03-09T15:23:08.515747+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:23:08.515747+0000","last_undegraded":"2024-03-09T15:23:08.515747+0000","last_fullsized":"2024-03-09T15:23:08.515747+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:31.144563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22447143,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":980,"num_read_kb":38802,"num_write":966,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.392914+0000","last_change":"2024-03-09T14:21:58.370397+0000","last_active":"2024-03-09T15:24:30.392914+0000","last_peered":"2024-03-09T15:24:30.392914+0000","last_clean":"2024-03-09T15:24:30.392914+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:24:30.392914+0000","last_undegraded":"2024-03-09T15:24:30.392914+0000","last_fullsized":"2024-03-09T15:24:30.392914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:50.562611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":622,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'90","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.298945+0000","last_change":"2024-03-09T14:22:00.492690+0000","last_active":"2024-03-09T15:22:36.298945+0000","last_peered":"2024-03-09T15:22:36.298945+0000","last_clean":"2024-03-09T15:22:36.298945+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:22:36.298945+0000","last_undegraded":"2024-03-09T15:22:36.298945+0000","last_fullsized":"2024-03-09T15:22:36.298945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:31.845945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'504","reported_seq":2210,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.887336+0000","last_change":"2024-03-09T14:22:02.396378+0000","last_active":"2024-03-09T15:24:30.887336+0000","last_peered":"2024-03-09T15:24:30.887336+0000","last_clean":"2024-03-09T15:24:30.887336+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:30.887336+0000","last_undegraded":"2024-03-09T15:24:30.887336+0000","last_fullsized":"2024-03-09T15:24:30.887336+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:11.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.167412+0000","last_change":"2024-03-09T14:22:04.402603+0000","last_active":"2024-03-09T15:22:32.167412+0000","last_peered":"2024-03-09T15:22:32.167412+0000","last_clean":"2024-03-09T15:22:32.167412+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:22:32.167412+0000","last_undegraded":"2024-03-09T15:22:32.167412+0000","last_fullsized":"2024-03-09T15:22:32.167412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:25.906429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995042+0000","last_change":"2024-03-09T14:21:56.368142+0000","last_active":"2024-03-09T15:20:36.995042+0000","last_peered":"2024-03-09T15:20:36.995042+0000","last_clean":"2024-03-09T15:20:36.995042+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:20:36.995042+0000","last_undegraded":"2024-03-09T15:20:36.995042+0000","last_fullsized":"2024-03-09T15:20:36.995042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:27.948389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'187","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006230+0000","last_change":"2024-03-09T14:21:54.368543+0000","last_active":"2024-03-09T15:20:27.006230+0000","last_peered":"2024-03-09T15:20:27.006230+0000","last_clean":"2024-03-09T15:20:27.006230+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:20:27.006230+0000","last_undegraded":"2024-03-09T15:20:27.006230+0000","last_fullsized":"2024-03-09T15:20:27.006230+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:57.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5588183,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":26998,"num_write":1065,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'4","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.382240+0000","last_change":"2024-03-09T14:21:58.371279+0000","last_active":"2024-03-09T15:24:30.382240+0000","last_peered":"2024-03-09T15:24:30.382240+0000","last_clean":"2024-03-09T15:24:30.382240+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:24:30.382240+0000","last_undegraded":"2024-03-09T15:24:30.382240+0000","last_fullsized":"2024-03-09T15:24:30.382240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:34.948133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":777,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'284","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.849045+0000","last_change":"2024-03-09T14:22:00.386117+0000","last_active":"2024-03-09T15:24:30.849045+0000","last_peered":"2024-03-09T15:24:30.849045+0000","last_clean":"2024-03-09T15:24:30.849045+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:24:30.849045+0000","last_undegraded":"2024-03-09T15:24:30.849045+0000","last_fullsized":"2024-03-09T15:24:30.849045+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:21.453812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9904,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1006,"num_read_kb":1062,"num_write":1592,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024722+0000","last_change":"2024-03-09T14:22:02.404333+0000","last_active":"2024-03-09T15:20:32.024722+0000","last_peered":"2024-03-09T15:20:32.024722+0000","last_clean":"2024-03-09T15:20:32.024722+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:20:32.024722+0000","last_undegraded":"2024-03-09T15:20:32.024722+0000","last_fullsized":"2024-03-09T15:20:32.024722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:37.735785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'157","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.405174+0000","last_change":"2024-03-09T14:22:04.400519+0000","last_active":"2024-03-09T15:23:44.405174+0000","last_peered":"2024-03-09T15:23:44.405174+0000","last_clean":"2024-03-09T15:23:44.405174+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:23:44.405174+0000","last_undegraded":"2024-03-09T15:23:44.405174+0000","last_fullsized":"2024-03-09T15:23:44.405174+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:16.309063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042466+0000","last_change":"2024-03-09T14:21:56.359275+0000","last_active":"2024-03-09T15:22:32.042466+0000","last_peered":"2024-03-09T15:22:32.042466+0000","last_clean":"2024-03-09T15:22:32.042466+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:22:32.042466+0000","last_undegraded":"2024-03-09T15:22:32.042466+0000","last_fullsized":"2024-03-09T15:22:32.042466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:10.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046197+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T15:21:57.046197+0000","last_peered":"2024-03-09T15:21:57.046197+0000","last_clean":"2024-03-09T15:21:57.046197+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:21:57.046197+0000","last_undegraded":"2024-03-09T15:21:57.046197+0000","last_fullsized":"2024-03-09T15:21:57.046197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'151","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:35.946875+0000","last_change":"2024-03-09T14:21:54.358849+0000","last_active":"2024-03-09T15:22:35.946875+0000","last_peered":"2024-03-09T15:22:35.946875+0000","last_clean":"2024-03-09T15:22:35.946875+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:22:35.946875+0000","last_undegraded":"2024-03-09T15:22:35.946875+0000","last_fullsized":"2024-03-09T15:22:35.946875+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:39.818710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319062,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":408,"num_read_kb":7813,"num_write":924,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.051219+0000","last_change":"2024-03-09T14:21:58.372665+0000","last_active":"2024-03-09T15:22:27.051219+0000","last_peered":"2024-03-09T15:22:27.051219+0000","last_clean":"2024-03-09T15:22:27.051219+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:22:27.051219+0000","last_undegraded":"2024-03-09T15:22:27.051219+0000","last_fullsized":"2024-03-09T15:22:27.051219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:20.394198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'288","reported_seq":982,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.851468+0000","last_change":"2024-03-09T14:22:00.387288+0000","last_active":"2024-03-09T15:24:30.851468+0000","last_peered":"2024-03-09T15:24:30.851468+0000","last_clean":"2024-03-09T15:24:30.851468+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:24:30.851468+0000","last_undegraded":"2024-03-09T15:24:30.851468+0000","last_fullsized":"2024-03-09T15:24:30.851468+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:13.322082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17691,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":547,"num_write":464,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999998+0000","last_change":"2024-03-09T14:22:02.403697+0000","last_active":"2024-03-09T15:20:31.999998+0000","last_peered":"2024-03-09T15:20:31.999998+0000","last_clean":"2024-03-09T15:20:31.999998+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:20:31.999998+0000","last_undegraded":"2024-03-09T15:20:31.999998+0000","last_fullsized":"2024-03-09T15:20:31.999998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:19:46.922962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'215","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.799050+0000","last_change":"2024-03-09T14:22:04.400948+0000","last_active":"2024-03-09T15:23:55.799050+0000","last_peered":"2024-03-09T15:23:55.799050+0000","last_clean":"2024-03-09T15:23:55.799050+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:23:55.799050+0000","last_undegraded":"2024-03-09T15:23:55.799050+0000","last_fullsized":"2024-03-09T15:23:55.799050+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:37.990701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'338","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006035+0000","last_change":"2024-03-09T14:21:56.364183+0000","last_active":"2024-03-09T15:22:22.006035+0000","last_peered":"2024-03-09T15:22:22.006035+0000","last_clean":"2024-03-09T15:22:22.006035+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:22:22.006035+0000","last_undegraded":"2024-03-09T15:22:22.006035+0000","last_fullsized":"2024-03-09T15:22:22.006035+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:20.353413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038029+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T15:22:02.038029+0000","last_peered":"2024-03-09T15:22:02.038029+0000","last_clean":"2024-03-09T15:22:02.038029+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:22:02.038029+0000","last_undegraded":"2024-03-09T15:22:02.038029+0000","last_fullsized":"2024-03-09T15:22:02.038029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'155","reported_seq":748,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:55.944251+0000","last_change":"2024-03-09T14:21:54.357687+0000","last_active":"2024-03-09T15:22:55.944251+0000","last_peered":"2024-03-09T15:22:55.944251+0000","last_clean":"2024-03-09T15:22:55.944251+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:22:55.944251+0000","last_undegraded":"2024-03-09T15:22:55.944251+0000","last_fullsized":"2024-03-09T15:22:55.944251+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:07.591910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1104040,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":314,"num_read_kb":1406,"num_write":851,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000526+0000","last_change":"2024-03-09T14:21:58.373133+0000","last_active":"2024-03-09T15:20:37.000526+0000","last_peered":"2024-03-09T15:20:37.000526+0000","last_clean":"2024-03-09T15:20:37.000526+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:20:37.000526+0000","last_undegraded":"2024-03-09T15:20:37.000526+0000","last_fullsized":"2024-03-09T15:20:37.000526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:53.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'144","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.207457+0000","last_change":"2024-03-09T14:22:00.388917+0000","last_active":"2024-03-09T15:22:36.207457+0000","last_peered":"2024-03-09T15:22:36.207457+0000","last_clean":"2024-03-09T15:22:36.207457+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:22:36.207457+0000","last_undegraded":"2024-03-09T15:22:36.207457+0000","last_fullsized":"2024-03-09T15:22:36.207457+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:20.768721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024785+0000","last_change":"2024-03-09T14:22:02.401190+0000","last_active":"2024-03-09T15:20:32.024785+0000","last_peered":"2024-03-09T15:20:32.024785+0000","last_clean":"2024-03-09T15:20:32.024785+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:20:32.024785+0000","last_undegraded":"2024-03-09T15:20:32.024785+0000","last_fullsized":"2024-03-09T15:20:32.024785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:59.946005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'103","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.267023+0000","last_change":"2024-03-09T14:22:04.408883+0000","last_active":"2024-03-09T15:23:23.267023+0000","last_peered":"2024-03-09T15:23:23.267023+0000","last_clean":"2024-03-09T15:23:23.267023+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:23:23.267023+0000","last_undegraded":"2024-03-09T15:23:23.267023+0000","last_fullsized":"2024-03-09T15:23:23.267023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:20.342826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.115078+0000","last_change":"2024-03-09T14:21:56.362977+0000","last_active":"2024-03-09T15:22:43.115078+0000","last_peered":"2024-03-09T15:22:43.115078+0000","last_clean":"2024-03-09T15:22:43.115078+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:22:43.115078+0000","last_undegraded":"2024-03-09T15:22:43.115078+0000","last_fullsized":"2024-03-09T15:22:43.115078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:56.941578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047191+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T15:22:02.047191+0000","last_peered":"2024-03-09T15:22:02.047191+0000","last_clean":"2024-03-09T15:22:02.047191+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:22:02.047191+0000","last_undegraded":"2024-03-09T15:22:02.047191+0000","last_fullsized":"2024-03-09T15:22:02.047191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'203","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.279511+0000","last_change":"2024-03-09T14:21:54.371651+0000","last_active":"2024-03-09T15:22:41.279511+0000","last_peered":"2024-03-09T15:22:41.279511+0000","last_clean":"2024-03-09T15:22:41.279511+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:22:41.279511+0000","last_undegraded":"2024-03-09T15:22:41.279511+0000","last_fullsized":"2024-03-09T15:22:41.279511+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:50.559760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11854883,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":458,"num_read_kb":33193,"num_write":1179,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992747+0000","last_change":"2024-03-09T14:21:58.371500+0000","last_active":"2024-03-09T15:20:31.992747+0000","last_peered":"2024-03-09T15:20:31.992747+0000","last_clean":"2024-03-09T15:20:31.992747+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:20:31.992747+0000","last_undegraded":"2024-03-09T15:20:31.992747+0000","last_fullsized":"2024-03-09T15:20:31.992747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:26.928736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'282","reported_seq":1581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.033091+0000","last_change":"2024-03-09T14:22:00.494298+0000","last_active":"2024-03-09T15:24:31.033091+0000","last_peered":"2024-03-09T15:24:31.033091+0000","last_clean":"2024-03-09T15:24:31.033091+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:24:31.033091+0000","last_undegraded":"2024-03-09T15:24:31.033091+0000","last_fullsized":"2024-03-09T15:24:31.033091+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:34.240386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908159+0000","last_change":"2024-03-09T14:22:02.400334+0000","last_active":"2024-03-09T15:22:26.908159+0000","last_peered":"2024-03-09T15:22:26.908159+0000","last_clean":"2024-03-09T15:22:26.908159+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:22:26.908159+0000","last_undegraded":"2024-03-09T15:22:26.908159+0000","last_fullsized":"2024-03-09T15:22:26.908159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:04.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'256","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:19.404283+0000","last_change":"2024-03-09T14:22:04.404883+0000","last_active":"2024-03-09T15:23:19.404283+0000","last_peered":"2024-03-09T15:23:19.404283+0000","last_clean":"2024-03-09T15:23:19.404283+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:23:19.404283+0000","last_undegraded":"2024-03-09T15:23:19.404283+0000","last_fullsized":"2024-03-09T15:23:19.404283+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:39.148958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999417+0000","last_change":"2024-03-09T14:21:56.371601+0000","last_active":"2024-03-09T15:20:26.999417+0000","last_peered":"2024-03-09T15:20:26.999417+0000","last_clean":"2024-03-09T15:20:26.999417+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:20:26.999417+0000","last_undegraded":"2024-03-09T15:20:26.999417+0000","last_fullsized":"2024-03-09T15:20:26.999417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:04.533578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.004180+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T15:22:07.004180+0000","last_peered":"2024-03-09T15:22:07.004180+0000","last_clean":"2024-03-09T15:22:07.004180+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:22:07.004180+0000","last_undegraded":"2024-03-09T15:22:07.004180+0000","last_fullsized":"2024-03-09T15:22:07.004180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:14.047597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046218+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T15:21:57.046218+0000","last_peered":"2024-03-09T15:21:57.046218+0000","last_clean":"2024-03-09T15:21:57.046218+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:21:57.046218+0000","last_undegraded":"2024-03-09T15:21:57.046218+0000","last_fullsized":"2024-03-09T15:21:57.046218+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:25:40.528352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'144","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.742914+0000","last_change":"2024-03-09T14:21:54.370907+0000","last_active":"2024-03-09T15:24:14.742914+0000","last_peered":"2024-03-09T15:24:14.742914+0000","last_clean":"2024-03-09T15:24:14.742914+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:24:14.742914+0000","last_undegraded":"2024-03-09T15:24:14.742914+0000","last_fullsized":"2024-03-09T15:24:14.742914+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:00.830027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534362,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":317,"num_read_kb":13701,"num_write":829,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024862+0000","last_change":"2024-03-09T14:21:58.370284+0000","last_active":"2024-03-09T15:20:32.024862+0000","last_peered":"2024-03-09T15:20:32.024862+0000","last_clean":"2024-03-09T15:20:32.024862+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:20:32.024862+0000","last_undegraded":"2024-03-09T15:20:32.024862+0000","last_fullsized":"2024-03-09T15:20:32.024862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:59.246060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'720","reported_seq":2322,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.019434+0000","last_change":"2024-03-09T14:22:00.388074+0000","last_active":"2024-03-09T15:24:32.019434+0000","last_peered":"2024-03-09T15:24:32.019434+0000","last_clean":"2024-03-09T15:24:32.019434+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:24:32.019434+0000","last_undegraded":"2024-03-09T15:24:32.019434+0000","last_fullsized":"2024-03-09T15:24:32.019434+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:01.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24809,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":1092,"num_write":352,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163647+0000","last_change":"2024-03-09T14:22:02.392515+0000","last_active":"2024-03-09T15:20:32.163647+0000","last_peered":"2024-03-09T15:20:32.163647+0000","last_clean":"2024-03-09T15:20:32.163647+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:20:32.163647+0000","last_undegraded":"2024-03-09T15:20:32.163647+0000","last_fullsized":"2024-03-09T15:20:32.163647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:41.546333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'158","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:46.996025+0000","last_change":"2024-03-09T14:22:04.397452+0000","last_active":"2024-03-09T15:20:46.996025+0000","last_peered":"2024-03-09T15:20:46.996025+0000","last_clean":"2024-03-09T15:20:46.996025+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:20:46.996025+0000","last_undegraded":"2024-03-09T15:20:46.996025+0000","last_fullsized":"2024-03-09T15:20:46.996025+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:18:25.696387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":803,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.018038+0000","last_change":"2024-03-09T14:21:56.356659+0000","last_active":"2024-03-09T15:22:56.018038+0000","last_peered":"2024-03-09T15:22:56.018038+0000","last_clean":"2024-03-09T15:22:56.018038+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:22:56.018038+0000","last_undegraded":"2024-03-09T15:22:56.018038+0000","last_fullsized":"2024-03-09T15:22:56.018038+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.345499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'130","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.022807+0000","last_change":"2024-03-09T14:22:31.510611+0000","last_active":"2024-03-09T15:23:23.022807+0000","last_peered":"2024-03-09T15:23:23.022807+0000","last_clean":"2024-03-09T15:23:23.022807+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:23:23.022807+0000","last_undegraded":"2024-03-09T15:23:23.022807+0000","last_fullsized":"2024-03-09T15:23:23.022807+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:42.545379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16317048,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":310,"num_read_kb":4172,"num_write":716,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.018367+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T15:22:07.018367+0000","last_peered":"2024-03-09T15:22:07.018367+0000","last_clean":"2024-03-09T15:22:07.018367+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:22:07.018367+0000","last_undegraded":"2024-03-09T15:22:07.018367+0000","last_fullsized":"2024-03-09T15:22:07.018367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019477+0000","last_change":"2024-03-09T14:21:58.372306+0000","last_active":"2024-03-09T15:22:17.019477+0000","last_peered":"2024-03-09T15:22:17.019477+0000","last_clean":"2024-03-09T15:22:17.019477+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:22:17.019477+0000","last_undegraded":"2024-03-09T15:22:17.019477+0000","last_fullsized":"2024-03-09T15:22:17.019477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:31.060450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'334","reported_seq":1051,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.846598+0000","last_change":"2024-03-09T14:22:00.492596+0000","last_active":"2024-03-09T15:24:30.846598+0000","last_peered":"2024-03-09T15:24:30.846598+0000","last_clean":"2024-03-09T15:24:30.846598+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:24:30.846598+0000","last_undegraded":"2024-03-09T15:24:30.846598+0000","last_fullsized":"2024-03-09T15:24:30.846598+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:55.986088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40546,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":636,"num_write":246,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.020677+0000","last_change":"2024-03-09T14:22:02.401629+0000","last_active":"2024-03-09T15:22:27.020677+0000","last_peered":"2024-03-09T15:22:27.020677+0000","last_clean":"2024-03-09T15:22:27.020677+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:22:27.020677+0000","last_undegraded":"2024-03-09T15:22:27.020677+0000","last_fullsized":"2024-03-09T15:22:27.020677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:24.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'144","reported_seq":634,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.827582+0000","last_change":"2024-03-09T14:22:04.400992+0000","last_active":"2024-03-09T15:23:33.827582+0000","last_peered":"2024-03-09T15:23:33.827582+0000","last_clean":"2024-03-09T15:23:33.827582+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:23:33.827582+0000","last_undegraded":"2024-03-09T15:23:33.827582+0000","last_fullsized":"2024-03-09T15:23:33.827582+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:22.181899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":758,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018863+0000","last_change":"2024-03-09T14:21:56.367601+0000","last_active":"2024-03-09T15:22:12.018863+0000","last_peered":"2024-03-09T15:22:12.018863+0000","last_clean":"2024-03-09T15:22:12.018863+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:22:12.018863+0000","last_undegraded":"2024-03-09T15:22:12.018863+0000","last_fullsized":"2024-03-09T15:22:12.018863+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:01.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'185","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.713042+0000","last_change":"2024-03-09T14:21:54.358356+0000","last_active":"2024-03-09T15:22:38.713042+0000","last_peered":"2024-03-09T15:22:38.713042+0000","last_clean":"2024-03-09T15:22:38.713042+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:22:38.713042+0000","last_undegraded":"2024-03-09T15:22:38.713042+0000","last_fullsized":"2024-03-09T15:22:38.713042+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:19.858694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263493,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":43067,"num_write":1016,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.164751+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T15:22:12.164751+0000","last_peered":"2024-03-09T15:22:12.164751+0000","last_clean":"2024-03-09T15:22:12.164751+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:22:12.164751+0000","last_undegraded":"2024-03-09T15:22:12.164751+0000","last_fullsized":"2024-03-09T15:22:12.164751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166771+0000","last_change":"2024-03-09T14:21:58.373524+0000","last_active":"2024-03-09T15:22:27.166771+0000","last_peered":"2024-03-09T15:22:27.166771+0000","last_clean":"2024-03-09T15:22:27.166771+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:22:27.166771+0000","last_undegraded":"2024-03-09T15:22:27.166771+0000","last_fullsized":"2024-03-09T15:22:27.166771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:39.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'122","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.450139+0000","last_change":"2024-03-09T14:22:00.386056+0000","last_active":"2024-03-09T15:22:36.450139+0000","last_peered":"2024-03-09T15:22:36.450139+0000","last_clean":"2024-03-09T15:22:36.450139+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:22:36.450139+0000","last_undegraded":"2024-03-09T15:22:36.450139+0000","last_fullsized":"2024-03-09T15:22:36.450139+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:40.186793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'545","reported_seq":4158,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.038330+0000","last_change":"2024-03-09T14:22:02.399139+0000","last_active":"2024-03-09T15:24:32.038330+0000","last_peered":"2024-03-09T15:24:32.038330+0000","last_clean":"2024-03-09T15:24:32.038330+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:24:32.038330+0000","last_undegraded":"2024-03-09T15:24:32.038330+0000","last_fullsized":"2024-03-09T15:24:32.038330+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:34.998650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'182","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.340909+0000","last_change":"2024-03-09T14:22:04.405073+0000","last_active":"2024-03-09T15:22:41.340909+0000","last_peered":"2024-03-09T15:22:41.340909+0000","last_clean":"2024-03-09T15:22:41.340909+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:22:41.340909+0000","last_undegraded":"2024-03-09T15:22:41.340909+0000","last_fullsized":"2024-03-09T15:22:41.340909+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:37.566660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.421696+0000","last_change":"2024-03-09T14:21:56.370846+0000","last_active":"2024-03-09T15:23:04.421696+0000","last_peered":"2024-03-09T15:23:04.421696+0000","last_clean":"2024-03-09T15:23:04.421696+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:23:04.421696+0000","last_undegraded":"2024-03-09T15:23:04.421696+0000","last_fullsized":"2024-03-09T15:23:04.421696+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:27:16.582369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'206","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006017+0000","last_change":"2024-03-09T14:21:54.370705+0000","last_active":"2024-03-09T15:22:22.006017+0000","last_peered":"2024-03-09T15:22:22.006017+0000","last_clean":"2024-03-09T15:22:22.006017+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:22:22.006017+0000","last_undegraded":"2024-03-09T15:22:22.006017+0000","last_fullsized":"2024-03-09T15:22:22.006017+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:43.848851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11138561,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":117883,"num_write":1117,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040120+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T15:22:17.040120+0000","last_peered":"2024-03-09T15:22:17.040120+0000","last_clean":"2024-03-09T15:22:17.040120+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:22:17.040120+0000","last_undegraded":"2024-03-09T15:22:17.040120+0000","last_fullsized":"2024-03-09T15:22:17.040120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:38.232466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041830+0000","last_change":"2024-03-09T14:21:58.371830+0000","last_active":"2024-03-09T15:22:27.041830+0000","last_peered":"2024-03-09T15:22:27.041830+0000","last_clean":"2024-03-09T15:22:27.041830+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:22:27.041830+0000","last_undegraded":"2024-03-09T15:22:27.041830+0000","last_fullsized":"2024-03-09T15:22:27.041830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:28.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'237","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.056546+0000","last_change":"2024-03-09T14:22:00.492643+0000","last_active":"2024-03-09T15:24:31.056546+0000","last_peered":"2024-03-09T15:24:31.056546+0000","last_clean":"2024-03-09T15:24:31.056546+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:24:31.056546+0000","last_undegraded":"2024-03-09T15:24:31.056546+0000","last_fullsized":"2024-03-09T15:24:31.056546+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:59.553996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'538","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.884147+0000","last_change":"2024-03-09T14:22:02.395536+0000","last_active":"2024-03-09T15:24:30.884147+0000","last_peered":"2024-03-09T15:24:30.884147+0000","last_clean":"2024-03-09T15:24:30.884147+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:30.884147+0000","last_undegraded":"2024-03-09T15:24:30.884147+0000","last_fullsized":"2024-03-09T15:24:30.884147+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:34.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'116","reported_seq":608,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:07.027423+0000","last_change":"2024-03-09T14:22:04.405236+0000","last_active":"2024-03-09T15:23:07.027423+0000","last_peered":"2024-03-09T15:23:07.027423+0000","last_clean":"2024-03-09T15:23:07.027423+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:23:07.027423+0000","last_undegraded":"2024-03-09T15:23:07.027423+0000","last_fullsized":"2024-03-09T15:23:07.027423+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:17.271331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.005976+0000","last_change":"2024-03-09T14:21:56.359311+0000","last_active":"2024-03-09T15:22:22.005976+0000","last_peered":"2024-03-09T15:22:22.005976+0000","last_clean":"2024-03-09T15:22:22.005976+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:22:22.005976+0000","last_undegraded":"2024-03-09T15:22:22.005976+0000","last_fullsized":"2024-03-09T15:22:22.005976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:45.357583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'192","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042519+0000","last_change":"2024-03-09T14:21:54.371711+0000","last_active":"2024-03-09T15:22:32.042519+0000","last_peered":"2024-03-09T15:22:32.042519+0000","last_clean":"2024-03-09T15:22:32.042519+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:22:32.042519+0000","last_undegraded":"2024-03-09T15:22:32.042519+0000","last_fullsized":"2024-03-09T15:22:32.042519+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:21.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15704678,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":52342,"num_write":1099,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040153+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T15:22:17.040153+0000","last_peered":"2024-03-09T15:22:17.040153+0000","last_clean":"2024-03-09T15:22:17.040153+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:22:17.040153+0000","last_undegraded":"2024-03-09T15:22:17.040153+0000","last_fullsized":"2024-03-09T15:22:17.040153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:58.533776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908142+0000","last_change":"2024-03-09T14:21:58.369587+0000","last_active":"2024-03-09T15:22:26.908142+0000","last_peered":"2024-03-09T15:22:26.908142+0000","last_clean":"2024-03-09T15:22:26.908142+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:22:26.908142+0000","last_undegraded":"2024-03-09T15:22:26.908142+0000","last_fullsized":"2024-03-09T15:22:26.908142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:01.184512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'270","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.842459+0000","last_change":"2024-03-09T14:22:00.386745+0000","last_active":"2024-03-09T15:24:30.842459+0000","last_peered":"2024-03-09T15:24:30.842459+0000","last_clean":"2024-03-09T15:24:30.842459+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:24:30.842459+0000","last_undegraded":"2024-03-09T15:24:30.842459+0000","last_fullsized":"2024-03-09T15:24:30.842459+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:58.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18542,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":518,"num_write":220,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166791+0000","last_change":"2024-03-09T14:22:02.400357+0000","last_active":"2024-03-09T15:22:27.166791+0000","last_peered":"2024-03-09T15:22:27.166791+0000","last_clean":"2024-03-09T15:22:27.166791+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:22:27.166791+0000","last_undegraded":"2024-03-09T15:22:27.166791+0000","last_fullsized":"2024-03-09T15:22:27.166791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:34.726729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'185","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.397957+0000","last_change":"2024-03-09T14:22:04.402392+0000","last_active":"2024-03-09T15:23:42.397957+0000","last_peered":"2024-03-09T15:23:42.397957+0000","last_clean":"2024-03-09T15:23:42.397957+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:23:42.397957+0000","last_undegraded":"2024-03-09T15:23:42.397957+0000","last_fullsized":"2024-03-09T15:23:42.397957+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:54.527353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'134","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:31.908737+0000","last_change":"2024-03-09T14:22:04.401080+0000","last_active":"2024-03-09T15:22:31.908737+0000","last_peered":"2024-03-09T15:22:31.908737+0000","last_clean":"2024-03-09T15:22:31.908737+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:22:31.908737+0000","last_undegraded":"2024-03-09T15:22:31.908737+0000","last_fullsized":"2024-03-09T15:22:31.908737+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:15.758082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4672,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.508782+0000","last_change":"2024-03-09T14:21:56.355418+0000","last_active":"2024-03-09T15:21:01.508782+0000","last_peered":"2024-03-09T15:21:01.508782+0000","last_clean":"2024-03-09T15:21:01.508782+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:21:01.508782+0000","last_undegraded":"2024-03-09T15:21:01.508782+0000","last_fullsized":"2024-03-09T15:21:01.508782+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:03.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'145","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.147275+0000","last_change":"2024-03-09T14:21:54.362232+0000","last_active":"2024-03-09T15:20:22.147275+0000","last_peered":"2024-03-09T15:20:22.147275+0000","last_clean":"2024-03-09T15:20:22.147275+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:20:22.147275+0000","last_undegraded":"2024-03-09T15:20:22.147275+0000","last_fullsized":"2024-03-09T15:20:22.147275+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:27.911421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8673473,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":29246,"num_write":811,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.993238+0000","last_change":"2024-03-09T14:21:58.371454+0000","last_active":"2024-03-09T15:20:21.993238+0000","last_peered":"2024-03-09T15:20:21.993238+0000","last_clean":"2024-03-09T15:20:21.993238+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:20:21.993238+0000","last_undegraded":"2024-03-09T15:20:21.993238+0000","last_fullsized":"2024-03-09T15:20:21.993238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:42.569021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'142","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:42.022643+0000","last_change":"2024-03-09T14:22:00.386530+0000","last_active":"2024-03-09T15:22:42.022643+0000","last_peered":"2024-03-09T15:22:42.022643+0000","last_clean":"2024-03-09T15:22:42.022643+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:22:42.022643+0000","last_undegraded":"2024-03-09T15:22:42.022643+0000","last_fullsized":"2024-03-09T15:22:42.022643+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:02.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14541,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":279,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005572+0000","last_change":"2024-03-09T14:22:02.399358+0000","last_active":"2024-03-09T15:20:22.005572+0000","last_peered":"2024-03-09T15:20:22.005572+0000","last_clean":"2024-03-09T15:20:22.005572+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:20:22.005572+0000","last_undegraded":"2024-03-09T15:20:22.005572+0000","last_fullsized":"2024-03-09T15:20:22.005572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:26.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020178+0000","last_change":"2024-03-09T14:22:04.403191+0000","last_active":"2024-03-09T15:22:22.020178+0000","last_peered":"2024-03-09T15:22:22.020178+0000","last_clean":"2024-03-09T15:22:22.020178+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:22:22.020178+0000","last_undegraded":"2024-03-09T15:22:22.020178+0000","last_fullsized":"2024-03-09T15:22:22.020178+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:51.085844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4078","reported_seq":4649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992713+0000","last_change":"2024-03-09T14:21:56.365718+0000","last_active":"2024-03-09T15:20:16.992713+0000","last_peered":"2024-03-09T15:20:16.992713+0000","last_clean":"2024-03-09T15:20:16.992713+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:20:16.992713+0000","last_undegraded":"2024-03-09T15:20:16.992713+0000","last_fullsized":"2024-03-09T15:20:16.992713+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:52.273131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'199","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.158041+0000","last_change":"2024-03-09T14:21:54.370617+0000","last_active":"2024-03-09T15:19:57.158041+0000","last_peered":"2024-03-09T15:19:57.158041+0000","last_clean":"2024-03-09T15:19:57.158041+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:19:57.158041+0000","last_undegraded":"2024-03-09T15:19:57.158041+0000","last_fullsized":"2024-03-09T15:19:57.158041+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:10.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559776,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":34556,"num_write":1088,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005680+0000","last_change":"2024-03-09T14:21:58.373073+0000","last_active":"2024-03-09T15:20:22.005680+0000","last_peered":"2024-03-09T15:20:22.005680+0000","last_clean":"2024-03-09T15:20:22.005680+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:20:22.005680+0000","last_undegraded":"2024-03-09T15:20:22.005680+0000","last_fullsized":"2024-03-09T15:20:22.005680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:00.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'44","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.028912+0000","last_change":"2024-03-09T14:22:00.389956+0000","last_active":"2024-03-09T15:22:36.028912+0000","last_peered":"2024-03-09T15:22:36.028912+0000","last_clean":"2024-03-09T15:22:36.028912+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:22:36.028912+0000","last_undegraded":"2024-03-09T15:22:36.028912+0000","last_fullsized":"2024-03-09T15:22:36.028912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:40.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161788+0000","last_change":"2024-03-09T14:22:02.397849+0000","last_active":"2024-03-09T15:20:22.161788+0000","last_peered":"2024-03-09T15:20:22.161788+0000","last_clean":"2024-03-09T15:20:22.161788+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:20:22.161788+0000","last_undegraded":"2024-03-09T15:20:22.161788+0000","last_fullsized":"2024-03-09T15:20:22.161788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:48.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'189","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.006224+0000","last_change":"2024-03-09T14:22:04.401057+0000","last_active":"2024-03-09T15:22:56.006224+0000","last_peered":"2024-03-09T15:22:56.006224+0000","last_clean":"2024-03-09T15:22:56.006224+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:22:56.006224+0000","last_undegraded":"2024-03-09T15:22:56.006224+0000","last_fullsized":"2024-03-09T15:22:56.006224+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:30.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004987+0000","last_change":"2024-03-09T14:21:56.360219+0000","last_active":"2024-03-09T15:20:17.004987+0000","last_peered":"2024-03-09T15:20:17.004987+0000","last_clean":"2024-03-09T15:20:17.004987+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:20:17.004987+0000","last_undegraded":"2024-03-09T15:20:17.004987+0000","last_fullsized":"2024-03-09T15:20:17.004987+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:44:55.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'138","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.610242+0000","last_change":"2024-03-09T14:21:54.360121+0000","last_active":"2024-03-09T15:20:13.610242+0000","last_peered":"2024-03-09T15:20:13.610242+0000","last_clean":"2024-03-09T15:20:13.610242+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:20:13.610242+0000","last_undegraded":"2024-03-09T15:20:13.610242+0000","last_fullsized":"2024-03-09T15:20:13.610242+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:23.649957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10522711,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":77468,"num_write":817,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161750+0000","last_change":"2024-03-09T14:21:58.371755+0000","last_active":"2024-03-09T15:20:22.161750+0000","last_peered":"2024-03-09T15:20:22.161750+0000","last_clean":"2024-03-09T15:20:22.161750+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:20:22.161750+0000","last_undegraded":"2024-03-09T15:20:22.161750+0000","last_fullsized":"2024-03-09T15:20:22.161750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:18.384428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'168","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.899211+0000","last_change":"2024-03-09T14:22:00.388758+0000","last_active":"2024-03-09T15:23:32.899211+0000","last_peered":"2024-03-09T15:23:32.899211+0000","last_clean":"2024-03-09T15:23:32.899211+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:23:32.899211+0000","last_undegraded":"2024-03-09T15:23:32.899211+0000","last_fullsized":"2024-03-09T15:23:32.899211+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:21.509939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12325,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":274,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023321+0000","last_change":"2024-03-09T14:22:02.401182+0000","last_active":"2024-03-09T15:20:22.023321+0000","last_peered":"2024-03-09T15:20:22.023321+0000","last_clean":"2024-03-09T15:20:22.023321+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:20:22.023321+0000","last_undegraded":"2024-03-09T15:20:22.023321+0000","last_fullsized":"2024-03-09T15:20:22.023321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:34.573612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'123","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.171935+0000","last_change":"2024-03-09T14:22:04.400641+0000","last_active":"2024-03-09T15:23:15.171935+0000","last_peered":"2024-03-09T15:23:15.171935+0000","last_clean":"2024-03-09T15:23:15.171935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:23:15.171935+0000","last_undegraded":"2024-03-09T15:23:15.171935+0000","last_fullsized":"2024-03-09T15:23:15.171935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:41.104332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004952+0000","last_change":"2024-03-09T14:21:56.353346+0000","last_active":"2024-03-09T15:20:17.004952+0000","last_peered":"2024-03-09T15:20:17.004952+0000","last_clean":"2024-03-09T15:20:17.004952+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:20:17.004952+0000","last_undegraded":"2024-03-09T15:20:17.004952+0000","last_fullsized":"2024-03-09T15:20:17.004952+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:34.741252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'173","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.741970+0000","last_change":"2024-03-09T14:21:54.368774+0000","last_active":"2024-03-09T15:24:14.741970+0000","last_peered":"2024-03-09T15:24:14.741970+0000","last_clean":"2024-03-09T15:24:14.741970+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:24:14.741970+0000","last_undegraded":"2024-03-09T15:24:14.741970+0000","last_fullsized":"2024-03-09T15:24:14.741970+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:07.130860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28356633,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":367,"num_read_kb":57120,"num_write":926,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023278+0000","last_change":"2024-03-09T14:21:58.371834+0000","last_active":"2024-03-09T15:20:22.023278+0000","last_peered":"2024-03-09T15:20:22.023278+0000","last_clean":"2024-03-09T15:20:22.023278+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:20:22.023278+0000","last_undegraded":"2024-03-09T15:20:22.023278+0000","last_fullsized":"2024-03-09T15:20:22.023278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:41.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'143","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.057027+0000","last_change":"2024-03-09T14:22:00.383681+0000","last_active":"2024-03-09T15:22:58.057027+0000","last_peered":"2024-03-09T15:22:58.057027+0000","last_clean":"2024-03-09T15:22:58.057027+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:22:58.057027+0000","last_undegraded":"2024-03-09T15:22:58.057027+0000","last_fullsized":"2024-03-09T15:22:58.057027+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:07.824315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":242,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.998738+0000","last_change":"2024-03-09T14:22:02.402801+0000","last_active":"2024-03-09T15:20:21.998738+0000","last_peered":"2024-03-09T15:20:21.998738+0000","last_clean":"2024-03-09T15:20:21.998738+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:20:21.998738+0000","last_undegraded":"2024-03-09T15:20:21.998738+0000","last_fullsized":"2024-03-09T15:20:21.998738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:42.052921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.177922+0000","last_change":"2024-03-09T14:21:56.355621+0000","last_active":"2024-03-09T15:23:15.177922+0000","last_peered":"2024-03-09T15:23:15.177922+0000","last_clean":"2024-03-09T15:23:15.177922+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:23:15.177922+0000","last_undegraded":"2024-03-09T15:23:15.177922+0000","last_fullsized":"2024-03-09T15:23:15.177922+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:48:40.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'186","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002294+0000","last_change":"2024-03-09T14:21:54.361543+0000","last_active":"2024-03-09T15:19:57.002294+0000","last_peered":"2024-03-09T15:19:57.002294+0000","last_clean":"2024-03-09T15:19:57.002294+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:19:57.002294+0000","last_undegraded":"2024-03-09T15:19:57.002294+0000","last_fullsized":"2024-03-09T15:19:57.002294+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:42.544106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11056654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":29766,"num_write":1069,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907526+0000","last_change":"2024-03-09T14:21:58.370949+0000","last_active":"2024-03-09T15:22:21.907526+0000","last_peered":"2024-03-09T15:22:21.907526+0000","last_clean":"2024-03-09T15:22:21.907526+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:22:21.907526+0000","last_undegraded":"2024-03-09T15:22:21.907526+0000","last_fullsized":"2024-03-09T15:22:21.907526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:55.442426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'213","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.862351+0000","last_change":"2024-03-09T14:22:00.386952+0000","last_active":"2024-03-09T15:24:30.862351+0000","last_peered":"2024-03-09T15:24:30.862351+0000","last_clean":"2024-03-09T15:24:30.862351+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:24:30.862351+0000","last_undegraded":"2024-03-09T15:24:30.862351+0000","last_fullsized":"2024-03-09T15:24:30.862351+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:12.101312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23073,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":315,"num_read_kb":453,"num_write":204,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038100+0000","last_change":"2024-03-09T14:22:02.402061+0000","last_active":"2024-03-09T15:22:02.038100+0000","last_peered":"2024-03-09T15:22:02.038100+0000","last_clean":"2024-03-09T15:22:02.038100+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:22:02.038100+0000","last_undegraded":"2024-03-09T15:22:02.038100+0000","last_fullsized":"2024-03-09T15:22:02.038100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:24.862935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'174","reported_seq":686,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.819989+0000","last_change":"2024-03-09T14:22:04.404476+0000","last_active":"2024-03-09T15:23:33.819989+0000","last_peered":"2024-03-09T15:23:33.819989+0000","last_clean":"2024-03-09T15:23:33.819989+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:23:33.819989+0000","last_undegraded":"2024-03-09T15:23:33.819989+0000","last_fullsized":"2024-03-09T15:23:33.819989+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:11.852013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:16.906878+0000","last_change":"2024-03-09T14:21:56.366627+0000","last_active":"2024-03-09T15:22:16.906878+0000","last_peered":"2024-03-09T15:22:16.906878+0000","last_clean":"2024-03-09T15:22:16.906878+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:22:16.906878+0000","last_undegraded":"2024-03-09T15:22:16.906878+0000","last_fullsized":"2024-03-09T15:22:16.906878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:53.735520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'314","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.991593+0000","last_change":"2024-03-09T14:21:54.370005+0000","last_active":"2024-03-09T15:20:06.991593+0000","last_peered":"2024-03-09T15:20:06.991593+0000","last_clean":"2024-03-09T15:20:06.991593+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:20:06.991593+0000","last_undegraded":"2024-03-09T15:20:06.991593+0000","last_fullsized":"2024-03-09T15:20:06.991593+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:34.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19923144,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":20523,"num_write":1603,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041888+0000","last_change":"2024-03-09T14:21:58.372204+0000","last_active":"2024-03-09T15:22:27.041888+0000","last_peered":"2024-03-09T15:22:27.041888+0000","last_clean":"2024-03-09T15:22:27.041888+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:22:27.041888+0000","last_undegraded":"2024-03-09T15:22:27.041888+0000","last_fullsized":"2024-03-09T15:22:27.041888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:24.041345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'177","reported_seq":767,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.838251+0000","last_change":"2024-03-09T14:22:00.384248+0000","last_active":"2024-03-09T15:24:30.838251+0000","last_peered":"2024-03-09T15:24:30.838251+0000","last_clean":"2024-03-09T15:24:30.838251+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:24:30.838251+0000","last_undegraded":"2024-03-09T15:24:30.838251+0000","last_fullsized":"2024-03-09T15:24:30.838251+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:27.943625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":321,"num_write":172,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003643+0000","last_change":"2024-03-09T14:22:02.397994+0000","last_active":"2024-03-09T15:22:02.003643+0000","last_peered":"2024-03-09T15:22:02.003643+0000","last_clean":"2024-03-09T15:22:02.003643+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:22:02.003643+0000","last_undegraded":"2024-03-09T15:22:02.003643+0000","last_fullsized":"2024-03-09T15:22:02.003643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:49.447597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'169","reported_seq":1359,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:29.026404+0000","last_change":"2024-03-09T14:22:04.398055+0000","last_active":"2024-03-09T15:24:29.026404+0000","last_peered":"2024-03-09T15:24:29.026404+0000","last_clean":"2024-03-09T15:24:29.026404+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:24:29.026404+0000","last_undegraded":"2024-03-09T15:24:29.026404+0000","last_fullsized":"2024-03-09T15:24:29.026404+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:45:27.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.795535+0000","last_change":"2024-03-09T14:21:56.352420+0000","last_active":"2024-03-09T15:22:38.795535+0000","last_peered":"2024-03-09T15:22:38.795535+0000","last_clean":"2024-03-09T15:22:38.795535+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:22:38.795535+0000","last_undegraded":"2024-03-09T15:22:38.795535+0000","last_fullsized":"2024-03-09T15:22:38.795535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:39.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'178","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.989620+0000","last_change":"2024-03-09T14:22:31.509702+0000","last_active":"2024-03-09T15:20:01.989620+0000","last_peered":"2024-03-09T15:20:01.989620+0000","last_clean":"2024-03-09T15:20:01.989620+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:20:01.989620+0000","last_undegraded":"2024-03-09T15:20:01.989620+0000","last_fullsized":"2024-03-09T15:20:01.989620+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:06.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324902,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":395,"num_read_kb":42859,"num_write":1105,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163221+0000","last_change":"2024-03-09T14:21:58.373433+0000","last_active":"2024-03-09T15:22:02.163221+0000","last_peered":"2024-03-09T15:22:02.163221+0000","last_clean":"2024-03-09T15:22:02.163221+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:22:02.163221+0000","last_undegraded":"2024-03-09T15:22:02.163221+0000","last_fullsized":"2024-03-09T15:22:02.163221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:25.282408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'141","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.859792+0000","last_change":"2024-03-09T14:22:00.493124+0000","last_active":"2024-03-09T15:24:30.859792+0000","last_peered":"2024-03-09T15:24:30.859792+0000","last_clean":"2024-03-09T15:24:30.859792+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:24:30.859792+0000","last_undegraded":"2024-03-09T15:24:30.859792+0000","last_fullsized":"2024-03-09T15:24:30.859792+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:05.031002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7694,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":253,"num_write":106,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.004846+0000","last_change":"2024-03-09T14:22:02.402300+0000","last_active":"2024-03-09T15:22:12.004846+0000","last_peered":"2024-03-09T15:22:12.004846+0000","last_clean":"2024-03-09T15:22:12.004846+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:22:12.004846+0000","last_undegraded":"2024-03-09T15:22:12.004846+0000","last_fullsized":"2024-03-09T15:22:12.004846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:54.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'107","reported_seq":599,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.867392+0000","last_change":"2024-03-09T14:22:04.400295+0000","last_active":"2024-03-09T15:24:30.867392+0000","last_peered":"2024-03-09T15:24:30.867392+0000","last_clean":"2024-03-09T15:24:30.867392+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:30.867392+0000","last_undegraded":"2024-03-09T15:24:30.867392+0000","last_fullsized":"2024-03-09T15:24:30.867392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:31.557973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.001414+0000","last_change":"2024-03-09T14:21:56.368701+0000","last_active":"2024-03-09T15:21:57.001414+0000","last_peered":"2024-03-09T15:21:57.001414+0000","last_clean":"2024-03-09T15:21:57.001414+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:21:57.001414+0000","last_undegraded":"2024-03-09T15:21:57.001414+0000","last_fullsized":"2024-03-09T15:21:57.001414+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:17.172991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'194","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904492+0000","last_change":"2024-03-09T14:22:31.527571+0000","last_active":"2024-03-09T15:21:56.904492+0000","last_peered":"2024-03-09T15:21:56.904492+0000","last_clean":"2024-03-09T15:21:56.904492+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:21:56.904492+0000","last_undegraded":"2024-03-09T15:21:56.904492+0000","last_fullsized":"2024-03-09T15:21:56.904492+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:45.724834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14734205,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":417,"num_read_kb":96221,"num_write":1017,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003663+0000","last_change":"2024-03-09T14:21:58.369956+0000","last_active":"2024-03-09T15:22:02.003663+0000","last_peered":"2024-03-09T15:22:02.003663+0000","last_clean":"2024-03-09T15:22:02.003663+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:22:02.003663+0000","last_undegraded":"2024-03-09T15:22:02.003663+0000","last_fullsized":"2024-03-09T15:22:02.003663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:20.111905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'103","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.471989+0000","last_change":"2024-03-09T14:22:00.492818+0000","last_active":"2024-03-09T15:22:36.471989+0000","last_peered":"2024-03-09T15:22:36.471989+0000","last_clean":"2024-03-09T15:22:36.471989+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:22:36.471989+0000","last_undegraded":"2024-03-09T15:22:36.471989+0000","last_fullsized":"2024-03-09T15:22:36.471989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:19:37.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'504","reported_seq":2243,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.060051+0000","last_change":"2024-03-09T14:22:02.396058+0000","last_active":"2024-03-09T15:24:32.060051+0000","last_peered":"2024-03-09T15:24:32.060051+0000","last_clean":"2024-03-09T15:24:32.060051+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:32.060051+0000","last_undegraded":"2024-03-09T15:24:32.060051+0000","last_fullsized":"2024-03-09T15:24:32.060051+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:28:12.304576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.043783+0000","last_change":"2024-03-09T14:22:04.400380+0000","last_active":"2024-03-09T15:23:16.043783+0000","last_peered":"2024-03-09T15:23:16.043783+0000","last_clean":"2024-03-09T15:23:16.043783+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:23:16.043783+0000","last_undegraded":"2024-03-09T15:23:16.043783+0000","last_fullsized":"2024-03-09T15:23:16.043783+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:28.603631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.417821+0000","last_change":"2024-03-09T14:21:56.352673+0000","last_active":"2024-03-09T15:23:44.417821+0000","last_peered":"2024-03-09T15:23:44.417821+0000","last_clean":"2024-03-09T15:23:44.417821+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:23:44.417821+0000","last_undegraded":"2024-03-09T15:23:44.417821+0000","last_fullsized":"2024-03-09T15:23:44.417821+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:05.415890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'145","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.037245+0000","last_change":"2024-03-09T14:21:54.361414+0000","last_active":"2024-03-09T15:21:57.037245+0000","last_peered":"2024-03-09T15:21:57.037245+0000","last_clean":"2024-03-09T15:21:57.037245+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:21:57.037245+0000","last_undegraded":"2024-03-09T15:21:57.037245+0000","last_fullsized":"2024-03-09T15:21:57.037245+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:31.236227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11643525,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":322,"num_read_kb":36416,"num_write":865,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047170+0000","last_change":"2024-03-09T14:21:58.368512+0000","last_active":"2024-03-09T15:22:02.047170+0000","last_peered":"2024-03-09T15:22:02.047170+0000","last_clean":"2024-03-09T15:22:02.047170+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:22:02.047170+0000","last_undegraded":"2024-03-09T15:22:02.047170+0000","last_fullsized":"2024-03-09T15:22:02.047170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:42.028813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'171","reported_seq":761,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.181529+0000","last_change":"2024-03-09T14:22:00.386165+0000","last_active":"2024-03-09T15:22:50.181529+0000","last_peered":"2024-03-09T15:22:50.181529+0000","last_clean":"2024-03-09T15:22:50.181529+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:22:50.181529+0000","last_undegraded":"2024-03-09T15:22:50.181529+0000","last_fullsized":"2024-03-09T15:22:50.181529+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:03.010266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8115,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":286,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996260+0000","last_change":"2024-03-09T14:22:02.398377+0000","last_active":"2024-03-09T15:20:01.996260+0000","last_peered":"2024-03-09T15:20:01.996260+0000","last_clean":"2024-03-09T15:20:01.996260+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:20:01.996260+0000","last_undegraded":"2024-03-09T15:20:01.996260+0000","last_fullsized":"2024-03-09T15:20:01.996260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:14:54.574464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'108","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:43.269705+0000","last_change":"2024-03-09T14:22:04.405953+0000","last_active":"2024-03-09T15:23:43.269705+0000","last_peered":"2024-03-09T15:23:43.269705+0000","last_clean":"2024-03-09T15:23:43.269705+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:23:43.269705+0000","last_undegraded":"2024-03-09T15:23:43.269705+0000","last_fullsized":"2024-03-09T15:23:43.269705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:28:15.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162368+0000","last_change":"2024-03-09T14:21:56.352123+0000","last_active":"2024-03-09T15:21:57.162368+0000","last_peered":"2024-03-09T15:21:57.162368+0000","last_clean":"2024-03-09T15:21:57.162368+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:21:57.162368+0000","last_undegraded":"2024-03-09T15:21:57.162368+0000","last_fullsized":"2024-03-09T15:21:57.162368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:01.770090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'163","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:15.251405+0000","last_change":"2024-03-09T14:21:54.371725+0000","last_active":"2024-03-09T15:24:15.251405+0000","last_peered":"2024-03-09T15:24:15.251405+0000","last_clean":"2024-03-09T15:24:15.251405+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:24:15.251405+0000","last_undegraded":"2024-03-09T15:24:15.251405+0000","last_fullsized":"2024-03-09T15:24:15.251405+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:57.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11077075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":381,"num_read_kb":54818,"num_write":995,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038072+0000","last_change":"2024-03-09T14:21:58.374073+0000","last_active":"2024-03-09T15:22:02.038072+0000","last_peered":"2024-03-09T15:22:02.038072+0000","last_clean":"2024-03-09T15:22:02.038072+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:22:02.038072+0000","last_undegraded":"2024-03-09T15:22:02.038072+0000","last_fullsized":"2024-03-09T15:22:02.038072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:43.159760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'132","reported_seq":696,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:33.648119+0000","last_change":"2024-03-09T14:22:00.384316+0000","last_active":"2024-03-09T15:22:33.648119+0000","last_peered":"2024-03-09T15:22:33.648119+0000","last_clean":"2024-03-09T15:22:33.648119+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:22:33.648119+0000","last_undegraded":"2024-03-09T15:22:33.648119+0000","last_fullsized":"2024-03-09T15:22:33.648119+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:49.725490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6560,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":215,"num_write":90,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021797+0000","last_change":"2024-03-09T14:22:02.396214+0000","last_active":"2024-03-09T15:20:12.021797+0000","last_peered":"2024-03-09T15:20:12.021797+0000","last_clean":"2024-03-09T15:20:12.021797+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:20:12.021797+0000","last_undegraded":"2024-03-09T15:20:12.021797+0000","last_fullsized":"2024-03-09T15:20:12.021797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:36.788962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'96","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.124529+0000","last_change":"2024-03-09T14:22:04.402457+0000","last_active":"2024-03-09T15:22:43.124529+0000","last_peered":"2024-03-09T15:22:43.124529+0000","last_clean":"2024-03-09T15:22:43.124529+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:22:43.124529+0000","last_undegraded":"2024-03-09T15:22:43.124529+0000","last_fullsized":"2024-03-09T15:22:43.124529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:20.405079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":768,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.882808+0000","last_change":"2024-03-09T14:21:56.361858+0000","last_active":"2024-03-09T15:23:32.882808+0000","last_peered":"2024-03-09T15:23:32.882808+0000","last_clean":"2024-03-09T15:23:32.882808+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:23:32.882808+0000","last_undegraded":"2024-03-09T15:23:32.882808+0000","last_fullsized":"2024-03-09T15:23:32.882808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:19:13.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'225","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018958+0000","last_change":"2024-03-09T14:21:54.358944+0000","last_active":"2024-03-09T15:22:12.018958+0000","last_peered":"2024-03-09T15:22:12.018958+0000","last_clean":"2024-03-09T15:22:12.018958+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:22:12.018958+0000","last_undegraded":"2024-03-09T15:22:12.018958+0000","last_fullsized":"2024-03-09T15:22:12.018958+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:31.824683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5894290,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":472,"num_read_kb":44740,"num_write":1207,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144162+0000","last_change":"2024-03-09T14:21:58.368610+0000","last_active":"2024-03-09T15:20:02.144162+0000","last_peered":"2024-03-09T15:20:02.144162+0000","last_clean":"2024-03-09T15:20:02.144162+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:20:02.144162+0000","last_undegraded":"2024-03-09T15:20:02.144162+0000","last_fullsized":"2024-03-09T15:20:02.144162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:54.314632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'111","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.857610+0000","last_change":"2024-03-09T14:22:00.390046+0000","last_active":"2024-03-09T15:24:30.857610+0000","last_peered":"2024-03-09T15:24:30.857610+0000","last_clean":"2024-03-09T15:24:30.857610+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:24:30.857610+0000","last_undegraded":"2024-03-09T15:24:30.857610+0000","last_fullsized":"2024-03-09T15:24:30.857610+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:50.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8520,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":179,"num_write":66,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163173+0000","last_change":"2024-03-09T14:22:02.397881+0000","last_active":"2024-03-09T15:22:02.163173+0000","last_peered":"2024-03-09T15:22:02.163173+0000","last_clean":"2024-03-09T15:22:02.163173+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:22:02.163173+0000","last_undegraded":"2024-03-09T15:22:02.163173+0000","last_fullsized":"2024-03-09T15:22:02.163173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:13.863238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'148","reported_seq":1807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.936366+0000","last_change":"2024-03-09T14:22:04.399435+0000","last_active":"2024-03-09T15:24:28.936366+0000","last_peered":"2024-03-09T15:24:28.936366+0000","last_clean":"2024-03-09T15:24:28.936366+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:24:28.936366+0000","last_undegraded":"2024-03-09T15:24:28.936366+0000","last_fullsized":"2024-03-09T15:24:28.936366+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.710673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.686428+0000","last_change":"2024-03-09T14:21:56.356912+0000","last_active":"2024-03-09T15:20:13.686428+0000","last_peered":"2024-03-09T15:20:13.686428+0000","last_clean":"2024-03-09T15:20:13.686428+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:20:13.686428+0000","last_undegraded":"2024-03-09T15:20:13.686428+0000","last_fullsized":"2024-03-09T15:20:13.686428+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:30.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'204","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907568+0000","last_change":"2024-03-09T14:21:54.358595+0000","last_active":"2024-03-09T15:22:21.907568+0000","last_peered":"2024-03-09T15:22:21.907568+0000","last_clean":"2024-03-09T15:22:21.907568+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:22:21.907568+0000","last_undegraded":"2024-03-09T15:22:21.907568+0000","last_fullsized":"2024-03-09T15:22:21.907568+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:14.194545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16015484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":64454,"num_write":1154,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"32'4","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.382657+0000","last_change":"2024-03-09T14:21:58.370687+0000","last_active":"2024-03-09T15:24:30.382657+0000","last_peered":"2024-03-09T15:24:30.382657+0000","last_clean":"2024-03-09T15:24:30.382657+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:30.382657+0000","last_undegraded":"2024-03-09T15:24:30.382657+0000","last_fullsized":"2024-03-09T15:24:30.382657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:27.059761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":474,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'162","reported_seq":754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.861372+0000","last_change":"2024-03-09T14:22:00.381012+0000","last_active":"2024-03-09T15:24:30.861372+0000","last_peered":"2024-03-09T15:24:30.861372+0000","last_clean":"2024-03-09T15:24:30.861372+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:24:30.861372+0000","last_undegraded":"2024-03-09T15:24:30.861372+0000","last_fullsized":"2024-03-09T15:24:30.861372+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:29.659729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20695,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":310,"num_write":122,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:01.905044+0000","last_change":"2024-03-09T14:22:02.401394+0000","last_active":"2024-03-09T15:22:01.905044+0000","last_peered":"2024-03-09T15:22:01.905044+0000","last_clean":"2024-03-09T15:22:01.905044+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:22:01.905044+0000","last_undegraded":"2024-03-09T15:22:01.905044+0000","last_fullsized":"2024-03-09T15:22:01.905044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:36.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'106","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:24.040847+0000","last_change":"2024-03-09T14:22:04.402287+0000","last_active":"2024-03-09T15:23:24.040847+0000","last_peered":"2024-03-09T15:23:24.040847+0000","last_clean":"2024-03-09T15:23:24.040847+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:23:24.040847+0000","last_undegraded":"2024-03-09T15:23:24.040847+0000","last_fullsized":"2024-03-09T15:23:24.040847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:54.058990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993860+0000","last_change":"2024-03-09T14:21:56.357674+0000","last_active":"2024-03-09T15:20:26.993860+0000","last_peered":"2024-03-09T15:20:26.993860+0000","last_clean":"2024-03-09T15:20:26.993860+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:20:26.993860+0000","last_undegraded":"2024-03-09T15:20:26.993860+0000","last_fullsized":"2024-03-09T15:20:26.993860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:37.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'180","reported_seq":990,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040923+0000","last_change":"2024-03-09T14:21:54.367079+0000","last_active":"2024-03-09T15:22:22.040923+0000","last_peered":"2024-03-09T15:22:22.040923+0000","last_clean":"2024-03-09T15:22:22.040923+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:22:22.040923+0000","last_undegraded":"2024-03-09T15:22:22.040923+0000","last_fullsized":"2024-03-09T15:22:22.040923+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:51.408419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730712,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":787,"num_read_kb":18311,"num_write":1111,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":855,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993837+0000","last_change":"2024-03-09T14:21:56.368289+0000","last_active":"2024-03-09T15:20:26.993837+0000","last_peered":"2024-03-09T15:20:26.993837+0000","last_clean":"2024-03-09T15:20:26.993837+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:20:26.993837+0000","last_undegraded":"2024-03-09T15:20:26.993837+0000","last_fullsized":"2024-03-09T15:20:26.993837+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:13.723494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'269","reported_seq":1081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003736+0000","last_change":"2024-03-09T14:21:54.359757+0000","last_active":"2024-03-09T15:22:22.003736+0000","last_peered":"2024-03-09T15:22:22.003736+0000","last_clean":"2024-03-09T15:22:22.003736+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:22:22.003736+0000","last_undegraded":"2024-03-09T15:22:22.003736+0000","last_fullsized":"2024-03-09T15:22:22.003736+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:57.050243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351863,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1218,"num_read_kb":137737,"num_write":1248,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024150+0000","last_change":"2024-03-09T14:21:56.360003+0000","last_active":"2024-03-09T15:20:27.024150+0000","last_peered":"2024-03-09T15:20:27.024150+0000","last_clean":"2024-03-09T15:20:27.024150+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:20:27.024150+0000","last_undegraded":"2024-03-09T15:20:27.024150+0000","last_fullsized":"2024-03-09T15:20:27.024150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'162","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.331004+0000","last_change":"2024-03-09T14:21:54.370800+0000","last_active":"2024-03-09T15:23:42.331004+0000","last_peered":"2024-03-09T15:23:42.331004+0000","last_clean":"2024-03-09T15:23:42.331004+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:23:42.331004+0000","last_undegraded":"2024-03-09T15:23:42.331004+0000","last_fullsized":"2024-03-09T15:23:42.331004+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:44.318284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":5631,"num_write":925,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.967315+0000","last_change":"2024-03-09T14:21:56.364838+0000","last_active":"2024-03-09T15:23:37.967315+0000","last_peered":"2024-03-09T15:23:37.967315+0000","last_clean":"2024-03-09T15:23:37.967315+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:23:37.967315+0000","last_undegraded":"2024-03-09T15:23:37.967315+0000","last_fullsized":"2024-03-09T15:23:37.967315+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:10.284801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'145","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999945+0000","last_change":"2024-03-09T14:22:31.512263+0000","last_active":"2024-03-09T15:20:31.999945+0000","last_peered":"2024-03-09T15:20:31.999945+0000","last_clean":"2024-03-09T15:20:31.999945+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:20:31.999945+0000","last_undegraded":"2024-03-09T15:20:31.999945+0000","last_fullsized":"2024-03-09T15:20:31.999945+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:22.007571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469459,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":2407,"num_write":835,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'203","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.006966+0000","last_change":"2024-03-09T14:21:56.356735+0000","last_active":"2024-03-09T15:20:32.006966+0000","last_peered":"2024-03-09T15:20:32.006966+0000","last_clean":"2024-03-09T15:20:32.006966+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:20:32.006966+0000","last_undegraded":"2024-03-09T15:20:32.006966+0000","last_fullsized":"2024-03-09T15:20:32.006966+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:40.763958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'222","reported_seq":959,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.301620+0000","last_change":"2024-03-09T14:21:54.360027+0000","last_active":"2024-03-09T15:21:18.301620+0000","last_peered":"2024-03-09T15:21:18.301620+0000","last_clean":"2024-03-09T15:21:18.301620+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:21:18.301620+0000","last_undegraded":"2024-03-09T15:21:18.301620+0000","last_fullsized":"2024-03-09T15:21:18.301620+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:39.068686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7319443,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":802,"num_read_kb":22283,"num_write":1149,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166084+0000","last_change":"2024-03-09T14:21:56.363506+0000","last_active":"2024-03-09T15:22:22.166084+0000","last_peered":"2024-03-09T15:22:22.166084+0000","last_clean":"2024-03-09T15:22:22.166084+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:22:22.166084+0000","last_undegraded":"2024-03-09T15:22:22.166084+0000","last_fullsized":"2024-03-09T15:22:22.166084+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:50.856855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'195","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993807+0000","last_change":"2024-03-09T14:21:54.371723+0000","last_active":"2024-03-09T15:20:26.993807+0000","last_peered":"2024-03-09T15:20:26.993807+0000","last_clean":"2024-03-09T15:20:26.993807+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:20:26.993807+0000","last_undegraded":"2024-03-09T15:20:26.993807+0000","last_fullsized":"2024-03-09T15:20:26.993807+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:20.005554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324814,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":38599,"num_write":1105,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020078+0000","last_change":"2024-03-09T14:21:56.359970+0000","last_active":"2024-03-09T15:22:22.020078+0000","last_peered":"2024-03-09T15:22:22.020078+0000","last_clean":"2024-03-09T15:22:22.020078+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:22:22.020078+0000","last_undegraded":"2024-03-09T15:22:22.020078+0000","last_fullsized":"2024-03-09T15:22:22.020078+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:09.990655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'210","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024091+0000","last_change":"2024-03-09T14:21:54.364970+0000","last_active":"2024-03-09T15:20:27.024091+0000","last_peered":"2024-03-09T15:20:27.024091+0000","last_clean":"2024-03-09T15:20:27.024091+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:20:27.024091+0000","last_undegraded":"2024-03-09T15:20:27.024091+0000","last_fullsized":"2024-03-09T15:20:27.024091+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:09.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11397214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":1161,"num_write":1163,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040950+0000","last_change":"2024-03-09T14:21:56.360728+0000","last_active":"2024-03-09T15:22:22.040950+0000","last_peered":"2024-03-09T15:22:22.040950+0000","last_clean":"2024-03-09T15:22:22.040950+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:22:22.040950+0000","last_undegraded":"2024-03-09T15:22:22.040950+0000","last_fullsized":"2024-03-09T15:22:22.040950+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:03:35.870767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'183","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006364+0000","last_change":"2024-03-09T14:21:54.365980+0000","last_active":"2024-03-09T15:20:27.006364+0000","last_peered":"2024-03-09T15:20:27.006364+0000","last_clean":"2024-03-09T15:20:27.006364+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:20:27.006364+0000","last_undegraded":"2024-03-09T15:20:27.006364+0000","last_fullsized":"2024-03-09T15:20:27.006364+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:10.240743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12616287,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":15052,"num_write":1035,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998176+0000","last_change":"2024-03-09T14:23:32.139833+0000","last_active":"2024-03-09T15:20:16.998176+0000","last_peered":"2024-03-09T15:20:16.998176+0000","last_clean":"2024-03-09T15:20:16.998176+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:20:16.998176+0000","last_undegraded":"2024-03-09T15:20:16.998176+0000","last_fullsized":"2024-03-09T15:20:16.998176+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:24.028499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'173","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025532+0000","last_change":"2024-03-09T14:21:54.370760+0000","last_active":"2024-03-09T15:20:37.025532+0000","last_peered":"2024-03-09T15:20:37.025532+0000","last_clean":"2024-03-09T15:20:37.025532+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:20:37.025532+0000","last_undegraded":"2024-03-09T15:20:37.025532+0000","last_fullsized":"2024-03-09T15:20:37.025532+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:04:48.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7402673,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":2617,"num_write":1100,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'89","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.146608+0000","last_change":"2024-03-09T14:21:56.362263+0000","last_active":"2024-03-09T15:20:17.146608+0000","last_peered":"2024-03-09T15:20:17.146608+0000","last_clean":"2024-03-09T15:20:17.146608+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:20:17.146608+0000","last_undegraded":"2024-03-09T15:20:17.146608+0000","last_fullsized":"2024-03-09T15:20:17.146608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:54.785232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995931+0000","last_change":"2024-03-09T14:22:31.509909+0000","last_active":"2024-03-09T15:21:01.995931+0000","last_peered":"2024-03-09T15:21:01.995931+0000","last_clean":"2024-03-09T15:21:01.995931+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:21:01.995931+0000","last_undegraded":"2024-03-09T15:21:01.995931+0000","last_fullsized":"2024-03-09T15:21:01.995931+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:26.468991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993373+0000","last_change":"2024-03-09T14:21:56.361155+0000","last_active":"2024-03-09T15:20:36.993373+0000","last_peered":"2024-03-09T15:20:36.993373+0000","last_clean":"2024-03-09T15:20:36.993373+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:20:36.993373+0000","last_undegraded":"2024-03-09T15:20:36.993373+0000","last_fullsized":"2024-03-09T15:20:36.993373+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:24.944266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'153","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024078+0000","last_change":"2024-03-09T14:21:54.359540+0000","last_active":"2024-03-09T15:20:27.024078+0000","last_peered":"2024-03-09T15:20:27.024078+0000","last_clean":"2024-03-09T15:20:27.024078+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:20:27.024078+0000","last_undegraded":"2024-03-09T15:20:27.024078+0000","last_fullsized":"2024-03-09T15:20:27.024078+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:36.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5692335,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":3591,"num_write":915,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148046+0000","last_change":"2024-03-09T14:21:56.357637+0000","last_active":"2024-03-09T15:20:27.148046+0000","last_peered":"2024-03-09T15:20:27.148046+0000","last_clean":"2024-03-09T15:20:27.148046+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:20:27.148046+0000","last_undegraded":"2024-03-09T15:20:27.148046+0000","last_fullsized":"2024-03-09T15:20:27.148046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:40.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'227","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:30.558860+0000","last_change":"2024-03-09T14:21:54.361294+0000","last_active":"2024-03-09T15:20:30.558860+0000","last_peered":"2024-03-09T15:20:30.558860+0000","last_clean":"2024-03-09T15:20:30.558860+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:20:30.558860+0000","last_undegraded":"2024-03-09T15:20:30.558860+0000","last_fullsized":"2024-03-09T15:20:30.558860+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:03.466571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5751340,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":6366,"num_write":1239,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162762+0000","last_change":"2024-03-09T14:21:56.366542+0000","last_active":"2024-03-09T15:20:27.162762+0000","last_peered":"2024-03-09T15:20:27.162762+0000","last_clean":"2024-03-09T15:20:27.162762+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:20:27.162762+0000","last_undegraded":"2024-03-09T15:20:27.162762+0000","last_fullsized":"2024-03-09T15:20:27.162762+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:07.419936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'210","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995977+0000","last_change":"2024-03-09T14:22:31.512292+0000","last_active":"2024-03-09T15:21:01.995977+0000","last_peered":"2024-03-09T15:21:01.995977+0000","last_clean":"2024-03-09T15:21:01.995977+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:21:01.995977+0000","last_undegraded":"2024-03-09T15:21:01.995977+0000","last_fullsized":"2024-03-09T15:21:01.995977+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:33.917233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933588,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":457,"num_read_kb":30999,"num_write":1207,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999345+0000","last_change":"2024-03-09T14:21:56.371868+0000","last_active":"2024-03-09T15:20:26.999345+0000","last_peered":"2024-03-09T15:20:26.999345+0000","last_clean":"2024-03-09T15:20:26.999345+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:20:26.999345+0000","last_undegraded":"2024-03-09T15:20:26.999345+0000","last_fullsized":"2024-03-09T15:20:26.999345+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:15.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'185","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.057080+0000","last_change":"2024-03-09T14:21:54.364838+0000","last_active":"2024-03-09T15:22:43.057080+0000","last_peered":"2024-03-09T15:22:43.057080+0000","last_clean":"2024-03-09T15:22:43.057080+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:22:43.057080+0000","last_undegraded":"2024-03-09T15:22:43.057080+0000","last_fullsized":"2024-03-09T15:22:43.057080+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:49.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5287633,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":8057,"num_write":1055,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006259+0000","last_change":"2024-03-09T14:21:56.374875+0000","last_active":"2024-03-09T15:20:27.006259+0000","last_peered":"2024-03-09T15:20:27.006259+0000","last_clean":"2024-03-09T15:20:27.006259+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:20:27.006259+0000","last_undegraded":"2024-03-09T15:20:27.006259+0000","last_fullsized":"2024-03-09T15:20:27.006259+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:04.393658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'187","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.991193+0000","last_change":"2024-03-09T14:21:54.358572+0000","last_active":"2024-03-09T15:20:16.991193+0000","last_peered":"2024-03-09T15:20:16.991193+0000","last_clean":"2024-03-09T15:20:16.991193+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:20:16.991193+0000","last_undegraded":"2024-03-09T15:20:16.991193+0000","last_fullsized":"2024-03-09T15:20:16.991193+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:42.206920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12701674,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":370,"num_read_kb":1771,"num_write":1073,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.582786+0000","last_change":"2024-03-09T14:21:56.366749+0000","last_active":"2024-03-09T15:23:08.582786+0000","last_peered":"2024-03-09T15:23:08.582786+0000","last_clean":"2024-03-09T15:23:08.582786+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:23:08.582786+0000","last_undegraded":"2024-03-09T15:23:08.582786+0000","last_fullsized":"2024-03-09T15:23:08.582786+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:28.693682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022779+0000","last_change":"2024-03-09T14:21:54.362334+0000","last_active":"2024-03-09T15:20:17.022779+0000","last_peered":"2024-03-09T15:20:17.022779+0000","last_clean":"2024-03-09T15:20:17.022779+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:20:17.022779+0000","last_undegraded":"2024-03-09T15:20:17.022779+0000","last_fullsized":"2024-03-09T15:20:17.022779+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:07.779443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":6618,"num_write":997,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'203","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022634+0000","last_change":"2024-03-09T14:22:31.500572+0000","last_active":"2024-03-09T15:20:17.022634+0000","last_peered":"2024-03-09T15:20:17.022634+0000","last_clean":"2024-03-09T15:20:17.022634+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:20:17.022634+0000","last_undegraded":"2024-03-09T15:20:17.022634+0000","last_fullsized":"2024-03-09T15:20:17.022634+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:04.341433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18506442,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":427,"num_read_kb":70161,"num_write":1218,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.091735+0000","last_change":"2024-03-09T14:21:56.373545+0000","last_active":"2024-03-09T15:23:23.091735+0000","last_peered":"2024-03-09T15:23:23.091735+0000","last_clean":"2024-03-09T15:23:23.091735+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:23:23.091735+0000","last_undegraded":"2024-03-09T15:23:23.091735+0000","last_fullsized":"2024-03-09T15:23:23.091735+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:55.978437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'189","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.902114+0000","last_change":"2024-03-09T14:21:54.366684+0000","last_active":"2024-03-09T15:23:37.902114+0000","last_peered":"2024-03-09T15:23:37.902114+0000","last_clean":"2024-03-09T15:23:37.902114+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:23:37.902114+0000","last_undegraded":"2024-03-09T15:23:37.902114+0000","last_fullsized":"2024-03-09T15:23:37.902114+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:50.065605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23102045,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":29809,"num_write":1050,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019819+0000","last_change":"2024-03-09T14:21:56.373920+0000","last_active":"2024-03-09T15:19:57.019819+0000","last_peered":"2024-03-09T15:19:57.019819+0000","last_clean":"2024-03-09T15:19:57.019819+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:19:57.019819+0000","last_undegraded":"2024-03-09T15:19:57.019819+0000","last_fullsized":"2024-03-09T15:19:57.019819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:31.026336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1226,"ondisk_log_size":1226,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":632,"ondisk_log_size":632,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":334127,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8854,"num_read_kb":10560,"num_write":6413,"num_write_kb":2961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712704,"data_stored":178786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1868,"ondisk_log_size":1868,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1573,"num_read_kb":1873,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3747,"ondisk_log_size":3747,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":633895248,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":31765,"num_read_kb":2295828,"num_write":68028,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":953536512,"data_stored":953536512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4586,"ondisk_log_size":4586,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":80534719,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":113,"num_read_kb":170575,"num_write":132,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161079296,"data_stored":161069438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":80534719,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":114,"num_read_kb":174957,"num_write":132,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161079296,"data_stored":161069438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575608,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451364,"kb_used_data":159196,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93920476,"statfs":{"total":96636764160,"available":96174567424,"internally_reserved":0,"allocated":163016704,"data_stored":161020128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575608,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394184,"kb_used_data":156160,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93977656,"statfs":{"total":96636764160,"available":96233119744,"internally_reserved":0,"allocated":159907840,"data_stored":157991089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575609,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244964,"kb_used_data":159708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94126876,"statfs":{"total":96636764160,"available":96385921024,"internally_reserved":0,"allocated":163540992,"data_stored":161520121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259136,"kb_used_data":183544,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94112704,"statfs":{"total":96636764160,"available":96371408896,"internally_reserved":0,"allocated":187949056,"data_stored":186062276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575611,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394820,"kb_used_data":183164,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93977020,"statfs":{"total":96636764160,"available":96232468480,"internally_reserved":0,"allocated":187559936,"data_stored":185582722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575610,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209948,"kb_used_data":124692,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94161892,"statfs":{"total":96636764160,"available":96421777408,"internally_reserved":0,"allocated":127684608,"data_stored":125769330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575609,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276512,"kb_used_data":169048,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94095328,"statfs":{"total":96636764160,"available":96353615872,"internally_reserved":0,"allocated":173105152,"data_stored":171158574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575607,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364476,"kb_used_data":144500,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94007364,"statfs":{"total":96636764160,"available":96263540736,"internally_reserved":0,"allocated":147968000,"data_stored":145989418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":121610240,"data_stored":121610240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115818496,"data_stored":115818496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":96149504,"data_stored":96149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116727808,"data_stored":116727808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":135528448,"data_stored":135528448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":130207744,"data_stored":130207744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":118968320,"data_stored":118968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118525952,"data_stored":118525952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":20357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":23559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":9420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":20894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":28805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":26027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":47157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26255360,"data_stored":26254545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21737472,"data_stored":21734173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32546816,"data_stored":32546001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28069888,"data_stored":28065774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20013056,"data_stored":20011517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44847104,"data_stored":44842990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17491441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18915328,"data_stored":18914513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:24:39.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:24:40.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:40.070 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:24:40.074 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2144,"stamp":"2024-03-09T15:24:39.149657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":795903647,"num_objects":792,"num_object_clones":0,"num_object_copies":2024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":150491,"num_read_kb":2743710,"num_write":128205,"num_write_kb":2398286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14411,"ondisk_log_size":14411,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2595404,"kb_used_data":1280012,"kb_used_omap":12,"kb_used_meta":1315315,"kb_avail":752379316,"statfs":{"total":773094113280,"available":770436419584,"internally_reserved":0,"allocated":1310732288,"data_stored":1295093658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1346883120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4194440,"num_objects":-8,"num_object_clones":0,"num_object_copies":-17,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":71,"num_read_kb":76,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004849"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.021041+0000","last_change":"2024-03-09T14:50:03.656802+0000","last_active":"2024-03-09T15:20:07.021041+0000","last_peered":"2024-03-09T15:20:07.021041+0000","last_clean":"2024-03-09T15:20:07.021041+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:20:07.021041+0000","last_undegraded":"2024-03-09T15:20:07.021041+0000","last_fullsized":"2024-03-09T15:20:07.021041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:04.962196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'7","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.028585+0000","last_change":"2024-03-09T14:35:55.601961+0000","last_active":"2024-03-09T15:20:57.028585+0000","last_peered":"2024-03-09T15:20:57.028585+0000","last_clean":"2024-03-09T15:20:57.028585+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:20:57.028585+0000","last_undegraded":"2024-03-09T15:20:57.028585+0000","last_fullsized":"2024-03-09T15:20:57.028585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:04:58.889343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009287+0000","last_change":"2024-03-09T14:35:50.589013+0000","last_active":"2024-03-09T15:20:52.009287+0000","last_peered":"2024-03-09T15:20:52.009287+0000","last_clean":"2024-03-09T15:20:52.009287+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:20:52.009287+0000","last_undegraded":"2024-03-09T15:20:52.009287+0000","last_fullsized":"2024-03-09T15:20:52.009287+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:23.606923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003320+0000","last_change":"2024-03-09T14:31:01.149135+0000","last_active":"2024-03-09T15:21:02.003320+0000","last_peered":"2024-03-09T15:21:02.003320+0000","last_clean":"2024-03-09T15:21:02.003320+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:21:02.003320+0000","last_undegraded":"2024-03-09T15:21:02.003320+0000","last_fullsized":"2024-03-09T15:21:02.003320+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:09.105678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.990155+0000","last_change":"2024-03-09T14:50:03.659762+0000","last_active":"2024-03-09T15:20:06.990155+0000","last_peered":"2024-03-09T15:20:06.990155+0000","last_clean":"2024-03-09T15:20:06.990155+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:20:06.990155+0000","last_undegraded":"2024-03-09T15:20:06.990155+0000","last_fullsized":"2024-03-09T15:20:06.990155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:14.705784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.151881+0000","last_change":"2024-03-09T14:35:55.598964+0000","last_active":"2024-03-09T15:20:57.151881+0000","last_peered":"2024-03-09T15:20:57.151881+0000","last_clean":"2024-03-09T15:20:57.151881+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:20:57.151881+0000","last_undegraded":"2024-03-09T15:20:57.151881+0000","last_fullsized":"2024-03-09T15:20:57.151881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:08.079908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.996523+0000","last_change":"2024-03-09T14:35:50.590196+0000","last_active":"2024-03-09T15:20:51.996523+0000","last_peered":"2024-03-09T15:20:51.996523+0000","last_clean":"2024-03-09T15:20:51.996523+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:20:51.996523+0000","last_undegraded":"2024-03-09T15:20:51.996523+0000","last_fullsized":"2024-03-09T15:20:51.996523+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:35.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":156,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:11.996933+0000","last_change":"2024-03-09T14:31:01.138966+0000","last_active":"2024-03-09T15:21:11.996933+0000","last_peered":"2024-03-09T15:21:11.996933+0000","last_clean":"2024-03-09T15:21:11.996933+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:21:11.996933+0000","last_undegraded":"2024-03-09T15:21:11.996933+0000","last_fullsized":"2024-03-09T15:21:11.996933+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:10.293011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.033437+0000","last_change":"2024-03-09T14:50:03.653730+0000","last_active":"2024-03-09T15:21:32.033437+0000","last_peered":"2024-03-09T15:21:32.033437+0000","last_clean":"2024-03-09T15:21:32.033437+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:21:32.033437+0000","last_undegraded":"2024-03-09T15:21:32.033437+0000","last_fullsized":"2024-03-09T15:21:32.033437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:21.654055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'1","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903377+0000","last_change":"2024-03-09T14:35:55.635024+0000","last_active":"2024-03-09T15:21:46.903377+0000","last_peered":"2024-03-09T15:21:46.903377+0000","last_clean":"2024-03-09T15:21:46.903377+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:21:46.903377+0000","last_undegraded":"2024-03-09T15:21:46.903377+0000","last_fullsized":"2024-03-09T15:21:46.903377+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:46.253263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'7","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.001931+0000","last_change":"2024-03-09T14:35:50.592237+0000","last_active":"2024-03-09T15:22:02.001931+0000","last_peered":"2024-03-09T15:22:02.001931+0000","last_clean":"2024-03-09T15:22:02.001931+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:22:02.001931+0000","last_undegraded":"2024-03-09T15:22:02.001931+0000","last_fullsized":"2024-03-09T15:22:02.001931+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:31.946306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003270+0000","last_change":"2024-03-09T14:31:01.144121+0000","last_active":"2024-03-09T15:21:02.003270+0000","last_peered":"2024-03-09T15:21:02.003270+0000","last_clean":"2024-03-09T15:21:02.003270+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:21:02.003270+0000","last_undegraded":"2024-03-09T15:21:02.003270+0000","last_fullsized":"2024-03-09T15:21:02.003270+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:07.901302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.015382+0000","last_change":"2024-03-09T14:50:03.664715+0000","last_active":"2024-03-09T15:21:42.015382+0000","last_peered":"2024-03-09T15:21:42.015382+0000","last_clean":"2024-03-09T15:21:42.015382+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:21:42.015382+0000","last_undegraded":"2024-03-09T15:21:42.015382+0000","last_fullsized":"2024-03-09T15:21:42.015382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:17.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018993+0000","last_change":"2024-03-09T14:35:55.633735+0000","last_active":"2024-03-09T15:22:12.018993+0000","last_peered":"2024-03-09T15:22:12.018993+0000","last_clean":"2024-03-09T15:22:12.018993+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:22:12.018993+0000","last_undegraded":"2024-03-09T15:22:12.018993+0000","last_fullsized":"2024-03-09T15:22:12.018993+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:58.258793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3194156,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":2,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.160281+0000","last_change":"2024-03-09T14:35:50.588633+0000","last_active":"2024-03-09T15:21:42.160281+0000","last_peered":"2024-03-09T15:21:42.160281+0000","last_clean":"2024-03-09T15:21:42.160281+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:21:42.160281+0000","last_undegraded":"2024-03-09T15:21:42.160281+0000","last_fullsized":"2024-03-09T15:21:42.160281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:47.842912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010493+0000","last_change":"2024-03-09T14:31:01.143564+0000","last_active":"2024-03-09T15:21:02.010493+0000","last_peered":"2024-03-09T15:21:02.010493+0000","last_clean":"2024-03-09T15:21:02.010493+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:21:02.010493+0000","last_undegraded":"2024-03-09T15:21:02.010493+0000","last_fullsized":"2024-03-09T15:21:02.010493+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:38.918335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019554+0000","last_change":"2024-03-09T14:50:03.656253+0000","last_active":"2024-03-09T15:22:17.019554+0000","last_peered":"2024-03-09T15:22:17.019554+0000","last_clean":"2024-03-09T15:22:17.019554+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:22:17.019554+0000","last_undegraded":"2024-03-09T15:22:17.019554+0000","last_fullsized":"2024-03-09T15:22:17.019554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:38.610391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'1","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.037997+0000","last_change":"2024-03-09T14:35:55.603890+0000","last_active":"2024-03-09T15:22:02.037997+0000","last_peered":"2024-03-09T15:22:02.037997+0000","last_clean":"2024-03-09T15:22:02.037997+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:22:02.037997+0000","last_undegraded":"2024-03-09T15:22:02.037997+0000","last_fullsized":"2024-03-09T15:22:02.037997+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:40.989711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903235+0000","last_change":"2024-03-09T14:35:50.586383+0000","last_active":"2024-03-09T15:21:46.903235+0000","last_peered":"2024-03-09T15:21:46.903235+0000","last_clean":"2024-03-09T15:21:46.903235+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:21:46.903235+0000","last_undegraded":"2024-03-09T15:21:46.903235+0000","last_fullsized":"2024-03-09T15:21:46.903235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:58.715378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":164,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010460+0000","last_change":"2024-03-09T14:31:01.141921+0000","last_active":"2024-03-09T15:21:02.010460+0000","last_peered":"2024-03-09T15:21:02.010460+0000","last_clean":"2024-03-09T15:21:02.010460+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:21:02.010460+0000","last_undegraded":"2024-03-09T15:21:02.010460+0000","last_fullsized":"2024-03-09T15:21:02.010460+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:28.572848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999640+0000","last_change":"2024-03-09T14:50:03.661504+0000","last_active":"2024-03-09T15:21:21.999640+0000","last_peered":"2024-03-09T15:21:21.999640+0000","last_clean":"2024-03-09T15:21:21.999640+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:21:21.999640+0000","last_undegraded":"2024-03-09T15:21:21.999640+0000","last_fullsized":"2024-03-09T15:21:21.999640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:16.731080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.036471+0000","last_change":"2024-03-09T14:35:55.603980+0000","last_active":"2024-03-09T15:21:52.036471+0000","last_peered":"2024-03-09T15:21:52.036471+0000","last_clean":"2024-03-09T15:21:52.036471+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:21:52.036471+0000","last_undegraded":"2024-03-09T15:21:52.036471+0000","last_fullsized":"2024-03-09T15:21:52.036471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:36.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'10","reported_seq":75,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161560+0000","last_change":"2024-03-09T14:35:50.584429+0000","last_active":"2024-03-09T15:21:52.161560+0000","last_peered":"2024-03-09T15:21:52.161560+0000","last_clean":"2024-03-09T15:21:52.161560+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:21:52.161560+0000","last_undegraded":"2024-03-09T15:21:52.161560+0000","last_fullsized":"2024-03-09T15:21:52.161560+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:35.785481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":37890,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029279+0000","last_change":"2024-03-09T14:31:01.137869+0000","last_active":"2024-03-09T15:21:02.029279+0000","last_peered":"2024-03-09T15:21:02.029279+0000","last_clean":"2024-03-09T15:21:02.029279+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:21:02.029279+0000","last_undegraded":"2024-03-09T15:21:02.029279+0000","last_fullsized":"2024-03-09T15:21:02.029279+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:00.440659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159481+0000","last_change":"2024-03-09T14:50:03.659706+0000","last_active":"2024-03-09T15:20:07.159481+0000","last_peered":"2024-03-09T15:20:07.159481+0000","last_clean":"2024-03-09T15:20:07.159481+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:20:07.159481+0000","last_undegraded":"2024-03-09T15:20:07.159481+0000","last_fullsized":"2024-03-09T15:20:07.159481+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:01.960769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.028566+0000","last_change":"2024-03-09T14:35:55.605449+0000","last_active":"2024-03-09T15:20:57.028566+0000","last_peered":"2024-03-09T15:20:57.028566+0000","last_clean":"2024-03-09T15:20:57.028566+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:20:57.028566+0000","last_undegraded":"2024-03-09T15:20:57.028566+0000","last_fullsized":"2024-03-09T15:20:57.028566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:08.518355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151137+0000","last_change":"2024-03-09T14:35:50.585219+0000","last_active":"2024-03-09T15:20:52.151137+0000","last_peered":"2024-03-09T15:20:52.151137+0000","last_clean":"2024-03-09T15:20:52.151137+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:20:52.151137+0000","last_undegraded":"2024-03-09T15:20:52.151137+0000","last_fullsized":"2024-03-09T15:20:52.151137+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:40.696301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905562+0000","last_change":"2024-03-09T14:31:01.146419+0000","last_active":"2024-03-09T15:22:06.905562+0000","last_peered":"2024-03-09T15:22:06.905562+0000","last_clean":"2024-03-09T15:22:06.905562+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:22:06.905562+0000","last_undegraded":"2024-03-09T15:22:06.905562+0000","last_fullsized":"2024-03-09T15:22:06.905562+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:26.233793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159538+0000","last_change":"2024-03-09T14:50:03.664828+0000","last_active":"2024-03-09T15:20:07.159538+0000","last_peered":"2024-03-09T15:20:07.159538+0000","last_clean":"2024-03-09T15:20:07.159538+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:20:07.159538+0000","last_undegraded":"2024-03-09T15:20:07.159538+0000","last_fullsized":"2024-03-09T15:20:07.159538+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:43:10.894912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009850+0000","last_change":"2024-03-09T14:35:55.606688+0000","last_active":"2024-03-09T15:20:57.009850+0000","last_peered":"2024-03-09T15:20:57.009850+0000","last_clean":"2024-03-09T15:20:57.009850+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:20:57.009850+0000","last_undegraded":"2024-03-09T15:20:57.009850+0000","last_fullsized":"2024-03-09T15:20:57.009850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:27.128463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002039+0000","last_change":"2024-03-09T14:35:50.593904+0000","last_active":"2024-03-09T15:20:52.002039+0000","last_peered":"2024-03-09T15:20:52.002039+0000","last_clean":"2024-03-09T15:20:52.002039+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:20:52.002039+0000","last_undegraded":"2024-03-09T15:20:52.002039+0000","last_fullsized":"2024-03-09T15:20:52.002039+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:03.967997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002072+0000","last_change":"2024-03-09T14:31:01.135095+0000","last_active":"2024-03-09T15:21:47.002072+0000","last_peered":"2024-03-09T15:21:47.002072+0000","last_clean":"2024-03-09T15:21:47.002072+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:21:47.002072+0000","last_undegraded":"2024-03-09T15:21:47.002072+0000","last_fullsized":"2024-03-09T15:21:47.002072+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:55.759399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993733+0000","last_change":"2024-03-09T14:50:03.657383+0000","last_active":"2024-03-09T15:20:26.993733+0000","last_peered":"2024-03-09T15:20:26.993733+0000","last_clean":"2024-03-09T15:20:26.993733+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:20:26.993733+0000","last_undegraded":"2024-03-09T15:20:26.993733+0000","last_fullsized":"2024-03-09T15:20:26.993733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:07.698784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"257'11","reported_seq":68,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016714+0000","last_change":"2024-03-09T14:35:55.634050+0000","last_active":"2024-03-09T15:21:52.016714+0000","last_peered":"2024-03-09T15:21:52.016714+0000","last_clean":"2024-03-09T15:21:52.016714+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:21:52.016714+0000","last_undegraded":"2024-03-09T15:21:52.016714+0000","last_fullsized":"2024-03-09T15:21:52.016714+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:35.953944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"257'10","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023348+0000","last_change":"2024-03-09T14:35:50.582640+0000","last_active":"2024-03-09T15:20:22.023348+0000","last_peered":"2024-03-09T15:20:22.023348+0000","last_clean":"2024-03-09T15:20:22.023348+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:20:22.023348+0000","last_undegraded":"2024-03-09T15:20:22.023348+0000","last_fullsized":"2024-03-09T15:20:22.023348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:34.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903407+0000","last_change":"2024-03-09T14:31:01.148885+0000","last_active":"2024-03-09T15:21:46.903407+0000","last_peered":"2024-03-09T15:21:46.903407+0000","last_clean":"2024-03-09T15:21:46.903407+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:21:46.903407+0000","last_undegraded":"2024-03-09T15:21:46.903407+0000","last_fullsized":"2024-03-09T15:21:46.903407+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:02.222592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992120+0000","last_change":"2024-03-09T14:50:03.655189+0000","last_active":"2024-03-09T15:20:26.992120+0000","last_peered":"2024-03-09T15:20:26.992120+0000","last_clean":"2024-03-09T15:20:26.992120+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:20:26.992120+0000","last_undegraded":"2024-03-09T15:20:26.992120+0000","last_fullsized":"2024-03-09T15:20:26.992120+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:03.341531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.007023+0000","last_change":"2024-03-09T14:35:55.633676+0000","last_active":"2024-03-09T15:20:32.007023+0000","last_peered":"2024-03-09T15:20:32.007023+0000","last_clean":"2024-03-09T15:20:32.007023+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:20:32.007023+0000","last_undegraded":"2024-03-09T15:20:32.007023+0000","last_fullsized":"2024-03-09T15:20:32.007023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:05:23.209750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.174264+0000","last_change":"2024-03-09T14:35:50.585080+0000","last_active":"2024-03-09T15:21:47.174264+0000","last_peered":"2024-03-09T15:21:47.174264+0000","last_clean":"2024-03-09T15:21:47.174264+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:21:47.174264+0000","last_undegraded":"2024-03-09T15:21:47.174264+0000","last_fullsized":"2024-03-09T15:21:47.174264+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.598130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":95,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.016119+0000","last_change":"2024-03-09T14:31:01.143022+0000","last_active":"2024-03-09T15:21:47.016119+0000","last_peered":"2024-03-09T15:21:47.016119+0000","last_clean":"2024-03-09T15:21:47.016119+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:21:47.016119+0000","last_undegraded":"2024-03-09T15:21:47.016119+0000","last_fullsized":"2024-03-09T15:21:47.016119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:37.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162669+0000","last_change":"2024-03-09T14:50:03.658035+0000","last_active":"2024-03-09T15:20:27.162669+0000","last_peered":"2024-03-09T15:20:27.162669+0000","last_clean":"2024-03-09T15:20:27.162669+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:20:27.162669+0000","last_undegraded":"2024-03-09T15:20:27.162669+0000","last_fullsized":"2024-03-09T15:20:27.162669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:02.499788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'4","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016749+0000","last_change":"2024-03-09T14:35:55.636071+0000","last_active":"2024-03-09T15:21:52.016749+0000","last_peered":"2024-03-09T15:21:52.016749+0000","last_clean":"2024-03-09T15:21:52.016749+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:21:52.016749+0000","last_undegraded":"2024-03-09T15:21:52.016749+0000","last_fullsized":"2024-03-09T15:21:52.016749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:26.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000382+0000","last_change":"2024-03-09T14:35:50.592957+0000","last_active":"2024-03-09T15:21:47.000382+0000","last_peered":"2024-03-09T15:21:47.000382+0000","last_clean":"2024-03-09T15:21:47.000382+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:21:47.000382+0000","last_undegraded":"2024-03-09T15:21:47.000382+0000","last_fullsized":"2024-03-09T15:21:47.000382+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:17.607559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000355+0000","last_change":"2024-03-09T14:31:01.134030+0000","last_active":"2024-03-09T15:21:47.000355+0000","last_peered":"2024-03-09T15:21:47.000355+0000","last_clean":"2024-03-09T15:21:47.000355+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:21:47.000355+0000","last_undegraded":"2024-03-09T15:21:47.000355+0000","last_fullsized":"2024-03-09T15:21:47.000355+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:28.544093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024030+0000","last_change":"2024-03-09T14:50:03.654352+0000","last_active":"2024-03-09T15:20:27.024030+0000","last_peered":"2024-03-09T15:20:27.024030+0000","last_clean":"2024-03-09T15:20:27.024030+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:20:27.024030+0000","last_undegraded":"2024-03-09T15:20:27.024030+0000","last_fullsized":"2024-03-09T15:20:27.024030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:36.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161653+0000","last_change":"2024-03-09T14:35:55.604280+0000","last_active":"2024-03-09T15:21:52.161653+0000","last_peered":"2024-03-09T15:21:52.161653+0000","last_clean":"2024-03-09T15:21:52.161653+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:21:52.161653+0000","last_undegraded":"2024-03-09T15:21:52.161653+0000","last_fullsized":"2024-03-09T15:21:52.161653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:34.983233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903393+0000","last_change":"2024-03-09T14:35:50.585309+0000","last_active":"2024-03-09T15:21:46.903393+0000","last_peered":"2024-03-09T15:21:46.903393+0000","last_clean":"2024-03-09T15:21:46.903393+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:21:46.903393+0000","last_undegraded":"2024-03-09T15:21:46.903393+0000","last_fullsized":"2024-03-09T15:21:46.903393+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:46:45.637003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.160203+0000","last_change":"2024-03-09T14:31:01.137671+0000","last_active":"2024-03-09T15:20:12.160203+0000","last_peered":"2024-03-09T15:20:12.160203+0000","last_clean":"2024-03-09T15:20:12.160203+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:20:12.160203+0000","last_undegraded":"2024-03-09T15:20:12.160203+0000","last_fullsized":"2024-03-09T15:20:12.160203+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:01.231496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014344+0000","last_change":"2024-03-09T14:50:03.655960+0000","last_active":"2024-03-09T15:21:32.014344+0000","last_peered":"2024-03-09T15:21:32.014344+0000","last_clean":"2024-03-09T15:21:32.014344+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:21:32.014344+0000","last_undegraded":"2024-03-09T15:21:32.014344+0000","last_fullsized":"2024-03-09T15:21:32.014344+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:11.272439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992699+0000","last_change":"2024-03-09T14:35:55.606840+0000","last_active":"2024-03-09T15:20:16.992699+0000","last_peered":"2024-03-09T15:20:16.992699+0000","last_clean":"2024-03-09T15:20:16.992699+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:20:16.992699+0000","last_undegraded":"2024-03-09T15:20:16.992699+0000","last_fullsized":"2024-03-09T15:20:16.992699+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.473637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.145659+0000","last_change":"2024-03-09T14:35:50.590700+0000","last_active":"2024-03-09T15:20:12.145659+0000","last_peered":"2024-03-09T15:20:12.145659+0000","last_clean":"2024-03-09T15:20:12.145659+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:20:12.145659+0000","last_undegraded":"2024-03-09T15:20:12.145659+0000","last_fullsized":"2024-03-09T15:20:12.145659+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:08.873263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":83,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158796+0000","last_change":"2024-03-09T14:31:01.137580+0000","last_active":"2024-03-09T15:20:02.158796+0000","last_peered":"2024-03-09T15:20:02.158796+0000","last_clean":"2024-03-09T15:20:02.158796+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:02.158796+0000","last_undegraded":"2024-03-09T15:20:02.158796+0000","last_fullsized":"2024-03-09T15:20:02.158796+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:12.605404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.006645+0000","last_change":"2024-03-09T14:50:03.660277+0000","last_active":"2024-03-09T15:21:32.006645+0000","last_peered":"2024-03-09T15:21:32.006645+0000","last_clean":"2024-03-09T15:21:32.006645+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:21:32.006645+0000","last_undegraded":"2024-03-09T15:21:32.006645+0000","last_fullsized":"2024-03-09T15:21:32.006645+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:40.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992671+0000","last_change":"2024-03-09T14:35:55.600712+0000","last_active":"2024-03-09T15:20:16.992671+0000","last_peered":"2024-03-09T15:20:16.992671+0000","last_clean":"2024-03-09T15:20:16.992671+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:20:16.992671+0000","last_undegraded":"2024-03-09T15:20:16.992671+0000","last_fullsized":"2024-03-09T15:20:16.992671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:03.894551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.004349+0000","last_change":"2024-03-09T14:35:50.590828+0000","last_active":"2024-03-09T15:20:12.004349+0000","last_peered":"2024-03-09T15:20:12.004349+0000","last_clean":"2024-03-09T15:20:12.004349+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:20:12.004349+0000","last_undegraded":"2024-03-09T15:20:12.004349+0000","last_fullsized":"2024-03-09T15:20:12.004349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:47.297475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996277+0000","last_change":"2024-03-09T14:31:01.144397+0000","last_active":"2024-03-09T15:20:01.996277+0000","last_peered":"2024-03-09T15:20:01.996277+0000","last_clean":"2024-03-09T15:20:01.996277+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:20:01.996277+0000","last_undegraded":"2024-03-09T15:20:01.996277+0000","last_fullsized":"2024-03-09T15:20:01.996277+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:38.797574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000514+0000","last_change":"2024-03-09T14:50:03.662986+0000","last_active":"2024-03-09T15:20:37.000514+0000","last_peered":"2024-03-09T15:20:37.000514+0000","last_clean":"2024-03-09T15:20:37.000514+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:20:37.000514+0000","last_undegraded":"2024-03-09T15:20:37.000514+0000","last_fullsized":"2024-03-09T15:20:37.000514+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:12.215808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.005063+0000","last_change":"2024-03-09T14:35:55.606971+0000","last_active":"2024-03-09T15:20:17.005063+0000","last_peered":"2024-03-09T15:20:17.005063+0000","last_clean":"2024-03-09T15:20:17.005063+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:20:17.005063+0000","last_undegraded":"2024-03-09T15:20:17.005063+0000","last_fullsized":"2024-03-09T15:20:17.005063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:59.770598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021829+0000","last_change":"2024-03-09T14:35:50.581340+0000","last_active":"2024-03-09T15:20:12.021829+0000","last_peered":"2024-03-09T15:20:12.021829+0000","last_clean":"2024-03-09T15:20:12.021829+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:20:12.021829+0000","last_undegraded":"2024-03-09T15:20:12.021829+0000","last_fullsized":"2024-03-09T15:20:12.021829+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:47.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'83","reported_seq":297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144192+0000","last_change":"2024-03-09T14:31:01.140501+0000","last_active":"2024-03-09T15:20:02.144192+0000","last_peered":"2024-03-09T15:20:02.144192+0000","last_clean":"2024-03-09T15:20:02.144192+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:20:02.144192+0000","last_undegraded":"2024-03-09T15:20:02.144192+0000","last_fullsized":"2024-03-09T15:20:02.144192+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:25.600781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014299+0000","last_change":"2024-03-09T14:50:03.654675+0000","last_active":"2024-03-09T15:21:32.014299+0000","last_peered":"2024-03-09T15:21:32.014299+0000","last_clean":"2024-03-09T15:21:32.014299+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:21:32.014299+0000","last_undegraded":"2024-03-09T15:21:32.014299+0000","last_fullsized":"2024-03-09T15:21:32.014299+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:16.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022667+0000","last_change":"2024-03-09T14:35:55.607431+0000","last_active":"2024-03-09T15:20:17.022667+0000","last_peered":"2024-03-09T15:20:17.022667+0000","last_clean":"2024-03-09T15:20:17.022667+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:20:17.022667+0000","last_undegraded":"2024-03-09T15:20:17.022667+0000","last_fullsized":"2024-03-09T15:20:17.022667+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021909+0000","last_change":"2024-03-09T14:35:50.592140+0000","last_active":"2024-03-09T15:20:12.021909+0000","last_peered":"2024-03-09T15:20:12.021909+0000","last_clean":"2024-03-09T15:20:12.021909+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:20:12.021909+0000","last_undegraded":"2024-03-09T15:20:12.021909+0000","last_fullsized":"2024-03-09T15:20:12.021909+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:08.154255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.002932+0000","last_change":"2024-03-09T14:31:01.141535+0000","last_active":"2024-03-09T15:20:02.002932+0000","last_peered":"2024-03-09T15:20:02.002932+0000","last_clean":"2024-03-09T15:20:02.002932+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:20:02.002932+0000","last_undegraded":"2024-03-09T15:20:02.002932+0000","last_fullsized":"2024-03-09T15:20:02.002932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:30.104908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993313+0000","last_change":"2024-03-09T14:50:03.655565+0000","last_active":"2024-03-09T15:20:36.993313+0000","last_peered":"2024-03-09T15:20:36.993313+0000","last_clean":"2024-03-09T15:20:36.993313+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:20:36.993313+0000","last_undegraded":"2024-03-09T15:20:36.993313+0000","last_fullsized":"2024-03-09T15:20:36.993313+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:49.229016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'6","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009911+0000","last_change":"2024-03-09T14:35:55.606305+0000","last_active":"2024-03-09T15:20:57.009911+0000","last_peered":"2024-03-09T15:20:57.009911+0000","last_clean":"2024-03-09T15:20:57.009911+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:20:57.009911+0000","last_undegraded":"2024-03-09T15:20:57.009911+0000","last_fullsized":"2024-03-09T15:20:57.009911+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:34.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20522,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'6","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.166560+0000","last_change":"2024-03-09T14:35:50.588195+0000","last_active":"2024-03-09T15:20:52.166560+0000","last_peered":"2024-03-09T15:20:52.166560+0000","last_clean":"2024-03-09T15:20:52.166560+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:20:52.166560+0000","last_undegraded":"2024-03-09T15:20:52.166560+0000","last_fullsized":"2024-03-09T15:20:52.166560+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:50:18.644010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":6842,"num_write":11,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008749+0000","last_change":"2024-03-09T14:31:01.145852+0000","last_active":"2024-03-09T15:20:47.008749+0000","last_peered":"2024-03-09T15:20:47.008749+0000","last_clean":"2024-03-09T15:20:47.008749+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:20:47.008749+0000","last_undegraded":"2024-03-09T15:20:47.008749+0000","last_fullsized":"2024-03-09T15:20:47.008749+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:57.994897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172868+0000","last_change":"2024-03-09T14:50:03.664102+0000","last_active":"2024-03-09T15:21:37.172868+0000","last_peered":"2024-03-09T15:21:37.172868+0000","last_clean":"2024-03-09T15:21:37.172868+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:21:37.172868+0000","last_undegraded":"2024-03-09T15:21:37.172868+0000","last_fullsized":"2024-03-09T15:21:37.172868+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:04.844692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.034355+0000","last_change":"2024-03-09T14:36:32.678035+0000","last_active":"2024-03-09T15:21:37.034355+0000","last_peered":"2024-03-09T15:21:37.034355+0000","last_clean":"2024-03-09T15:21:37.034355+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:21:37.034355+0000","last_undegraded":"2024-03-09T15:21:37.034355+0000","last_fullsized":"2024-03-09T15:21:37.034355+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:52.793827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.994913+0000","last_change":"2024-03-09T14:35:50.593689+0000","last_active":"2024-03-09T15:20:51.994913+0000","last_peered":"2024-03-09T15:20:51.994913+0000","last_clean":"2024-03-09T15:20:51.994913+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:20:51.994913+0000","last_undegraded":"2024-03-09T15:20:51.994913+0000","last_fullsized":"2024-03-09T15:20:51.994913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:17.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024819+0000","last_change":"2024-03-09T14:31:01.138384+0000","last_active":"2024-03-09T15:20:32.024819+0000","last_peered":"2024-03-09T15:20:32.024819+0000","last_clean":"2024-03-09T15:20:32.024819+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:20:32.024819+0000","last_undegraded":"2024-03-09T15:20:32.024819+0000","last_fullsized":"2024-03-09T15:20:32.024819+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:52.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023996+0000","last_change":"2024-03-09T14:50:03.658657+0000","last_active":"2024-03-09T15:20:27.023996+0000","last_peered":"2024-03-09T15:20:27.023996+0000","last_clean":"2024-03-09T15:20:27.023996+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:20:27.023996+0000","last_undegraded":"2024-03-09T15:20:27.023996+0000","last_fullsized":"2024-03-09T15:20:27.023996+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:18.812497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:06.998034+0000","last_change":"2024-03-09T14:35:55.635179+0000","last_active":"2024-03-09T15:21:06.998034+0000","last_peered":"2024-03-09T15:21:06.998034+0000","last_clean":"2024-03-09T15:21:06.998034+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:21:06.998034+0000","last_undegraded":"2024-03-09T15:21:06.998034+0000","last_fullsized":"2024-03-09T15:21:06.998034+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:57.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002095+0000","last_change":"2024-03-09T14:35:50.588159+0000","last_active":"2024-03-09T15:20:52.002095+0000","last_peered":"2024-03-09T15:20:52.002095+0000","last_clean":"2024-03-09T15:20:52.002095+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:20:52.002095+0000","last_undegraded":"2024-03-09T15:20:52.002095+0000","last_fullsized":"2024-03-09T15:20:52.002095+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:42.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024744+0000","last_change":"2024-03-09T14:31:01.139440+0000","last_active":"2024-03-09T15:20:32.024744+0000","last_peered":"2024-03-09T15:20:32.024744+0000","last_clean":"2024-03-09T15:20:32.024744+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:20:32.024744+0000","last_undegraded":"2024-03-09T15:20:32.024744+0000","last_fullsized":"2024-03-09T15:20:32.024744+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:05.382467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162719+0000","last_change":"2024-03-09T14:50:03.657344+0000","last_active":"2024-03-09T15:20:27.162719+0000","last_peered":"2024-03-09T15:20:27.162719+0000","last_clean":"2024-03-09T15:20:27.162719+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:20:27.162719+0000","last_undegraded":"2024-03-09T15:20:27.162719+0000","last_fullsized":"2024-03-09T15:20:27.162719+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:00.699350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009935+0000","last_change":"2024-03-09T14:35:55.603538+0000","last_active":"2024-03-09T15:20:57.009935+0000","last_peered":"2024-03-09T15:20:57.009935+0000","last_clean":"2024-03-09T15:20:57.009935+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:20:57.009935+0000","last_undegraded":"2024-03-09T15:20:57.009935+0000","last_fullsized":"2024-03-09T15:20:57.009935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:48.904849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'1","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997509+0000","last_change":"2024-03-09T14:35:50.587122+0000","last_active":"2024-03-09T15:21:01.997509+0000","last_peered":"2024-03-09T15:21:01.997509+0000","last_clean":"2024-03-09T15:21:01.997509+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:21:01.997509+0000","last_undegraded":"2024-03-09T15:21:01.997509+0000","last_fullsized":"2024-03-09T15:21:01.997509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:59.885398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992702+0000","last_change":"2024-03-09T14:31:01.142302+0000","last_active":"2024-03-09T15:20:31.992702+0000","last_peered":"2024-03-09T15:20:31.992702+0000","last_clean":"2024-03-09T15:20:31.992702+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:20:31.992702+0000","last_undegraded":"2024-03-09T15:20:31.992702+0000","last_fullsized":"2024-03-09T15:20:31.992702+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:40.401950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.014916+0000","last_change":"2024-03-09T14:50:03.656718+0000","last_active":"2024-03-09T15:21:37.014916+0000","last_peered":"2024-03-09T15:21:37.014916+0000","last_clean":"2024-03-09T15:21:37.014916+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:21:37.014916+0000","last_undegraded":"2024-03-09T15:21:37.014916+0000","last_fullsized":"2024-03-09T15:21:37.014916+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:52.066966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'7","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.157899+0000","last_change":"2024-03-09T14:35:55.603262+0000","last_active":"2024-03-09T15:21:27.157899+0000","last_peered":"2024-03-09T15:21:27.157899+0000","last_clean":"2024-03-09T15:21:27.157899+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:21:27.157899+0000","last_undegraded":"2024-03-09T15:21:27.157899+0000","last_fullsized":"2024-03-09T15:21:27.157899+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:45.193657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005483+0000","last_change":"2024-03-09T14:35:50.586279+0000","last_active":"2024-03-09T15:21:22.005483+0000","last_peered":"2024-03-09T15:21:22.005483+0000","last_clean":"2024-03-09T15:21:22.005483+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:21:22.005483+0000","last_undegraded":"2024-03-09T15:21:22.005483+0000","last_fullsized":"2024-03-09T15:21:22.005483+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:50.461301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999932+0000","last_change":"2024-03-09T14:31:01.148313+0000","last_active":"2024-03-09T15:20:31.999932+0000","last_peered":"2024-03-09T15:20:31.999932+0000","last_clean":"2024-03-09T15:20:31.999932+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:20:31.999932+0000","last_undegraded":"2024-03-09T15:20:31.999932+0000","last_fullsized":"2024-03-09T15:20:31.999932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:27.523628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173665+0000","last_change":"2024-03-09T14:50:03.659935+0000","last_active":"2024-03-09T15:21:42.173665+0000","last_peered":"2024-03-09T15:21:42.173665+0000","last_clean":"2024-03-09T15:21:42.173665+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:21:42.173665+0000","last_undegraded":"2024-03-09T15:21:42.173665+0000","last_fullsized":"2024-03-09T15:21:42.173665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:35.107226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171479+0000","last_change":"2024-03-09T14:35:55.633083+0000","last_active":"2024-03-09T15:21:27.171479+0000","last_peered":"2024-03-09T15:21:27.171479+0000","last_clean":"2024-03-09T15:21:27.171479+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:21:27.171479+0000","last_undegraded":"2024-03-09T15:21:27.171479+0000","last_fullsized":"2024-03-09T15:21:27.171479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:21.416130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999575+0000","last_change":"2024-03-09T14:35:50.583192+0000","last_active":"2024-03-09T15:21:21.999575+0000","last_peered":"2024-03-09T15:21:21.999575+0000","last_clean":"2024-03-09T15:21:21.999575+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:21:21.999575+0000","last_undegraded":"2024-03-09T15:21:21.999575+0000","last_fullsized":"2024-03-09T15:21:21.999575+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:36.010771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.167798+0000","last_change":"2024-03-09T14:31:01.138602+0000","last_active":"2024-03-09T15:21:02.167798+0000","last_peered":"2024-03-09T15:21:02.167798+0000","last_clean":"2024-03-09T15:21:02.167798+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:21:02.167798+0000","last_undegraded":"2024-03-09T15:21:02.167798+0000","last_fullsized":"2024-03-09T15:21:02.167798+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:22.514104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172891+0000","last_change":"2024-03-09T14:50:03.659514+0000","last_active":"2024-03-09T15:21:37.172891+0000","last_peered":"2024-03-09T15:21:37.172891+0000","last_clean":"2024-03-09T15:21:37.172891+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:21:37.172891+0000","last_undegraded":"2024-03-09T15:21:37.172891+0000","last_fullsized":"2024-03-09T15:21:37.172891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:41.947406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:56.996980+0000","last_change":"2024-03-09T14:35:55.605840+0000","last_active":"2024-03-09T15:20:56.996980+0000","last_peered":"2024-03-09T15:20:56.996980+0000","last_clean":"2024-03-09T15:20:56.996980+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:20:56.996980+0000","last_undegraded":"2024-03-09T15:20:56.996980+0000","last_fullsized":"2024-03-09T15:20:56.996980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:02.619502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'1","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:41.902673+0000","last_change":"2024-03-09T14:35:50.584614+0000","last_active":"2024-03-09T15:21:41.902673+0000","last_peered":"2024-03-09T15:21:41.902673+0000","last_clean":"2024-03-09T15:21:41.902673+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:21:41.902673+0000","last_undegraded":"2024-03-09T15:21:41.902673+0000","last_fullsized":"2024-03-09T15:21:41.902673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:53.029868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009230+0000","last_change":"2024-03-09T14:31:01.141879+0000","last_active":"2024-03-09T15:20:52.009230+0000","last_peered":"2024-03-09T15:20:52.009230+0000","last_clean":"2024-03-09T15:20:52.009230+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:20:52.009230+0000","last_undegraded":"2024-03-09T15:20:52.009230+0000","last_fullsized":"2024-03-09T15:20:52.009230+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:28.690709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:36.902107+0000","last_change":"2024-03-09T14:50:03.659852+0000","last_active":"2024-03-09T15:21:36.902107+0000","last_peered":"2024-03-09T15:21:36.902107+0000","last_clean":"2024-03-09T15:21:36.902107+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:21:36.902107+0000","last_undegraded":"2024-03-09T15:21:36.902107+0000","last_fullsized":"2024-03-09T15:21:36.902107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:56.267905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172839+0000","last_change":"2024-03-09T14:35:55.601630+0000","last_active":"2024-03-09T15:21:37.172839+0000","last_peered":"2024-03-09T15:21:37.172839+0000","last_clean":"2024-03-09T15:21:37.172839+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:21:37.172839+0000","last_undegraded":"2024-03-09T15:21:37.172839+0000","last_fullsized":"2024-03-09T15:21:37.172839+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:40.116666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'3","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151186+0000","last_change":"2024-03-09T14:35:50.593430+0000","last_active":"2024-03-09T15:20:52.151186+0000","last_peered":"2024-03-09T15:20:52.151186+0000","last_clean":"2024-03-09T15:20:52.151186+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:20:52.151186+0000","last_undegraded":"2024-03-09T15:20:52.151186+0000","last_fullsized":"2024-03-09T15:20:52.151186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:07.895578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":10280,"num_write":8,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027735+0000","last_change":"2024-03-09T14:31:01.140169+0000","last_active":"2024-03-09T15:20:52.027735+0000","last_peered":"2024-03-09T15:20:52.027735+0000","last_clean":"2024-03-09T15:20:52.027735+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:20:52.027735+0000","last_undegraded":"2024-03-09T15:20:52.027735+0000","last_fullsized":"2024-03-09T15:20:52.027735+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:33.984575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170878+0000","last_change":"2024-03-09T14:50:03.660084+0000","last_active":"2024-03-09T15:21:22.170878+0000","last_peered":"2024-03-09T15:21:22.170878+0000","last_clean":"2024-03-09T15:21:22.170878+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:21:22.170878+0000","last_undegraded":"2024-03-09T15:21:22.170878+0000","last_fullsized":"2024-03-09T15:21:22.170878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:00.134823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905652+0000","last_change":"2024-03-09T14:35:55.603484+0000","last_active":"2024-03-09T15:22:06.905652+0000","last_peered":"2024-03-09T15:22:06.905652+0000","last_clean":"2024-03-09T15:22:06.905652+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:22:06.905652+0000","last_undegraded":"2024-03-09T15:22:06.905652+0000","last_fullsized":"2024-03-09T15:22:06.905652+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:49.786326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173621+0000","last_change":"2024-03-09T14:35:50.584143+0000","last_active":"2024-03-09T15:21:42.173621+0000","last_peered":"2024-03-09T15:21:42.173621+0000","last_clean":"2024-03-09T15:21:42.173621+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:21:42.173621+0000","last_undegraded":"2024-03-09T15:21:42.173621+0000","last_fullsized":"2024-03-09T15:21:42.173621+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:51.754061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":182,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002119+0000","last_change":"2024-03-09T14:31:01.149003+0000","last_active":"2024-03-09T15:20:52.002119+0000","last_peered":"2024-03-09T15:20:52.002119+0000","last_clean":"2024-03-09T15:20:52.002119+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:20:52.002119+0000","last_undegraded":"2024-03-09T15:20:52.002119+0000","last_fullsized":"2024-03-09T15:20:52.002119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:24.001646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032229+0000","last_change":"2024-03-09T14:50:03.664606+0000","last_active":"2024-03-09T15:21:22.032229+0000","last_peered":"2024-03-09T15:21:22.032229+0000","last_clean":"2024-03-09T15:21:22.032229+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:21:22.032229+0000","last_undegraded":"2024-03-09T15:21:22.032229+0000","last_fullsized":"2024-03-09T15:21:22.032229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.328351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903317+0000","last_change":"2024-03-09T14:35:55.633776+0000","last_active":"2024-03-09T15:21:46.903317+0000","last_peered":"2024-03-09T15:21:46.903317+0000","last_clean":"2024-03-09T15:21:46.903317+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:21:46.903317+0000","last_undegraded":"2024-03-09T15:21:46.903317+0000","last_fullsized":"2024-03-09T15:21:46.903317+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:12:36.318597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.000932+0000","last_change":"2024-03-09T14:35:50.591618+0000","last_active":"2024-03-09T15:21:52.000932+0000","last_peered":"2024-03-09T15:21:52.000932+0000","last_clean":"2024-03-09T15:21:52.000932+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:21:52.000932+0000","last_undegraded":"2024-03-09T15:21:52.000932+0000","last_fullsized":"2024-03-09T15:21:52.000932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:28.323159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027822+0000","last_change":"2024-03-09T14:31:01.137572+0000","last_active":"2024-03-09T15:20:52.027822+0000","last_peered":"2024-03-09T15:20:52.027822+0000","last_clean":"2024-03-09T15:20:52.027822+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:52.027822+0000","last_undegraded":"2024-03-09T15:20:52.027822+0000","last_fullsized":"2024-03-09T15:20:52.027822+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:52.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.005314+0000","last_change":"2024-03-09T14:50:03.658082+0000","last_active":"2024-03-09T15:22:17.005314+0000","last_peered":"2024-03-09T15:22:17.005314+0000","last_clean":"2024-03-09T15:22:17.005314+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:22:17.005314+0000","last_undegraded":"2024-03-09T15:22:17.005314+0000","last_fullsized":"2024-03-09T15:22:17.005314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:47.239990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171609+0000","last_change":"2024-03-09T14:35:55.634847+0000","last_active":"2024-03-09T15:21:27.171609+0000","last_peered":"2024-03-09T15:21:27.171609+0000","last_clean":"2024-03-09T15:21:27.171609+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:21:27.171609+0000","last_undegraded":"2024-03-09T15:21:27.171609+0000","last_fullsized":"2024-03-09T15:21:27.171609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:24.831161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032308+0000","last_change":"2024-03-09T14:35:50.590046+0000","last_active":"2024-03-09T15:21:22.032308+0000","last_peered":"2024-03-09T15:21:22.032308+0000","last_clean":"2024-03-09T15:21:22.032308+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:21:22.032308+0000","last_undegraded":"2024-03-09T15:21:22.032308+0000","last_fullsized":"2024-03-09T15:21:22.032308+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:09.975491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169286+0000","last_change":"2024-03-09T14:31:01.145294+0000","last_active":"2024-03-09T15:21:12.169286+0000","last_peered":"2024-03-09T15:21:12.169286+0000","last_clean":"2024-03-09T15:21:12.169286+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:21:12.169286+0000","last_undegraded":"2024-03-09T15:21:12.169286+0000","last_fullsized":"2024-03-09T15:21:12.169286+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:45.565527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.157206+0000","last_change":"2024-03-09T14:50:03.664652+0000","last_active":"2024-03-09T15:21:22.157206+0000","last_peered":"2024-03-09T15:21:22.157206+0000","last_clean":"2024-03-09T15:21:22.157206+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:21:22.157206+0000","last_undegraded":"2024-03-09T15:21:22.157206+0000","last_fullsized":"2024-03-09T15:21:22.157206+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:30.997877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'4","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.157985+0000","last_change":"2024-03-09T14:35:55.606581+0000","last_active":"2024-03-09T15:21:27.157985+0000","last_peered":"2024-03-09T15:21:27.157985+0000","last_clean":"2024-03-09T15:21:27.157985+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:21:27.157985+0000","last_undegraded":"2024-03-09T15:21:27.157985+0000","last_fullsized":"2024-03-09T15:21:27.157985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:53:40.747872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":4,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'5","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170949+0000","last_change":"2024-03-09T14:35:50.588264+0000","last_active":"2024-03-09T15:21:22.170949+0000","last_peered":"2024-03-09T15:21:22.170949+0000","last_clean":"2024-03-09T15:21:22.170949+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:21:22.170949+0000","last_undegraded":"2024-03-09T15:21:22.170949+0000","last_fullsized":"2024-03-09T15:21:22.170949+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:37.262134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9232,"num_write":5,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":232,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997471+0000","last_change":"2024-03-09T14:31:01.140875+0000","last_active":"2024-03-09T15:21:01.997471+0000","last_peered":"2024-03-09T15:21:01.997471+0000","last_clean":"2024-03-09T15:21:01.997471+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:21:01.997471+0000","last_undegraded":"2024-03-09T15:21:01.997471+0000","last_fullsized":"2024-03-09T15:21:01.997471+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:48:41.613699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992174+0000","last_change":"2024-03-09T14:50:03.659231+0000","last_active":"2024-03-09T15:20:26.992174+0000","last_peered":"2024-03-09T15:20:26.992174+0000","last_clean":"2024-03-09T15:20:26.992174+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:20:26.992174+0000","last_undegraded":"2024-03-09T15:20:26.992174+0000","last_fullsized":"2024-03-09T15:20:26.992174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:29.158875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'4","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002102+0000","last_change":"2024-03-09T14:35:55.596692+0000","last_active":"2024-03-09T15:21:47.002102+0000","last_peered":"2024-03-09T15:21:47.002102+0000","last_clean":"2024-03-09T15:21:47.002102+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:21:47.002102+0000","last_undegraded":"2024-03-09T15:21:47.002102+0000","last_fullsized":"2024-03-09T15:21:47.002102+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:12.701527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'6","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.048034+0000","last_change":"2024-03-09T14:35:50.591561+0000","last_active":"2024-03-09T15:22:07.048034+0000","last_peered":"2024-03-09T15:22:07.048034+0000","last_clean":"2024-03-09T15:22:07.048034+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:22:07.048034+0000","last_undegraded":"2024-03-09T15:22:07.048034+0000","last_fullsized":"2024-03-09T15:22:07.048034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:32.145049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4138,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'95","reported_seq":333,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029266+0000","last_change":"2024-03-09T14:31:01.135715+0000","last_active":"2024-03-09T15:21:02.029266+0000","last_peered":"2024-03-09T15:21:02.029266+0000","last_clean":"2024-03-09T15:21:02.029266+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:21:02.029266+0000","last_undegraded":"2024-03-09T15:21:02.029266+0000","last_fullsized":"2024-03-09T15:21:02.029266+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999435+0000","last_change":"2024-03-09T14:50:03.655635+0000","last_active":"2024-03-09T15:20:26.999435+0000","last_peered":"2024-03-09T15:20:26.999435+0000","last_clean":"2024-03-09T15:20:26.999435+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:20:26.999435+0000","last_undegraded":"2024-03-09T15:20:26.999435+0000","last_fullsized":"2024-03-09T15:20:26.999435+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:27.965268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038744+0000","last_change":"2024-03-09T14:35:55.599321+0000","last_active":"2024-03-09T15:22:07.038744+0000","last_peered":"2024-03-09T15:22:07.038744+0000","last_clean":"2024-03-09T15:22:07.038744+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:22:07.038744+0000","last_undegraded":"2024-03-09T15:22:07.038744+0000","last_fullsized":"2024-03-09T15:22:07.038744+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:11.127875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'5","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173528+0000","last_change":"2024-03-09T14:35:50.590738+0000","last_active":"2024-03-09T15:21:42.173528+0000","last_peered":"2024-03-09T15:21:42.173528+0000","last_clean":"2024-03-09T15:21:42.173528+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:21:42.173528+0000","last_undegraded":"2024-03-09T15:21:42.173528+0000","last_fullsized":"2024-03-09T15:21:42.173528+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:21.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339884,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10288,"num_write":5,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":174,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.152669+0000","last_change":"2024-03-09T14:31:01.141681+0000","last_active":"2024-03-09T15:21:02.152669+0000","last_peered":"2024-03-09T15:21:02.152669+0000","last_clean":"2024-03-09T15:21:02.152669+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:21:02.152669+0000","last_undegraded":"2024-03-09T15:21:02.152669+0000","last_fullsized":"2024-03-09T15:21:02.152669+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:15.144703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005544+0000","last_change":"2024-03-09T14:50:03.658063+0000","last_active":"2024-03-09T15:21:22.005544+0000","last_peered":"2024-03-09T15:21:22.005544+0000","last_clean":"2024-03-09T15:21:22.005544+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:21:22.005544+0000","last_undegraded":"2024-03-09T15:21:22.005544+0000","last_fullsized":"2024-03-09T15:21:22.005544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:35.088953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.035791+0000","last_change":"2024-03-09T14:35:55.604413+0000","last_active":"2024-03-09T15:21:47.035791+0000","last_peered":"2024-03-09T15:21:47.035791+0000","last_clean":"2024-03-09T15:21:47.035791+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:21:47.035791+0000","last_undegraded":"2024-03-09T15:21:47.035791+0000","last_fullsized":"2024-03-09T15:21:47.035791+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:57.199079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'2","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.001611+0000","last_change":"2024-03-09T14:35:50.580849+0000","last_active":"2024-03-09T15:21:42.001611+0000","last_peered":"2024-03-09T15:21:42.001611+0000","last_clean":"2024-03-09T15:21:42.001611+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:21:42.001611+0000","last_undegraded":"2024-03-09T15:21:42.001611+0000","last_fullsized":"2024-03-09T15:21:42.001611+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:35.776820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029254+0000","last_change":"2024-03-09T14:31:01.141116+0000","last_active":"2024-03-09T15:21:02.029254+0000","last_peered":"2024-03-09T15:21:02.029254+0000","last_clean":"2024-03-09T15:21:02.029254+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:21:02.029254+0000","last_undegraded":"2024-03-09T15:21:02.029254+0000","last_fullsized":"2024-03-09T15:21:02.029254+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:23.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171561+0000","last_change":"2024-03-09T14:50:03.662160+0000","last_active":"2024-03-09T15:21:27.171561+0000","last_peered":"2024-03-09T15:21:27.171561+0000","last_clean":"2024-03-09T15:21:27.171561+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:21:27.171561+0000","last_undegraded":"2024-03-09T15:21:27.171561+0000","last_fullsized":"2024-03-09T15:21:27.171561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:05.477257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.160855+0000","last_change":"2024-03-09T14:35:55.603267+0000","last_active":"2024-03-09T15:21:47.160855+0000","last_peered":"2024-03-09T15:21:47.160855+0000","last_clean":"2024-03-09T15:21:47.160855+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:21:47.160855+0000","last_undegraded":"2024-03-09T15:21:47.160855+0000","last_fullsized":"2024-03-09T15:21:47.160855+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:33.336533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.034960+0000","last_change":"2024-03-09T14:35:50.579692+0000","last_active":"2024-03-09T15:21:42.034960+0000","last_peered":"2024-03-09T15:21:42.034960+0000","last_clean":"2024-03-09T15:21:42.034960+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:21:42.034960+0000","last_undegraded":"2024-03-09T15:21:42.034960+0000","last_fullsized":"2024-03-09T15:21:42.034960+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:53.022221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169202+0000","last_change":"2024-03-09T14:31:01.140181+0000","last_active":"2024-03-09T15:21:12.169202+0000","last_peered":"2024-03-09T15:21:12.169202+0000","last_clean":"2024-03-09T15:21:12.169202+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:21:12.169202+0000","last_undegraded":"2024-03-09T15:21:12.169202+0000","last_fullsized":"2024-03-09T15:21:12.169202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:06.660569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'216","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.103557+0000","last_change":"2024-03-09T14:21:54.364507+0000","last_active":"2024-03-09T15:23:15.103557+0000","last_peered":"2024-03-09T15:23:15.103557+0000","last_clean":"2024-03-09T15:23:15.103557+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:23:15.103557+0000","last_undegraded":"2024-03-09T15:23:15.103557+0000","last_fullsized":"2024-03-09T15:23:15.103557+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:02.602654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340141,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":32250,"num_write":1231,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'370","reported_seq":1077,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.361437+0000","last_change":"2024-03-09T14:21:56.357692+0000","last_active":"2024-03-09T15:22:36.361437+0000","last_peered":"2024-03-09T15:22:36.361437+0000","last_clean":"2024-03-09T15:22:36.361437+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:22:36.361437+0000","last_undegraded":"2024-03-09T15:22:36.361437+0000","last_fullsized":"2024-03-09T15:22:36.361437+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:59.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'181","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006074+0000","last_change":"2024-03-09T14:21:54.365933+0000","last_active":"2024-03-09T15:22:22.006074+0000","last_peered":"2024-03-09T15:22:22.006074+0000","last_clean":"2024-03-09T15:22:22.006074+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:22:22.006074+0000","last_undegraded":"2024-03-09T15:22:22.006074+0000","last_fullsized":"2024-03-09T15:22:22.006074+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:55:13.927594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16281911,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":348,"num_read_kb":33432,"num_write":990,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046256+0000","last_change":"2024-03-09T14:21:56.371109+0000","last_active":"2024-03-09T15:21:57.046256+0000","last_peered":"2024-03-09T15:21:57.046256+0000","last_clean":"2024-03-09T15:21:57.046256+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:21:57.046256+0000","last_undegraded":"2024-03-09T15:21:57.046256+0000","last_fullsized":"2024-03-09T15:21:57.046256+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:07.830191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.103341+0000","last_change":"2024-03-09T14:21:54.357346+0000","last_active":"2024-03-09T15:22:50.103341+0000","last_peered":"2024-03-09T15:22:50.103341+0000","last_clean":"2024-03-09T15:22:50.103341+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:22:50.103341+0000","last_undegraded":"2024-03-09T15:22:50.103341+0000","last_fullsized":"2024-03-09T15:22:50.103341+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:26.965320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162411+0000","last_change":"2024-03-09T14:21:56.366924+0000","last_active":"2024-03-09T15:21:57.162411+0000","last_peered":"2024-03-09T15:21:57.162411+0000","last_clean":"2024-03-09T15:21:57.162411+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:21:57.162411+0000","last_undegraded":"2024-03-09T15:21:57.162411+0000","last_fullsized":"2024-03-09T15:21:57.162411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:20.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'187","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038840+0000","last_change":"2024-03-09T14:21:54.371185+0000","last_active":"2024-03-09T15:22:07.038840+0000","last_peered":"2024-03-09T15:22:07.038840+0000","last_clean":"2024-03-09T15:22:07.038840+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:22:07.038840+0000","last_undegraded":"2024-03-09T15:22:07.038840+0000","last_fullsized":"2024-03-09T15:22:07.038840+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:56.928314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10859253,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":551,"num_read_kb":57961,"num_write":1116,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904523+0000","last_change":"2024-03-09T14:21:56.372686+0000","last_active":"2024-03-09T15:21:56.904523+0000","last_peered":"2024-03-09T15:21:56.904523+0000","last_clean":"2024-03-09T15:21:56.904523+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:21:56.904523+0000","last_undegraded":"2024-03-09T15:21:56.904523+0000","last_fullsized":"2024-03-09T15:21:56.904523+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:21.714174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'186","reported_seq":916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.741731+0000","last_change":"2024-03-09T14:21:54.361340+0000","last_active":"2024-03-09T15:24:14.741731+0000","last_peered":"2024-03-09T15:24:14.741731+0000","last_clean":"2024-03-09T15:24:14.741731+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:24:14.741731+0000","last_undegraded":"2024-03-09T15:24:14.741731+0000","last_fullsized":"2024-03-09T15:24:14.741731+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:38.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25832994,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":536,"num_read_kb":140946,"num_write":1098,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038703+0000","last_change":"2024-03-09T14:21:56.367286+0000","last_active":"2024-03-09T15:22:07.038703+0000","last_peered":"2024-03-09T15:22:07.038703+0000","last_clean":"2024-03-09T15:22:07.038703+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:22:07.038703+0000","last_undegraded":"2024-03-09T15:22:07.038703+0000","last_fullsized":"2024-03-09T15:22:07.038703+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:52.107232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'183","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.037192+0000","last_change":"2024-03-09T14:21:54.369817+0000","last_active":"2024-03-09T15:21:57.037192+0000","last_peered":"2024-03-09T15:21:57.037192+0000","last_clean":"2024-03-09T15:21:57.037192+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:21:57.037192+0000","last_undegraded":"2024-03-09T15:21:57.037192+0000","last_fullsized":"2024-03-09T15:21:57.037192+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:45.301805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11413170,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":389,"num_read_kb":13387,"num_write":1027,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166139+0000","last_change":"2024-03-09T14:21:56.359071+0000","last_active":"2024-03-09T15:22:22.166139+0000","last_peered":"2024-03-09T15:22:22.166139+0000","last_clean":"2024-03-09T15:22:22.166139+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:22:22.166139+0000","last_undegraded":"2024-03-09T15:22:22.166139+0000","last_fullsized":"2024-03-09T15:22:22.166139+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:29.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046242+0000","last_change":"2024-03-09T14:21:54.360895+0000","last_active":"2024-03-09T15:21:57.046242+0000","last_peered":"2024-03-09T15:21:57.046242+0000","last_clean":"2024-03-09T15:21:57.046242+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:21:57.046242+0000","last_undegraded":"2024-03-09T15:21:57.046242+0000","last_fullsized":"2024-03-09T15:21:57.046242+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:47.207849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:17.701829+0000","last_change":"2024-03-09T14:23:32.139848+0000","last_active":"2024-03-09T15:23:17.701829+0000","last_peered":"2024-03-09T15:23:17.701829+0000","last_clean":"2024-03-09T15:23:17.701829+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:23:17.701829+0000","last_undegraded":"2024-03-09T15:23:17.701829+0000","last_fullsized":"2024-03-09T15:23:17.701829+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:13:35.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'198","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.312186+0000","last_change":"2024-03-09T14:21:54.367692+0000","last_active":"2024-03-09T15:24:28.312186+0000","last_peered":"2024-03-09T15:24:28.312186+0000","last_clean":"2024-03-09T15:24:28.312186+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:24:28.312186+0000","last_undegraded":"2024-03-09T15:24:28.312186+0000","last_fullsized":"2024-03-09T15:24:28.312186+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:00:15.272460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505066,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":42906,"num_write":1254,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003815+0000","last_change":"2024-03-09T14:21:56.362728+0000","last_active":"2024-03-09T15:22:22.003815+0000","last_peered":"2024-03-09T15:22:22.003815+0000","last_clean":"2024-03-09T15:22:22.003815+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:22:22.003815+0000","last_undegraded":"2024-03-09T15:22:22.003815+0000","last_fullsized":"2024-03-09T15:22:22.003815+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:45.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'152","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.039856+0000","last_change":"2024-03-09T14:21:56.368382+0000","last_active":"2024-03-09T15:22:58.039856+0000","last_peered":"2024-03-09T15:22:58.039856+0000","last_clean":"2024-03-09T15:22:58.039856+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:22:58.039856+0000","last_undegraded":"2024-03-09T15:22:58.039856+0000","last_fullsized":"2024-03-09T15:22:58.039856+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:14.989000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'167","reported_seq":809,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.069704+0000","last_change":"2024-03-09T14:21:54.358160+0000","last_active":"2024-03-09T15:21:08.069704+0000","last_peered":"2024-03-09T15:21:08.069704+0000","last_clean":"2024-03-09T15:21:08.069704+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:21:08.069704+0000","last_undegraded":"2024-03-09T15:21:08.069704+0000","last_fullsized":"2024-03-09T15:21:08.069704+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:23:07.592095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5921421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":28832,"num_write":1014,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160954+0000","last_change":"2024-03-09T14:21:56.371113+0000","last_active":"2024-03-09T15:20:17.160954+0000","last_peered":"2024-03-09T15:20:17.160954+0000","last_clean":"2024-03-09T15:20:17.160954+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:20:17.160954+0000","last_undegraded":"2024-03-09T15:20:17.160954+0000","last_fullsized":"2024-03-09T15:20:17.160954+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:56.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'201","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019772+0000","last_change":"2024-03-09T14:21:54.366475+0000","last_active":"2024-03-09T15:19:57.019772+0000","last_peered":"2024-03-09T15:19:57.019772+0000","last_clean":"2024-03-09T15:19:57.019772+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:19:57.019772+0000","last_undegraded":"2024-03-09T15:19:57.019772+0000","last_fullsized":"2024-03-09T15:19:57.019772+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:47.826416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14711542,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":392,"num_read_kb":20924,"num_write":1100,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.378336+0000","last_change":"2024-03-09T14:21:56.362335+0000","last_active":"2024-03-09T15:24:28.378336+0000","last_peered":"2024-03-09T15:24:28.378336+0000","last_clean":"2024-03-09T15:24:28.378336+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:24:28.378336+0000","last_undegraded":"2024-03-09T15:24:28.378336+0000","last_fullsized":"2024-03-09T15:24:28.378336+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:04.650448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'190","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:55.883915+0000","last_change":"2024-03-09T14:21:54.369118+0000","last_active":"2024-03-09T15:20:55.883915+0000","last_peered":"2024-03-09T15:20:55.883915+0000","last_clean":"2024-03-09T15:20:55.883915+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:20:55.883915+0000","last_undegraded":"2024-03-09T15:20:55.883915+0000","last_fullsized":"2024-03-09T15:20:55.883915+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:23.759764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904028,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":640,"num_read_kb":129688,"num_write":1090,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'327","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.988967+0000","last_change":"2024-03-09T14:21:56.363364+0000","last_active":"2024-03-09T15:19:56.988967+0000","last_peered":"2024-03-09T15:19:56.988967+0000","last_clean":"2024-03-09T15:19:56.988967+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:19:56.988967+0000","last_undegraded":"2024-03-09T15:19:56.988967+0000","last_fullsized":"2024-03-09T15:19:56.988967+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:59.653300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'184","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:54.109866+0000","last_change":"2024-03-09T14:22:31.545671+0000","last_active":"2024-03-09T15:22:54.109866+0000","last_peered":"2024-03-09T15:22:54.109866+0000","last_clean":"2024-03-09T15:22:54.109866+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:22:54.109866+0000","last_undegraded":"2024-03-09T15:22:54.109866+0000","last_fullsized":"2024-03-09T15:22:54.109866+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:17.161201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397961,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":17983,"num_write":1106,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":687,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.338240+0000","last_change":"2024-03-09T14:21:56.360414+0000","last_active":"2024-03-09T15:22:41.338240+0000","last_peered":"2024-03-09T15:22:41.338240+0000","last_clean":"2024-03-09T15:22:41.338240+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:22:41.338240+0000","last_undegraded":"2024-03-09T15:22:41.338240+0000","last_fullsized":"2024-03-09T15:22:41.338240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:32.887159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'189","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.018393+0000","last_change":"2024-03-09T14:21:54.371479+0000","last_active":"2024-03-09T15:22:32.018393+0000","last_peered":"2024-03-09T15:22:32.018393+0000","last_clean":"2024-03-09T15:22:32.018393+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:22:32.018393+0000","last_undegraded":"2024-03-09T15:22:32.018393+0000","last_fullsized":"2024-03-09T15:22:32.018393+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:20.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":503,"num_read_kb":27148,"num_write":1012,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":733,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.143484+0000","last_change":"2024-03-09T14:21:56.360518+0000","last_active":"2024-03-09T15:19:57.143484+0000","last_peered":"2024-03-09T15:19:57.143484+0000","last_clean":"2024-03-09T15:19:57.143484+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:19:57.143484+0000","last_undegraded":"2024-03-09T15:19:57.143484+0000","last_fullsized":"2024-03-09T15:19:57.143484+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:16.918503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'243","reported_seq":981,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999917+0000","last_change":"2024-03-09T14:21:54.371089+0000","last_active":"2024-03-09T15:20:31.999917+0000","last_peered":"2024-03-09T15:20:31.999917+0000","last_clean":"2024-03-09T15:20:31.999917+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:20:31.999917+0000","last_undegraded":"2024-03-09T15:20:31.999917+0000","last_fullsized":"2024-03-09T15:20:31.999917+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:56.588140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599382,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1061,"num_read_kb":11712,"num_write":1252,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.145020+0000","last_change":"2024-03-09T14:22:04.407438+0000","last_active":"2024-03-09T15:20:07.145020+0000","last_peered":"2024-03-09T15:20:07.145020+0000","last_clean":"2024-03-09T15:20:07.145020+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:20:07.145020+0000","last_undegraded":"2024-03-09T15:20:07.145020+0000","last_fullsized":"2024-03-09T15:20:07.145020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:02.777937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'115","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.144676+0000","last_change":"2024-03-09T14:21:56.354345+0000","last_active":"2024-03-09T15:21:08.144676+0000","last_peered":"2024-03-09T15:21:08.144676+0000","last_clean":"2024-03-09T15:21:08.144676+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:21:08.144676+0000","last_undegraded":"2024-03-09T15:21:08.144676+0000","last_fullsized":"2024-03-09T15:21:08.144676+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:38.265091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'199","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.341742+0000","last_change":"2024-03-09T14:21:54.364329+0000","last_active":"2024-03-09T15:23:04.341742+0000","last_peered":"2024-03-09T15:23:04.341742+0000","last_clean":"2024-03-09T15:23:04.341742+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:23:04.341742+0000","last_undegraded":"2024-03-09T15:23:04.341742+0000","last_fullsized":"2024-03-09T15:23:04.341742+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:32.579399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":418,"num_read_kb":3002,"num_write":988,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020417+0000","last_change":"2024-03-09T14:21:58.369901+0000","last_active":"2024-03-09T15:20:02.020417+0000","last_peered":"2024-03-09T15:20:02.020417+0000","last_clean":"2024-03-09T15:20:02.020417+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:20:02.020417+0000","last_undegraded":"2024-03-09T15:20:02.020417+0000","last_fullsized":"2024-03-09T15:20:02.020417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:00.598181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'207","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.020490+0000","last_change":"2024-03-09T14:22:00.387965+0000","last_active":"2024-03-09T15:22:56.020490+0000","last_peered":"2024-03-09T15:22:56.020490+0000","last_clean":"2024-03-09T15:22:56.020490+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:22:56.020490+0000","last_undegraded":"2024-03-09T15:22:56.020490+0000","last_fullsized":"2024-03-09T15:22:56.020490+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:55.493455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":277,"num_read_kb":373,"num_write":168,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158882+0000","last_change":"2024-03-09T14:22:02.391044+0000","last_active":"2024-03-09T15:20:02.158882+0000","last_peered":"2024-03-09T15:20:02.158882+0000","last_clean":"2024-03-09T15:20:02.158882+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:20:02.158882+0000","last_undegraded":"2024-03-09T15:20:02.158882+0000","last_fullsized":"2024-03-09T15:20:02.158882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:46.242039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2478","reported_seq":4903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.846417+0000","last_change":"2024-03-09T14:22:04.401509+0000","last_active":"2024-03-09T15:24:28.846417+0000","last_peered":"2024-03-09T15:24:28.846417+0000","last_clean":"2024-03-09T15:24:28.846417+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:28.846417+0000","last_undegraded":"2024-03-09T15:24:28.846417+0000","last_fullsized":"2024-03-09T15:24:28.846417+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:21.913278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.084519+0000","last_change":"2024-03-09T14:21:56.360757+0000","last_active":"2024-03-09T15:22:32.084519+0000","last_peered":"2024-03-09T15:22:32.084519+0000","last_clean":"2024-03-09T15:22:32.084519+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:22:32.084519+0000","last_undegraded":"2024-03-09T15:22:32.084519+0000","last_fullsized":"2024-03-09T15:22:32.084519+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:11.828260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'185","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998070+0000","last_change":"2024-03-09T14:21:54.370606+0000","last_active":"2024-03-09T15:20:16.998070+0000","last_peered":"2024-03-09T15:20:16.998070+0000","last_clean":"2024-03-09T15:20:16.998070+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:20:16.998070+0000","last_undegraded":"2024-03-09T15:20:16.998070+0000","last_fullsized":"2024-03-09T15:20:16.998070+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:07.279208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5489185,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":36262,"num_write":1055,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.007681+0000","last_change":"2024-03-09T14:21:58.370142+0000","last_active":"2024-03-09T15:20:37.007681+0000","last_peered":"2024-03-09T15:20:37.007681+0000","last_clean":"2024-03-09T15:20:37.007681+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:20:37.007681+0000","last_undegraded":"2024-03-09T15:20:37.007681+0000","last_fullsized":"2024-03-09T15:20:37.007681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:26.942518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'108","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.364936+0000","last_change":"2024-03-09T14:22:00.383851+0000","last_active":"2024-03-09T15:22:36.364936+0000","last_peered":"2024-03-09T15:22:36.364936+0000","last_clean":"2024-03-09T15:22:36.364936+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:22:36.364936+0000","last_undegraded":"2024-03-09T15:22:36.364936+0000","last_fullsized":"2024-03-09T15:22:36.364936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:38.700465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144268+0000","last_change":"2024-03-09T14:22:02.401387+0000","last_active":"2024-03-09T15:20:02.144268+0000","last_peered":"2024-03-09T15:20:02.144268+0000","last_clean":"2024-03-09T15:20:02.144268+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:20:02.144268+0000","last_undegraded":"2024-03-09T15:20:02.144268+0000","last_fullsized":"2024-03-09T15:20:02.144268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:17:02.585085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'114","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.784543+0000","last_change":"2024-03-09T14:22:04.401757+0000","last_active":"2024-03-09T15:22:38.784543+0000","last_peered":"2024-03-09T15:22:38.784543+0000","last_clean":"2024-03-09T15:22:38.784543+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:22:38.784543+0000","last_undegraded":"2024-03-09T15:22:38.784543+0000","last_fullsized":"2024-03-09T15:22:38.784543+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:00.751890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.995723+0000","last_change":"2024-03-09T14:21:56.372711+0000","last_active":"2024-03-09T15:19:56.995723+0000","last_peered":"2024-03-09T15:19:56.995723+0000","last_clean":"2024-03-09T15:19:56.995723+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:19:56.995723+0000","last_undegraded":"2024-03-09T15:19:56.995723+0000","last_fullsized":"2024-03-09T15:19:56.995723+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'166","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160910+0000","last_change":"2024-03-09T14:21:54.365114+0000","last_active":"2024-03-09T15:20:17.160910+0000","last_peered":"2024-03-09T15:20:17.160910+0000","last_clean":"2024-03-09T15:20:17.160910+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:20:17.160910+0000","last_undegraded":"2024-03-09T15:20:17.160910+0000","last_fullsized":"2024-03-09T15:20:17.160910+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:25.691680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21590719,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":415,"num_read_kb":24289,"num_write":900,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.003117+0000","last_change":"2024-03-09T14:21:58.372340+0000","last_active":"2024-03-09T15:20:02.003117+0000","last_peered":"2024-03-09T15:20:02.003117+0000","last_clean":"2024-03-09T15:20:02.003117+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:20:02.003117+0000","last_undegraded":"2024-03-09T15:20:02.003117+0000","last_fullsized":"2024-03-09T15:20:02.003117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:20.284463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'131","reported_seq":673,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.440694+0000","last_change":"2024-03-09T14:22:00.384182+0000","last_active":"2024-03-09T15:22:36.440694+0000","last_peered":"2024-03-09T15:22:36.440694+0000","last_clean":"2024-03-09T15:22:36.440694+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:22:36.440694+0000","last_undegraded":"2024-03-09T15:22:36.440694+0000","last_fullsized":"2024-03-09T15:22:36.440694+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:22.730875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'502","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.885268+0000","last_change":"2024-03-09T14:22:02.394468+0000","last_active":"2024-03-09T15:24:30.885268+0000","last_peered":"2024-03-09T15:24:30.885268+0000","last_clean":"2024-03-09T15:24:30.885268+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:24:30.885268+0000","last_undegraded":"2024-03-09T15:24:30.885268+0000","last_fullsized":"2024-03-09T15:24:30.885268+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:21.183335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'198","reported_seq":1009,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.173166+0000","last_change":"2024-03-09T14:22:04.393662+0000","last_active":"2024-03-09T15:22:50.173166+0000","last_peered":"2024-03-09T15:22:50.173166+0000","last_clean":"2024-03-09T15:22:50.173166+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:22:50.173166+0000","last_undegraded":"2024-03-09T15:22:50.173166+0000","last_fullsized":"2024-03-09T15:22:50.173166+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:52.946807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":935,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002403+0000","last_change":"2024-03-09T14:21:56.366895+0000","last_active":"2024-03-09T15:19:57.002403+0000","last_peered":"2024-03-09T15:19:57.002403+0000","last_clean":"2024-03-09T15:19:57.002403+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:19:57.002403+0000","last_undegraded":"2024-03-09T15:19:57.002403+0000","last_fullsized":"2024-03-09T15:19:57.002403+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:26.788549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'328","reported_seq":1051,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022611+0000","last_change":"2024-03-09T14:21:54.366866+0000","last_active":"2024-03-09T15:20:17.022611+0000","last_peered":"2024-03-09T15:20:17.022611+0000","last_clean":"2024-03-09T15:20:17.022611+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:20:17.022611+0000","last_undegraded":"2024-03-09T15:20:17.022611+0000","last_fullsized":"2024-03-09T15:20:17.022611+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:51.068751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16819939,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":885,"num_read_kb":69587,"num_write":1464,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020448+0000","last_change":"2024-03-09T14:21:58.370760+0000","last_active":"2024-03-09T15:20:02.020448+0000","last_peered":"2024-03-09T15:20:02.020448+0000","last_clean":"2024-03-09T15:20:02.020448+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:20:02.020448+0000","last_undegraded":"2024-03-09T15:20:02.020448+0000","last_fullsized":"2024-03-09T15:20:02.020448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.151599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'135","reported_seq":704,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.984795+0000","last_change":"2024-03-09T14:22:00.494140+0000","last_active":"2024-03-09T15:23:37.984795+0000","last_peered":"2024-03-09T15:23:37.984795+0000","last_clean":"2024-03-09T15:23:37.984795+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:23:37.984795+0000","last_undegraded":"2024-03-09T15:23:37.984795+0000","last_fullsized":"2024-03-09T15:23:37.984795+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:56.507586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9949,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":234,"num_write":92,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'544","reported_seq":2339,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.889024+0000","last_change":"2024-03-09T14:22:02.399618+0000","last_active":"2024-03-09T15:24:30.889024+0000","last_peered":"2024-03-09T15:24:30.889024+0000","last_clean":"2024-03-09T15:24:30.889024+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:24:30.889024+0000","last_undegraded":"2024-03-09T15:24:30.889024+0000","last_fullsized":"2024-03-09T15:24:30.889024+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:16.944105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'167","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023997+0000","last_change":"2024-03-09T14:21:56.361954+0000","last_active":"2024-03-09T15:20:27.023997+0000","last_peered":"2024-03-09T15:20:27.023997+0000","last_clean":"2024-03-09T15:20:27.023997+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:20:27.023997+0000","last_undegraded":"2024-03-09T15:20:27.023997+0000","last_fullsized":"2024-03-09T15:20:27.023997+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:31.594273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'207","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.164406+0000","last_change":"2024-03-09T14:21:54.363733+0000","last_active":"2024-03-09T15:20:37.164406+0000","last_peered":"2024-03-09T15:20:37.164406+0000","last_clean":"2024-03-09T15:20:37.164406+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:20:37.164406+0000","last_undegraded":"2024-03-09T15:20:37.164406+0000","last_fullsized":"2024-03-09T15:20:37.164406+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:17.383801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103988,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":482,"num_read_kb":2825,"num_write":1213,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163560+0000","last_change":"2024-03-09T14:21:58.368654+0000","last_active":"2024-03-09T15:20:32.163560+0000","last_peered":"2024-03-09T15:20:32.163560+0000","last_clean":"2024-03-09T15:20:32.163560+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:20:32.163560+0000","last_undegraded":"2024-03-09T15:20:32.163560+0000","last_fullsized":"2024-03-09T15:20:32.163560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:21.594710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'228","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:52.045357+0000","last_change":"2024-03-09T14:22:00.493626+0000","last_active":"2024-03-09T15:22:52.045357+0000","last_peered":"2024-03-09T15:22:52.045357+0000","last_clean":"2024-03-09T15:22:52.045357+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:22:52.045357+0000","last_undegraded":"2024-03-09T15:22:52.045357+0000","last_fullsized":"2024-03-09T15:22:52.045357+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:35.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9908,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":384,"num_write":190,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994431+0000","last_change":"2024-03-09T14:22:02.394441+0000","last_active":"2024-03-09T15:20:31.994431+0000","last_peered":"2024-03-09T15:20:31.994431+0000","last_clean":"2024-03-09T15:20:31.994431+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:20:31.994431+0000","last_undegraded":"2024-03-09T15:20:31.994431+0000","last_fullsized":"2024-03-09T15:20:31.994431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:20.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'547","reported_seq":1355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.875337+0000","last_change":"2024-03-09T14:22:04.401516+0000","last_active":"2024-03-09T15:24:30.875337+0000","last_peered":"2024-03-09T15:24:30.875337+0000","last_clean":"2024-03-09T15:24:30.875337+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:30.875337+0000","last_undegraded":"2024-03-09T15:24:30.875337+0000","last_fullsized":"2024-03-09T15:24:30.875337+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:22.487334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'160","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.147996+0000","last_change":"2024-03-09T14:21:56.360517+0000","last_active":"2024-03-09T15:20:27.147996+0000","last_peered":"2024-03-09T15:20:27.147996+0000","last_clean":"2024-03-09T15:20:27.147996+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:20:27.147996+0000","last_undegraded":"2024-03-09T15:20:27.147996+0000","last_fullsized":"2024-03-09T15:20:27.147996+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:05.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162818+0000","last_change":"2024-03-09T14:21:54.361313+0000","last_active":"2024-03-09T15:20:27.162818+0000","last_peered":"2024-03-09T15:20:27.162818+0000","last_clean":"2024-03-09T15:20:27.162818+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:20:27.162818+0000","last_undegraded":"2024-03-09T15:20:27.162818+0000","last_fullsized":"2024-03-09T15:20:27.162818+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:49:23.800324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992640+0000","last_change":"2024-03-09T14:21:58.373445+0000","last_active":"2024-03-09T15:20:31.992640+0000","last_peered":"2024-03-09T15:20:31.992640+0000","last_clean":"2024-03-09T15:20:31.992640+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:20:31.992640+0000","last_undegraded":"2024-03-09T15:20:31.992640+0000","last_fullsized":"2024-03-09T15:20:31.992640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:12:36.728172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'133","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.023415+0000","last_change":"2024-03-09T14:22:00.387422+0000","last_active":"2024-03-09T15:22:47.023415+0000","last_peered":"2024-03-09T15:22:47.023415+0000","last_clean":"2024-03-09T15:22:47.023415+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:22:47.023415+0000","last_undegraded":"2024-03-09T15:22:47.023415+0000","last_fullsized":"2024-03-09T15:22:47.023415+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:44.158848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":174,"num_read_kb":233,"num_write":94,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008667+0000","last_change":"2024-03-09T14:22:02.399383+0000","last_active":"2024-03-09T15:20:47.008667+0000","last_peered":"2024-03-09T15:20:47.008667+0000","last_clean":"2024-03-09T15:20:47.008667+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:20:47.008667+0000","last_undegraded":"2024-03-09T15:20:47.008667+0000","last_fullsized":"2024-03-09T15:20:47.008667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:46.573953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'154","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.051056+0000","last_change":"2024-03-09T14:22:04.401728+0000","last_active":"2024-03-09T15:23:16.051056+0000","last_peered":"2024-03-09T15:23:16.051056+0000","last_clean":"2024-03-09T15:23:16.051056+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:23:16.051056+0000","last_undegraded":"2024-03-09T15:23:16.051056+0000","last_fullsized":"2024-03-09T15:23:16.051056+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:36.044586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025573+0000","last_change":"2024-03-09T14:21:56.363935+0000","last_active":"2024-03-09T15:20:37.025573+0000","last_peered":"2024-03-09T15:20:37.025573+0000","last_clean":"2024-03-09T15:20:37.025573+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:20:37.025573+0000","last_undegraded":"2024-03-09T15:20:37.025573+0000","last_fullsized":"2024-03-09T15:20:37.025573+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:22.924584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'198","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162790+0000","last_change":"2024-03-09T14:21:54.370752+0000","last_active":"2024-03-09T15:20:27.162790+0000","last_peered":"2024-03-09T15:20:27.162790+0000","last_clean":"2024-03-09T15:20:27.162790+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:20:27.162790+0000","last_undegraded":"2024-03-09T15:20:27.162790+0000","last_fullsized":"2024-03-09T15:20:27.162790+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:42.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6994754,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":99405,"num_write":1010,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992670+0000","last_change":"2024-03-09T14:21:58.373407+0000","last_active":"2024-03-09T15:20:31.992670+0000","last_peered":"2024-03-09T15:20:31.992670+0000","last_clean":"2024-03-09T15:20:31.992670+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:20:31.992670+0000","last_undegraded":"2024-03-09T15:20:31.992670+0000","last_fullsized":"2024-03-09T15:20:31.992670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:40.360322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'181","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:42.053222+0000","last_change":"2024-03-09T14:22:00.384337+0000","last_active":"2024-03-09T15:22:42.053222+0000","last_peered":"2024-03-09T15:22:42.053222+0000","last_clean":"2024-03-09T15:22:42.053222+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:22:42.053222+0000","last_undegraded":"2024-03-09T15:22:42.053222+0000","last_fullsized":"2024-03-09T15:22:42.053222+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:43.164450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8238,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":234,"num_read_kb":285,"num_write":134,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'508","reported_seq":2131,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.889951+0000","last_change":"2024-03-09T14:22:02.399057+0000","last_active":"2024-03-09T15:24:30.889951+0000","last_peered":"2024-03-09T15:24:30.889951+0000","last_clean":"2024-03-09T15:24:30.889951+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:24:30.889951+0000","last_undegraded":"2024-03-09T15:24:30.889951+0000","last_fullsized":"2024-03-09T15:24:30.889951+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:12.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'144","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.791883+0000","last_change":"2024-03-09T14:22:04.402136+0000","last_active":"2024-03-09T15:23:55.791883+0000","last_peered":"2024-03-09T15:23:55.791883+0000","last_clean":"2024-03-09T15:23:55.791883+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:23:55.791883+0000","last_undegraded":"2024-03-09T15:23:55.791883+0000","last_fullsized":"2024-03-09T15:23:55.791883+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:19.283035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.377637+0000","last_change":"2024-03-09T14:21:56.371534+0000","last_active":"2024-03-09T15:21:18.377637+0000","last_peered":"2024-03-09T15:21:18.377637+0000","last_clean":"2024-03-09T15:21:18.377637+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:21:18.377637+0000","last_undegraded":"2024-03-09T15:21:18.377637+0000","last_fullsized":"2024-03-09T15:21:18.377637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:24.972146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'163","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.968717+0000","last_change":"2024-03-09T14:21:54.369550+0000","last_active":"2024-03-09T15:22:57.968717+0000","last_peered":"2024-03-09T15:22:57.968717+0000","last_clean":"2024-03-09T15:22:57.968717+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:22:57.968717+0000","last_undegraded":"2024-03-09T15:22:57.968717+0000","last_fullsized":"2024-03-09T15:22:57.968717+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:28.659325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529210,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":41462,"num_write":959,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:41.993861+0000","last_change":"2024-03-09T14:21:58.372864+0000","last_active":"2024-03-09T15:20:41.993861+0000","last_peered":"2024-03-09T15:20:41.993861+0000","last_clean":"2024-03-09T15:20:41.993861+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:20:41.993861+0000","last_undegraded":"2024-03-09T15:20:41.993861+0000","last_fullsized":"2024-03-09T15:20:41.993861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:02.146801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'209","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.832771+0000","last_change":"2024-03-09T14:22:00.383682+0000","last_active":"2024-03-09T15:24:30.832771+0000","last_peered":"2024-03-09T15:24:30.832771+0000","last_clean":"2024-03-09T15:24:30.832771+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:24:30.832771+0000","last_undegraded":"2024-03-09T15:24:30.832771+0000","last_fullsized":"2024-03-09T15:24:30.832771+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:15.223090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18794,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":288,"num_read_kb":411,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992613+0000","last_change":"2024-03-09T14:22:02.391676+0000","last_active":"2024-03-09T15:20:31.992613+0000","last_peered":"2024-03-09T15:20:31.992613+0000","last_clean":"2024-03-09T15:20:31.992613+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:20:31.992613+0000","last_undegraded":"2024-03-09T15:20:31.992613+0000","last_fullsized":"2024-03-09T15:20:31.992613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:52.125960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'95","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995021+0000","last_change":"2024-03-09T14:22:04.407155+0000","last_active":"2024-03-09T15:20:36.995021+0000","last_peered":"2024-03-09T15:20:36.995021+0000","last_clean":"2024-03-09T15:20:36.995021+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:20:36.995021+0000","last_undegraded":"2024-03-09T15:20:36.995021+0000","last_fullsized":"2024-03-09T15:20:36.995021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:01.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148074+0000","last_change":"2024-03-09T14:21:56.352377+0000","last_active":"2024-03-09T15:20:27.148074+0000","last_peered":"2024-03-09T15:20:27.148074+0000","last_clean":"2024-03-09T15:20:27.148074+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:20:27.148074+0000","last_undegraded":"2024-03-09T15:20:27.148074+0000","last_fullsized":"2024-03-09T15:20:27.148074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:26.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'159","reported_seq":776,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995960+0000","last_change":"2024-03-09T14:22:31.502194+0000","last_active":"2024-03-09T15:21:01.995960+0000","last_peered":"2024-03-09T15:21:01.995960+0000","last_clean":"2024-03-09T15:21:01.995960+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:21:01.995960+0000","last_undegraded":"2024-03-09T15:21:01.995960+0000","last_fullsized":"2024-03-09T15:21:01.995960+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:07:53.358348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142213,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":87296,"num_write":880,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992720+0000","last_change":"2024-03-09T14:21:58.373193+0000","last_active":"2024-03-09T15:20:31.992720+0000","last_peered":"2024-03-09T15:20:31.992720+0000","last_clean":"2024-03-09T15:20:31.992720+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:20:31.992720+0000","last_undegraded":"2024-03-09T15:20:31.992720+0000","last_fullsized":"2024-03-09T15:20:31.992720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:54:43.726744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'165","reported_seq":751,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.108483+0000","last_change":"2024-03-09T14:22:00.383871+0000","last_active":"2024-03-09T15:23:23.108483+0000","last_peered":"2024-03-09T15:23:23.108483+0000","last_clean":"2024-03-09T15:23:23.108483+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:23:23.108483+0000","last_undegraded":"2024-03-09T15:23:23.108483+0000","last_fullsized":"2024-03-09T15:23:23.108483+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.715476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":290,"num_write":174,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.001564+0000","last_change":"2024-03-09T14:22:02.404397+0000","last_active":"2024-03-09T15:20:47.001564+0000","last_peered":"2024-03-09T15:20:47.001564+0000","last_clean":"2024-03-09T15:20:47.001564+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:20:47.001564+0000","last_undegraded":"2024-03-09T15:20:47.001564+0000","last_fullsized":"2024-03-09T15:20:47.001564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:30.954615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'103","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.585805+0000","last_change":"2024-03-09T14:22:04.407840+0000","last_active":"2024-03-09T15:23:08.585805+0000","last_peered":"2024-03-09T15:23:08.585805+0000","last_clean":"2024-03-09T15:23:08.585805+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:23:08.585805+0000","last_undegraded":"2024-03-09T15:23:08.585805+0000","last_fullsized":"2024-03-09T15:23:08.585805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:20:34.107387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148090+0000","last_change":"2024-03-09T14:21:56.363858+0000","last_active":"2024-03-09T15:20:27.148090+0000","last_peered":"2024-03-09T15:20:27.148090+0000","last_clean":"2024-03-09T15:20:27.148090+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:20:27.148090+0000","last_undegraded":"2024-03-09T15:20:27.148090+0000","last_fullsized":"2024-03-09T15:20:27.148090+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:13.291056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'173","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025557+0000","last_change":"2024-03-09T14:21:54.361281+0000","last_active":"2024-03-09T15:20:37.025557+0000","last_peered":"2024-03-09T15:20:37.025557+0000","last_clean":"2024-03-09T15:20:37.025557+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:20:37.025557+0000","last_undegraded":"2024-03-09T15:20:37.025557+0000","last_fullsized":"2024-03-09T15:20:37.025557+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:46.098501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567604,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":426,"num_read_kb":31184,"num_write":928,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994467+0000","last_change":"2024-03-09T14:21:58.376298+0000","last_active":"2024-03-09T15:20:31.994467+0000","last_peered":"2024-03-09T15:20:31.994467+0000","last_clean":"2024-03-09T15:20:31.994467+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:20:31.994467+0000","last_undegraded":"2024-03-09T15:20:31.994467+0000","last_fullsized":"2024-03-09T15:20:31.994467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:16:22.147321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'193","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.007290+0000","last_change":"2024-03-09T14:22:00.389792+0000","last_active":"2024-03-09T15:22:57.007290+0000","last_peered":"2024-03-09T15:22:57.007290+0000","last_clean":"2024-03-09T15:22:57.007290+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:22:57.007290+0000","last_undegraded":"2024-03-09T15:22:57.007290+0000","last_fullsized":"2024-03-09T15:22:57.007290+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:30.722738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10726,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":325,"num_write":148,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'487","reported_seq":4300,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.886002+0000","last_change":"2024-03-09T14:22:02.395597+0000","last_active":"2024-03-09T15:24:30.886002+0000","last_peered":"2024-03-09T15:24:30.886002+0000","last_clean":"2024-03-09T15:24:30.886002+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:30.886002+0000","last_undegraded":"2024-03-09T15:24:30.886002+0000","last_fullsized":"2024-03-09T15:24:30.886002+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:37.933532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'203","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.269247+0000","last_change":"2024-03-09T14:22:04.405779+0000","last_active":"2024-03-09T15:23:23.269247+0000","last_peered":"2024-03-09T15:23:23.269247+0000","last_clean":"2024-03-09T15:23:23.269247+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:23:23.269247+0000","last_undegraded":"2024-03-09T15:23:23.269247+0000","last_fullsized":"2024-03-09T15:23:23.269247+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:22:23.514316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148107+0000","last_change":"2024-03-09T14:21:56.356981+0000","last_active":"2024-03-09T15:20:27.148107+0000","last_peered":"2024-03-09T15:20:27.148107+0000","last_clean":"2024-03-09T15:20:27.148107+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:20:27.148107+0000","last_undegraded":"2024-03-09T15:20:27.148107+0000","last_fullsized":"2024-03-09T15:20:27.148107+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:14.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'166","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.515747+0000","last_change":"2024-03-09T14:21:54.363849+0000","last_active":"2024-03-09T15:23:08.515747+0000","last_peered":"2024-03-09T15:23:08.515747+0000","last_clean":"2024-03-09T15:23:08.515747+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:23:08.515747+0000","last_undegraded":"2024-03-09T15:23:08.515747+0000","last_fullsized":"2024-03-09T15:23:08.515747+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:31.144563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22447143,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":980,"num_read_kb":38802,"num_write":966,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.392914+0000","last_change":"2024-03-09T14:21:58.370397+0000","last_active":"2024-03-09T15:24:30.392914+0000","last_peered":"2024-03-09T15:24:30.392914+0000","last_clean":"2024-03-09T15:24:30.392914+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:24:30.392914+0000","last_undegraded":"2024-03-09T15:24:30.392914+0000","last_fullsized":"2024-03-09T15:24:30.392914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:50.562611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":622,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'90","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.298945+0000","last_change":"2024-03-09T14:22:00.492690+0000","last_active":"2024-03-09T15:22:36.298945+0000","last_peered":"2024-03-09T15:22:36.298945+0000","last_clean":"2024-03-09T15:22:36.298945+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:22:36.298945+0000","last_undegraded":"2024-03-09T15:22:36.298945+0000","last_fullsized":"2024-03-09T15:22:36.298945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:31.845945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'504","reported_seq":2210,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.887336+0000","last_change":"2024-03-09T14:22:02.396378+0000","last_active":"2024-03-09T15:24:30.887336+0000","last_peered":"2024-03-09T15:24:30.887336+0000","last_clean":"2024-03-09T15:24:30.887336+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:30.887336+0000","last_undegraded":"2024-03-09T15:24:30.887336+0000","last_fullsized":"2024-03-09T15:24:30.887336+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:11.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.167412+0000","last_change":"2024-03-09T14:22:04.402603+0000","last_active":"2024-03-09T15:22:32.167412+0000","last_peered":"2024-03-09T15:22:32.167412+0000","last_clean":"2024-03-09T15:22:32.167412+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:22:32.167412+0000","last_undegraded":"2024-03-09T15:22:32.167412+0000","last_fullsized":"2024-03-09T15:22:32.167412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:25.906429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995042+0000","last_change":"2024-03-09T14:21:56.368142+0000","last_active":"2024-03-09T15:20:36.995042+0000","last_peered":"2024-03-09T15:20:36.995042+0000","last_clean":"2024-03-09T15:20:36.995042+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:20:36.995042+0000","last_undegraded":"2024-03-09T15:20:36.995042+0000","last_fullsized":"2024-03-09T15:20:36.995042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:27.948389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'187","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006230+0000","last_change":"2024-03-09T14:21:54.368543+0000","last_active":"2024-03-09T15:20:27.006230+0000","last_peered":"2024-03-09T15:20:27.006230+0000","last_clean":"2024-03-09T15:20:27.006230+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:20:27.006230+0000","last_undegraded":"2024-03-09T15:20:27.006230+0000","last_fullsized":"2024-03-09T15:20:27.006230+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:57.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5588183,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":26998,"num_write":1065,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'4","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.382240+0000","last_change":"2024-03-09T14:21:58.371279+0000","last_active":"2024-03-09T15:24:30.382240+0000","last_peered":"2024-03-09T15:24:30.382240+0000","last_clean":"2024-03-09T15:24:30.382240+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:24:30.382240+0000","last_undegraded":"2024-03-09T15:24:30.382240+0000","last_fullsized":"2024-03-09T15:24:30.382240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:34.948133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":777,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'284","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.849045+0000","last_change":"2024-03-09T14:22:00.386117+0000","last_active":"2024-03-09T15:24:30.849045+0000","last_peered":"2024-03-09T15:24:30.849045+0000","last_clean":"2024-03-09T15:24:30.849045+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:24:30.849045+0000","last_undegraded":"2024-03-09T15:24:30.849045+0000","last_fullsized":"2024-03-09T15:24:30.849045+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:21.453812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9904,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1006,"num_read_kb":1062,"num_write":1592,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024722+0000","last_change":"2024-03-09T14:22:02.404333+0000","last_active":"2024-03-09T15:20:32.024722+0000","last_peered":"2024-03-09T15:20:32.024722+0000","last_clean":"2024-03-09T15:20:32.024722+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:20:32.024722+0000","last_undegraded":"2024-03-09T15:20:32.024722+0000","last_fullsized":"2024-03-09T15:20:32.024722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:37.735785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'157","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.405174+0000","last_change":"2024-03-09T14:22:04.400519+0000","last_active":"2024-03-09T15:23:44.405174+0000","last_peered":"2024-03-09T15:23:44.405174+0000","last_clean":"2024-03-09T15:23:44.405174+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:23:44.405174+0000","last_undegraded":"2024-03-09T15:23:44.405174+0000","last_fullsized":"2024-03-09T15:23:44.405174+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:16.309063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042466+0000","last_change":"2024-03-09T14:21:56.359275+0000","last_active":"2024-03-09T15:22:32.042466+0000","last_peered":"2024-03-09T15:22:32.042466+0000","last_clean":"2024-03-09T15:22:32.042466+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:22:32.042466+0000","last_undegraded":"2024-03-09T15:22:32.042466+0000","last_fullsized":"2024-03-09T15:22:32.042466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:10.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046197+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T15:21:57.046197+0000","last_peered":"2024-03-09T15:21:57.046197+0000","last_clean":"2024-03-09T15:21:57.046197+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:21:57.046197+0000","last_undegraded":"2024-03-09T15:21:57.046197+0000","last_fullsized":"2024-03-09T15:21:57.046197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'151","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:35.946875+0000","last_change":"2024-03-09T14:21:54.358849+0000","last_active":"2024-03-09T15:22:35.946875+0000","last_peered":"2024-03-09T15:22:35.946875+0000","last_clean":"2024-03-09T15:22:35.946875+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:22:35.946875+0000","last_undegraded":"2024-03-09T15:22:35.946875+0000","last_fullsized":"2024-03-09T15:22:35.946875+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:39.818710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319062,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":408,"num_read_kb":7813,"num_write":924,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.051219+0000","last_change":"2024-03-09T14:21:58.372665+0000","last_active":"2024-03-09T15:22:27.051219+0000","last_peered":"2024-03-09T15:22:27.051219+0000","last_clean":"2024-03-09T15:22:27.051219+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:22:27.051219+0000","last_undegraded":"2024-03-09T15:22:27.051219+0000","last_fullsized":"2024-03-09T15:22:27.051219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:20.394198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'288","reported_seq":982,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.851468+0000","last_change":"2024-03-09T14:22:00.387288+0000","last_active":"2024-03-09T15:24:30.851468+0000","last_peered":"2024-03-09T15:24:30.851468+0000","last_clean":"2024-03-09T15:24:30.851468+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:24:30.851468+0000","last_undegraded":"2024-03-09T15:24:30.851468+0000","last_fullsized":"2024-03-09T15:24:30.851468+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:13.322082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17691,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":547,"num_write":464,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999998+0000","last_change":"2024-03-09T14:22:02.403697+0000","last_active":"2024-03-09T15:20:31.999998+0000","last_peered":"2024-03-09T15:20:31.999998+0000","last_clean":"2024-03-09T15:20:31.999998+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:20:31.999998+0000","last_undegraded":"2024-03-09T15:20:31.999998+0000","last_fullsized":"2024-03-09T15:20:31.999998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:19:46.922962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'215","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.799050+0000","last_change":"2024-03-09T14:22:04.400948+0000","last_active":"2024-03-09T15:23:55.799050+0000","last_peered":"2024-03-09T15:23:55.799050+0000","last_clean":"2024-03-09T15:23:55.799050+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:23:55.799050+0000","last_undegraded":"2024-03-09T15:23:55.799050+0000","last_fullsized":"2024-03-09T15:23:55.799050+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:37.990701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'338","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006035+0000","last_change":"2024-03-09T14:21:56.364183+0000","last_active":"2024-03-09T15:22:22.006035+0000","last_peered":"2024-03-09T15:22:22.006035+0000","last_clean":"2024-03-09T15:22:22.006035+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:22:22.006035+0000","last_undegraded":"2024-03-09T15:22:22.006035+0000","last_fullsized":"2024-03-09T15:22:22.006035+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:20.353413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038029+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T15:22:02.038029+0000","last_peered":"2024-03-09T15:22:02.038029+0000","last_clean":"2024-03-09T15:22:02.038029+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:22:02.038029+0000","last_undegraded":"2024-03-09T15:22:02.038029+0000","last_fullsized":"2024-03-09T15:22:02.038029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'155","reported_seq":748,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:55.944251+0000","last_change":"2024-03-09T14:21:54.357687+0000","last_active":"2024-03-09T15:22:55.944251+0000","last_peered":"2024-03-09T15:22:55.944251+0000","last_clean":"2024-03-09T15:22:55.944251+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:22:55.944251+0000","last_undegraded":"2024-03-09T15:22:55.944251+0000","last_fullsized":"2024-03-09T15:22:55.944251+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:07.591910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1104040,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":314,"num_read_kb":1406,"num_write":851,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000526+0000","last_change":"2024-03-09T14:21:58.373133+0000","last_active":"2024-03-09T15:20:37.000526+0000","last_peered":"2024-03-09T15:20:37.000526+0000","last_clean":"2024-03-09T15:20:37.000526+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:20:37.000526+0000","last_undegraded":"2024-03-09T15:20:37.000526+0000","last_fullsized":"2024-03-09T15:20:37.000526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:53.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'144","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.207457+0000","last_change":"2024-03-09T14:22:00.388917+0000","last_active":"2024-03-09T15:22:36.207457+0000","last_peered":"2024-03-09T15:22:36.207457+0000","last_clean":"2024-03-09T15:22:36.207457+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:22:36.207457+0000","last_undegraded":"2024-03-09T15:22:36.207457+0000","last_fullsized":"2024-03-09T15:22:36.207457+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:20.768721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024785+0000","last_change":"2024-03-09T14:22:02.401190+0000","last_active":"2024-03-09T15:20:32.024785+0000","last_peered":"2024-03-09T15:20:32.024785+0000","last_clean":"2024-03-09T15:20:32.024785+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:20:32.024785+0000","last_undegraded":"2024-03-09T15:20:32.024785+0000","last_fullsized":"2024-03-09T15:20:32.024785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:59.946005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'103","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.267023+0000","last_change":"2024-03-09T14:22:04.408883+0000","last_active":"2024-03-09T15:23:23.267023+0000","last_peered":"2024-03-09T15:23:23.267023+0000","last_clean":"2024-03-09T15:23:23.267023+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:23:23.267023+0000","last_undegraded":"2024-03-09T15:23:23.267023+0000","last_fullsized":"2024-03-09T15:23:23.267023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:20.342826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.115078+0000","last_change":"2024-03-09T14:21:56.362977+0000","last_active":"2024-03-09T15:22:43.115078+0000","last_peered":"2024-03-09T15:22:43.115078+0000","last_clean":"2024-03-09T15:22:43.115078+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:22:43.115078+0000","last_undegraded":"2024-03-09T15:22:43.115078+0000","last_fullsized":"2024-03-09T15:22:43.115078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:56.941578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047191+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T15:22:02.047191+0000","last_peered":"2024-03-09T15:22:02.047191+0000","last_clean":"2024-03-09T15:22:02.047191+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:22:02.047191+0000","last_undegraded":"2024-03-09T15:22:02.047191+0000","last_fullsized":"2024-03-09T15:22:02.047191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'203","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.279511+0000","last_change":"2024-03-09T14:21:54.371651+0000","last_active":"2024-03-09T15:22:41.279511+0000","last_peered":"2024-03-09T15:22:41.279511+0000","last_clean":"2024-03-09T15:22:41.279511+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:22:41.279511+0000","last_undegraded":"2024-03-09T15:22:41.279511+0000","last_fullsized":"2024-03-09T15:22:41.279511+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:50.559760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11854883,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":458,"num_read_kb":33193,"num_write":1179,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992747+0000","last_change":"2024-03-09T14:21:58.371500+0000","last_active":"2024-03-09T15:20:31.992747+0000","last_peered":"2024-03-09T15:20:31.992747+0000","last_clean":"2024-03-09T15:20:31.992747+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:20:31.992747+0000","last_undegraded":"2024-03-09T15:20:31.992747+0000","last_fullsized":"2024-03-09T15:20:31.992747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:26.928736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'282","reported_seq":1581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.033091+0000","last_change":"2024-03-09T14:22:00.494298+0000","last_active":"2024-03-09T15:24:31.033091+0000","last_peered":"2024-03-09T15:24:31.033091+0000","last_clean":"2024-03-09T15:24:31.033091+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:24:31.033091+0000","last_undegraded":"2024-03-09T15:24:31.033091+0000","last_fullsized":"2024-03-09T15:24:31.033091+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:34.240386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908159+0000","last_change":"2024-03-09T14:22:02.400334+0000","last_active":"2024-03-09T15:22:26.908159+0000","last_peered":"2024-03-09T15:22:26.908159+0000","last_clean":"2024-03-09T15:22:26.908159+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:22:26.908159+0000","last_undegraded":"2024-03-09T15:22:26.908159+0000","last_fullsized":"2024-03-09T15:22:26.908159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:04.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'256","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:19.404283+0000","last_change":"2024-03-09T14:22:04.404883+0000","last_active":"2024-03-09T15:23:19.404283+0000","last_peered":"2024-03-09T15:23:19.404283+0000","last_clean":"2024-03-09T15:23:19.404283+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:23:19.404283+0000","last_undegraded":"2024-03-09T15:23:19.404283+0000","last_fullsized":"2024-03-09T15:23:19.404283+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:39.148958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999417+0000","last_change":"2024-03-09T14:21:56.371601+0000","last_active":"2024-03-09T15:20:26.999417+0000","last_peered":"2024-03-09T15:20:26.999417+0000","last_clean":"2024-03-09T15:20:26.999417+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:20:26.999417+0000","last_undegraded":"2024-03-09T15:20:26.999417+0000","last_fullsized":"2024-03-09T15:20:26.999417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:04.533578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.004180+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T15:22:07.004180+0000","last_peered":"2024-03-09T15:22:07.004180+0000","last_clean":"2024-03-09T15:22:07.004180+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:22:07.004180+0000","last_undegraded":"2024-03-09T15:22:07.004180+0000","last_fullsized":"2024-03-09T15:22:07.004180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:14.047597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046218+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T15:21:57.046218+0000","last_peered":"2024-03-09T15:21:57.046218+0000","last_clean":"2024-03-09T15:21:57.046218+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:21:57.046218+0000","last_undegraded":"2024-03-09T15:21:57.046218+0000","last_fullsized":"2024-03-09T15:21:57.046218+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:25:40.528352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'144","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.742914+0000","last_change":"2024-03-09T14:21:54.370907+0000","last_active":"2024-03-09T15:24:14.742914+0000","last_peered":"2024-03-09T15:24:14.742914+0000","last_clean":"2024-03-09T15:24:14.742914+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:24:14.742914+0000","last_undegraded":"2024-03-09T15:24:14.742914+0000","last_fullsized":"2024-03-09T15:24:14.742914+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:00.830027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534362,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":317,"num_read_kb":13701,"num_write":829,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024862+0000","last_change":"2024-03-09T14:21:58.370284+0000","last_active":"2024-03-09T15:20:32.024862+0000","last_peered":"2024-03-09T15:20:32.024862+0000","last_clean":"2024-03-09T15:20:32.024862+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:20:32.024862+0000","last_undegraded":"2024-03-09T15:20:32.024862+0000","last_fullsized":"2024-03-09T15:20:32.024862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:59.246060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'720","reported_seq":2322,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.019434+0000","last_change":"2024-03-09T14:22:00.388074+0000","last_active":"2024-03-09T15:24:32.019434+0000","last_peered":"2024-03-09T15:24:32.019434+0000","last_clean":"2024-03-09T15:24:32.019434+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:24:32.019434+0000","last_undegraded":"2024-03-09T15:24:32.019434+0000","last_fullsized":"2024-03-09T15:24:32.019434+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:01.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24809,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":1092,"num_write":352,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163647+0000","last_change":"2024-03-09T14:22:02.392515+0000","last_active":"2024-03-09T15:20:32.163647+0000","last_peered":"2024-03-09T15:20:32.163647+0000","last_clean":"2024-03-09T15:20:32.163647+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:20:32.163647+0000","last_undegraded":"2024-03-09T15:20:32.163647+0000","last_fullsized":"2024-03-09T15:20:32.163647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:41.546333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'158","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:46.996025+0000","last_change":"2024-03-09T14:22:04.397452+0000","last_active":"2024-03-09T15:20:46.996025+0000","last_peered":"2024-03-09T15:20:46.996025+0000","last_clean":"2024-03-09T15:20:46.996025+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:20:46.996025+0000","last_undegraded":"2024-03-09T15:20:46.996025+0000","last_fullsized":"2024-03-09T15:20:46.996025+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:18:25.696387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":803,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.018038+0000","last_change":"2024-03-09T14:21:56.356659+0000","last_active":"2024-03-09T15:22:56.018038+0000","last_peered":"2024-03-09T15:22:56.018038+0000","last_clean":"2024-03-09T15:22:56.018038+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:22:56.018038+0000","last_undegraded":"2024-03-09T15:22:56.018038+0000","last_fullsized":"2024-03-09T15:22:56.018038+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.345499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'130","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.022807+0000","last_change":"2024-03-09T14:22:31.510611+0000","last_active":"2024-03-09T15:23:23.022807+0000","last_peered":"2024-03-09T15:23:23.022807+0000","last_clean":"2024-03-09T15:23:23.022807+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:23:23.022807+0000","last_undegraded":"2024-03-09T15:23:23.022807+0000","last_fullsized":"2024-03-09T15:23:23.022807+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:42.545379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16317048,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":310,"num_read_kb":4172,"num_write":716,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.018367+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T15:22:07.018367+0000","last_peered":"2024-03-09T15:22:07.018367+0000","last_clean":"2024-03-09T15:22:07.018367+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:22:07.018367+0000","last_undegraded":"2024-03-09T15:22:07.018367+0000","last_fullsized":"2024-03-09T15:22:07.018367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019477+0000","last_change":"2024-03-09T14:21:58.372306+0000","last_active":"2024-03-09T15:22:17.019477+0000","last_peered":"2024-03-09T15:22:17.019477+0000","last_clean":"2024-03-09T15:22:17.019477+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:22:17.019477+0000","last_undegraded":"2024-03-09T15:22:17.019477+0000","last_fullsized":"2024-03-09T15:22:17.019477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:31.060450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'334","reported_seq":1051,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.846598+0000","last_change":"2024-03-09T14:22:00.492596+0000","last_active":"2024-03-09T15:24:30.846598+0000","last_peered":"2024-03-09T15:24:30.846598+0000","last_clean":"2024-03-09T15:24:30.846598+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:24:30.846598+0000","last_undegraded":"2024-03-09T15:24:30.846598+0000","last_fullsized":"2024-03-09T15:24:30.846598+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:55.986088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40546,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":636,"num_write":246,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.020677+0000","last_change":"2024-03-09T14:22:02.401629+0000","last_active":"2024-03-09T15:22:27.020677+0000","last_peered":"2024-03-09T15:22:27.020677+0000","last_clean":"2024-03-09T15:22:27.020677+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:22:27.020677+0000","last_undegraded":"2024-03-09T15:22:27.020677+0000","last_fullsized":"2024-03-09T15:22:27.020677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:24.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'144","reported_seq":634,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.827582+0000","last_change":"2024-03-09T14:22:04.400992+0000","last_active":"2024-03-09T15:23:33.827582+0000","last_peered":"2024-03-09T15:23:33.827582+0000","last_clean":"2024-03-09T15:23:33.827582+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:23:33.827582+0000","last_undegraded":"2024-03-09T15:23:33.827582+0000","last_fullsized":"2024-03-09T15:23:33.827582+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:22.181899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":758,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018863+0000","last_change":"2024-03-09T14:21:56.367601+0000","last_active":"2024-03-09T15:22:12.018863+0000","last_peered":"2024-03-09T15:22:12.018863+0000","last_clean":"2024-03-09T15:22:12.018863+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:22:12.018863+0000","last_undegraded":"2024-03-09T15:22:12.018863+0000","last_fullsized":"2024-03-09T15:22:12.018863+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:01.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'185","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.713042+0000","last_change":"2024-03-09T14:21:54.358356+0000","last_active":"2024-03-09T15:22:38.713042+0000","last_peered":"2024-03-09T15:22:38.713042+0000","last_clean":"2024-03-09T15:22:38.713042+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:22:38.713042+0000","last_undegraded":"2024-03-09T15:22:38.713042+0000","last_fullsized":"2024-03-09T15:22:38.713042+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:19.858694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263493,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":43067,"num_write":1016,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.164751+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T15:22:12.164751+0000","last_peered":"2024-03-09T15:22:12.164751+0000","last_clean":"2024-03-09T15:22:12.164751+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:22:12.164751+0000","last_undegraded":"2024-03-09T15:22:12.164751+0000","last_fullsized":"2024-03-09T15:22:12.164751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166771+0000","last_change":"2024-03-09T14:21:58.373524+0000","last_active":"2024-03-09T15:22:27.166771+0000","last_peered":"2024-03-09T15:22:27.166771+0000","last_clean":"2024-03-09T15:22:27.166771+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:22:27.166771+0000","last_undegraded":"2024-03-09T15:22:27.166771+0000","last_fullsized":"2024-03-09T15:22:27.166771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:39.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'122","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.450139+0000","last_change":"2024-03-09T14:22:00.386056+0000","last_active":"2024-03-09T15:22:36.450139+0000","last_peered":"2024-03-09T15:22:36.450139+0000","last_clean":"2024-03-09T15:22:36.450139+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:22:36.450139+0000","last_undegraded":"2024-03-09T15:22:36.450139+0000","last_fullsized":"2024-03-09T15:22:36.450139+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:40.186793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'545","reported_seq":4158,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.038330+0000","last_change":"2024-03-09T14:22:02.399139+0000","last_active":"2024-03-09T15:24:32.038330+0000","last_peered":"2024-03-09T15:24:32.038330+0000","last_clean":"2024-03-09T15:24:32.038330+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:24:32.038330+0000","last_undegraded":"2024-03-09T15:24:32.038330+0000","last_fullsized":"2024-03-09T15:24:32.038330+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:34.998650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'182","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.340909+0000","last_change":"2024-03-09T14:22:04.405073+0000","last_active":"2024-03-09T15:22:41.340909+0000","last_peered":"2024-03-09T15:22:41.340909+0000","last_clean":"2024-03-09T15:22:41.340909+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:22:41.340909+0000","last_undegraded":"2024-03-09T15:22:41.340909+0000","last_fullsized":"2024-03-09T15:22:41.340909+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:37.566660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.421696+0000","last_change":"2024-03-09T14:21:56.370846+0000","last_active":"2024-03-09T15:23:04.421696+0000","last_peered":"2024-03-09T15:23:04.421696+0000","last_clean":"2024-03-09T15:23:04.421696+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:23:04.421696+0000","last_undegraded":"2024-03-09T15:23:04.421696+0000","last_fullsized":"2024-03-09T15:23:04.421696+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:27:16.582369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'206","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006017+0000","last_change":"2024-03-09T14:21:54.370705+0000","last_active":"2024-03-09T15:22:22.006017+0000","last_peered":"2024-03-09T15:22:22.006017+0000","last_clean":"2024-03-09T15:22:22.006017+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:22:22.006017+0000","last_undegraded":"2024-03-09T15:22:22.006017+0000","last_fullsized":"2024-03-09T15:22:22.006017+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:43.848851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11138561,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":117883,"num_write":1117,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040120+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T15:22:17.040120+0000","last_peered":"2024-03-09T15:22:17.040120+0000","last_clean":"2024-03-09T15:22:17.040120+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:22:17.040120+0000","last_undegraded":"2024-03-09T15:22:17.040120+0000","last_fullsized":"2024-03-09T15:22:17.040120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:38.232466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041830+0000","last_change":"2024-03-09T14:21:58.371830+0000","last_active":"2024-03-09T15:22:27.041830+0000","last_peered":"2024-03-09T15:22:27.041830+0000","last_clean":"2024-03-09T15:22:27.041830+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:22:27.041830+0000","last_undegraded":"2024-03-09T15:22:27.041830+0000","last_fullsized":"2024-03-09T15:22:27.041830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:28.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'237","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.056546+0000","last_change":"2024-03-09T14:22:00.492643+0000","last_active":"2024-03-09T15:24:31.056546+0000","last_peered":"2024-03-09T15:24:31.056546+0000","last_clean":"2024-03-09T15:24:31.056546+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:24:31.056546+0000","last_undegraded":"2024-03-09T15:24:31.056546+0000","last_fullsized":"2024-03-09T15:24:31.056546+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:59.553996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'538","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.884147+0000","last_change":"2024-03-09T14:22:02.395536+0000","last_active":"2024-03-09T15:24:30.884147+0000","last_peered":"2024-03-09T15:24:30.884147+0000","last_clean":"2024-03-09T15:24:30.884147+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:30.884147+0000","last_undegraded":"2024-03-09T15:24:30.884147+0000","last_fullsized":"2024-03-09T15:24:30.884147+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:34.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'116","reported_seq":608,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:07.027423+0000","last_change":"2024-03-09T14:22:04.405236+0000","last_active":"2024-03-09T15:23:07.027423+0000","last_peered":"2024-03-09T15:23:07.027423+0000","last_clean":"2024-03-09T15:23:07.027423+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:23:07.027423+0000","last_undegraded":"2024-03-09T15:23:07.027423+0000","last_fullsized":"2024-03-09T15:23:07.027423+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:17.271331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.005976+0000","last_change":"2024-03-09T14:21:56.359311+0000","last_active":"2024-03-09T15:22:22.005976+0000","last_peered":"2024-03-09T15:22:22.005976+0000","last_clean":"2024-03-09T15:22:22.005976+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:22:22.005976+0000","last_undegraded":"2024-03-09T15:22:22.005976+0000","last_fullsized":"2024-03-09T15:22:22.005976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:45.357583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'192","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042519+0000","last_change":"2024-03-09T14:21:54.371711+0000","last_active":"2024-03-09T15:22:32.042519+0000","last_peered":"2024-03-09T15:22:32.042519+0000","last_clean":"2024-03-09T15:22:32.042519+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:22:32.042519+0000","last_undegraded":"2024-03-09T15:22:32.042519+0000","last_fullsized":"2024-03-09T15:22:32.042519+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:21.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15704678,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":52342,"num_write":1099,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040153+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T15:22:17.040153+0000","last_peered":"2024-03-09T15:22:17.040153+0000","last_clean":"2024-03-09T15:22:17.040153+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:22:17.040153+0000","last_undegraded":"2024-03-09T15:22:17.040153+0000","last_fullsized":"2024-03-09T15:22:17.040153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:58.533776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908142+0000","last_change":"2024-03-09T14:21:58.369587+0000","last_active":"2024-03-09T15:22:26.908142+0000","last_peered":"2024-03-09T15:22:26.908142+0000","last_clean":"2024-03-09T15:22:26.908142+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:22:26.908142+0000","last_undegraded":"2024-03-09T15:22:26.908142+0000","last_fullsized":"2024-03-09T15:22:26.908142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:01.184512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'270","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.842459+0000","last_change":"2024-03-09T14:22:00.386745+0000","last_active":"2024-03-09T15:24:30.842459+0000","last_peered":"2024-03-09T15:24:30.842459+0000","last_clean":"2024-03-09T15:24:30.842459+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:24:30.842459+0000","last_undegraded":"2024-03-09T15:24:30.842459+0000","last_fullsized":"2024-03-09T15:24:30.842459+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:58.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18542,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":518,"num_write":220,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166791+0000","last_change":"2024-03-09T14:22:02.400357+0000","last_active":"2024-03-09T15:22:27.166791+0000","last_peered":"2024-03-09T15:22:27.166791+0000","last_clean":"2024-03-09T15:22:27.166791+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:22:27.166791+0000","last_undegraded":"2024-03-09T15:22:27.166791+0000","last_fullsized":"2024-03-09T15:22:27.166791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:34.726729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'185","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.397957+0000","last_change":"2024-03-09T14:22:04.402392+0000","last_active":"2024-03-09T15:23:42.397957+0000","last_peered":"2024-03-09T15:23:42.397957+0000","last_clean":"2024-03-09T15:23:42.397957+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:23:42.397957+0000","last_undegraded":"2024-03-09T15:23:42.397957+0000","last_fullsized":"2024-03-09T15:23:42.397957+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:54.527353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'134","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:31.908737+0000","last_change":"2024-03-09T14:22:04.401080+0000","last_active":"2024-03-09T15:22:31.908737+0000","last_peered":"2024-03-09T15:22:31.908737+0000","last_clean":"2024-03-09T15:22:31.908737+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:22:31.908737+0000","last_undegraded":"2024-03-09T15:22:31.908737+0000","last_fullsized":"2024-03-09T15:22:31.908737+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:15.758082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4672,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.508782+0000","last_change":"2024-03-09T14:21:56.355418+0000","last_active":"2024-03-09T15:21:01.508782+0000","last_peered":"2024-03-09T15:21:01.508782+0000","last_clean":"2024-03-09T15:21:01.508782+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:21:01.508782+0000","last_undegraded":"2024-03-09T15:21:01.508782+0000","last_fullsized":"2024-03-09T15:21:01.508782+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:03.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'145","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.147275+0000","last_change":"2024-03-09T14:21:54.362232+0000","last_active":"2024-03-09T15:20:22.147275+0000","last_peered":"2024-03-09T15:20:22.147275+0000","last_clean":"2024-03-09T15:20:22.147275+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:20:22.147275+0000","last_undegraded":"2024-03-09T15:20:22.147275+0000","last_fullsized":"2024-03-09T15:20:22.147275+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:27.911421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8673473,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":29246,"num_write":811,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.993238+0000","last_change":"2024-03-09T14:21:58.371454+0000","last_active":"2024-03-09T15:20:21.993238+0000","last_peered":"2024-03-09T15:20:21.993238+0000","last_clean":"2024-03-09T15:20:21.993238+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:20:21.993238+0000","last_undegraded":"2024-03-09T15:20:21.993238+0000","last_fullsized":"2024-03-09T15:20:21.993238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:42.569021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'142","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:42.022643+0000","last_change":"2024-03-09T14:22:00.386530+0000","last_active":"2024-03-09T15:22:42.022643+0000","last_peered":"2024-03-09T15:22:42.022643+0000","last_clean":"2024-03-09T15:22:42.022643+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:22:42.022643+0000","last_undegraded":"2024-03-09T15:22:42.022643+0000","last_fullsized":"2024-03-09T15:22:42.022643+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:02.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14541,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":279,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005572+0000","last_change":"2024-03-09T14:22:02.399358+0000","last_active":"2024-03-09T15:20:22.005572+0000","last_peered":"2024-03-09T15:20:22.005572+0000","last_clean":"2024-03-09T15:20:22.005572+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:20:22.005572+0000","last_undegraded":"2024-03-09T15:20:22.005572+0000","last_fullsized":"2024-03-09T15:20:22.005572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:26.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020178+0000","last_change":"2024-03-09T14:22:04.403191+0000","last_active":"2024-03-09T15:22:22.020178+0000","last_peered":"2024-03-09T15:22:22.020178+0000","last_clean":"2024-03-09T15:22:22.020178+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:22:22.020178+0000","last_undegraded":"2024-03-09T15:22:22.020178+0000","last_fullsized":"2024-03-09T15:22:22.020178+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:51.085844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4078","reported_seq":4649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992713+0000","last_change":"2024-03-09T14:21:56.365718+0000","last_active":"2024-03-09T15:20:16.992713+0000","last_peered":"2024-03-09T15:20:16.992713+0000","last_clean":"2024-03-09T15:20:16.992713+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:20:16.992713+0000","last_undegraded":"2024-03-09T15:20:16.992713+0000","last_fullsized":"2024-03-09T15:20:16.992713+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:52.273131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'199","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.158041+0000","last_change":"2024-03-09T14:21:54.370617+0000","last_active":"2024-03-09T15:19:57.158041+0000","last_peered":"2024-03-09T15:19:57.158041+0000","last_clean":"2024-03-09T15:19:57.158041+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:19:57.158041+0000","last_undegraded":"2024-03-09T15:19:57.158041+0000","last_fullsized":"2024-03-09T15:19:57.158041+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:10.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559776,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":34556,"num_write":1088,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005680+0000","last_change":"2024-03-09T14:21:58.373073+0000","last_active":"2024-03-09T15:20:22.005680+0000","last_peered":"2024-03-09T15:20:22.005680+0000","last_clean":"2024-03-09T15:20:22.005680+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:20:22.005680+0000","last_undegraded":"2024-03-09T15:20:22.005680+0000","last_fullsized":"2024-03-09T15:20:22.005680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:00.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'44","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.028912+0000","last_change":"2024-03-09T14:22:00.389956+0000","last_active":"2024-03-09T15:22:36.028912+0000","last_peered":"2024-03-09T15:22:36.028912+0000","last_clean":"2024-03-09T15:22:36.028912+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:22:36.028912+0000","last_undegraded":"2024-03-09T15:22:36.028912+0000","last_fullsized":"2024-03-09T15:22:36.028912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:40.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161788+0000","last_change":"2024-03-09T14:22:02.397849+0000","last_active":"2024-03-09T15:20:22.161788+0000","last_peered":"2024-03-09T15:20:22.161788+0000","last_clean":"2024-03-09T15:20:22.161788+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:20:22.161788+0000","last_undegraded":"2024-03-09T15:20:22.161788+0000","last_fullsized":"2024-03-09T15:20:22.161788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:48.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'189","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.006224+0000","last_change":"2024-03-09T14:22:04.401057+0000","last_active":"2024-03-09T15:22:56.006224+0000","last_peered":"2024-03-09T15:22:56.006224+0000","last_clean":"2024-03-09T15:22:56.006224+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:22:56.006224+0000","last_undegraded":"2024-03-09T15:22:56.006224+0000","last_fullsized":"2024-03-09T15:22:56.006224+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:30.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004987+0000","last_change":"2024-03-09T14:21:56.360219+0000","last_active":"2024-03-09T15:20:17.004987+0000","last_peered":"2024-03-09T15:20:17.004987+0000","last_clean":"2024-03-09T15:20:17.004987+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:20:17.004987+0000","last_undegraded":"2024-03-09T15:20:17.004987+0000","last_fullsized":"2024-03-09T15:20:17.004987+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:44:55.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'138","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.610242+0000","last_change":"2024-03-09T14:21:54.360121+0000","last_active":"2024-03-09T15:20:13.610242+0000","last_peered":"2024-03-09T15:20:13.610242+0000","last_clean":"2024-03-09T15:20:13.610242+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:20:13.610242+0000","last_undegraded":"2024-03-09T15:20:13.610242+0000","last_fullsized":"2024-03-09T15:20:13.610242+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:23.649957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10522711,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":77468,"num_write":817,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161750+0000","last_change":"2024-03-09T14:21:58.371755+0000","last_active":"2024-03-09T15:20:22.161750+0000","last_peered":"2024-03-09T15:20:22.161750+0000","last_clean":"2024-03-09T15:20:22.161750+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:20:22.161750+0000","last_undegraded":"2024-03-09T15:20:22.161750+0000","last_fullsized":"2024-03-09T15:20:22.161750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:18.384428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'168","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.899211+0000","last_change":"2024-03-09T14:22:00.388758+0000","last_active":"2024-03-09T15:23:32.899211+0000","last_peered":"2024-03-09T15:23:32.899211+0000","last_clean":"2024-03-09T15:23:32.899211+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:23:32.899211+0000","last_undegraded":"2024-03-09T15:23:32.899211+0000","last_fullsized":"2024-03-09T15:23:32.899211+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:21.509939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12325,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":274,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023321+0000","last_change":"2024-03-09T14:22:02.401182+0000","last_active":"2024-03-09T15:20:22.023321+0000","last_peered":"2024-03-09T15:20:22.023321+0000","last_clean":"2024-03-09T15:20:22.023321+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:20:22.023321+0000","last_undegraded":"2024-03-09T15:20:22.023321+0000","last_fullsized":"2024-03-09T15:20:22.023321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:34.573612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'123","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.171935+0000","last_change":"2024-03-09T14:22:04.400641+0000","last_active":"2024-03-09T15:23:15.171935+0000","last_peered":"2024-03-09T15:23:15.171935+0000","last_clean":"2024-03-09T15:23:15.171935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:23:15.171935+0000","last_undegraded":"2024-03-09T15:23:15.171935+0000","last_fullsized":"2024-03-09T15:23:15.171935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:41.104332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004952+0000","last_change":"2024-03-09T14:21:56.353346+0000","last_active":"2024-03-09T15:20:17.004952+0000","last_peered":"2024-03-09T15:20:17.004952+0000","last_clean":"2024-03-09T15:20:17.004952+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:20:17.004952+0000","last_undegraded":"2024-03-09T15:20:17.004952+0000","last_fullsized":"2024-03-09T15:20:17.004952+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:34.741252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'173","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.741970+0000","last_change":"2024-03-09T14:21:54.368774+0000","last_active":"2024-03-09T15:24:14.741970+0000","last_peered":"2024-03-09T15:24:14.741970+0000","last_clean":"2024-03-09T15:24:14.741970+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:24:14.741970+0000","last_undegraded":"2024-03-09T15:24:14.741970+0000","last_fullsized":"2024-03-09T15:24:14.741970+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:07.130860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28356633,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":367,"num_read_kb":57120,"num_write":926,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023278+0000","last_change":"2024-03-09T14:21:58.371834+0000","last_active":"2024-03-09T15:20:22.023278+0000","last_peered":"2024-03-09T15:20:22.023278+0000","last_clean":"2024-03-09T15:20:22.023278+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:20:22.023278+0000","last_undegraded":"2024-03-09T15:20:22.023278+0000","last_fullsized":"2024-03-09T15:20:22.023278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:41.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'143","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.057027+0000","last_change":"2024-03-09T14:22:00.383681+0000","last_active":"2024-03-09T15:22:58.057027+0000","last_peered":"2024-03-09T15:22:58.057027+0000","last_clean":"2024-03-09T15:22:58.057027+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:22:58.057027+0000","last_undegraded":"2024-03-09T15:22:58.057027+0000","last_fullsized":"2024-03-09T15:22:58.057027+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:07.824315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":242,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.998738+0000","last_change":"2024-03-09T14:22:02.402801+0000","last_active":"2024-03-09T15:20:21.998738+0000","last_peered":"2024-03-09T15:20:21.998738+0000","last_clean":"2024-03-09T15:20:21.998738+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:20:21.998738+0000","last_undegraded":"2024-03-09T15:20:21.998738+0000","last_fullsized":"2024-03-09T15:20:21.998738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:42.052921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.177922+0000","last_change":"2024-03-09T14:21:56.355621+0000","last_active":"2024-03-09T15:23:15.177922+0000","last_peered":"2024-03-09T15:23:15.177922+0000","last_clean":"2024-03-09T15:23:15.177922+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:23:15.177922+0000","last_undegraded":"2024-03-09T15:23:15.177922+0000","last_fullsized":"2024-03-09T15:23:15.177922+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:48:40.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'186","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002294+0000","last_change":"2024-03-09T14:21:54.361543+0000","last_active":"2024-03-09T15:19:57.002294+0000","last_peered":"2024-03-09T15:19:57.002294+0000","last_clean":"2024-03-09T15:19:57.002294+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:19:57.002294+0000","last_undegraded":"2024-03-09T15:19:57.002294+0000","last_fullsized":"2024-03-09T15:19:57.002294+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:42.544106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11056654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":29766,"num_write":1069,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907526+0000","last_change":"2024-03-09T14:21:58.370949+0000","last_active":"2024-03-09T15:22:21.907526+0000","last_peered":"2024-03-09T15:22:21.907526+0000","last_clean":"2024-03-09T15:22:21.907526+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:22:21.907526+0000","last_undegraded":"2024-03-09T15:22:21.907526+0000","last_fullsized":"2024-03-09T15:22:21.907526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:55.442426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'213","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.862351+0000","last_change":"2024-03-09T14:22:00.386952+0000","last_active":"2024-03-09T15:24:30.862351+0000","last_peered":"2024-03-09T15:24:30.862351+0000","last_clean":"2024-03-09T15:24:30.862351+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:24:30.862351+0000","last_undegraded":"2024-03-09T15:24:30.862351+0000","last_fullsized":"2024-03-09T15:24:30.862351+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:12.101312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23073,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":315,"num_read_kb":453,"num_write":204,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038100+0000","last_change":"2024-03-09T14:22:02.402061+0000","last_active":"2024-03-09T15:22:02.038100+0000","last_peered":"2024-03-09T15:22:02.038100+0000","last_clean":"2024-03-09T15:22:02.038100+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:22:02.038100+0000","last_undegraded":"2024-03-09T15:22:02.038100+0000","last_fullsized":"2024-03-09T15:22:02.038100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:24.862935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'174","reported_seq":686,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.819989+0000","last_change":"2024-03-09T14:22:04.404476+0000","last_active":"2024-03-09T15:23:33.819989+0000","last_peered":"2024-03-09T15:23:33.819989+0000","last_clean":"2024-03-09T15:23:33.819989+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:23:33.819989+0000","last_undegraded":"2024-03-09T15:23:33.819989+0000","last_fullsized":"2024-03-09T15:23:33.819989+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:11.852013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:16.906878+0000","last_change":"2024-03-09T14:21:56.366627+0000","last_active":"2024-03-09T15:22:16.906878+0000","last_peered":"2024-03-09T15:22:16.906878+0000","last_clean":"2024-03-09T15:22:16.906878+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:22:16.906878+0000","last_undegraded":"2024-03-09T15:22:16.906878+0000","last_fullsized":"2024-03-09T15:22:16.906878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:53.735520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'314","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.991593+0000","last_change":"2024-03-09T14:21:54.370005+0000","last_active":"2024-03-09T15:20:06.991593+0000","last_peered":"2024-03-09T15:20:06.991593+0000","last_clean":"2024-03-09T15:20:06.991593+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:20:06.991593+0000","last_undegraded":"2024-03-09T15:20:06.991593+0000","last_fullsized":"2024-03-09T15:20:06.991593+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:34.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19923144,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":20523,"num_write":1603,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041888+0000","last_change":"2024-03-09T14:21:58.372204+0000","last_active":"2024-03-09T15:22:27.041888+0000","last_peered":"2024-03-09T15:22:27.041888+0000","last_clean":"2024-03-09T15:22:27.041888+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:22:27.041888+0000","last_undegraded":"2024-03-09T15:22:27.041888+0000","last_fullsized":"2024-03-09T15:22:27.041888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:24.041345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'177","reported_seq":767,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.838251+0000","last_change":"2024-03-09T14:22:00.384248+0000","last_active":"2024-03-09T15:24:30.838251+0000","last_peered":"2024-03-09T15:24:30.838251+0000","last_clean":"2024-03-09T15:24:30.838251+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:24:30.838251+0000","last_undegraded":"2024-03-09T15:24:30.838251+0000","last_fullsized":"2024-03-09T15:24:30.838251+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:27.943625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":321,"num_write":172,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003643+0000","last_change":"2024-03-09T14:22:02.397994+0000","last_active":"2024-03-09T15:22:02.003643+0000","last_peered":"2024-03-09T15:22:02.003643+0000","last_clean":"2024-03-09T15:22:02.003643+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:22:02.003643+0000","last_undegraded":"2024-03-09T15:22:02.003643+0000","last_fullsized":"2024-03-09T15:22:02.003643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:49.447597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'169","reported_seq":1359,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:29.026404+0000","last_change":"2024-03-09T14:22:04.398055+0000","last_active":"2024-03-09T15:24:29.026404+0000","last_peered":"2024-03-09T15:24:29.026404+0000","last_clean":"2024-03-09T15:24:29.026404+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:24:29.026404+0000","last_undegraded":"2024-03-09T15:24:29.026404+0000","last_fullsized":"2024-03-09T15:24:29.026404+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:45:27.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.795535+0000","last_change":"2024-03-09T14:21:56.352420+0000","last_active":"2024-03-09T15:22:38.795535+0000","last_peered":"2024-03-09T15:22:38.795535+0000","last_clean":"2024-03-09T15:22:38.795535+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:22:38.795535+0000","last_undegraded":"2024-03-09T15:22:38.795535+0000","last_fullsized":"2024-03-09T15:22:38.795535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:39.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'178","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.989620+0000","last_change":"2024-03-09T14:22:31.509702+0000","last_active":"2024-03-09T15:20:01.989620+0000","last_peered":"2024-03-09T15:20:01.989620+0000","last_clean":"2024-03-09T15:20:01.989620+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:20:01.989620+0000","last_undegraded":"2024-03-09T15:20:01.989620+0000","last_fullsized":"2024-03-09T15:20:01.989620+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:06.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324902,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":395,"num_read_kb":42859,"num_write":1105,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163221+0000","last_change":"2024-03-09T14:21:58.373433+0000","last_active":"2024-03-09T15:22:02.163221+0000","last_peered":"2024-03-09T15:22:02.163221+0000","last_clean":"2024-03-09T15:22:02.163221+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:22:02.163221+0000","last_undegraded":"2024-03-09T15:22:02.163221+0000","last_fullsized":"2024-03-09T15:22:02.163221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:25.282408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'141","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.859792+0000","last_change":"2024-03-09T14:22:00.493124+0000","last_active":"2024-03-09T15:24:30.859792+0000","last_peered":"2024-03-09T15:24:30.859792+0000","last_clean":"2024-03-09T15:24:30.859792+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:24:30.859792+0000","last_undegraded":"2024-03-09T15:24:30.859792+0000","last_fullsized":"2024-03-09T15:24:30.859792+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:05.031002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7694,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":253,"num_write":106,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.004846+0000","last_change":"2024-03-09T14:22:02.402300+0000","last_active":"2024-03-09T15:22:12.004846+0000","last_peered":"2024-03-09T15:22:12.004846+0000","last_clean":"2024-03-09T15:22:12.004846+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:22:12.004846+0000","last_undegraded":"2024-03-09T15:22:12.004846+0000","last_fullsized":"2024-03-09T15:22:12.004846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:54.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'107","reported_seq":599,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.867392+0000","last_change":"2024-03-09T14:22:04.400295+0000","last_active":"2024-03-09T15:24:30.867392+0000","last_peered":"2024-03-09T15:24:30.867392+0000","last_clean":"2024-03-09T15:24:30.867392+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:30.867392+0000","last_undegraded":"2024-03-09T15:24:30.867392+0000","last_fullsized":"2024-03-09T15:24:30.867392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:31.557973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.001414+0000","last_change":"2024-03-09T14:21:56.368701+0000","last_active":"2024-03-09T15:21:57.001414+0000","last_peered":"2024-03-09T15:21:57.001414+0000","last_clean":"2024-03-09T15:21:57.001414+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:21:57.001414+0000","last_undegraded":"2024-03-09T15:21:57.001414+0000","last_fullsized":"2024-03-09T15:21:57.001414+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:17.172991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'194","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904492+0000","last_change":"2024-03-09T14:22:31.527571+0000","last_active":"2024-03-09T15:21:56.904492+0000","last_peered":"2024-03-09T15:21:56.904492+0000","last_clean":"2024-03-09T15:21:56.904492+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:21:56.904492+0000","last_undegraded":"2024-03-09T15:21:56.904492+0000","last_fullsized":"2024-03-09T15:21:56.904492+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:45.724834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14734205,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":417,"num_read_kb":96221,"num_write":1017,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003663+0000","last_change":"2024-03-09T14:21:58.369956+0000","last_active":"2024-03-09T15:22:02.003663+0000","last_peered":"2024-03-09T15:22:02.003663+0000","last_clean":"2024-03-09T15:22:02.003663+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:22:02.003663+0000","last_undegraded":"2024-03-09T15:22:02.003663+0000","last_fullsized":"2024-03-09T15:22:02.003663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:20.111905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'103","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.471989+0000","last_change":"2024-03-09T14:22:00.492818+0000","last_active":"2024-03-09T15:22:36.471989+0000","last_peered":"2024-03-09T15:22:36.471989+0000","last_clean":"2024-03-09T15:22:36.471989+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:22:36.471989+0000","last_undegraded":"2024-03-09T15:22:36.471989+0000","last_fullsized":"2024-03-09T15:22:36.471989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:19:37.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'504","reported_seq":2243,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.060051+0000","last_change":"2024-03-09T14:22:02.396058+0000","last_active":"2024-03-09T15:24:32.060051+0000","last_peered":"2024-03-09T15:24:32.060051+0000","last_clean":"2024-03-09T15:24:32.060051+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:32.060051+0000","last_undegraded":"2024-03-09T15:24:32.060051+0000","last_fullsized":"2024-03-09T15:24:32.060051+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:28:12.304576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.043783+0000","last_change":"2024-03-09T14:22:04.400380+0000","last_active":"2024-03-09T15:23:16.043783+0000","last_peered":"2024-03-09T15:23:16.043783+0000","last_clean":"2024-03-09T15:23:16.043783+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:23:16.043783+0000","last_undegraded":"2024-03-09T15:23:16.043783+0000","last_fullsized":"2024-03-09T15:23:16.043783+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:28.603631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.417821+0000","last_change":"2024-03-09T14:21:56.352673+0000","last_active":"2024-03-09T15:23:44.417821+0000","last_peered":"2024-03-09T15:23:44.417821+0000","last_clean":"2024-03-09T15:23:44.417821+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:23:44.417821+0000","last_undegraded":"2024-03-09T15:23:44.417821+0000","last_fullsized":"2024-03-09T15:23:44.417821+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:05.415890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'145","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.037245+0000","last_change":"2024-03-09T14:21:54.361414+0000","last_active":"2024-03-09T15:21:57.037245+0000","last_peered":"2024-03-09T15:21:57.037245+0000","last_clean":"2024-03-09T15:21:57.037245+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:21:57.037245+0000","last_undegraded":"2024-03-09T15:21:57.037245+0000","last_fullsized":"2024-03-09T15:21:57.037245+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:31.236227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11643525,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":322,"num_read_kb":36416,"num_write":865,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047170+0000","last_change":"2024-03-09T14:21:58.368512+0000","last_active":"2024-03-09T15:22:02.047170+0000","last_peered":"2024-03-09T15:22:02.047170+0000","last_clean":"2024-03-09T15:22:02.047170+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:22:02.047170+0000","last_undegraded":"2024-03-09T15:22:02.047170+0000","last_fullsized":"2024-03-09T15:22:02.047170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:42.028813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'171","reported_seq":761,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.181529+0000","last_change":"2024-03-09T14:22:00.386165+0000","last_active":"2024-03-09T15:22:50.181529+0000","last_peered":"2024-03-09T15:22:50.181529+0000","last_clean":"2024-03-09T15:22:50.181529+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:22:50.181529+0000","last_undegraded":"2024-03-09T15:22:50.181529+0000","last_fullsized":"2024-03-09T15:22:50.181529+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:03.010266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8115,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":286,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996260+0000","last_change":"2024-03-09T14:22:02.398377+0000","last_active":"2024-03-09T15:20:01.996260+0000","last_peered":"2024-03-09T15:20:01.996260+0000","last_clean":"2024-03-09T15:20:01.996260+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:20:01.996260+0000","last_undegraded":"2024-03-09T15:20:01.996260+0000","last_fullsized":"2024-03-09T15:20:01.996260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:14:54.574464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'108","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:43.269705+0000","last_change":"2024-03-09T14:22:04.405953+0000","last_active":"2024-03-09T15:23:43.269705+0000","last_peered":"2024-03-09T15:23:43.269705+0000","last_clean":"2024-03-09T15:23:43.269705+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:23:43.269705+0000","last_undegraded":"2024-03-09T15:23:43.269705+0000","last_fullsized":"2024-03-09T15:23:43.269705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:28:15.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162368+0000","last_change":"2024-03-09T14:21:56.352123+0000","last_active":"2024-03-09T15:21:57.162368+0000","last_peered":"2024-03-09T15:21:57.162368+0000","last_clean":"2024-03-09T15:21:57.162368+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:21:57.162368+0000","last_undegraded":"2024-03-09T15:21:57.162368+0000","last_fullsized":"2024-03-09T15:21:57.162368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:01.770090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'163","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:15.251405+0000","last_change":"2024-03-09T14:21:54.371725+0000","last_active":"2024-03-09T15:24:15.251405+0000","last_peered":"2024-03-09T15:24:15.251405+0000","last_clean":"2024-03-09T15:24:15.251405+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:24:15.251405+0000","last_undegraded":"2024-03-09T15:24:15.251405+0000","last_fullsized":"2024-03-09T15:24:15.251405+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:57.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11077075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":381,"num_read_kb":54818,"num_write":995,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038072+0000","last_change":"2024-03-09T14:21:58.374073+0000","last_active":"2024-03-09T15:22:02.038072+0000","last_peered":"2024-03-09T15:22:02.038072+0000","last_clean":"2024-03-09T15:22:02.038072+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:22:02.038072+0000","last_undegraded":"2024-03-09T15:22:02.038072+0000","last_fullsized":"2024-03-09T15:22:02.038072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:43.159760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'132","reported_seq":696,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:33.648119+0000","last_change":"2024-03-09T14:22:00.384316+0000","last_active":"2024-03-09T15:22:33.648119+0000","last_peered":"2024-03-09T15:22:33.648119+0000","last_clean":"2024-03-09T15:22:33.648119+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:22:33.648119+0000","last_undegraded":"2024-03-09T15:22:33.648119+0000","last_fullsized":"2024-03-09T15:22:33.648119+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:49.725490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6560,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":215,"num_write":90,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021797+0000","last_change":"2024-03-09T14:22:02.396214+0000","last_active":"2024-03-09T15:20:12.021797+0000","last_peered":"2024-03-09T15:20:12.021797+0000","last_clean":"2024-03-09T15:20:12.021797+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:20:12.021797+0000","last_undegraded":"2024-03-09T15:20:12.021797+0000","last_fullsized":"2024-03-09T15:20:12.021797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:36.788962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'96","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.124529+0000","last_change":"2024-03-09T14:22:04.402457+0000","last_active":"2024-03-09T15:22:43.124529+0000","last_peered":"2024-03-09T15:22:43.124529+0000","last_clean":"2024-03-09T15:22:43.124529+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:22:43.124529+0000","last_undegraded":"2024-03-09T15:22:43.124529+0000","last_fullsized":"2024-03-09T15:22:43.124529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:20.405079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":768,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.882808+0000","last_change":"2024-03-09T14:21:56.361858+0000","last_active":"2024-03-09T15:23:32.882808+0000","last_peered":"2024-03-09T15:23:32.882808+0000","last_clean":"2024-03-09T15:23:32.882808+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:23:32.882808+0000","last_undegraded":"2024-03-09T15:23:32.882808+0000","last_fullsized":"2024-03-09T15:23:32.882808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:19:13.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'225","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018958+0000","last_change":"2024-03-09T14:21:54.358944+0000","last_active":"2024-03-09T15:22:12.018958+0000","last_peered":"2024-03-09T15:22:12.018958+0000","last_clean":"2024-03-09T15:22:12.018958+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:22:12.018958+0000","last_undegraded":"2024-03-09T15:22:12.018958+0000","last_fullsized":"2024-03-09T15:22:12.018958+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:31.824683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5894290,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":472,"num_read_kb":44740,"num_write":1207,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144162+0000","last_change":"2024-03-09T14:21:58.368610+0000","last_active":"2024-03-09T15:20:02.144162+0000","last_peered":"2024-03-09T15:20:02.144162+0000","last_clean":"2024-03-09T15:20:02.144162+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:20:02.144162+0000","last_undegraded":"2024-03-09T15:20:02.144162+0000","last_fullsized":"2024-03-09T15:20:02.144162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:54.314632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'111","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.857610+0000","last_change":"2024-03-09T14:22:00.390046+0000","last_active":"2024-03-09T15:24:30.857610+0000","last_peered":"2024-03-09T15:24:30.857610+0000","last_clean":"2024-03-09T15:24:30.857610+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:24:30.857610+0000","last_undegraded":"2024-03-09T15:24:30.857610+0000","last_fullsized":"2024-03-09T15:24:30.857610+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:50.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8520,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":179,"num_write":66,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163173+0000","last_change":"2024-03-09T14:22:02.397881+0000","last_active":"2024-03-09T15:22:02.163173+0000","last_peered":"2024-03-09T15:22:02.163173+0000","last_clean":"2024-03-09T15:22:02.163173+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:22:02.163173+0000","last_undegraded":"2024-03-09T15:22:02.163173+0000","last_fullsized":"2024-03-09T15:22:02.163173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:13.863238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'148","reported_seq":1807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.936366+0000","last_change":"2024-03-09T14:22:04.399435+0000","last_active":"2024-03-09T15:24:28.936366+0000","last_peered":"2024-03-09T15:24:28.936366+0000","last_clean":"2024-03-09T15:24:28.936366+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:24:28.936366+0000","last_undegraded":"2024-03-09T15:24:28.936366+0000","last_fullsized":"2024-03-09T15:24:28.936366+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.710673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.686428+0000","last_change":"2024-03-09T14:21:56.356912+0000","last_active":"2024-03-09T15:20:13.686428+0000","last_peered":"2024-03-09T15:20:13.686428+0000","last_clean":"2024-03-09T15:20:13.686428+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:20:13.686428+0000","last_undegraded":"2024-03-09T15:20:13.686428+0000","last_fullsized":"2024-03-09T15:20:13.686428+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:30.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'204","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907568+0000","last_change":"2024-03-09T14:21:54.358595+0000","last_active":"2024-03-09T15:22:21.907568+0000","last_peered":"2024-03-09T15:22:21.907568+0000","last_clean":"2024-03-09T15:22:21.907568+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:22:21.907568+0000","last_undegraded":"2024-03-09T15:22:21.907568+0000","last_fullsized":"2024-03-09T15:22:21.907568+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:14.194545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16015484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":64454,"num_write":1154,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"32'4","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.382657+0000","last_change":"2024-03-09T14:21:58.370687+0000","last_active":"2024-03-09T15:24:30.382657+0000","last_peered":"2024-03-09T15:24:30.382657+0000","last_clean":"2024-03-09T15:24:30.382657+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:30.382657+0000","last_undegraded":"2024-03-09T15:24:30.382657+0000","last_fullsized":"2024-03-09T15:24:30.382657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:27.059761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":474,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'162","reported_seq":754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.861372+0000","last_change":"2024-03-09T14:22:00.381012+0000","last_active":"2024-03-09T15:24:30.861372+0000","last_peered":"2024-03-09T15:24:30.861372+0000","last_clean":"2024-03-09T15:24:30.861372+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:24:30.861372+0000","last_undegraded":"2024-03-09T15:24:30.861372+0000","last_fullsized":"2024-03-09T15:24:30.861372+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:29.659729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20695,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":310,"num_write":122,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:01.905044+0000","last_change":"2024-03-09T14:22:02.401394+0000","last_active":"2024-03-09T15:22:01.905044+0000","last_peered":"2024-03-09T15:22:01.905044+0000","last_clean":"2024-03-09T15:22:01.905044+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:22:01.905044+0000","last_undegraded":"2024-03-09T15:22:01.905044+0000","last_fullsized":"2024-03-09T15:22:01.905044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:36.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'106","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:24.040847+0000","last_change":"2024-03-09T14:22:04.402287+0000","last_active":"2024-03-09T15:23:24.040847+0000","last_peered":"2024-03-09T15:23:24.040847+0000","last_clean":"2024-03-09T15:23:24.040847+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:23:24.040847+0000","last_undegraded":"2024-03-09T15:23:24.040847+0000","last_fullsized":"2024-03-09T15:23:24.040847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:54.058990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993860+0000","last_change":"2024-03-09T14:21:56.357674+0000","last_active":"2024-03-09T15:20:26.993860+0000","last_peered":"2024-03-09T15:20:26.993860+0000","last_clean":"2024-03-09T15:20:26.993860+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:20:26.993860+0000","last_undegraded":"2024-03-09T15:20:26.993860+0000","last_fullsized":"2024-03-09T15:20:26.993860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:37.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'180","reported_seq":990,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040923+0000","last_change":"2024-03-09T14:21:54.367079+0000","last_active":"2024-03-09T15:22:22.040923+0000","last_peered":"2024-03-09T15:22:22.040923+0000","last_clean":"2024-03-09T15:22:22.040923+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:22:22.040923+0000","last_undegraded":"2024-03-09T15:22:22.040923+0000","last_fullsized":"2024-03-09T15:22:22.040923+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:51.408419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730712,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":787,"num_read_kb":18311,"num_write":1111,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":855,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993837+0000","last_change":"2024-03-09T14:21:56.368289+0000","last_active":"2024-03-09T15:20:26.993837+0000","last_peered":"2024-03-09T15:20:26.993837+0000","last_clean":"2024-03-09T15:20:26.993837+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:20:26.993837+0000","last_undegraded":"2024-03-09T15:20:26.993837+0000","last_fullsized":"2024-03-09T15:20:26.993837+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:13.723494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'269","reported_seq":1081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003736+0000","last_change":"2024-03-09T14:21:54.359757+0000","last_active":"2024-03-09T15:22:22.003736+0000","last_peered":"2024-03-09T15:22:22.003736+0000","last_clean":"2024-03-09T15:22:22.003736+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:22:22.003736+0000","last_undegraded":"2024-03-09T15:22:22.003736+0000","last_fullsized":"2024-03-09T15:22:22.003736+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:57.050243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351863,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1218,"num_read_kb":137737,"num_write":1248,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024150+0000","last_change":"2024-03-09T14:21:56.360003+0000","last_active":"2024-03-09T15:20:27.024150+0000","last_peered":"2024-03-09T15:20:27.024150+0000","last_clean":"2024-03-09T15:20:27.024150+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:20:27.024150+0000","last_undegraded":"2024-03-09T15:20:27.024150+0000","last_fullsized":"2024-03-09T15:20:27.024150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'162","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.331004+0000","last_change":"2024-03-09T14:21:54.370800+0000","last_active":"2024-03-09T15:23:42.331004+0000","last_peered":"2024-03-09T15:23:42.331004+0000","last_clean":"2024-03-09T15:23:42.331004+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:23:42.331004+0000","last_undegraded":"2024-03-09T15:23:42.331004+0000","last_fullsized":"2024-03-09T15:23:42.331004+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:44.318284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":5631,"num_write":925,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.967315+0000","last_change":"2024-03-09T14:21:56.364838+0000","last_active":"2024-03-09T15:23:37.967315+0000","last_peered":"2024-03-09T15:23:37.967315+0000","last_clean":"2024-03-09T15:23:37.967315+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:23:37.967315+0000","last_undegraded":"2024-03-09T15:23:37.967315+0000","last_fullsized":"2024-03-09T15:23:37.967315+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:10.284801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'145","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999945+0000","last_change":"2024-03-09T14:22:31.512263+0000","last_active":"2024-03-09T15:20:31.999945+0000","last_peered":"2024-03-09T15:20:31.999945+0000","last_clean":"2024-03-09T15:20:31.999945+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:20:31.999945+0000","last_undegraded":"2024-03-09T15:20:31.999945+0000","last_fullsized":"2024-03-09T15:20:31.999945+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:22.007571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469459,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":2407,"num_write":835,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'203","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.006966+0000","last_change":"2024-03-09T14:21:56.356735+0000","last_active":"2024-03-09T15:20:32.006966+0000","last_peered":"2024-03-09T15:20:32.006966+0000","last_clean":"2024-03-09T15:20:32.006966+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:20:32.006966+0000","last_undegraded":"2024-03-09T15:20:32.006966+0000","last_fullsized":"2024-03-09T15:20:32.006966+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:40.763958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'222","reported_seq":959,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.301620+0000","last_change":"2024-03-09T14:21:54.360027+0000","last_active":"2024-03-09T15:21:18.301620+0000","last_peered":"2024-03-09T15:21:18.301620+0000","last_clean":"2024-03-09T15:21:18.301620+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:21:18.301620+0000","last_undegraded":"2024-03-09T15:21:18.301620+0000","last_fullsized":"2024-03-09T15:21:18.301620+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:39.068686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7319443,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":802,"num_read_kb":22283,"num_write":1149,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166084+0000","last_change":"2024-03-09T14:21:56.363506+0000","last_active":"2024-03-09T15:22:22.166084+0000","last_peered":"2024-03-09T15:22:22.166084+0000","last_clean":"2024-03-09T15:22:22.166084+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:22:22.166084+0000","last_undegraded":"2024-03-09T15:22:22.166084+0000","last_fullsized":"2024-03-09T15:22:22.166084+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:50.856855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'195","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993807+0000","last_change":"2024-03-09T14:21:54.371723+0000","last_active":"2024-03-09T15:20:26.993807+0000","last_peered":"2024-03-09T15:20:26.993807+0000","last_clean":"2024-03-09T15:20:26.993807+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:20:26.993807+0000","last_undegraded":"2024-03-09T15:20:26.993807+0000","last_fullsized":"2024-03-09T15:20:26.993807+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:20.005554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324814,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":38599,"num_write":1105,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020078+0000","last_change":"2024-03-09T14:21:56.359970+0000","last_active":"2024-03-09T15:22:22.020078+0000","last_peered":"2024-03-09T15:22:22.020078+0000","last_clean":"2024-03-09T15:22:22.020078+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:22:22.020078+0000","last_undegraded":"2024-03-09T15:22:22.020078+0000","last_fullsized":"2024-03-09T15:22:22.020078+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:09.990655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'210","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024091+0000","last_change":"2024-03-09T14:21:54.364970+0000","last_active":"2024-03-09T15:20:27.024091+0000","last_peered":"2024-03-09T15:20:27.024091+0000","last_clean":"2024-03-09T15:20:27.024091+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:20:27.024091+0000","last_undegraded":"2024-03-09T15:20:27.024091+0000","last_fullsized":"2024-03-09T15:20:27.024091+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:09.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11397214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":1161,"num_write":1163,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040950+0000","last_change":"2024-03-09T14:21:56.360728+0000","last_active":"2024-03-09T15:22:22.040950+0000","last_peered":"2024-03-09T15:22:22.040950+0000","last_clean":"2024-03-09T15:22:22.040950+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:22:22.040950+0000","last_undegraded":"2024-03-09T15:22:22.040950+0000","last_fullsized":"2024-03-09T15:22:22.040950+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:03:35.870767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'183","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006364+0000","last_change":"2024-03-09T14:21:54.365980+0000","last_active":"2024-03-09T15:20:27.006364+0000","last_peered":"2024-03-09T15:20:27.006364+0000","last_clean":"2024-03-09T15:20:27.006364+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:20:27.006364+0000","last_undegraded":"2024-03-09T15:20:27.006364+0000","last_fullsized":"2024-03-09T15:20:27.006364+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:10.240743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12616287,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":15052,"num_write":1035,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998176+0000","last_change":"2024-03-09T14:23:32.139833+0000","last_active":"2024-03-09T15:20:16.998176+0000","last_peered":"2024-03-09T15:20:16.998176+0000","last_clean":"2024-03-09T15:20:16.998176+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:20:16.998176+0000","last_undegraded":"2024-03-09T15:20:16.998176+0000","last_fullsized":"2024-03-09T15:20:16.998176+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:24.028499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'173","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025532+0000","last_change":"2024-03-09T14:21:54.370760+0000","last_active":"2024-03-09T15:20:37.025532+0000","last_peered":"2024-03-09T15:20:37.025532+0000","last_clean":"2024-03-09T15:20:37.025532+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:20:37.025532+0000","last_undegraded":"2024-03-09T15:20:37.025532+0000","last_fullsized":"2024-03-09T15:20:37.025532+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:04:48.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7402673,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":2617,"num_write":1100,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'89","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.146608+0000","last_change":"2024-03-09T14:21:56.362263+0000","last_active":"2024-03-09T15:20:17.146608+0000","last_peered":"2024-03-09T15:20:17.146608+0000","last_clean":"2024-03-09T15:20:17.146608+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:20:17.146608+0000","last_undegraded":"2024-03-09T15:20:17.146608+0000","last_fullsized":"2024-03-09T15:20:17.146608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:54.785232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995931+0000","last_change":"2024-03-09T14:22:31.509909+0000","last_active":"2024-03-09T15:21:01.995931+0000","last_peered":"2024-03-09T15:21:01.995931+0000","last_clean":"2024-03-09T15:21:01.995931+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:21:01.995931+0000","last_undegraded":"2024-03-09T15:21:01.995931+0000","last_fullsized":"2024-03-09T15:21:01.995931+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:26.468991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993373+0000","last_change":"2024-03-09T14:21:56.361155+0000","last_active":"2024-03-09T15:20:36.993373+0000","last_peered":"2024-03-09T15:20:36.993373+0000","last_clean":"2024-03-09T15:20:36.993373+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:20:36.993373+0000","last_undegraded":"2024-03-09T15:20:36.993373+0000","last_fullsized":"2024-03-09T15:20:36.993373+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:24.944266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'153","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024078+0000","last_change":"2024-03-09T14:21:54.359540+0000","last_active":"2024-03-09T15:20:27.024078+0000","last_peered":"2024-03-09T15:20:27.024078+0000","last_clean":"2024-03-09T15:20:27.024078+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:20:27.024078+0000","last_undegraded":"2024-03-09T15:20:27.024078+0000","last_fullsized":"2024-03-09T15:20:27.024078+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:36.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5692335,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":3591,"num_write":915,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148046+0000","last_change":"2024-03-09T14:21:56.357637+0000","last_active":"2024-03-09T15:20:27.148046+0000","last_peered":"2024-03-09T15:20:27.148046+0000","last_clean":"2024-03-09T15:20:27.148046+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:20:27.148046+0000","last_undegraded":"2024-03-09T15:20:27.148046+0000","last_fullsized":"2024-03-09T15:20:27.148046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:40.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'227","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:30.558860+0000","last_change":"2024-03-09T14:21:54.361294+0000","last_active":"2024-03-09T15:20:30.558860+0000","last_peered":"2024-03-09T15:20:30.558860+0000","last_clean":"2024-03-09T15:20:30.558860+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:20:30.558860+0000","last_undegraded":"2024-03-09T15:20:30.558860+0000","last_fullsized":"2024-03-09T15:20:30.558860+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:03.466571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5751340,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":6366,"num_write":1239,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162762+0000","last_change":"2024-03-09T14:21:56.366542+0000","last_active":"2024-03-09T15:20:27.162762+0000","last_peered":"2024-03-09T15:20:27.162762+0000","last_clean":"2024-03-09T15:20:27.162762+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:20:27.162762+0000","last_undegraded":"2024-03-09T15:20:27.162762+0000","last_fullsized":"2024-03-09T15:20:27.162762+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:07.419936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'210","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995977+0000","last_change":"2024-03-09T14:22:31.512292+0000","last_active":"2024-03-09T15:21:01.995977+0000","last_peered":"2024-03-09T15:21:01.995977+0000","last_clean":"2024-03-09T15:21:01.995977+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:21:01.995977+0000","last_undegraded":"2024-03-09T15:21:01.995977+0000","last_fullsized":"2024-03-09T15:21:01.995977+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:33.917233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933588,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":457,"num_read_kb":30999,"num_write":1207,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999345+0000","last_change":"2024-03-09T14:21:56.371868+0000","last_active":"2024-03-09T15:20:26.999345+0000","last_peered":"2024-03-09T15:20:26.999345+0000","last_clean":"2024-03-09T15:20:26.999345+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:20:26.999345+0000","last_undegraded":"2024-03-09T15:20:26.999345+0000","last_fullsized":"2024-03-09T15:20:26.999345+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:15.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'185","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.057080+0000","last_change":"2024-03-09T14:21:54.364838+0000","last_active":"2024-03-09T15:22:43.057080+0000","last_peered":"2024-03-09T15:22:43.057080+0000","last_clean":"2024-03-09T15:22:43.057080+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:22:43.057080+0000","last_undegraded":"2024-03-09T15:22:43.057080+0000","last_fullsized":"2024-03-09T15:22:43.057080+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:49.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5287633,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":8057,"num_write":1055,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006259+0000","last_change":"2024-03-09T14:21:56.374875+0000","last_active":"2024-03-09T15:20:27.006259+0000","last_peered":"2024-03-09T15:20:27.006259+0000","last_clean":"2024-03-09T15:20:27.006259+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:20:27.006259+0000","last_undegraded":"2024-03-09T15:20:27.006259+0000","last_fullsized":"2024-03-09T15:20:27.006259+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:04.393658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'187","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.991193+0000","last_change":"2024-03-09T14:21:54.358572+0000","last_active":"2024-03-09T15:20:16.991193+0000","last_peered":"2024-03-09T15:20:16.991193+0000","last_clean":"2024-03-09T15:20:16.991193+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:20:16.991193+0000","last_undegraded":"2024-03-09T15:20:16.991193+0000","last_fullsized":"2024-03-09T15:20:16.991193+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:42.206920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12701674,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":370,"num_read_kb":1771,"num_write":1073,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.582786+0000","last_change":"2024-03-09T14:21:56.366749+0000","last_active":"2024-03-09T15:23:08.582786+0000","last_peered":"2024-03-09T15:23:08.582786+0000","last_clean":"2024-03-09T15:23:08.582786+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:23:08.582786+0000","last_undegraded":"2024-03-09T15:23:08.582786+0000","last_fullsized":"2024-03-09T15:23:08.582786+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:28.693682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022779+0000","last_change":"2024-03-09T14:21:54.362334+0000","last_active":"2024-03-09T15:20:17.022779+0000","last_peered":"2024-03-09T15:20:17.022779+0000","last_clean":"2024-03-09T15:20:17.022779+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:20:17.022779+0000","last_undegraded":"2024-03-09T15:20:17.022779+0000","last_fullsized":"2024-03-09T15:20:17.022779+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:07.779443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":6618,"num_write":997,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'203","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022634+0000","last_change":"2024-03-09T14:22:31.500572+0000","last_active":"2024-03-09T15:20:17.022634+0000","last_peered":"2024-03-09T15:20:17.022634+0000","last_clean":"2024-03-09T15:20:17.022634+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:20:17.022634+0000","last_undegraded":"2024-03-09T15:20:17.022634+0000","last_fullsized":"2024-03-09T15:20:17.022634+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:04.341433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18506442,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":427,"num_read_kb":70161,"num_write":1218,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.091735+0000","last_change":"2024-03-09T14:21:56.373545+0000","last_active":"2024-03-09T15:23:23.091735+0000","last_peered":"2024-03-09T15:23:23.091735+0000","last_clean":"2024-03-09T15:23:23.091735+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:23:23.091735+0000","last_undegraded":"2024-03-09T15:23:23.091735+0000","last_fullsized":"2024-03-09T15:23:23.091735+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:55.978437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'189","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.902114+0000","last_change":"2024-03-09T14:21:54.366684+0000","last_active":"2024-03-09T15:23:37.902114+0000","last_peered":"2024-03-09T15:23:37.902114+0000","last_clean":"2024-03-09T15:23:37.902114+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:23:37.902114+0000","last_undegraded":"2024-03-09T15:23:37.902114+0000","last_fullsized":"2024-03-09T15:23:37.902114+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:50.065605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23102045,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":29809,"num_write":1050,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019819+0000","last_change":"2024-03-09T14:21:56.373920+0000","last_active":"2024-03-09T15:19:57.019819+0000","last_peered":"2024-03-09T15:19:57.019819+0000","last_clean":"2024-03-09T15:19:57.019819+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:19:57.019819+0000","last_undegraded":"2024-03-09T15:19:57.019819+0000","last_fullsized":"2024-03-09T15:19:57.019819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:31.026336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1226,"ondisk_log_size":1226,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":632,"ondisk_log_size":632,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":334127,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8854,"num_read_kb":10560,"num_write":6413,"num_write_kb":2961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712704,"data_stored":178786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1868,"ondisk_log_size":1868,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1573,"num_read_kb":1873,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3747,"ondisk_log_size":3747,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":633895248,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":31765,"num_read_kb":2295828,"num_write":68028,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":953536512,"data_stored":953536512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4586,"ondisk_log_size":4586,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":80534719,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":113,"num_read_kb":170575,"num_write":132,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161079296,"data_stored":161069438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":80534719,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":114,"num_read_kb":174957,"num_write":132,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161079296,"data_stored":161069438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575608,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451364,"kb_used_data":159196,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93920476,"statfs":{"total":96636764160,"available":96174567424,"internally_reserved":0,"allocated":163016704,"data_stored":161020128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575608,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394184,"kb_used_data":156160,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93977656,"statfs":{"total":96636764160,"available":96233119744,"internally_reserved":0,"allocated":159907840,"data_stored":157991089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575609,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244964,"kb_used_data":159708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94126876,"statfs":{"total":96636764160,"available":96385921024,"internally_reserved":0,"allocated":163540992,"data_stored":161520121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259136,"kb_used_data":183544,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94112704,"statfs":{"total":96636764160,"available":96371408896,"internally_reserved":0,"allocated":187949056,"data_stored":186062276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575611,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394820,"kb_used_data":183164,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93977020,"statfs":{"total":96636764160,"available":96232468480,"internally_reserved":0,"allocated":187559936,"data_stored":185582722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575610,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209948,"kb_used_data":124692,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94161892,"statfs":{"total":96636764160,"available":96421777408,"internally_reserved":0,"allocated":127684608,"data_stored":125769330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575609,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276512,"kb_used_data":169048,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94095328,"statfs":{"total":96636764160,"available":96353615872,"internally_reserved":0,"allocated":173105152,"data_stored":171158574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575607,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364476,"kb_used_data":144500,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94007364,"statfs":{"total":96636764160,"available":96263540736,"internally_reserved":0,"allocated":147968000,"data_stored":145989418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":121610240,"data_stored":121610240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115818496,"data_stored":115818496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":96149504,"data_stored":96149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116727808,"data_stored":116727808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":135528448,"data_stored":135528448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":130207744,"data_stored":130207744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":118968320,"data_stored":118968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118525952,"data_stored":118525952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":20357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":23559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":9420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":20894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":28805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":26027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":47157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26255360,"data_stored":26254545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21737472,"data_stored":21734173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32546816,"data_stored":32546001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28069888,"data_stored":28065774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20013056,"data_stored":20011517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44847104,"data_stored":44842990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17491441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18915328,"data_stored":18914513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:24:40.095 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-09T15:24:40.095 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:24:40.438 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:40.449 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:24:40.451 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2144,"stamp":"2024-03-09T15:24:39.149657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":795903647,"num_objects":792,"num_object_clones":0,"num_object_copies":2024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":792,"num_whiteouts":0,"num_read":150491,"num_read_kb":2743710,"num_write":128205,"num_write_kb":2398286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14411,"ondisk_log_size":14411,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2595404,"kb_used_data":1280012,"kb_used_omap":12,"kb_used_meta":1315315,"kb_avail":752379316,"statfs":{"total":773094113280,"available":770436419584,"internally_reserved":0,"allocated":1310732288,"data_stored":1295093658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1346883120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4194440,"num_objects":-8,"num_object_clones":0,"num_object_copies":-17,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":71,"num_read_kb":76,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004849"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.021041+0000","last_change":"2024-03-09T14:50:03.656802+0000","last_active":"2024-03-09T15:20:07.021041+0000","last_peered":"2024-03-09T15:20:07.021041+0000","last_clean":"2024-03-09T15:20:07.021041+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:20:07.021041+0000","last_undegraded":"2024-03-09T15:20:07.021041+0000","last_fullsized":"2024-03-09T15:20:07.021041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:04.962196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'7","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.028585+0000","last_change":"2024-03-09T14:35:55.601961+0000","last_active":"2024-03-09T15:20:57.028585+0000","last_peered":"2024-03-09T15:20:57.028585+0000","last_clean":"2024-03-09T15:20:57.028585+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:20:57.028585+0000","last_undegraded":"2024-03-09T15:20:57.028585+0000","last_fullsized":"2024-03-09T15:20:57.028585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:04:58.889343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009287+0000","last_change":"2024-03-09T14:35:50.589013+0000","last_active":"2024-03-09T15:20:52.009287+0000","last_peered":"2024-03-09T15:20:52.009287+0000","last_clean":"2024-03-09T15:20:52.009287+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:20:52.009287+0000","last_undegraded":"2024-03-09T15:20:52.009287+0000","last_fullsized":"2024-03-09T15:20:52.009287+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:23.606923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003320+0000","last_change":"2024-03-09T14:31:01.149135+0000","last_active":"2024-03-09T15:21:02.003320+0000","last_peered":"2024-03-09T15:21:02.003320+0000","last_clean":"2024-03-09T15:21:02.003320+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:21:02.003320+0000","last_undegraded":"2024-03-09T15:21:02.003320+0000","last_fullsized":"2024-03-09T15:21:02.003320+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:09.105678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.990155+0000","last_change":"2024-03-09T14:50:03.659762+0000","last_active":"2024-03-09T15:20:06.990155+0000","last_peered":"2024-03-09T15:20:06.990155+0000","last_clean":"2024-03-09T15:20:06.990155+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:20:06.990155+0000","last_undegraded":"2024-03-09T15:20:06.990155+0000","last_fullsized":"2024-03-09T15:20:06.990155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:14.705784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.151881+0000","last_change":"2024-03-09T14:35:55.598964+0000","last_active":"2024-03-09T15:20:57.151881+0000","last_peered":"2024-03-09T15:20:57.151881+0000","last_clean":"2024-03-09T15:20:57.151881+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:20:57.151881+0000","last_undegraded":"2024-03-09T15:20:57.151881+0000","last_fullsized":"2024-03-09T15:20:57.151881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:08.079908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.996523+0000","last_change":"2024-03-09T14:35:50.590196+0000","last_active":"2024-03-09T15:20:51.996523+0000","last_peered":"2024-03-09T15:20:51.996523+0000","last_clean":"2024-03-09T15:20:51.996523+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:20:51.996523+0000","last_undegraded":"2024-03-09T15:20:51.996523+0000","last_fullsized":"2024-03-09T15:20:51.996523+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:35.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":156,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:11.996933+0000","last_change":"2024-03-09T14:31:01.138966+0000","last_active":"2024-03-09T15:21:11.996933+0000","last_peered":"2024-03-09T15:21:11.996933+0000","last_clean":"2024-03-09T15:21:11.996933+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:21:11.996933+0000","last_undegraded":"2024-03-09T15:21:11.996933+0000","last_fullsized":"2024-03-09T15:21:11.996933+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:10.293011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.033437+0000","last_change":"2024-03-09T14:50:03.653730+0000","last_active":"2024-03-09T15:21:32.033437+0000","last_peered":"2024-03-09T15:21:32.033437+0000","last_clean":"2024-03-09T15:21:32.033437+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:21:32.033437+0000","last_undegraded":"2024-03-09T15:21:32.033437+0000","last_fullsized":"2024-03-09T15:21:32.033437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:21.654055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'1","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903377+0000","last_change":"2024-03-09T14:35:55.635024+0000","last_active":"2024-03-09T15:21:46.903377+0000","last_peered":"2024-03-09T15:21:46.903377+0000","last_clean":"2024-03-09T15:21:46.903377+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:21:46.903377+0000","last_undegraded":"2024-03-09T15:21:46.903377+0000","last_fullsized":"2024-03-09T15:21:46.903377+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:46.253263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'7","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.001931+0000","last_change":"2024-03-09T14:35:50.592237+0000","last_active":"2024-03-09T15:22:02.001931+0000","last_peered":"2024-03-09T15:22:02.001931+0000","last_clean":"2024-03-09T15:22:02.001931+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:22:02.001931+0000","last_undegraded":"2024-03-09T15:22:02.001931+0000","last_fullsized":"2024-03-09T15:22:02.001931+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:31.946306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":22,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003270+0000","last_change":"2024-03-09T14:31:01.144121+0000","last_active":"2024-03-09T15:21:02.003270+0000","last_peered":"2024-03-09T15:21:02.003270+0000","last_clean":"2024-03-09T15:21:02.003270+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:21:02.003270+0000","last_undegraded":"2024-03-09T15:21:02.003270+0000","last_fullsized":"2024-03-09T15:21:02.003270+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:07.901302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.015382+0000","last_change":"2024-03-09T14:50:03.664715+0000","last_active":"2024-03-09T15:21:42.015382+0000","last_peered":"2024-03-09T15:21:42.015382+0000","last_clean":"2024-03-09T15:21:42.015382+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:21:42.015382+0000","last_undegraded":"2024-03-09T15:21:42.015382+0000","last_fullsized":"2024-03-09T15:21:42.015382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:17.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018993+0000","last_change":"2024-03-09T14:35:55.633735+0000","last_active":"2024-03-09T15:22:12.018993+0000","last_peered":"2024-03-09T15:22:12.018993+0000","last_clean":"2024-03-09T15:22:12.018993+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:22:12.018993+0000","last_undegraded":"2024-03-09T15:22:12.018993+0000","last_fullsized":"2024-03-09T15:22:12.018993+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:58.258793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3194156,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6192,"num_write":2,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.160281+0000","last_change":"2024-03-09T14:35:50.588633+0000","last_active":"2024-03-09T15:21:42.160281+0000","last_peered":"2024-03-09T15:21:42.160281+0000","last_clean":"2024-03-09T15:21:42.160281+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:21:42.160281+0000","last_undegraded":"2024-03-09T15:21:42.160281+0000","last_fullsized":"2024-03-09T15:21:42.160281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:47.842912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010493+0000","last_change":"2024-03-09T14:31:01.143564+0000","last_active":"2024-03-09T15:21:02.010493+0000","last_peered":"2024-03-09T15:21:02.010493+0000","last_clean":"2024-03-09T15:21:02.010493+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:21:02.010493+0000","last_undegraded":"2024-03-09T15:21:02.010493+0000","last_fullsized":"2024-03-09T15:21:02.010493+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:38.918335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019554+0000","last_change":"2024-03-09T14:50:03.656253+0000","last_active":"2024-03-09T15:22:17.019554+0000","last_peered":"2024-03-09T15:22:17.019554+0000","last_clean":"2024-03-09T15:22:17.019554+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:22:17.019554+0000","last_undegraded":"2024-03-09T15:22:17.019554+0000","last_fullsized":"2024-03-09T15:22:17.019554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:38.610391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'1","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.037997+0000","last_change":"2024-03-09T14:35:55.603890+0000","last_active":"2024-03-09T15:22:02.037997+0000","last_peered":"2024-03-09T15:22:02.037997+0000","last_clean":"2024-03-09T15:22:02.037997+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:22:02.037997+0000","last_undegraded":"2024-03-09T15:22:02.037997+0000","last_fullsized":"2024-03-09T15:22:02.037997+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:40.989711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903235+0000","last_change":"2024-03-09T14:35:50.586383+0000","last_active":"2024-03-09T15:21:46.903235+0000","last_peered":"2024-03-09T15:21:46.903235+0000","last_clean":"2024-03-09T15:21:46.903235+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:21:46.903235+0000","last_undegraded":"2024-03-09T15:21:46.903235+0000","last_fullsized":"2024-03-09T15:21:46.903235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:58.715378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":164,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010460+0000","last_change":"2024-03-09T14:31:01.141921+0000","last_active":"2024-03-09T15:21:02.010460+0000","last_peered":"2024-03-09T15:21:02.010460+0000","last_clean":"2024-03-09T15:21:02.010460+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:21:02.010460+0000","last_undegraded":"2024-03-09T15:21:02.010460+0000","last_fullsized":"2024-03-09T15:21:02.010460+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:28.572848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999640+0000","last_change":"2024-03-09T14:50:03.661504+0000","last_active":"2024-03-09T15:21:21.999640+0000","last_peered":"2024-03-09T15:21:21.999640+0000","last_clean":"2024-03-09T15:21:21.999640+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:21:21.999640+0000","last_undegraded":"2024-03-09T15:21:21.999640+0000","last_fullsized":"2024-03-09T15:21:21.999640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:16.731080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'2","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.036471+0000","last_change":"2024-03-09T14:35:55.603980+0000","last_active":"2024-03-09T15:21:52.036471+0000","last_peered":"2024-03-09T15:21:52.036471+0000","last_clean":"2024-03-09T15:21:52.036471+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:21:52.036471+0000","last_undegraded":"2024-03-09T15:21:52.036471+0000","last_fullsized":"2024-03-09T15:21:52.036471+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:36.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'10","reported_seq":75,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161560+0000","last_change":"2024-03-09T14:35:50.584429+0000","last_active":"2024-03-09T15:21:52.161560+0000","last_peered":"2024-03-09T15:21:52.161560+0000","last_clean":"2024-03-09T15:21:52.161560+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:21:52.161560+0000","last_undegraded":"2024-03-09T15:21:52.161560+0000","last_fullsized":"2024-03-09T15:21:52.161560+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:35.785481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":37890,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029279+0000","last_change":"2024-03-09T14:31:01.137869+0000","last_active":"2024-03-09T15:21:02.029279+0000","last_peered":"2024-03-09T15:21:02.029279+0000","last_clean":"2024-03-09T15:21:02.029279+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:21:02.029279+0000","last_undegraded":"2024-03-09T15:21:02.029279+0000","last_fullsized":"2024-03-09T15:21:02.029279+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:00.440659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159481+0000","last_change":"2024-03-09T14:50:03.659706+0000","last_active":"2024-03-09T15:20:07.159481+0000","last_peered":"2024-03-09T15:20:07.159481+0000","last_clean":"2024-03-09T15:20:07.159481+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:20:07.159481+0000","last_undegraded":"2024-03-09T15:20:07.159481+0000","last_fullsized":"2024-03-09T15:20:07.159481+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:01.960769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'4","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.028566+0000","last_change":"2024-03-09T14:35:55.605449+0000","last_active":"2024-03-09T15:20:57.028566+0000","last_peered":"2024-03-09T15:20:57.028566+0000","last_clean":"2024-03-09T15:20:57.028566+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:20:57.028566+0000","last_undegraded":"2024-03-09T15:20:57.028566+0000","last_fullsized":"2024-03-09T15:20:57.028566+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:08.518355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151137+0000","last_change":"2024-03-09T14:35:50.585219+0000","last_active":"2024-03-09T15:20:52.151137+0000","last_peered":"2024-03-09T15:20:52.151137+0000","last_clean":"2024-03-09T15:20:52.151137+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:20:52.151137+0000","last_undegraded":"2024-03-09T15:20:52.151137+0000","last_fullsized":"2024-03-09T15:20:52.151137+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:40.696301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905562+0000","last_change":"2024-03-09T14:31:01.146419+0000","last_active":"2024-03-09T15:22:06.905562+0000","last_peered":"2024-03-09T15:22:06.905562+0000","last_clean":"2024-03-09T15:22:06.905562+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:22:06.905562+0000","last_undegraded":"2024-03-09T15:22:06.905562+0000","last_fullsized":"2024-03-09T15:22:06.905562+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:26.233793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159538+0000","last_change":"2024-03-09T14:50:03.664828+0000","last_active":"2024-03-09T15:20:07.159538+0000","last_peered":"2024-03-09T15:20:07.159538+0000","last_clean":"2024-03-09T15:20:07.159538+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:20:07.159538+0000","last_undegraded":"2024-03-09T15:20:07.159538+0000","last_fullsized":"2024-03-09T15:20:07.159538+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:43:10.894912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009850+0000","last_change":"2024-03-09T14:35:55.606688+0000","last_active":"2024-03-09T15:20:57.009850+0000","last_peered":"2024-03-09T15:20:57.009850+0000","last_clean":"2024-03-09T15:20:57.009850+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:20:57.009850+0000","last_undegraded":"2024-03-09T15:20:57.009850+0000","last_fullsized":"2024-03-09T15:20:57.009850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:27.128463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002039+0000","last_change":"2024-03-09T14:35:50.593904+0000","last_active":"2024-03-09T15:20:52.002039+0000","last_peered":"2024-03-09T15:20:52.002039+0000","last_clean":"2024-03-09T15:20:52.002039+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:20:52.002039+0000","last_undegraded":"2024-03-09T15:20:52.002039+0000","last_fullsized":"2024-03-09T15:20:52.002039+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:03.967997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002072+0000","last_change":"2024-03-09T14:31:01.135095+0000","last_active":"2024-03-09T15:21:47.002072+0000","last_peered":"2024-03-09T15:21:47.002072+0000","last_clean":"2024-03-09T15:21:47.002072+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:21:47.002072+0000","last_undegraded":"2024-03-09T15:21:47.002072+0000","last_fullsized":"2024-03-09T15:21:47.002072+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:55.759399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993733+0000","last_change":"2024-03-09T14:50:03.657383+0000","last_active":"2024-03-09T15:20:26.993733+0000","last_peered":"2024-03-09T15:20:26.993733+0000","last_clean":"2024-03-09T15:20:26.993733+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:20:26.993733+0000","last_undegraded":"2024-03-09T15:20:26.993733+0000","last_fullsized":"2024-03-09T15:20:26.993733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:07.698784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"257'11","reported_seq":68,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016714+0000","last_change":"2024-03-09T14:35:55.634050+0000","last_active":"2024-03-09T15:21:52.016714+0000","last_peered":"2024-03-09T15:21:52.016714+0000","last_clean":"2024-03-09T15:21:52.016714+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:21:52.016714+0000","last_undegraded":"2024-03-09T15:21:52.016714+0000","last_fullsized":"2024-03-09T15:21:52.016714+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:35.953944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"257'10","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023348+0000","last_change":"2024-03-09T14:35:50.582640+0000","last_active":"2024-03-09T15:20:22.023348+0000","last_peered":"2024-03-09T15:20:22.023348+0000","last_clean":"2024-03-09T15:20:22.023348+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:20:22.023348+0000","last_undegraded":"2024-03-09T15:20:22.023348+0000","last_fullsized":"2024-03-09T15:20:22.023348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:34.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903407+0000","last_change":"2024-03-09T14:31:01.148885+0000","last_active":"2024-03-09T15:21:46.903407+0000","last_peered":"2024-03-09T15:21:46.903407+0000","last_clean":"2024-03-09T15:21:46.903407+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:21:46.903407+0000","last_undegraded":"2024-03-09T15:21:46.903407+0000","last_fullsized":"2024-03-09T15:21:46.903407+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:02.222592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992120+0000","last_change":"2024-03-09T14:50:03.655189+0000","last_active":"2024-03-09T15:20:26.992120+0000","last_peered":"2024-03-09T15:20:26.992120+0000","last_clean":"2024-03-09T15:20:26.992120+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:20:26.992120+0000","last_undegraded":"2024-03-09T15:20:26.992120+0000","last_fullsized":"2024-03-09T15:20:26.992120+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:03.341531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.007023+0000","last_change":"2024-03-09T14:35:55.633676+0000","last_active":"2024-03-09T15:20:32.007023+0000","last_peered":"2024-03-09T15:20:32.007023+0000","last_clean":"2024-03-09T15:20:32.007023+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:20:32.007023+0000","last_undegraded":"2024-03-09T15:20:32.007023+0000","last_fullsized":"2024-03-09T15:20:32.007023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:05:23.209750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.174264+0000","last_change":"2024-03-09T14:35:50.585080+0000","last_active":"2024-03-09T15:21:47.174264+0000","last_peered":"2024-03-09T15:21:47.174264+0000","last_clean":"2024-03-09T15:21:47.174264+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:21:47.174264+0000","last_undegraded":"2024-03-09T15:21:47.174264+0000","last_fullsized":"2024-03-09T15:21:47.174264+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.598130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":95,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.016119+0000","last_change":"2024-03-09T14:31:01.143022+0000","last_active":"2024-03-09T15:21:47.016119+0000","last_peered":"2024-03-09T15:21:47.016119+0000","last_clean":"2024-03-09T15:21:47.016119+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:21:47.016119+0000","last_undegraded":"2024-03-09T15:21:47.016119+0000","last_fullsized":"2024-03-09T15:21:47.016119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:37.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162669+0000","last_change":"2024-03-09T14:50:03.658035+0000","last_active":"2024-03-09T15:20:27.162669+0000","last_peered":"2024-03-09T15:20:27.162669+0000","last_clean":"2024-03-09T15:20:27.162669+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:20:27.162669+0000","last_undegraded":"2024-03-09T15:20:27.162669+0000","last_fullsized":"2024-03-09T15:20:27.162669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:02.499788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'4","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016749+0000","last_change":"2024-03-09T14:35:55.636071+0000","last_active":"2024-03-09T15:21:52.016749+0000","last_peered":"2024-03-09T15:21:52.016749+0000","last_clean":"2024-03-09T15:21:52.016749+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:21:52.016749+0000","last_undegraded":"2024-03-09T15:21:52.016749+0000","last_fullsized":"2024-03-09T15:21:52.016749+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:26.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000382+0000","last_change":"2024-03-09T14:35:50.592957+0000","last_active":"2024-03-09T15:21:47.000382+0000","last_peered":"2024-03-09T15:21:47.000382+0000","last_clean":"2024-03-09T15:21:47.000382+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:21:47.000382+0000","last_undegraded":"2024-03-09T15:21:47.000382+0000","last_fullsized":"2024-03-09T15:21:47.000382+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:17.607559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000355+0000","last_change":"2024-03-09T14:31:01.134030+0000","last_active":"2024-03-09T15:21:47.000355+0000","last_peered":"2024-03-09T15:21:47.000355+0000","last_clean":"2024-03-09T15:21:47.000355+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:21:47.000355+0000","last_undegraded":"2024-03-09T15:21:47.000355+0000","last_fullsized":"2024-03-09T15:21:47.000355+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:28.544093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024030+0000","last_change":"2024-03-09T14:50:03.654352+0000","last_active":"2024-03-09T15:20:27.024030+0000","last_peered":"2024-03-09T15:20:27.024030+0000","last_clean":"2024-03-09T15:20:27.024030+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:20:27.024030+0000","last_undegraded":"2024-03-09T15:20:27.024030+0000","last_fullsized":"2024-03-09T15:20:27.024030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:36.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161653+0000","last_change":"2024-03-09T14:35:55.604280+0000","last_active":"2024-03-09T15:21:52.161653+0000","last_peered":"2024-03-09T15:21:52.161653+0000","last_clean":"2024-03-09T15:21:52.161653+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:21:52.161653+0000","last_undegraded":"2024-03-09T15:21:52.161653+0000","last_fullsized":"2024-03-09T15:21:52.161653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:34.983233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903393+0000","last_change":"2024-03-09T14:35:50.585309+0000","last_active":"2024-03-09T15:21:46.903393+0000","last_peered":"2024-03-09T15:21:46.903393+0000","last_clean":"2024-03-09T15:21:46.903393+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:21:46.903393+0000","last_undegraded":"2024-03-09T15:21:46.903393+0000","last_fullsized":"2024-03-09T15:21:46.903393+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:46:45.637003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.160203+0000","last_change":"2024-03-09T14:31:01.137671+0000","last_active":"2024-03-09T15:20:12.160203+0000","last_peered":"2024-03-09T15:20:12.160203+0000","last_clean":"2024-03-09T15:20:12.160203+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:20:12.160203+0000","last_undegraded":"2024-03-09T15:20:12.160203+0000","last_fullsized":"2024-03-09T15:20:12.160203+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:01.231496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014344+0000","last_change":"2024-03-09T14:50:03.655960+0000","last_active":"2024-03-09T15:21:32.014344+0000","last_peered":"2024-03-09T15:21:32.014344+0000","last_clean":"2024-03-09T15:21:32.014344+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:21:32.014344+0000","last_undegraded":"2024-03-09T15:21:32.014344+0000","last_fullsized":"2024-03-09T15:21:32.014344+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:11.272439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992699+0000","last_change":"2024-03-09T14:35:55.606840+0000","last_active":"2024-03-09T15:20:16.992699+0000","last_peered":"2024-03-09T15:20:16.992699+0000","last_clean":"2024-03-09T15:20:16.992699+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:20:16.992699+0000","last_undegraded":"2024-03-09T15:20:16.992699+0000","last_fullsized":"2024-03-09T15:20:16.992699+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.473637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.145659+0000","last_change":"2024-03-09T14:35:50.590700+0000","last_active":"2024-03-09T15:20:12.145659+0000","last_peered":"2024-03-09T15:20:12.145659+0000","last_clean":"2024-03-09T15:20:12.145659+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:20:12.145659+0000","last_undegraded":"2024-03-09T15:20:12.145659+0000","last_fullsized":"2024-03-09T15:20:12.145659+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:08.873263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":83,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158796+0000","last_change":"2024-03-09T14:31:01.137580+0000","last_active":"2024-03-09T15:20:02.158796+0000","last_peered":"2024-03-09T15:20:02.158796+0000","last_clean":"2024-03-09T15:20:02.158796+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:02.158796+0000","last_undegraded":"2024-03-09T15:20:02.158796+0000","last_fullsized":"2024-03-09T15:20:02.158796+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:12.605404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.006645+0000","last_change":"2024-03-09T14:50:03.660277+0000","last_active":"2024-03-09T15:21:32.006645+0000","last_peered":"2024-03-09T15:21:32.006645+0000","last_clean":"2024-03-09T15:21:32.006645+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:21:32.006645+0000","last_undegraded":"2024-03-09T15:21:32.006645+0000","last_fullsized":"2024-03-09T15:21:32.006645+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:40.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992671+0000","last_change":"2024-03-09T14:35:55.600712+0000","last_active":"2024-03-09T15:20:16.992671+0000","last_peered":"2024-03-09T15:20:16.992671+0000","last_clean":"2024-03-09T15:20:16.992671+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:20:16.992671+0000","last_undegraded":"2024-03-09T15:20:16.992671+0000","last_fullsized":"2024-03-09T15:20:16.992671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:03.894551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.004349+0000","last_change":"2024-03-09T14:35:50.590828+0000","last_active":"2024-03-09T15:20:12.004349+0000","last_peered":"2024-03-09T15:20:12.004349+0000","last_clean":"2024-03-09T15:20:12.004349+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:20:12.004349+0000","last_undegraded":"2024-03-09T15:20:12.004349+0000","last_fullsized":"2024-03-09T15:20:12.004349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:47.297475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996277+0000","last_change":"2024-03-09T14:31:01.144397+0000","last_active":"2024-03-09T15:20:01.996277+0000","last_peered":"2024-03-09T15:20:01.996277+0000","last_clean":"2024-03-09T15:20:01.996277+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:20:01.996277+0000","last_undegraded":"2024-03-09T15:20:01.996277+0000","last_fullsized":"2024-03-09T15:20:01.996277+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:38.797574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000514+0000","last_change":"2024-03-09T14:50:03.662986+0000","last_active":"2024-03-09T15:20:37.000514+0000","last_peered":"2024-03-09T15:20:37.000514+0000","last_clean":"2024-03-09T15:20:37.000514+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:20:37.000514+0000","last_undegraded":"2024-03-09T15:20:37.000514+0000","last_fullsized":"2024-03-09T15:20:37.000514+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:12.215808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.005063+0000","last_change":"2024-03-09T14:35:55.606971+0000","last_active":"2024-03-09T15:20:17.005063+0000","last_peered":"2024-03-09T15:20:17.005063+0000","last_clean":"2024-03-09T15:20:17.005063+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:20:17.005063+0000","last_undegraded":"2024-03-09T15:20:17.005063+0000","last_fullsized":"2024-03-09T15:20:17.005063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:59.770598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021829+0000","last_change":"2024-03-09T14:35:50.581340+0000","last_active":"2024-03-09T15:20:12.021829+0000","last_peered":"2024-03-09T15:20:12.021829+0000","last_clean":"2024-03-09T15:20:12.021829+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:20:12.021829+0000","last_undegraded":"2024-03-09T15:20:12.021829+0000","last_fullsized":"2024-03-09T15:20:12.021829+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:47.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'83","reported_seq":297,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144192+0000","last_change":"2024-03-09T14:31:01.140501+0000","last_active":"2024-03-09T15:20:02.144192+0000","last_peered":"2024-03-09T15:20:02.144192+0000","last_clean":"2024-03-09T15:20:02.144192+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:20:02.144192+0000","last_undegraded":"2024-03-09T15:20:02.144192+0000","last_fullsized":"2024-03-09T15:20:02.144192+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:25.600781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014299+0000","last_change":"2024-03-09T14:50:03.654675+0000","last_active":"2024-03-09T15:21:32.014299+0000","last_peered":"2024-03-09T15:21:32.014299+0000","last_clean":"2024-03-09T15:21:32.014299+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:21:32.014299+0000","last_undegraded":"2024-03-09T15:21:32.014299+0000","last_fullsized":"2024-03-09T15:21:32.014299+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:16.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022667+0000","last_change":"2024-03-09T14:35:55.607431+0000","last_active":"2024-03-09T15:20:17.022667+0000","last_peered":"2024-03-09T15:20:17.022667+0000","last_clean":"2024-03-09T15:20:17.022667+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:20:17.022667+0000","last_undegraded":"2024-03-09T15:20:17.022667+0000","last_fullsized":"2024-03-09T15:20:17.022667+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021909+0000","last_change":"2024-03-09T14:35:50.592140+0000","last_active":"2024-03-09T15:20:12.021909+0000","last_peered":"2024-03-09T15:20:12.021909+0000","last_clean":"2024-03-09T15:20:12.021909+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:20:12.021909+0000","last_undegraded":"2024-03-09T15:20:12.021909+0000","last_fullsized":"2024-03-09T15:20:12.021909+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:08.154255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.002932+0000","last_change":"2024-03-09T14:31:01.141535+0000","last_active":"2024-03-09T15:20:02.002932+0000","last_peered":"2024-03-09T15:20:02.002932+0000","last_clean":"2024-03-09T15:20:02.002932+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:20:02.002932+0000","last_undegraded":"2024-03-09T15:20:02.002932+0000","last_fullsized":"2024-03-09T15:20:02.002932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:30.104908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993313+0000","last_change":"2024-03-09T14:50:03.655565+0000","last_active":"2024-03-09T15:20:36.993313+0000","last_peered":"2024-03-09T15:20:36.993313+0000","last_clean":"2024-03-09T15:20:36.993313+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:20:36.993313+0000","last_undegraded":"2024-03-09T15:20:36.993313+0000","last_fullsized":"2024-03-09T15:20:36.993313+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:49.229016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'6","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009911+0000","last_change":"2024-03-09T14:35:55.606305+0000","last_active":"2024-03-09T15:20:57.009911+0000","last_peered":"2024-03-09T15:20:57.009911+0000","last_clean":"2024-03-09T15:20:57.009911+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:20:57.009911+0000","last_undegraded":"2024-03-09T15:20:57.009911+0000","last_fullsized":"2024-03-09T15:20:57.009911+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:34.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20522,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'6","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.166560+0000","last_change":"2024-03-09T14:35:50.588195+0000","last_active":"2024-03-09T15:20:52.166560+0000","last_peered":"2024-03-09T15:20:52.166560+0000","last_clean":"2024-03-09T15:20:52.166560+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:20:52.166560+0000","last_undegraded":"2024-03-09T15:20:52.166560+0000","last_fullsized":"2024-03-09T15:20:52.166560+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:50:18.644010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5957105,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":6842,"num_write":11,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008749+0000","last_change":"2024-03-09T14:31:01.145852+0000","last_active":"2024-03-09T15:20:47.008749+0000","last_peered":"2024-03-09T15:20:47.008749+0000","last_clean":"2024-03-09T15:20:47.008749+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:20:47.008749+0000","last_undegraded":"2024-03-09T15:20:47.008749+0000","last_fullsized":"2024-03-09T15:20:47.008749+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:57.994897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172868+0000","last_change":"2024-03-09T14:50:03.664102+0000","last_active":"2024-03-09T15:21:37.172868+0000","last_peered":"2024-03-09T15:21:37.172868+0000","last_clean":"2024-03-09T15:21:37.172868+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:21:37.172868+0000","last_undegraded":"2024-03-09T15:21:37.172868+0000","last_fullsized":"2024-03-09T15:21:37.172868+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:04.844692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.034355+0000","last_change":"2024-03-09T14:36:32.678035+0000","last_active":"2024-03-09T15:21:37.034355+0000","last_peered":"2024-03-09T15:21:37.034355+0000","last_clean":"2024-03-09T15:21:37.034355+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:21:37.034355+0000","last_undegraded":"2024-03-09T15:21:37.034355+0000","last_fullsized":"2024-03-09T15:21:37.034355+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:52.793827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.994913+0000","last_change":"2024-03-09T14:35:50.593689+0000","last_active":"2024-03-09T15:20:51.994913+0000","last_peered":"2024-03-09T15:20:51.994913+0000","last_clean":"2024-03-09T15:20:51.994913+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:20:51.994913+0000","last_undegraded":"2024-03-09T15:20:51.994913+0000","last_fullsized":"2024-03-09T15:20:51.994913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:17.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024819+0000","last_change":"2024-03-09T14:31:01.138384+0000","last_active":"2024-03-09T15:20:32.024819+0000","last_peered":"2024-03-09T15:20:32.024819+0000","last_clean":"2024-03-09T15:20:32.024819+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:20:32.024819+0000","last_undegraded":"2024-03-09T15:20:32.024819+0000","last_fullsized":"2024-03-09T15:20:32.024819+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:52.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023996+0000","last_change":"2024-03-09T14:50:03.658657+0000","last_active":"2024-03-09T15:20:27.023996+0000","last_peered":"2024-03-09T15:20:27.023996+0000","last_clean":"2024-03-09T15:20:27.023996+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:20:27.023996+0000","last_undegraded":"2024-03-09T15:20:27.023996+0000","last_fullsized":"2024-03-09T15:20:27.023996+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:18.812497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:06.998034+0000","last_change":"2024-03-09T14:35:55.635179+0000","last_active":"2024-03-09T15:21:06.998034+0000","last_peered":"2024-03-09T15:21:06.998034+0000","last_clean":"2024-03-09T15:21:06.998034+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:21:06.998034+0000","last_undegraded":"2024-03-09T15:21:06.998034+0000","last_fullsized":"2024-03-09T15:21:06.998034+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:57.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002095+0000","last_change":"2024-03-09T14:35:50.588159+0000","last_active":"2024-03-09T15:20:52.002095+0000","last_peered":"2024-03-09T15:20:52.002095+0000","last_clean":"2024-03-09T15:20:52.002095+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:20:52.002095+0000","last_undegraded":"2024-03-09T15:20:52.002095+0000","last_fullsized":"2024-03-09T15:20:52.002095+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:42.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024744+0000","last_change":"2024-03-09T14:31:01.139440+0000","last_active":"2024-03-09T15:20:32.024744+0000","last_peered":"2024-03-09T15:20:32.024744+0000","last_clean":"2024-03-09T15:20:32.024744+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:20:32.024744+0000","last_undegraded":"2024-03-09T15:20:32.024744+0000","last_fullsized":"2024-03-09T15:20:32.024744+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:05.382467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162719+0000","last_change":"2024-03-09T14:50:03.657344+0000","last_active":"2024-03-09T15:20:27.162719+0000","last_peered":"2024-03-09T15:20:27.162719+0000","last_clean":"2024-03-09T15:20:27.162719+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:20:27.162719+0000","last_undegraded":"2024-03-09T15:20:27.162719+0000","last_fullsized":"2024-03-09T15:20:27.162719+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:00.699350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009935+0000","last_change":"2024-03-09T14:35:55.603538+0000","last_active":"2024-03-09T15:20:57.009935+0000","last_peered":"2024-03-09T15:20:57.009935+0000","last_clean":"2024-03-09T15:20:57.009935+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:20:57.009935+0000","last_undegraded":"2024-03-09T15:20:57.009935+0000","last_fullsized":"2024-03-09T15:20:57.009935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:48.904849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'1","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997509+0000","last_change":"2024-03-09T14:35:50.587122+0000","last_active":"2024-03-09T15:21:01.997509+0000","last_peered":"2024-03-09T15:21:01.997509+0000","last_clean":"2024-03-09T15:21:01.997509+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:21:01.997509+0000","last_undegraded":"2024-03-09T15:21:01.997509+0000","last_fullsized":"2024-03-09T15:21:01.997509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:59.885398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992702+0000","last_change":"2024-03-09T14:31:01.142302+0000","last_active":"2024-03-09T15:20:31.992702+0000","last_peered":"2024-03-09T15:20:31.992702+0000","last_clean":"2024-03-09T15:20:31.992702+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:20:31.992702+0000","last_undegraded":"2024-03-09T15:20:31.992702+0000","last_fullsized":"2024-03-09T15:20:31.992702+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:40.401950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.014916+0000","last_change":"2024-03-09T14:50:03.656718+0000","last_active":"2024-03-09T15:21:37.014916+0000","last_peered":"2024-03-09T15:21:37.014916+0000","last_clean":"2024-03-09T15:21:37.014916+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:21:37.014916+0000","last_undegraded":"2024-03-09T15:21:37.014916+0000","last_fullsized":"2024-03-09T15:21:37.014916+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:52.066966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'7","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.157899+0000","last_change":"2024-03-09T14:35:55.603262+0000","last_active":"2024-03-09T15:21:27.157899+0000","last_peered":"2024-03-09T15:21:27.157899+0000","last_clean":"2024-03-09T15:21:27.157899+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:21:27.157899+0000","last_undegraded":"2024-03-09T15:21:27.157899+0000","last_fullsized":"2024-03-09T15:21:27.157899+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:45.193657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":14338,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005483+0000","last_change":"2024-03-09T14:35:50.586279+0000","last_active":"2024-03-09T15:21:22.005483+0000","last_peered":"2024-03-09T15:21:22.005483+0000","last_clean":"2024-03-09T15:21:22.005483+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:21:22.005483+0000","last_undegraded":"2024-03-09T15:21:22.005483+0000","last_fullsized":"2024-03-09T15:21:22.005483+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:50.461301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999932+0000","last_change":"2024-03-09T14:31:01.148313+0000","last_active":"2024-03-09T15:20:31.999932+0000","last_peered":"2024-03-09T15:20:31.999932+0000","last_clean":"2024-03-09T15:20:31.999932+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:20:31.999932+0000","last_undegraded":"2024-03-09T15:20:31.999932+0000","last_fullsized":"2024-03-09T15:20:31.999932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:27.523628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173665+0000","last_change":"2024-03-09T14:50:03.659935+0000","last_active":"2024-03-09T15:21:42.173665+0000","last_peered":"2024-03-09T15:21:42.173665+0000","last_clean":"2024-03-09T15:21:42.173665+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:21:42.173665+0000","last_undegraded":"2024-03-09T15:21:42.173665+0000","last_fullsized":"2024-03-09T15:21:42.173665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:35.107226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171479+0000","last_change":"2024-03-09T14:35:55.633083+0000","last_active":"2024-03-09T15:21:27.171479+0000","last_peered":"2024-03-09T15:21:27.171479+0000","last_clean":"2024-03-09T15:21:27.171479+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:21:27.171479+0000","last_undegraded":"2024-03-09T15:21:27.171479+0000","last_fullsized":"2024-03-09T15:21:27.171479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:21.416130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999575+0000","last_change":"2024-03-09T14:35:50.583192+0000","last_active":"2024-03-09T15:21:21.999575+0000","last_peered":"2024-03-09T15:21:21.999575+0000","last_clean":"2024-03-09T15:21:21.999575+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:21:21.999575+0000","last_undegraded":"2024-03-09T15:21:21.999575+0000","last_fullsized":"2024-03-09T15:21:21.999575+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:36.010771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.167798+0000","last_change":"2024-03-09T14:31:01.138602+0000","last_active":"2024-03-09T15:21:02.167798+0000","last_peered":"2024-03-09T15:21:02.167798+0000","last_clean":"2024-03-09T15:21:02.167798+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:21:02.167798+0000","last_undegraded":"2024-03-09T15:21:02.167798+0000","last_fullsized":"2024-03-09T15:21:02.167798+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:22.514104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172891+0000","last_change":"2024-03-09T14:50:03.659514+0000","last_active":"2024-03-09T15:21:37.172891+0000","last_peered":"2024-03-09T15:21:37.172891+0000","last_clean":"2024-03-09T15:21:37.172891+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:21:37.172891+0000","last_undegraded":"2024-03-09T15:21:37.172891+0000","last_fullsized":"2024-03-09T15:21:37.172891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:41.947406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:56.996980+0000","last_change":"2024-03-09T14:35:55.605840+0000","last_active":"2024-03-09T15:20:56.996980+0000","last_peered":"2024-03-09T15:20:56.996980+0000","last_clean":"2024-03-09T15:20:56.996980+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:20:56.996980+0000","last_undegraded":"2024-03-09T15:20:56.996980+0000","last_fullsized":"2024-03-09T15:20:56.996980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:02.619502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'1","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:41.902673+0000","last_change":"2024-03-09T14:35:50.584614+0000","last_active":"2024-03-09T15:21:41.902673+0000","last_peered":"2024-03-09T15:21:41.902673+0000","last_clean":"2024-03-09T15:21:41.902673+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:21:41.902673+0000","last_undegraded":"2024-03-09T15:21:41.902673+0000","last_fullsized":"2024-03-09T15:21:41.902673+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:53.029868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009230+0000","last_change":"2024-03-09T14:31:01.141879+0000","last_active":"2024-03-09T15:20:52.009230+0000","last_peered":"2024-03-09T15:20:52.009230+0000","last_clean":"2024-03-09T15:20:52.009230+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:20:52.009230+0000","last_undegraded":"2024-03-09T15:20:52.009230+0000","last_fullsized":"2024-03-09T15:20:52.009230+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:28.690709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:36.902107+0000","last_change":"2024-03-09T14:50:03.659852+0000","last_active":"2024-03-09T15:21:36.902107+0000","last_peered":"2024-03-09T15:21:36.902107+0000","last_clean":"2024-03-09T15:21:36.902107+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:21:36.902107+0000","last_undegraded":"2024-03-09T15:21:36.902107+0000","last_fullsized":"2024-03-09T15:21:36.902107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:56.267905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172839+0000","last_change":"2024-03-09T14:35:55.601630+0000","last_active":"2024-03-09T15:21:37.172839+0000","last_peered":"2024-03-09T15:21:37.172839+0000","last_clean":"2024-03-09T15:21:37.172839+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:21:37.172839+0000","last_undegraded":"2024-03-09T15:21:37.172839+0000","last_fullsized":"2024-03-09T15:21:37.172839+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:40.116666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'3","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151186+0000","last_change":"2024-03-09T14:35:50.593430+0000","last_active":"2024-03-09T15:20:52.151186+0000","last_peered":"2024-03-09T15:20:52.151186+0000","last_clean":"2024-03-09T15:20:52.151186+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:20:52.151186+0000","last_undegraded":"2024-03-09T15:20:52.151186+0000","last_fullsized":"2024-03-09T15:20:52.151186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:07.895578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5283025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":10280,"num_write":8,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027735+0000","last_change":"2024-03-09T14:31:01.140169+0000","last_active":"2024-03-09T15:20:52.027735+0000","last_peered":"2024-03-09T15:20:52.027735+0000","last_clean":"2024-03-09T15:20:52.027735+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:20:52.027735+0000","last_undegraded":"2024-03-09T15:20:52.027735+0000","last_fullsized":"2024-03-09T15:20:52.027735+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:33.984575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170878+0000","last_change":"2024-03-09T14:50:03.660084+0000","last_active":"2024-03-09T15:21:22.170878+0000","last_peered":"2024-03-09T15:21:22.170878+0000","last_clean":"2024-03-09T15:21:22.170878+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:21:22.170878+0000","last_undegraded":"2024-03-09T15:21:22.170878+0000","last_fullsized":"2024-03-09T15:21:22.170878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:00.134823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905652+0000","last_change":"2024-03-09T14:35:55.603484+0000","last_active":"2024-03-09T15:22:06.905652+0000","last_peered":"2024-03-09T15:22:06.905652+0000","last_clean":"2024-03-09T15:22:06.905652+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:22:06.905652+0000","last_undegraded":"2024-03-09T15:22:06.905652+0000","last_fullsized":"2024-03-09T15:22:06.905652+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:49.786326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173621+0000","last_change":"2024-03-09T14:35:50.584143+0000","last_active":"2024-03-09T15:21:42.173621+0000","last_peered":"2024-03-09T15:21:42.173621+0000","last_clean":"2024-03-09T15:21:42.173621+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:21:42.173621+0000","last_undegraded":"2024-03-09T15:21:42.173621+0000","last_fullsized":"2024-03-09T15:21:42.173621+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:51.754061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":182,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002119+0000","last_change":"2024-03-09T14:31:01.149003+0000","last_active":"2024-03-09T15:20:52.002119+0000","last_peered":"2024-03-09T15:20:52.002119+0000","last_clean":"2024-03-09T15:20:52.002119+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:20:52.002119+0000","last_undegraded":"2024-03-09T15:20:52.002119+0000","last_fullsized":"2024-03-09T15:20:52.002119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:24.001646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032229+0000","last_change":"2024-03-09T14:50:03.664606+0000","last_active":"2024-03-09T15:21:22.032229+0000","last_peered":"2024-03-09T15:21:22.032229+0000","last_clean":"2024-03-09T15:21:22.032229+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:21:22.032229+0000","last_undegraded":"2024-03-09T15:21:22.032229+0000","last_fullsized":"2024-03-09T15:21:22.032229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.328351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903317+0000","last_change":"2024-03-09T14:35:55.633776+0000","last_active":"2024-03-09T15:21:46.903317+0000","last_peered":"2024-03-09T15:21:46.903317+0000","last_clean":"2024-03-09T15:21:46.903317+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:21:46.903317+0000","last_undegraded":"2024-03-09T15:21:46.903317+0000","last_fullsized":"2024-03-09T15:21:46.903317+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:12:36.318597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.000932+0000","last_change":"2024-03-09T14:35:50.591618+0000","last_active":"2024-03-09T15:21:52.000932+0000","last_peered":"2024-03-09T15:21:52.000932+0000","last_clean":"2024-03-09T15:21:52.000932+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:21:52.000932+0000","last_undegraded":"2024-03-09T15:21:52.000932+0000","last_fullsized":"2024-03-09T15:21:52.000932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:28.323159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027822+0000","last_change":"2024-03-09T14:31:01.137572+0000","last_active":"2024-03-09T15:20:52.027822+0000","last_peered":"2024-03-09T15:20:52.027822+0000","last_clean":"2024-03-09T15:20:52.027822+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:52.027822+0000","last_undegraded":"2024-03-09T15:20:52.027822+0000","last_fullsized":"2024-03-09T15:20:52.027822+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:52.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.005314+0000","last_change":"2024-03-09T14:50:03.658082+0000","last_active":"2024-03-09T15:22:17.005314+0000","last_peered":"2024-03-09T15:22:17.005314+0000","last_clean":"2024-03-09T15:22:17.005314+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:22:17.005314+0000","last_undegraded":"2024-03-09T15:22:17.005314+0000","last_fullsized":"2024-03-09T15:22:17.005314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:47.239990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171609+0000","last_change":"2024-03-09T14:35:55.634847+0000","last_active":"2024-03-09T15:21:27.171609+0000","last_peered":"2024-03-09T15:21:27.171609+0000","last_clean":"2024-03-09T15:21:27.171609+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:21:27.171609+0000","last_undegraded":"2024-03-09T15:21:27.171609+0000","last_fullsized":"2024-03-09T15:21:27.171609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:24.831161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032308+0000","last_change":"2024-03-09T14:35:50.590046+0000","last_active":"2024-03-09T15:21:22.032308+0000","last_peered":"2024-03-09T15:21:22.032308+0000","last_clean":"2024-03-09T15:21:22.032308+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:21:22.032308+0000","last_undegraded":"2024-03-09T15:21:22.032308+0000","last_fullsized":"2024-03-09T15:21:22.032308+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:09.975491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169286+0000","last_change":"2024-03-09T14:31:01.145294+0000","last_active":"2024-03-09T15:21:12.169286+0000","last_peered":"2024-03-09T15:21:12.169286+0000","last_clean":"2024-03-09T15:21:12.169286+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:21:12.169286+0000","last_undegraded":"2024-03-09T15:21:12.169286+0000","last_fullsized":"2024-03-09T15:21:12.169286+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:45.565527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.157206+0000","last_change":"2024-03-09T14:50:03.664652+0000","last_active":"2024-03-09T15:21:22.157206+0000","last_peered":"2024-03-09T15:21:22.157206+0000","last_clean":"2024-03-09T15:21:22.157206+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:21:22.157206+0000","last_undegraded":"2024-03-09T15:21:22.157206+0000","last_fullsized":"2024-03-09T15:21:22.157206+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:30.997877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'4","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.157985+0000","last_change":"2024-03-09T14:35:55.606581+0000","last_active":"2024-03-09T15:21:27.157985+0000","last_peered":"2024-03-09T15:21:27.157985+0000","last_clean":"2024-03-09T15:21:27.157985+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:21:27.157985+0000","last_undegraded":"2024-03-09T15:21:27.157985+0000","last_fullsized":"2024-03-09T15:21:27.157985+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:53:40.747872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":4,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'5","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170949+0000","last_change":"2024-03-09T14:35:50.588264+0000","last_active":"2024-03-09T15:21:22.170949+0000","last_peered":"2024-03-09T15:21:22.170949+0000","last_clean":"2024-03-09T15:21:22.170949+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:21:22.170949+0000","last_undegraded":"2024-03-09T15:21:22.170949+0000","last_fullsized":"2024-03-09T15:21:22.170949+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:37.262134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":9232,"num_write":5,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":232,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997471+0000","last_change":"2024-03-09T14:31:01.140875+0000","last_active":"2024-03-09T15:21:01.997471+0000","last_peered":"2024-03-09T15:21:01.997471+0000","last_clean":"2024-03-09T15:21:01.997471+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:21:01.997471+0000","last_undegraded":"2024-03-09T15:21:01.997471+0000","last_fullsized":"2024-03-09T15:21:01.997471+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:48:41.613699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992174+0000","last_change":"2024-03-09T14:50:03.659231+0000","last_active":"2024-03-09T15:20:26.992174+0000","last_peered":"2024-03-09T15:20:26.992174+0000","last_clean":"2024-03-09T15:20:26.992174+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:20:26.992174+0000","last_undegraded":"2024-03-09T15:20:26.992174+0000","last_fullsized":"2024-03-09T15:20:26.992174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:29.158875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'4","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002102+0000","last_change":"2024-03-09T14:35:55.596692+0000","last_active":"2024-03-09T15:21:47.002102+0000","last_peered":"2024-03-09T15:21:47.002102+0000","last_clean":"2024-03-09T15:21:47.002102+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:21:47.002102+0000","last_undegraded":"2024-03-09T15:21:47.002102+0000","last_fullsized":"2024-03-09T15:21:47.002102+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:12.701527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'6","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.048034+0000","last_change":"2024-03-09T14:35:50.591561+0000","last_active":"2024-03-09T15:22:07.048034+0000","last_peered":"2024-03-09T15:22:07.048034+0000","last_clean":"2024-03-09T15:22:07.048034+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:22:07.048034+0000","last_undegraded":"2024-03-09T15:22:07.048034+0000","last_fullsized":"2024-03-09T15:22:07.048034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:32.145049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4138,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'95","reported_seq":333,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029266+0000","last_change":"2024-03-09T14:31:01.135715+0000","last_active":"2024-03-09T15:21:02.029266+0000","last_peered":"2024-03-09T15:21:02.029266+0000","last_clean":"2024-03-09T15:21:02.029266+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:21:02.029266+0000","last_undegraded":"2024-03-09T15:21:02.029266+0000","last_fullsized":"2024-03-09T15:21:02.029266+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999435+0000","last_change":"2024-03-09T14:50:03.655635+0000","last_active":"2024-03-09T15:20:26.999435+0000","last_peered":"2024-03-09T15:20:26.999435+0000","last_clean":"2024-03-09T15:20:26.999435+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:20:26.999435+0000","last_undegraded":"2024-03-09T15:20:26.999435+0000","last_fullsized":"2024-03-09T15:20:26.999435+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:27.965268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038744+0000","last_change":"2024-03-09T14:35:55.599321+0000","last_active":"2024-03-09T15:22:07.038744+0000","last_peered":"2024-03-09T15:22:07.038744+0000","last_clean":"2024-03-09T15:22:07.038744+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:22:07.038744+0000","last_undegraded":"2024-03-09T15:22:07.038744+0000","last_fullsized":"2024-03-09T15:22:07.038744+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:11.127875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'5","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173528+0000","last_change":"2024-03-09T14:35:50.590738+0000","last_active":"2024-03-09T15:21:42.173528+0000","last_peered":"2024-03-09T15:21:42.173528+0000","last_clean":"2024-03-09T15:21:42.173528+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:21:42.173528+0000","last_undegraded":"2024-03-09T15:21:42.173528+0000","last_fullsized":"2024-03-09T15:21:42.173528+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:21.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339884,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10288,"num_write":5,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":174,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.152669+0000","last_change":"2024-03-09T14:31:01.141681+0000","last_active":"2024-03-09T15:21:02.152669+0000","last_peered":"2024-03-09T15:21:02.152669+0000","last_clean":"2024-03-09T15:21:02.152669+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:21:02.152669+0000","last_undegraded":"2024-03-09T15:21:02.152669+0000","last_fullsized":"2024-03-09T15:21:02.152669+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:15.144703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005544+0000","last_change":"2024-03-09T14:50:03.658063+0000","last_active":"2024-03-09T15:21:22.005544+0000","last_peered":"2024-03-09T15:21:22.005544+0000","last_clean":"2024-03-09T15:21:22.005544+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:21:22.005544+0000","last_undegraded":"2024-03-09T15:21:22.005544+0000","last_fullsized":"2024-03-09T15:21:22.005544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:35.088953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.035791+0000","last_change":"2024-03-09T14:35:55.604413+0000","last_active":"2024-03-09T15:21:47.035791+0000","last_peered":"2024-03-09T15:21:47.035791+0000","last_clean":"2024-03-09T15:21:47.035791+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:21:47.035791+0000","last_undegraded":"2024-03-09T15:21:47.035791+0000","last_fullsized":"2024-03-09T15:21:47.035791+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:57.199079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'2","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.001611+0000","last_change":"2024-03-09T14:35:50.580849+0000","last_active":"2024-03-09T15:21:42.001611+0000","last_peered":"2024-03-09T15:21:42.001611+0000","last_clean":"2024-03-09T15:21:42.001611+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:21:42.001611+0000","last_undegraded":"2024-03-09T15:21:42.001611+0000","last_fullsized":"2024-03-09T15:21:42.001611+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:35.776820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029254+0000","last_change":"2024-03-09T14:31:01.141116+0000","last_active":"2024-03-09T15:21:02.029254+0000","last_peered":"2024-03-09T15:21:02.029254+0000","last_clean":"2024-03-09T15:21:02.029254+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:21:02.029254+0000","last_undegraded":"2024-03-09T15:21:02.029254+0000","last_fullsized":"2024-03-09T15:21:02.029254+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:23.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171561+0000","last_change":"2024-03-09T14:50:03.662160+0000","last_active":"2024-03-09T15:21:27.171561+0000","last_peered":"2024-03-09T15:21:27.171561+0000","last_clean":"2024-03-09T15:21:27.171561+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:21:27.171561+0000","last_undegraded":"2024-03-09T15:21:27.171561+0000","last_fullsized":"2024-03-09T15:21:27.171561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:05.477257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.160855+0000","last_change":"2024-03-09T14:35:55.603267+0000","last_active":"2024-03-09T15:21:47.160855+0000","last_peered":"2024-03-09T15:21:47.160855+0000","last_clean":"2024-03-09T15:21:47.160855+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:21:47.160855+0000","last_undegraded":"2024-03-09T15:21:47.160855+0000","last_fullsized":"2024-03-09T15:21:47.160855+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:33.336533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.034960+0000","last_change":"2024-03-09T14:35:50.579692+0000","last_active":"2024-03-09T15:21:42.034960+0000","last_peered":"2024-03-09T15:21:42.034960+0000","last_clean":"2024-03-09T15:21:42.034960+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:21:42.034960+0000","last_undegraded":"2024-03-09T15:21:42.034960+0000","last_fullsized":"2024-03-09T15:21:42.034960+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:53.022221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169202+0000","last_change":"2024-03-09T14:31:01.140181+0000","last_active":"2024-03-09T15:21:12.169202+0000","last_peered":"2024-03-09T15:21:12.169202+0000","last_clean":"2024-03-09T15:21:12.169202+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:21:12.169202+0000","last_undegraded":"2024-03-09T15:21:12.169202+0000","last_fullsized":"2024-03-09T15:21:12.169202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:06.660569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'216","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.103557+0000","last_change":"2024-03-09T14:21:54.364507+0000","last_active":"2024-03-09T15:23:15.103557+0000","last_peered":"2024-03-09T15:23:15.103557+0000","last_clean":"2024-03-09T15:23:15.103557+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:23:15.103557+0000","last_undegraded":"2024-03-09T15:23:15.103557+0000","last_fullsized":"2024-03-09T15:23:15.103557+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:02.602654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340141,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":32250,"num_write":1231,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'370","reported_seq":1077,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.361437+0000","last_change":"2024-03-09T14:21:56.357692+0000","last_active":"2024-03-09T15:22:36.361437+0000","last_peered":"2024-03-09T15:22:36.361437+0000","last_clean":"2024-03-09T15:22:36.361437+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:22:36.361437+0000","last_undegraded":"2024-03-09T15:22:36.361437+0000","last_fullsized":"2024-03-09T15:22:36.361437+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:59.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'181","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006074+0000","last_change":"2024-03-09T14:21:54.365933+0000","last_active":"2024-03-09T15:22:22.006074+0000","last_peered":"2024-03-09T15:22:22.006074+0000","last_clean":"2024-03-09T15:22:22.006074+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:22:22.006074+0000","last_undegraded":"2024-03-09T15:22:22.006074+0000","last_fullsized":"2024-03-09T15:22:22.006074+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:55:13.927594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16281911,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":348,"num_read_kb":33432,"num_write":990,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046256+0000","last_change":"2024-03-09T14:21:56.371109+0000","last_active":"2024-03-09T15:21:57.046256+0000","last_peered":"2024-03-09T15:21:57.046256+0000","last_clean":"2024-03-09T15:21:57.046256+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:21:57.046256+0000","last_undegraded":"2024-03-09T15:21:57.046256+0000","last_fullsized":"2024-03-09T15:21:57.046256+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:07.830191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.103341+0000","last_change":"2024-03-09T14:21:54.357346+0000","last_active":"2024-03-09T15:22:50.103341+0000","last_peered":"2024-03-09T15:22:50.103341+0000","last_clean":"2024-03-09T15:22:50.103341+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:22:50.103341+0000","last_undegraded":"2024-03-09T15:22:50.103341+0000","last_fullsized":"2024-03-09T15:22:50.103341+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:26.965320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162411+0000","last_change":"2024-03-09T14:21:56.366924+0000","last_active":"2024-03-09T15:21:57.162411+0000","last_peered":"2024-03-09T15:21:57.162411+0000","last_clean":"2024-03-09T15:21:57.162411+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:21:57.162411+0000","last_undegraded":"2024-03-09T15:21:57.162411+0000","last_fullsized":"2024-03-09T15:21:57.162411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:20.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'187","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038840+0000","last_change":"2024-03-09T14:21:54.371185+0000","last_active":"2024-03-09T15:22:07.038840+0000","last_peered":"2024-03-09T15:22:07.038840+0000","last_clean":"2024-03-09T15:22:07.038840+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:22:07.038840+0000","last_undegraded":"2024-03-09T15:22:07.038840+0000","last_fullsized":"2024-03-09T15:22:07.038840+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:56.928314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10859253,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":551,"num_read_kb":57961,"num_write":1116,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904523+0000","last_change":"2024-03-09T14:21:56.372686+0000","last_active":"2024-03-09T15:21:56.904523+0000","last_peered":"2024-03-09T15:21:56.904523+0000","last_clean":"2024-03-09T15:21:56.904523+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:21:56.904523+0000","last_undegraded":"2024-03-09T15:21:56.904523+0000","last_fullsized":"2024-03-09T15:21:56.904523+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:21.714174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'186","reported_seq":916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.741731+0000","last_change":"2024-03-09T14:21:54.361340+0000","last_active":"2024-03-09T15:24:14.741731+0000","last_peered":"2024-03-09T15:24:14.741731+0000","last_clean":"2024-03-09T15:24:14.741731+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:24:14.741731+0000","last_undegraded":"2024-03-09T15:24:14.741731+0000","last_fullsized":"2024-03-09T15:24:14.741731+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:38.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25832994,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":536,"num_read_kb":140946,"num_write":1098,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038703+0000","last_change":"2024-03-09T14:21:56.367286+0000","last_active":"2024-03-09T15:22:07.038703+0000","last_peered":"2024-03-09T15:22:07.038703+0000","last_clean":"2024-03-09T15:22:07.038703+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:22:07.038703+0000","last_undegraded":"2024-03-09T15:22:07.038703+0000","last_fullsized":"2024-03-09T15:22:07.038703+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:52.107232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'183","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.037192+0000","last_change":"2024-03-09T14:21:54.369817+0000","last_active":"2024-03-09T15:21:57.037192+0000","last_peered":"2024-03-09T15:21:57.037192+0000","last_clean":"2024-03-09T15:21:57.037192+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:21:57.037192+0000","last_undegraded":"2024-03-09T15:21:57.037192+0000","last_fullsized":"2024-03-09T15:21:57.037192+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:45.301805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11413170,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":389,"num_read_kb":13387,"num_write":1027,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166139+0000","last_change":"2024-03-09T14:21:56.359071+0000","last_active":"2024-03-09T15:22:22.166139+0000","last_peered":"2024-03-09T15:22:22.166139+0000","last_clean":"2024-03-09T15:22:22.166139+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:22:22.166139+0000","last_undegraded":"2024-03-09T15:22:22.166139+0000","last_fullsized":"2024-03-09T15:22:22.166139+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:29.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046242+0000","last_change":"2024-03-09T14:21:54.360895+0000","last_active":"2024-03-09T15:21:57.046242+0000","last_peered":"2024-03-09T15:21:57.046242+0000","last_clean":"2024-03-09T15:21:57.046242+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:21:57.046242+0000","last_undegraded":"2024-03-09T15:21:57.046242+0000","last_fullsized":"2024-03-09T15:21:57.046242+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:47.207849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:17.701829+0000","last_change":"2024-03-09T14:23:32.139848+0000","last_active":"2024-03-09T15:23:17.701829+0000","last_peered":"2024-03-09T15:23:17.701829+0000","last_clean":"2024-03-09T15:23:17.701829+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:23:17.701829+0000","last_undegraded":"2024-03-09T15:23:17.701829+0000","last_fullsized":"2024-03-09T15:23:17.701829+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:13:35.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'198","reported_seq":852,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.312186+0000","last_change":"2024-03-09T14:21:54.367692+0000","last_active":"2024-03-09T15:24:28.312186+0000","last_peered":"2024-03-09T15:24:28.312186+0000","last_clean":"2024-03-09T15:24:28.312186+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:24:28.312186+0000","last_undegraded":"2024-03-09T15:24:28.312186+0000","last_fullsized":"2024-03-09T15:24:28.312186+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:00:15.272460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505066,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":42906,"num_write":1254,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003815+0000","last_change":"2024-03-09T14:21:56.362728+0000","last_active":"2024-03-09T15:22:22.003815+0000","last_peered":"2024-03-09T15:22:22.003815+0000","last_clean":"2024-03-09T15:22:22.003815+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:22:22.003815+0000","last_undegraded":"2024-03-09T15:22:22.003815+0000","last_fullsized":"2024-03-09T15:22:22.003815+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:45.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'152","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.039856+0000","last_change":"2024-03-09T14:21:56.368382+0000","last_active":"2024-03-09T15:22:58.039856+0000","last_peered":"2024-03-09T15:22:58.039856+0000","last_clean":"2024-03-09T15:22:58.039856+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:22:58.039856+0000","last_undegraded":"2024-03-09T15:22:58.039856+0000","last_fullsized":"2024-03-09T15:22:58.039856+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:14.989000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'167","reported_seq":809,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.069704+0000","last_change":"2024-03-09T14:21:54.358160+0000","last_active":"2024-03-09T15:21:08.069704+0000","last_peered":"2024-03-09T15:21:08.069704+0000","last_clean":"2024-03-09T15:21:08.069704+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:21:08.069704+0000","last_undegraded":"2024-03-09T15:21:08.069704+0000","last_fullsized":"2024-03-09T15:21:08.069704+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:23:07.592095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5921421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":28832,"num_write":1014,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160954+0000","last_change":"2024-03-09T14:21:56.371113+0000","last_active":"2024-03-09T15:20:17.160954+0000","last_peered":"2024-03-09T15:20:17.160954+0000","last_clean":"2024-03-09T15:20:17.160954+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:20:17.160954+0000","last_undegraded":"2024-03-09T15:20:17.160954+0000","last_fullsized":"2024-03-09T15:20:17.160954+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:56.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'201","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019772+0000","last_change":"2024-03-09T14:21:54.366475+0000","last_active":"2024-03-09T15:19:57.019772+0000","last_peered":"2024-03-09T15:19:57.019772+0000","last_clean":"2024-03-09T15:19:57.019772+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:19:57.019772+0000","last_undegraded":"2024-03-09T15:19:57.019772+0000","last_fullsized":"2024-03-09T15:19:57.019772+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:47.826416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14711542,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":392,"num_read_kb":20924,"num_write":1100,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.378336+0000","last_change":"2024-03-09T14:21:56.362335+0000","last_active":"2024-03-09T15:24:28.378336+0000","last_peered":"2024-03-09T15:24:28.378336+0000","last_clean":"2024-03-09T15:24:28.378336+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:24:28.378336+0000","last_undegraded":"2024-03-09T15:24:28.378336+0000","last_fullsized":"2024-03-09T15:24:28.378336+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:04.650448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'190","reported_seq":881,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:55.883915+0000","last_change":"2024-03-09T14:21:54.369118+0000","last_active":"2024-03-09T15:20:55.883915+0000","last_peered":"2024-03-09T15:20:55.883915+0000","last_clean":"2024-03-09T15:20:55.883915+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:20:55.883915+0000","last_undegraded":"2024-03-09T15:20:55.883915+0000","last_fullsized":"2024-03-09T15:20:55.883915+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:23.759764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904028,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":640,"num_read_kb":129688,"num_write":1090,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'327","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.988967+0000","last_change":"2024-03-09T14:21:56.363364+0000","last_active":"2024-03-09T15:19:56.988967+0000","last_peered":"2024-03-09T15:19:56.988967+0000","last_clean":"2024-03-09T15:19:56.988967+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:19:56.988967+0000","last_undegraded":"2024-03-09T15:19:56.988967+0000","last_fullsized":"2024-03-09T15:19:56.988967+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:59.653300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'184","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:54.109866+0000","last_change":"2024-03-09T14:22:31.545671+0000","last_active":"2024-03-09T15:22:54.109866+0000","last_peered":"2024-03-09T15:22:54.109866+0000","last_clean":"2024-03-09T15:22:54.109866+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:22:54.109866+0000","last_undegraded":"2024-03-09T15:22:54.109866+0000","last_fullsized":"2024-03-09T15:22:54.109866+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:17.161201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1397961,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":17983,"num_write":1106,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":687,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.338240+0000","last_change":"2024-03-09T14:21:56.360414+0000","last_active":"2024-03-09T15:22:41.338240+0000","last_peered":"2024-03-09T15:22:41.338240+0000","last_clean":"2024-03-09T15:22:41.338240+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:22:41.338240+0000","last_undegraded":"2024-03-09T15:22:41.338240+0000","last_fullsized":"2024-03-09T15:22:41.338240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:32.887159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'189","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.018393+0000","last_change":"2024-03-09T14:21:54.371479+0000","last_active":"2024-03-09T15:22:32.018393+0000","last_peered":"2024-03-09T15:22:32.018393+0000","last_clean":"2024-03-09T15:22:32.018393+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:22:32.018393+0000","last_undegraded":"2024-03-09T15:22:32.018393+0000","last_fullsized":"2024-03-09T15:22:32.018393+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:20.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":503,"num_read_kb":27148,"num_write":1012,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":733,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.143484+0000","last_change":"2024-03-09T14:21:56.360518+0000","last_active":"2024-03-09T15:19:57.143484+0000","last_peered":"2024-03-09T15:19:57.143484+0000","last_clean":"2024-03-09T15:19:57.143484+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:19:57.143484+0000","last_undegraded":"2024-03-09T15:19:57.143484+0000","last_fullsized":"2024-03-09T15:19:57.143484+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:16.918503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'243","reported_seq":981,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999917+0000","last_change":"2024-03-09T14:21:54.371089+0000","last_active":"2024-03-09T15:20:31.999917+0000","last_peered":"2024-03-09T15:20:31.999917+0000","last_clean":"2024-03-09T15:20:31.999917+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:20:31.999917+0000","last_undegraded":"2024-03-09T15:20:31.999917+0000","last_fullsized":"2024-03-09T15:20:31.999917+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:56.588140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5599382,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1061,"num_read_kb":11712,"num_write":1252,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.145020+0000","last_change":"2024-03-09T14:22:04.407438+0000","last_active":"2024-03-09T15:20:07.145020+0000","last_peered":"2024-03-09T15:20:07.145020+0000","last_clean":"2024-03-09T15:20:07.145020+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:20:07.145020+0000","last_undegraded":"2024-03-09T15:20:07.145020+0000","last_fullsized":"2024-03-09T15:20:07.145020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:02.777937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'115","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.144676+0000","last_change":"2024-03-09T14:21:56.354345+0000","last_active":"2024-03-09T15:21:08.144676+0000","last_peered":"2024-03-09T15:21:08.144676+0000","last_clean":"2024-03-09T15:21:08.144676+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:21:08.144676+0000","last_undegraded":"2024-03-09T15:21:08.144676+0000","last_fullsized":"2024-03-09T15:21:08.144676+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:38.265091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'199","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.341742+0000","last_change":"2024-03-09T14:21:54.364329+0000","last_active":"2024-03-09T15:23:04.341742+0000","last_peered":"2024-03-09T15:23:04.341742+0000","last_clean":"2024-03-09T15:23:04.341742+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:23:04.341742+0000","last_undegraded":"2024-03-09T15:23:04.341742+0000","last_fullsized":"2024-03-09T15:23:04.341742+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:32.579399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":418,"num_read_kb":3002,"num_write":988,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020417+0000","last_change":"2024-03-09T14:21:58.369901+0000","last_active":"2024-03-09T15:20:02.020417+0000","last_peered":"2024-03-09T15:20:02.020417+0000","last_clean":"2024-03-09T15:20:02.020417+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:20:02.020417+0000","last_undegraded":"2024-03-09T15:20:02.020417+0000","last_fullsized":"2024-03-09T15:20:02.020417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:00.598181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'207","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.020490+0000","last_change":"2024-03-09T14:22:00.387965+0000","last_active":"2024-03-09T15:22:56.020490+0000","last_peered":"2024-03-09T15:22:56.020490+0000","last_clean":"2024-03-09T15:22:56.020490+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:22:56.020490+0000","last_undegraded":"2024-03-09T15:22:56.020490+0000","last_fullsized":"2024-03-09T15:22:56.020490+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:55.493455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18332,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":277,"num_read_kb":373,"num_write":168,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158882+0000","last_change":"2024-03-09T14:22:02.391044+0000","last_active":"2024-03-09T15:20:02.158882+0000","last_peered":"2024-03-09T15:20:02.158882+0000","last_clean":"2024-03-09T15:20:02.158882+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:20:02.158882+0000","last_undegraded":"2024-03-09T15:20:02.158882+0000","last_fullsized":"2024-03-09T15:20:02.158882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:46.242039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2478","reported_seq":4903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.846417+0000","last_change":"2024-03-09T14:22:04.401509+0000","last_active":"2024-03-09T15:24:28.846417+0000","last_peered":"2024-03-09T15:24:28.846417+0000","last_clean":"2024-03-09T15:24:28.846417+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:28.846417+0000","last_undegraded":"2024-03-09T15:24:28.846417+0000","last_fullsized":"2024-03-09T15:24:28.846417+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:21.913278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.084519+0000","last_change":"2024-03-09T14:21:56.360757+0000","last_active":"2024-03-09T15:22:32.084519+0000","last_peered":"2024-03-09T15:22:32.084519+0000","last_clean":"2024-03-09T15:22:32.084519+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:22:32.084519+0000","last_undegraded":"2024-03-09T15:22:32.084519+0000","last_fullsized":"2024-03-09T15:22:32.084519+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:11.828260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'185","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998070+0000","last_change":"2024-03-09T14:21:54.370606+0000","last_active":"2024-03-09T15:20:16.998070+0000","last_peered":"2024-03-09T15:20:16.998070+0000","last_clean":"2024-03-09T15:20:16.998070+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:20:16.998070+0000","last_undegraded":"2024-03-09T15:20:16.998070+0000","last_fullsized":"2024-03-09T15:20:16.998070+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:07.279208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5489185,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":427,"num_read_kb":36262,"num_write":1055,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.007681+0000","last_change":"2024-03-09T14:21:58.370142+0000","last_active":"2024-03-09T15:20:37.007681+0000","last_peered":"2024-03-09T15:20:37.007681+0000","last_clean":"2024-03-09T15:20:37.007681+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:20:37.007681+0000","last_undegraded":"2024-03-09T15:20:37.007681+0000","last_fullsized":"2024-03-09T15:20:37.007681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:26.942518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'108","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.364936+0000","last_change":"2024-03-09T14:22:00.383851+0000","last_active":"2024-03-09T15:22:36.364936+0000","last_peered":"2024-03-09T15:22:36.364936+0000","last_clean":"2024-03-09T15:22:36.364936+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:22:36.364936+0000","last_undegraded":"2024-03-09T15:22:36.364936+0000","last_fullsized":"2024-03-09T15:22:36.364936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:38.700465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144268+0000","last_change":"2024-03-09T14:22:02.401387+0000","last_active":"2024-03-09T15:20:02.144268+0000","last_peered":"2024-03-09T15:20:02.144268+0000","last_clean":"2024-03-09T15:20:02.144268+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:20:02.144268+0000","last_undegraded":"2024-03-09T15:20:02.144268+0000","last_fullsized":"2024-03-09T15:20:02.144268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:17:02.585085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'114","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.784543+0000","last_change":"2024-03-09T14:22:04.401757+0000","last_active":"2024-03-09T15:22:38.784543+0000","last_peered":"2024-03-09T15:22:38.784543+0000","last_clean":"2024-03-09T15:22:38.784543+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:22:38.784543+0000","last_undegraded":"2024-03-09T15:22:38.784543+0000","last_fullsized":"2024-03-09T15:22:38.784543+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:00.751890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.995723+0000","last_change":"2024-03-09T14:21:56.372711+0000","last_active":"2024-03-09T15:19:56.995723+0000","last_peered":"2024-03-09T15:19:56.995723+0000","last_clean":"2024-03-09T15:19:56.995723+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:19:56.995723+0000","last_undegraded":"2024-03-09T15:19:56.995723+0000","last_fullsized":"2024-03-09T15:19:56.995723+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'166","reported_seq":795,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160910+0000","last_change":"2024-03-09T14:21:54.365114+0000","last_active":"2024-03-09T15:20:17.160910+0000","last_peered":"2024-03-09T15:20:17.160910+0000","last_clean":"2024-03-09T15:20:17.160910+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:20:17.160910+0000","last_undegraded":"2024-03-09T15:20:17.160910+0000","last_fullsized":"2024-03-09T15:20:17.160910+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:25.691680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21590719,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":415,"num_read_kb":24289,"num_write":900,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.003117+0000","last_change":"2024-03-09T14:21:58.372340+0000","last_active":"2024-03-09T15:20:02.003117+0000","last_peered":"2024-03-09T15:20:02.003117+0000","last_clean":"2024-03-09T15:20:02.003117+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:20:02.003117+0000","last_undegraded":"2024-03-09T15:20:02.003117+0000","last_fullsized":"2024-03-09T15:20:02.003117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:20.284463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'131","reported_seq":673,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.440694+0000","last_change":"2024-03-09T14:22:00.384182+0000","last_active":"2024-03-09T15:22:36.440694+0000","last_peered":"2024-03-09T15:22:36.440694+0000","last_clean":"2024-03-09T15:22:36.440694+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:22:36.440694+0000","last_undegraded":"2024-03-09T15:22:36.440694+0000","last_fullsized":"2024-03-09T15:22:36.440694+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:22.730875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'502","reported_seq":2177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.885268+0000","last_change":"2024-03-09T14:22:02.394468+0000","last_active":"2024-03-09T15:24:30.885268+0000","last_peered":"2024-03-09T15:24:30.885268+0000","last_clean":"2024-03-09T15:24:30.885268+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:24:30.885268+0000","last_undegraded":"2024-03-09T15:24:30.885268+0000","last_fullsized":"2024-03-09T15:24:30.885268+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:21.183335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'198","reported_seq":1009,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.173166+0000","last_change":"2024-03-09T14:22:04.393662+0000","last_active":"2024-03-09T15:22:50.173166+0000","last_peered":"2024-03-09T15:22:50.173166+0000","last_clean":"2024-03-09T15:22:50.173166+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:22:50.173166+0000","last_undegraded":"2024-03-09T15:22:50.173166+0000","last_fullsized":"2024-03-09T15:22:50.173166+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:52.946807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":935,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002403+0000","last_change":"2024-03-09T14:21:56.366895+0000","last_active":"2024-03-09T15:19:57.002403+0000","last_peered":"2024-03-09T15:19:57.002403+0000","last_clean":"2024-03-09T15:19:57.002403+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:19:57.002403+0000","last_undegraded":"2024-03-09T15:19:57.002403+0000","last_fullsized":"2024-03-09T15:19:57.002403+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:26.788549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'328","reported_seq":1051,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022611+0000","last_change":"2024-03-09T14:21:54.366866+0000","last_active":"2024-03-09T15:20:17.022611+0000","last_peered":"2024-03-09T15:20:17.022611+0000","last_clean":"2024-03-09T15:20:17.022611+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:20:17.022611+0000","last_undegraded":"2024-03-09T15:20:17.022611+0000","last_fullsized":"2024-03-09T15:20:17.022611+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:51.068751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16819939,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":885,"num_read_kb":69587,"num_write":1464,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020448+0000","last_change":"2024-03-09T14:21:58.370760+0000","last_active":"2024-03-09T15:20:02.020448+0000","last_peered":"2024-03-09T15:20:02.020448+0000","last_clean":"2024-03-09T15:20:02.020448+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:20:02.020448+0000","last_undegraded":"2024-03-09T15:20:02.020448+0000","last_fullsized":"2024-03-09T15:20:02.020448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.151599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'135","reported_seq":704,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.984795+0000","last_change":"2024-03-09T14:22:00.494140+0000","last_active":"2024-03-09T15:23:37.984795+0000","last_peered":"2024-03-09T15:23:37.984795+0000","last_clean":"2024-03-09T15:23:37.984795+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:23:37.984795+0000","last_undegraded":"2024-03-09T15:23:37.984795+0000","last_fullsized":"2024-03-09T15:23:37.984795+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:56.507586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9949,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":234,"num_write":92,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'544","reported_seq":2339,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.889024+0000","last_change":"2024-03-09T14:22:02.399618+0000","last_active":"2024-03-09T15:24:30.889024+0000","last_peered":"2024-03-09T15:24:30.889024+0000","last_clean":"2024-03-09T15:24:30.889024+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:24:30.889024+0000","last_undegraded":"2024-03-09T15:24:30.889024+0000","last_fullsized":"2024-03-09T15:24:30.889024+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:16.944105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'167","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023997+0000","last_change":"2024-03-09T14:21:56.361954+0000","last_active":"2024-03-09T15:20:27.023997+0000","last_peered":"2024-03-09T15:20:27.023997+0000","last_clean":"2024-03-09T15:20:27.023997+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:20:27.023997+0000","last_undegraded":"2024-03-09T15:20:27.023997+0000","last_fullsized":"2024-03-09T15:20:27.023997+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:31.594273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'207","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.164406+0000","last_change":"2024-03-09T14:21:54.363733+0000","last_active":"2024-03-09T15:20:37.164406+0000","last_peered":"2024-03-09T15:20:37.164406+0000","last_clean":"2024-03-09T15:20:37.164406+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:20:37.164406+0000","last_undegraded":"2024-03-09T15:20:37.164406+0000","last_fullsized":"2024-03-09T15:20:37.164406+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:17.383801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103988,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":482,"num_read_kb":2825,"num_write":1213,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163560+0000","last_change":"2024-03-09T14:21:58.368654+0000","last_active":"2024-03-09T15:20:32.163560+0000","last_peered":"2024-03-09T15:20:32.163560+0000","last_clean":"2024-03-09T15:20:32.163560+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:20:32.163560+0000","last_undegraded":"2024-03-09T15:20:32.163560+0000","last_fullsized":"2024-03-09T15:20:32.163560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:21.594710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'228","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:52.045357+0000","last_change":"2024-03-09T14:22:00.493626+0000","last_active":"2024-03-09T15:22:52.045357+0000","last_peered":"2024-03-09T15:22:52.045357+0000","last_clean":"2024-03-09T15:22:52.045357+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:22:52.045357+0000","last_undegraded":"2024-03-09T15:22:52.045357+0000","last_fullsized":"2024-03-09T15:22:52.045357+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:35.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9908,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":322,"num_read_kb":384,"num_write":190,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994431+0000","last_change":"2024-03-09T14:22:02.394441+0000","last_active":"2024-03-09T15:20:31.994431+0000","last_peered":"2024-03-09T15:20:31.994431+0000","last_clean":"2024-03-09T15:20:31.994431+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:20:31.994431+0000","last_undegraded":"2024-03-09T15:20:31.994431+0000","last_fullsized":"2024-03-09T15:20:31.994431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:20.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'547","reported_seq":1355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.875337+0000","last_change":"2024-03-09T14:22:04.401516+0000","last_active":"2024-03-09T15:24:30.875337+0000","last_peered":"2024-03-09T15:24:30.875337+0000","last_clean":"2024-03-09T15:24:30.875337+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:30.875337+0000","last_undegraded":"2024-03-09T15:24:30.875337+0000","last_fullsized":"2024-03-09T15:24:30.875337+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:22.487334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'160","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.147996+0000","last_change":"2024-03-09T14:21:56.360517+0000","last_active":"2024-03-09T15:20:27.147996+0000","last_peered":"2024-03-09T15:20:27.147996+0000","last_clean":"2024-03-09T15:20:27.147996+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:20:27.147996+0000","last_undegraded":"2024-03-09T15:20:27.147996+0000","last_fullsized":"2024-03-09T15:20:27.147996+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:05.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162818+0000","last_change":"2024-03-09T14:21:54.361313+0000","last_active":"2024-03-09T15:20:27.162818+0000","last_peered":"2024-03-09T15:20:27.162818+0000","last_clean":"2024-03-09T15:20:27.162818+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:20:27.162818+0000","last_undegraded":"2024-03-09T15:20:27.162818+0000","last_fullsized":"2024-03-09T15:20:27.162818+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:49:23.800324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992640+0000","last_change":"2024-03-09T14:21:58.373445+0000","last_active":"2024-03-09T15:20:31.992640+0000","last_peered":"2024-03-09T15:20:31.992640+0000","last_clean":"2024-03-09T15:20:31.992640+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:20:31.992640+0000","last_undegraded":"2024-03-09T15:20:31.992640+0000","last_fullsized":"2024-03-09T15:20:31.992640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:12:36.728172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'133","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.023415+0000","last_change":"2024-03-09T14:22:00.387422+0000","last_active":"2024-03-09T15:22:47.023415+0000","last_peered":"2024-03-09T15:22:47.023415+0000","last_clean":"2024-03-09T15:22:47.023415+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:22:47.023415+0000","last_undegraded":"2024-03-09T15:22:47.023415+0000","last_fullsized":"2024-03-09T15:22:47.023415+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:44.158848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":174,"num_read_kb":233,"num_write":94,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008667+0000","last_change":"2024-03-09T14:22:02.399383+0000","last_active":"2024-03-09T15:20:47.008667+0000","last_peered":"2024-03-09T15:20:47.008667+0000","last_clean":"2024-03-09T15:20:47.008667+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:20:47.008667+0000","last_undegraded":"2024-03-09T15:20:47.008667+0000","last_fullsized":"2024-03-09T15:20:47.008667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:46.573953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'154","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.051056+0000","last_change":"2024-03-09T14:22:04.401728+0000","last_active":"2024-03-09T15:23:16.051056+0000","last_peered":"2024-03-09T15:23:16.051056+0000","last_clean":"2024-03-09T15:23:16.051056+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:23:16.051056+0000","last_undegraded":"2024-03-09T15:23:16.051056+0000","last_fullsized":"2024-03-09T15:23:16.051056+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:36.044586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025573+0000","last_change":"2024-03-09T14:21:56.363935+0000","last_active":"2024-03-09T15:20:37.025573+0000","last_peered":"2024-03-09T15:20:37.025573+0000","last_clean":"2024-03-09T15:20:37.025573+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:20:37.025573+0000","last_undegraded":"2024-03-09T15:20:37.025573+0000","last_fullsized":"2024-03-09T15:20:37.025573+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:22.924584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'198","reported_seq":886,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162790+0000","last_change":"2024-03-09T14:21:54.370752+0000","last_active":"2024-03-09T15:20:27.162790+0000","last_peered":"2024-03-09T15:20:27.162790+0000","last_clean":"2024-03-09T15:20:27.162790+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:20:27.162790+0000","last_undegraded":"2024-03-09T15:20:27.162790+0000","last_fullsized":"2024-03-09T15:20:27.162790+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:42.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6994754,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":564,"num_read_kb":99405,"num_write":1010,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992670+0000","last_change":"2024-03-09T14:21:58.373407+0000","last_active":"2024-03-09T15:20:31.992670+0000","last_peered":"2024-03-09T15:20:31.992670+0000","last_clean":"2024-03-09T15:20:31.992670+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:20:31.992670+0000","last_undegraded":"2024-03-09T15:20:31.992670+0000","last_fullsized":"2024-03-09T15:20:31.992670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:40.360322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'181","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:42.053222+0000","last_change":"2024-03-09T14:22:00.384337+0000","last_active":"2024-03-09T15:22:42.053222+0000","last_peered":"2024-03-09T15:22:42.053222+0000","last_clean":"2024-03-09T15:22:42.053222+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:22:42.053222+0000","last_undegraded":"2024-03-09T15:22:42.053222+0000","last_fullsized":"2024-03-09T15:22:42.053222+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:43.164450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8238,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":234,"num_read_kb":285,"num_write":134,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'508","reported_seq":2131,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.889951+0000","last_change":"2024-03-09T14:22:02.399057+0000","last_active":"2024-03-09T15:24:30.889951+0000","last_peered":"2024-03-09T15:24:30.889951+0000","last_clean":"2024-03-09T15:24:30.889951+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:24:30.889951+0000","last_undegraded":"2024-03-09T15:24:30.889951+0000","last_fullsized":"2024-03-09T15:24:30.889951+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:12.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'144","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.791883+0000","last_change":"2024-03-09T14:22:04.402136+0000","last_active":"2024-03-09T15:23:55.791883+0000","last_peered":"2024-03-09T15:23:55.791883+0000","last_clean":"2024-03-09T15:23:55.791883+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:23:55.791883+0000","last_undegraded":"2024-03-09T15:23:55.791883+0000","last_fullsized":"2024-03-09T15:23:55.791883+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:19.283035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.377637+0000","last_change":"2024-03-09T14:21:56.371534+0000","last_active":"2024-03-09T15:21:18.377637+0000","last_peered":"2024-03-09T15:21:18.377637+0000","last_clean":"2024-03-09T15:21:18.377637+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:21:18.377637+0000","last_undegraded":"2024-03-09T15:21:18.377637+0000","last_fullsized":"2024-03-09T15:21:18.377637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:24.972146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'163","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.968717+0000","last_change":"2024-03-09T14:21:54.369550+0000","last_active":"2024-03-09T15:22:57.968717+0000","last_peered":"2024-03-09T15:22:57.968717+0000","last_clean":"2024-03-09T15:22:57.968717+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:22:57.968717+0000","last_undegraded":"2024-03-09T15:22:57.968717+0000","last_fullsized":"2024-03-09T15:22:57.968717+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:28.659325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529210,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":41462,"num_write":959,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:41.993861+0000","last_change":"2024-03-09T14:21:58.372864+0000","last_active":"2024-03-09T15:20:41.993861+0000","last_peered":"2024-03-09T15:20:41.993861+0000","last_clean":"2024-03-09T15:20:41.993861+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:20:41.993861+0000","last_undegraded":"2024-03-09T15:20:41.993861+0000","last_fullsized":"2024-03-09T15:20:41.993861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:02.146801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'209","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.832771+0000","last_change":"2024-03-09T14:22:00.383682+0000","last_active":"2024-03-09T15:24:30.832771+0000","last_peered":"2024-03-09T15:24:30.832771+0000","last_clean":"2024-03-09T15:24:30.832771+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:24:30.832771+0000","last_undegraded":"2024-03-09T15:24:30.832771+0000","last_fullsized":"2024-03-09T15:24:30.832771+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:15.223090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18794,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":288,"num_read_kb":411,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992613+0000","last_change":"2024-03-09T14:22:02.391676+0000","last_active":"2024-03-09T15:20:31.992613+0000","last_peered":"2024-03-09T15:20:31.992613+0000","last_clean":"2024-03-09T15:20:31.992613+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:20:31.992613+0000","last_undegraded":"2024-03-09T15:20:31.992613+0000","last_fullsized":"2024-03-09T15:20:31.992613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:52.125960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'95","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995021+0000","last_change":"2024-03-09T14:22:04.407155+0000","last_active":"2024-03-09T15:20:36.995021+0000","last_peered":"2024-03-09T15:20:36.995021+0000","last_clean":"2024-03-09T15:20:36.995021+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:20:36.995021+0000","last_undegraded":"2024-03-09T15:20:36.995021+0000","last_fullsized":"2024-03-09T15:20:36.995021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:01.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148074+0000","last_change":"2024-03-09T14:21:56.352377+0000","last_active":"2024-03-09T15:20:27.148074+0000","last_peered":"2024-03-09T15:20:27.148074+0000","last_clean":"2024-03-09T15:20:27.148074+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:20:27.148074+0000","last_undegraded":"2024-03-09T15:20:27.148074+0000","last_fullsized":"2024-03-09T15:20:27.148074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:26.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'159","reported_seq":776,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995960+0000","last_change":"2024-03-09T14:22:31.502194+0000","last_active":"2024-03-09T15:21:01.995960+0000","last_peered":"2024-03-09T15:21:01.995960+0000","last_clean":"2024-03-09T15:21:01.995960+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:21:01.995960+0000","last_undegraded":"2024-03-09T15:21:01.995960+0000","last_fullsized":"2024-03-09T15:21:01.995960+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:07:53.358348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5142213,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":87296,"num_write":880,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992720+0000","last_change":"2024-03-09T14:21:58.373193+0000","last_active":"2024-03-09T15:20:31.992720+0000","last_peered":"2024-03-09T15:20:31.992720+0000","last_clean":"2024-03-09T15:20:31.992720+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:20:31.992720+0000","last_undegraded":"2024-03-09T15:20:31.992720+0000","last_fullsized":"2024-03-09T15:20:31.992720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:54:43.726744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'165","reported_seq":751,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.108483+0000","last_change":"2024-03-09T14:22:00.383871+0000","last_active":"2024-03-09T15:23:23.108483+0000","last_peered":"2024-03-09T15:23:23.108483+0000","last_clean":"2024-03-09T15:23:23.108483+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:23:23.108483+0000","last_undegraded":"2024-03-09T15:23:23.108483+0000","last_fullsized":"2024-03-09T15:23:23.108483+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.715476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10309,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":290,"num_write":174,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.001564+0000","last_change":"2024-03-09T14:22:02.404397+0000","last_active":"2024-03-09T15:20:47.001564+0000","last_peered":"2024-03-09T15:20:47.001564+0000","last_clean":"2024-03-09T15:20:47.001564+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:20:47.001564+0000","last_undegraded":"2024-03-09T15:20:47.001564+0000","last_fullsized":"2024-03-09T15:20:47.001564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:30.954615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'103","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.585805+0000","last_change":"2024-03-09T14:22:04.407840+0000","last_active":"2024-03-09T15:23:08.585805+0000","last_peered":"2024-03-09T15:23:08.585805+0000","last_clean":"2024-03-09T15:23:08.585805+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:23:08.585805+0000","last_undegraded":"2024-03-09T15:23:08.585805+0000","last_fullsized":"2024-03-09T15:23:08.585805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:20:34.107387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148090+0000","last_change":"2024-03-09T14:21:56.363858+0000","last_active":"2024-03-09T15:20:27.148090+0000","last_peered":"2024-03-09T15:20:27.148090+0000","last_clean":"2024-03-09T15:20:27.148090+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:20:27.148090+0000","last_undegraded":"2024-03-09T15:20:27.148090+0000","last_fullsized":"2024-03-09T15:20:27.148090+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:13.291056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'173","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025557+0000","last_change":"2024-03-09T14:21:54.361281+0000","last_active":"2024-03-09T15:20:37.025557+0000","last_peered":"2024-03-09T15:20:37.025557+0000","last_clean":"2024-03-09T15:20:37.025557+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:20:37.025557+0000","last_undegraded":"2024-03-09T15:20:37.025557+0000","last_fullsized":"2024-03-09T15:20:37.025557+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:46.098501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567604,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":426,"num_read_kb":31184,"num_write":928,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994467+0000","last_change":"2024-03-09T14:21:58.376298+0000","last_active":"2024-03-09T15:20:31.994467+0000","last_peered":"2024-03-09T15:20:31.994467+0000","last_clean":"2024-03-09T15:20:31.994467+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:20:31.994467+0000","last_undegraded":"2024-03-09T15:20:31.994467+0000","last_fullsized":"2024-03-09T15:20:31.994467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:16:22.147321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'193","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.007290+0000","last_change":"2024-03-09T14:22:00.389792+0000","last_active":"2024-03-09T15:22:57.007290+0000","last_peered":"2024-03-09T15:22:57.007290+0000","last_clean":"2024-03-09T15:22:57.007290+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:22:57.007290+0000","last_undegraded":"2024-03-09T15:22:57.007290+0000","last_fullsized":"2024-03-09T15:22:57.007290+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:30.722738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10726,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":251,"num_read_kb":325,"num_write":148,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'487","reported_seq":4300,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.886002+0000","last_change":"2024-03-09T14:22:02.395597+0000","last_active":"2024-03-09T15:24:30.886002+0000","last_peered":"2024-03-09T15:24:30.886002+0000","last_clean":"2024-03-09T15:24:30.886002+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:30.886002+0000","last_undegraded":"2024-03-09T15:24:30.886002+0000","last_fullsized":"2024-03-09T15:24:30.886002+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:37.933532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'203","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.269247+0000","last_change":"2024-03-09T14:22:04.405779+0000","last_active":"2024-03-09T15:23:23.269247+0000","last_peered":"2024-03-09T15:23:23.269247+0000","last_clean":"2024-03-09T15:23:23.269247+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:23:23.269247+0000","last_undegraded":"2024-03-09T15:23:23.269247+0000","last_fullsized":"2024-03-09T15:23:23.269247+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:22:23.514316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148107+0000","last_change":"2024-03-09T14:21:56.356981+0000","last_active":"2024-03-09T15:20:27.148107+0000","last_peered":"2024-03-09T15:20:27.148107+0000","last_clean":"2024-03-09T15:20:27.148107+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:20:27.148107+0000","last_undegraded":"2024-03-09T15:20:27.148107+0000","last_fullsized":"2024-03-09T15:20:27.148107+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:14.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'166","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.515747+0000","last_change":"2024-03-09T14:21:54.363849+0000","last_active":"2024-03-09T15:23:08.515747+0000","last_peered":"2024-03-09T15:23:08.515747+0000","last_clean":"2024-03-09T15:23:08.515747+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:23:08.515747+0000","last_undegraded":"2024-03-09T15:23:08.515747+0000","last_fullsized":"2024-03-09T15:23:08.515747+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:31.144563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22447143,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":980,"num_read_kb":38802,"num_write":966,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.392914+0000","last_change":"2024-03-09T14:21:58.370397+0000","last_active":"2024-03-09T15:24:30.392914+0000","last_peered":"2024-03-09T15:24:30.392914+0000","last_clean":"2024-03-09T15:24:30.392914+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:24:30.392914+0000","last_undegraded":"2024-03-09T15:24:30.392914+0000","last_fullsized":"2024-03-09T15:24:30.392914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:50.562611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":622,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'90","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.298945+0000","last_change":"2024-03-09T14:22:00.492690+0000","last_active":"2024-03-09T15:22:36.298945+0000","last_peered":"2024-03-09T15:22:36.298945+0000","last_clean":"2024-03-09T15:22:36.298945+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:22:36.298945+0000","last_undegraded":"2024-03-09T15:22:36.298945+0000","last_fullsized":"2024-03-09T15:22:36.298945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:31.845945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'504","reported_seq":2210,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.887336+0000","last_change":"2024-03-09T14:22:02.396378+0000","last_active":"2024-03-09T15:24:30.887336+0000","last_peered":"2024-03-09T15:24:30.887336+0000","last_clean":"2024-03-09T15:24:30.887336+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:30.887336+0000","last_undegraded":"2024-03-09T15:24:30.887336+0000","last_fullsized":"2024-03-09T15:24:30.887336+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:11.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.167412+0000","last_change":"2024-03-09T14:22:04.402603+0000","last_active":"2024-03-09T15:22:32.167412+0000","last_peered":"2024-03-09T15:22:32.167412+0000","last_clean":"2024-03-09T15:22:32.167412+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:22:32.167412+0000","last_undegraded":"2024-03-09T15:22:32.167412+0000","last_fullsized":"2024-03-09T15:22:32.167412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:25.906429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995042+0000","last_change":"2024-03-09T14:21:56.368142+0000","last_active":"2024-03-09T15:20:36.995042+0000","last_peered":"2024-03-09T15:20:36.995042+0000","last_clean":"2024-03-09T15:20:36.995042+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:20:36.995042+0000","last_undegraded":"2024-03-09T15:20:36.995042+0000","last_fullsized":"2024-03-09T15:20:36.995042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:27.948389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'187","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006230+0000","last_change":"2024-03-09T14:21:54.368543+0000","last_active":"2024-03-09T15:20:27.006230+0000","last_peered":"2024-03-09T15:20:27.006230+0000","last_clean":"2024-03-09T15:20:27.006230+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:20:27.006230+0000","last_undegraded":"2024-03-09T15:20:27.006230+0000","last_fullsized":"2024-03-09T15:20:27.006230+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:57.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5588183,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":26998,"num_write":1065,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'4","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.382240+0000","last_change":"2024-03-09T14:21:58.371279+0000","last_active":"2024-03-09T15:24:30.382240+0000","last_peered":"2024-03-09T15:24:30.382240+0000","last_clean":"2024-03-09T15:24:30.382240+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:24:30.382240+0000","last_undegraded":"2024-03-09T15:24:30.382240+0000","last_fullsized":"2024-03-09T15:24:30.382240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:34.948133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":475,"num_read_kb":777,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'284","reported_seq":898,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.849045+0000","last_change":"2024-03-09T14:22:00.386117+0000","last_active":"2024-03-09T15:24:30.849045+0000","last_peered":"2024-03-09T15:24:30.849045+0000","last_clean":"2024-03-09T15:24:30.849045+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:24:30.849045+0000","last_undegraded":"2024-03-09T15:24:30.849045+0000","last_fullsized":"2024-03-09T15:24:30.849045+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:21.453812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9904,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1006,"num_read_kb":1062,"num_write":1592,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024722+0000","last_change":"2024-03-09T14:22:02.404333+0000","last_active":"2024-03-09T15:20:32.024722+0000","last_peered":"2024-03-09T15:20:32.024722+0000","last_clean":"2024-03-09T15:20:32.024722+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:20:32.024722+0000","last_undegraded":"2024-03-09T15:20:32.024722+0000","last_fullsized":"2024-03-09T15:20:32.024722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:37.735785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'157","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.405174+0000","last_change":"2024-03-09T14:22:04.400519+0000","last_active":"2024-03-09T15:23:44.405174+0000","last_peered":"2024-03-09T15:23:44.405174+0000","last_clean":"2024-03-09T15:23:44.405174+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:23:44.405174+0000","last_undegraded":"2024-03-09T15:23:44.405174+0000","last_fullsized":"2024-03-09T15:23:44.405174+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:16.309063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042466+0000","last_change":"2024-03-09T14:21:56.359275+0000","last_active":"2024-03-09T15:22:32.042466+0000","last_peered":"2024-03-09T15:22:32.042466+0000","last_clean":"2024-03-09T15:22:32.042466+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:22:32.042466+0000","last_undegraded":"2024-03-09T15:22:32.042466+0000","last_fullsized":"2024-03-09T15:22:32.042466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:10.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046197+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T15:21:57.046197+0000","last_peered":"2024-03-09T15:21:57.046197+0000","last_clean":"2024-03-09T15:21:57.046197+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:21:57.046197+0000","last_undegraded":"2024-03-09T15:21:57.046197+0000","last_fullsized":"2024-03-09T15:21:57.046197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'151","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:35.946875+0000","last_change":"2024-03-09T14:21:54.358849+0000","last_active":"2024-03-09T15:22:35.946875+0000","last_peered":"2024-03-09T15:22:35.946875+0000","last_clean":"2024-03-09T15:22:35.946875+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:22:35.946875+0000","last_undegraded":"2024-03-09T15:22:35.946875+0000","last_fullsized":"2024-03-09T15:22:35.946875+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:39.818710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319062,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":408,"num_read_kb":7813,"num_write":924,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.051219+0000","last_change":"2024-03-09T14:21:58.372665+0000","last_active":"2024-03-09T15:22:27.051219+0000","last_peered":"2024-03-09T15:22:27.051219+0000","last_clean":"2024-03-09T15:22:27.051219+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:22:27.051219+0000","last_undegraded":"2024-03-09T15:22:27.051219+0000","last_fullsized":"2024-03-09T15:22:27.051219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:20.394198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'288","reported_seq":982,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.851468+0000","last_change":"2024-03-09T14:22:00.387288+0000","last_active":"2024-03-09T15:24:30.851468+0000","last_peered":"2024-03-09T15:24:30.851468+0000","last_clean":"2024-03-09T15:24:30.851468+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:24:30.851468+0000","last_undegraded":"2024-03-09T15:24:30.851468+0000","last_fullsized":"2024-03-09T15:24:30.851468+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:13.322082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17691,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":521,"num_read_kb":547,"num_write":464,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999998+0000","last_change":"2024-03-09T14:22:02.403697+0000","last_active":"2024-03-09T15:20:31.999998+0000","last_peered":"2024-03-09T15:20:31.999998+0000","last_clean":"2024-03-09T15:20:31.999998+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:20:31.999998+0000","last_undegraded":"2024-03-09T15:20:31.999998+0000","last_fullsized":"2024-03-09T15:20:31.999998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:19:46.922962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'215","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.799050+0000","last_change":"2024-03-09T14:22:04.400948+0000","last_active":"2024-03-09T15:23:55.799050+0000","last_peered":"2024-03-09T15:23:55.799050+0000","last_clean":"2024-03-09T15:23:55.799050+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:23:55.799050+0000","last_undegraded":"2024-03-09T15:23:55.799050+0000","last_fullsized":"2024-03-09T15:23:55.799050+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:37.990701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'338","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006035+0000","last_change":"2024-03-09T14:21:56.364183+0000","last_active":"2024-03-09T15:22:22.006035+0000","last_peered":"2024-03-09T15:22:22.006035+0000","last_clean":"2024-03-09T15:22:22.006035+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:22:22.006035+0000","last_undegraded":"2024-03-09T15:22:22.006035+0000","last_fullsized":"2024-03-09T15:22:22.006035+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:20.353413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038029+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T15:22:02.038029+0000","last_peered":"2024-03-09T15:22:02.038029+0000","last_clean":"2024-03-09T15:22:02.038029+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:22:02.038029+0000","last_undegraded":"2024-03-09T15:22:02.038029+0000","last_fullsized":"2024-03-09T15:22:02.038029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'155","reported_seq":748,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:55.944251+0000","last_change":"2024-03-09T14:21:54.357687+0000","last_active":"2024-03-09T15:22:55.944251+0000","last_peered":"2024-03-09T15:22:55.944251+0000","last_clean":"2024-03-09T15:22:55.944251+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:22:55.944251+0000","last_undegraded":"2024-03-09T15:22:55.944251+0000","last_fullsized":"2024-03-09T15:22:55.944251+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:07.591910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1104040,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":314,"num_read_kb":1406,"num_write":851,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000526+0000","last_change":"2024-03-09T14:21:58.373133+0000","last_active":"2024-03-09T15:20:37.000526+0000","last_peered":"2024-03-09T15:20:37.000526+0000","last_clean":"2024-03-09T15:20:37.000526+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:20:37.000526+0000","last_undegraded":"2024-03-09T15:20:37.000526+0000","last_fullsized":"2024-03-09T15:20:37.000526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:53.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'144","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.207457+0000","last_change":"2024-03-09T14:22:00.388917+0000","last_active":"2024-03-09T15:22:36.207457+0000","last_peered":"2024-03-09T15:22:36.207457+0000","last_clean":"2024-03-09T15:22:36.207457+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:22:36.207457+0000","last_undegraded":"2024-03-09T15:22:36.207457+0000","last_fullsized":"2024-03-09T15:22:36.207457+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:20.768721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024785+0000","last_change":"2024-03-09T14:22:02.401190+0000","last_active":"2024-03-09T15:20:32.024785+0000","last_peered":"2024-03-09T15:20:32.024785+0000","last_clean":"2024-03-09T15:20:32.024785+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:20:32.024785+0000","last_undegraded":"2024-03-09T15:20:32.024785+0000","last_fullsized":"2024-03-09T15:20:32.024785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:59.946005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'103","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.267023+0000","last_change":"2024-03-09T14:22:04.408883+0000","last_active":"2024-03-09T15:23:23.267023+0000","last_peered":"2024-03-09T15:23:23.267023+0000","last_clean":"2024-03-09T15:23:23.267023+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:23:23.267023+0000","last_undegraded":"2024-03-09T15:23:23.267023+0000","last_fullsized":"2024-03-09T15:23:23.267023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:20.342826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.115078+0000","last_change":"2024-03-09T14:21:56.362977+0000","last_active":"2024-03-09T15:22:43.115078+0000","last_peered":"2024-03-09T15:22:43.115078+0000","last_clean":"2024-03-09T15:22:43.115078+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:22:43.115078+0000","last_undegraded":"2024-03-09T15:22:43.115078+0000","last_fullsized":"2024-03-09T15:22:43.115078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:56.941578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047191+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T15:22:02.047191+0000","last_peered":"2024-03-09T15:22:02.047191+0000","last_clean":"2024-03-09T15:22:02.047191+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:22:02.047191+0000","last_undegraded":"2024-03-09T15:22:02.047191+0000","last_fullsized":"2024-03-09T15:22:02.047191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'203","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.279511+0000","last_change":"2024-03-09T14:21:54.371651+0000","last_active":"2024-03-09T15:22:41.279511+0000","last_peered":"2024-03-09T15:22:41.279511+0000","last_clean":"2024-03-09T15:22:41.279511+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:22:41.279511+0000","last_undegraded":"2024-03-09T15:22:41.279511+0000","last_fullsized":"2024-03-09T15:22:41.279511+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:50.559760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11854883,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":458,"num_read_kb":33193,"num_write":1179,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992747+0000","last_change":"2024-03-09T14:21:58.371500+0000","last_active":"2024-03-09T15:20:31.992747+0000","last_peered":"2024-03-09T15:20:31.992747+0000","last_clean":"2024-03-09T15:20:31.992747+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:20:31.992747+0000","last_undegraded":"2024-03-09T15:20:31.992747+0000","last_fullsized":"2024-03-09T15:20:31.992747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:26.928736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'282","reported_seq":1581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.033091+0000","last_change":"2024-03-09T14:22:00.494298+0000","last_active":"2024-03-09T15:24:31.033091+0000","last_peered":"2024-03-09T15:24:31.033091+0000","last_clean":"2024-03-09T15:24:31.033091+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:24:31.033091+0000","last_undegraded":"2024-03-09T15:24:31.033091+0000","last_fullsized":"2024-03-09T15:24:31.033091+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:34.240386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908159+0000","last_change":"2024-03-09T14:22:02.400334+0000","last_active":"2024-03-09T15:22:26.908159+0000","last_peered":"2024-03-09T15:22:26.908159+0000","last_clean":"2024-03-09T15:22:26.908159+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:22:26.908159+0000","last_undegraded":"2024-03-09T15:22:26.908159+0000","last_fullsized":"2024-03-09T15:22:26.908159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:04.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'256","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:19.404283+0000","last_change":"2024-03-09T14:22:04.404883+0000","last_active":"2024-03-09T15:23:19.404283+0000","last_peered":"2024-03-09T15:23:19.404283+0000","last_clean":"2024-03-09T15:23:19.404283+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:23:19.404283+0000","last_undegraded":"2024-03-09T15:23:19.404283+0000","last_fullsized":"2024-03-09T15:23:19.404283+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:39.148958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999417+0000","last_change":"2024-03-09T14:21:56.371601+0000","last_active":"2024-03-09T15:20:26.999417+0000","last_peered":"2024-03-09T15:20:26.999417+0000","last_clean":"2024-03-09T15:20:26.999417+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:20:26.999417+0000","last_undegraded":"2024-03-09T15:20:26.999417+0000","last_fullsized":"2024-03-09T15:20:26.999417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:04.533578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.004180+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T15:22:07.004180+0000","last_peered":"2024-03-09T15:22:07.004180+0000","last_clean":"2024-03-09T15:22:07.004180+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:22:07.004180+0000","last_undegraded":"2024-03-09T15:22:07.004180+0000","last_fullsized":"2024-03-09T15:22:07.004180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:14.047597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046218+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T15:21:57.046218+0000","last_peered":"2024-03-09T15:21:57.046218+0000","last_clean":"2024-03-09T15:21:57.046218+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:21:57.046218+0000","last_undegraded":"2024-03-09T15:21:57.046218+0000","last_fullsized":"2024-03-09T15:21:57.046218+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:25:40.528352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'144","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.742914+0000","last_change":"2024-03-09T14:21:54.370907+0000","last_active":"2024-03-09T15:24:14.742914+0000","last_peered":"2024-03-09T15:24:14.742914+0000","last_clean":"2024-03-09T15:24:14.742914+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:24:14.742914+0000","last_undegraded":"2024-03-09T15:24:14.742914+0000","last_fullsized":"2024-03-09T15:24:14.742914+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:00.830027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534362,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":317,"num_read_kb":13701,"num_write":829,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024862+0000","last_change":"2024-03-09T14:21:58.370284+0000","last_active":"2024-03-09T15:20:32.024862+0000","last_peered":"2024-03-09T15:20:32.024862+0000","last_clean":"2024-03-09T15:20:32.024862+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:20:32.024862+0000","last_undegraded":"2024-03-09T15:20:32.024862+0000","last_fullsized":"2024-03-09T15:20:32.024862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:59.246060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'720","reported_seq":2322,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.019434+0000","last_change":"2024-03-09T14:22:00.388074+0000","last_active":"2024-03-09T15:24:32.019434+0000","last_peered":"2024-03-09T15:24:32.019434+0000","last_clean":"2024-03-09T15:24:32.019434+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:24:32.019434+0000","last_undegraded":"2024-03-09T15:24:32.019434+0000","last_fullsized":"2024-03-09T15:24:32.019434+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:01.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24809,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":966,"num_read_kb":1092,"num_write":352,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163647+0000","last_change":"2024-03-09T14:22:02.392515+0000","last_active":"2024-03-09T15:20:32.163647+0000","last_peered":"2024-03-09T15:20:32.163647+0000","last_clean":"2024-03-09T15:20:32.163647+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:20:32.163647+0000","last_undegraded":"2024-03-09T15:20:32.163647+0000","last_fullsized":"2024-03-09T15:20:32.163647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:41.546333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'158","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:46.996025+0000","last_change":"2024-03-09T14:22:04.397452+0000","last_active":"2024-03-09T15:20:46.996025+0000","last_peered":"2024-03-09T15:20:46.996025+0000","last_clean":"2024-03-09T15:20:46.996025+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:20:46.996025+0000","last_undegraded":"2024-03-09T15:20:46.996025+0000","last_fullsized":"2024-03-09T15:20:46.996025+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:18:25.696387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":803,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.018038+0000","last_change":"2024-03-09T14:21:56.356659+0000","last_active":"2024-03-09T15:22:56.018038+0000","last_peered":"2024-03-09T15:22:56.018038+0000","last_clean":"2024-03-09T15:22:56.018038+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:22:56.018038+0000","last_undegraded":"2024-03-09T15:22:56.018038+0000","last_fullsized":"2024-03-09T15:22:56.018038+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.345499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'130","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.022807+0000","last_change":"2024-03-09T14:22:31.510611+0000","last_active":"2024-03-09T15:23:23.022807+0000","last_peered":"2024-03-09T15:23:23.022807+0000","last_clean":"2024-03-09T15:23:23.022807+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:23:23.022807+0000","last_undegraded":"2024-03-09T15:23:23.022807+0000","last_fullsized":"2024-03-09T15:23:23.022807+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:42.545379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16317048,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":310,"num_read_kb":4172,"num_write":716,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.018367+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T15:22:07.018367+0000","last_peered":"2024-03-09T15:22:07.018367+0000","last_clean":"2024-03-09T15:22:07.018367+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:22:07.018367+0000","last_undegraded":"2024-03-09T15:22:07.018367+0000","last_fullsized":"2024-03-09T15:22:07.018367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019477+0000","last_change":"2024-03-09T14:21:58.372306+0000","last_active":"2024-03-09T15:22:17.019477+0000","last_peered":"2024-03-09T15:22:17.019477+0000","last_clean":"2024-03-09T15:22:17.019477+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:22:17.019477+0000","last_undegraded":"2024-03-09T15:22:17.019477+0000","last_fullsized":"2024-03-09T15:22:17.019477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:31.060450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'334","reported_seq":1051,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.846598+0000","last_change":"2024-03-09T14:22:00.492596+0000","last_active":"2024-03-09T15:24:30.846598+0000","last_peered":"2024-03-09T15:24:30.846598+0000","last_clean":"2024-03-09T15:24:30.846598+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:24:30.846598+0000","last_undegraded":"2024-03-09T15:24:30.846598+0000","last_fullsized":"2024-03-09T15:24:30.846598+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:55.986088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40546,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":473,"num_read_kb":636,"num_write":246,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.020677+0000","last_change":"2024-03-09T14:22:02.401629+0000","last_active":"2024-03-09T15:22:27.020677+0000","last_peered":"2024-03-09T15:22:27.020677+0000","last_clean":"2024-03-09T15:22:27.020677+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:22:27.020677+0000","last_undegraded":"2024-03-09T15:22:27.020677+0000","last_fullsized":"2024-03-09T15:22:27.020677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:24.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'144","reported_seq":634,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.827582+0000","last_change":"2024-03-09T14:22:04.400992+0000","last_active":"2024-03-09T15:23:33.827582+0000","last_peered":"2024-03-09T15:23:33.827582+0000","last_clean":"2024-03-09T15:23:33.827582+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:23:33.827582+0000","last_undegraded":"2024-03-09T15:23:33.827582+0000","last_fullsized":"2024-03-09T15:23:33.827582+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:22.181899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":758,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018863+0000","last_change":"2024-03-09T14:21:56.367601+0000","last_active":"2024-03-09T15:22:12.018863+0000","last_peered":"2024-03-09T15:22:12.018863+0000","last_clean":"2024-03-09T15:22:12.018863+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:22:12.018863+0000","last_undegraded":"2024-03-09T15:22:12.018863+0000","last_fullsized":"2024-03-09T15:22:12.018863+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:01.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'185","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.713042+0000","last_change":"2024-03-09T14:21:54.358356+0000","last_active":"2024-03-09T15:22:38.713042+0000","last_peered":"2024-03-09T15:22:38.713042+0000","last_clean":"2024-03-09T15:22:38.713042+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:22:38.713042+0000","last_undegraded":"2024-03-09T15:22:38.713042+0000","last_fullsized":"2024-03-09T15:22:38.713042+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:19.858694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5263493,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":43067,"num_write":1016,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.164751+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T15:22:12.164751+0000","last_peered":"2024-03-09T15:22:12.164751+0000","last_clean":"2024-03-09T15:22:12.164751+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:22:12.164751+0000","last_undegraded":"2024-03-09T15:22:12.164751+0000","last_fullsized":"2024-03-09T15:22:12.164751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166771+0000","last_change":"2024-03-09T14:21:58.373524+0000","last_active":"2024-03-09T15:22:27.166771+0000","last_peered":"2024-03-09T15:22:27.166771+0000","last_clean":"2024-03-09T15:22:27.166771+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:22:27.166771+0000","last_undegraded":"2024-03-09T15:22:27.166771+0000","last_fullsized":"2024-03-09T15:22:27.166771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:39.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'122","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.450139+0000","last_change":"2024-03-09T14:22:00.386056+0000","last_active":"2024-03-09T15:22:36.450139+0000","last_peered":"2024-03-09T15:22:36.450139+0000","last_clean":"2024-03-09T15:22:36.450139+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:22:36.450139+0000","last_undegraded":"2024-03-09T15:22:36.450139+0000","last_fullsized":"2024-03-09T15:22:36.450139+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:40.186793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'545","reported_seq":4158,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.038330+0000","last_change":"2024-03-09T14:22:02.399139+0000","last_active":"2024-03-09T15:24:32.038330+0000","last_peered":"2024-03-09T15:24:32.038330+0000","last_clean":"2024-03-09T15:24:32.038330+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:24:32.038330+0000","last_undegraded":"2024-03-09T15:24:32.038330+0000","last_fullsized":"2024-03-09T15:24:32.038330+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:34.998650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'182","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.340909+0000","last_change":"2024-03-09T14:22:04.405073+0000","last_active":"2024-03-09T15:22:41.340909+0000","last_peered":"2024-03-09T15:22:41.340909+0000","last_clean":"2024-03-09T15:22:41.340909+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:22:41.340909+0000","last_undegraded":"2024-03-09T15:22:41.340909+0000","last_fullsized":"2024-03-09T15:22:41.340909+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:37.566660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.421696+0000","last_change":"2024-03-09T14:21:56.370846+0000","last_active":"2024-03-09T15:23:04.421696+0000","last_peered":"2024-03-09T15:23:04.421696+0000","last_clean":"2024-03-09T15:23:04.421696+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:23:04.421696+0000","last_undegraded":"2024-03-09T15:23:04.421696+0000","last_fullsized":"2024-03-09T15:23:04.421696+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:27:16.582369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'206","reported_seq":883,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006017+0000","last_change":"2024-03-09T14:21:54.370705+0000","last_active":"2024-03-09T15:22:22.006017+0000","last_peered":"2024-03-09T15:22:22.006017+0000","last_clean":"2024-03-09T15:22:22.006017+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:22:22.006017+0000","last_undegraded":"2024-03-09T15:22:22.006017+0000","last_fullsized":"2024-03-09T15:22:22.006017+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:43.848851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11138561,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":117883,"num_write":1117,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040120+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T15:22:17.040120+0000","last_peered":"2024-03-09T15:22:17.040120+0000","last_clean":"2024-03-09T15:22:17.040120+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:22:17.040120+0000","last_undegraded":"2024-03-09T15:22:17.040120+0000","last_fullsized":"2024-03-09T15:22:17.040120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:38.232466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041830+0000","last_change":"2024-03-09T14:21:58.371830+0000","last_active":"2024-03-09T15:22:27.041830+0000","last_peered":"2024-03-09T15:22:27.041830+0000","last_clean":"2024-03-09T15:22:27.041830+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:22:27.041830+0000","last_undegraded":"2024-03-09T15:22:27.041830+0000","last_fullsized":"2024-03-09T15:22:27.041830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:28.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'237","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.056546+0000","last_change":"2024-03-09T14:22:00.492643+0000","last_active":"2024-03-09T15:24:31.056546+0000","last_peered":"2024-03-09T15:24:31.056546+0000","last_clean":"2024-03-09T15:24:31.056546+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:24:31.056546+0000","last_undegraded":"2024-03-09T15:24:31.056546+0000","last_fullsized":"2024-03-09T15:24:31.056546+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:59.553996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'538","reported_seq":2689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.884147+0000","last_change":"2024-03-09T14:22:02.395536+0000","last_active":"2024-03-09T15:24:30.884147+0000","last_peered":"2024-03-09T15:24:30.884147+0000","last_clean":"2024-03-09T15:24:30.884147+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:30.884147+0000","last_undegraded":"2024-03-09T15:24:30.884147+0000","last_fullsized":"2024-03-09T15:24:30.884147+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:34.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'116","reported_seq":608,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:07.027423+0000","last_change":"2024-03-09T14:22:04.405236+0000","last_active":"2024-03-09T15:23:07.027423+0000","last_peered":"2024-03-09T15:23:07.027423+0000","last_clean":"2024-03-09T15:23:07.027423+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:23:07.027423+0000","last_undegraded":"2024-03-09T15:23:07.027423+0000","last_fullsized":"2024-03-09T15:23:07.027423+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:17.271331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.005976+0000","last_change":"2024-03-09T14:21:56.359311+0000","last_active":"2024-03-09T15:22:22.005976+0000","last_peered":"2024-03-09T15:22:22.005976+0000","last_clean":"2024-03-09T15:22:22.005976+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:22:22.005976+0000","last_undegraded":"2024-03-09T15:22:22.005976+0000","last_fullsized":"2024-03-09T15:22:22.005976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:45.357583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'192","reported_seq":845,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042519+0000","last_change":"2024-03-09T14:21:54.371711+0000","last_active":"2024-03-09T15:22:32.042519+0000","last_peered":"2024-03-09T15:22:32.042519+0000","last_clean":"2024-03-09T15:22:32.042519+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:22:32.042519+0000","last_undegraded":"2024-03-09T15:22:32.042519+0000","last_fullsized":"2024-03-09T15:22:32.042519+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:21.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15704678,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":440,"num_read_kb":52342,"num_write":1099,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040153+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T15:22:17.040153+0000","last_peered":"2024-03-09T15:22:17.040153+0000","last_clean":"2024-03-09T15:22:17.040153+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:22:17.040153+0000","last_undegraded":"2024-03-09T15:22:17.040153+0000","last_fullsized":"2024-03-09T15:22:17.040153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:58.533776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908142+0000","last_change":"2024-03-09T14:21:58.369587+0000","last_active":"2024-03-09T15:22:26.908142+0000","last_peered":"2024-03-09T15:22:26.908142+0000","last_clean":"2024-03-09T15:22:26.908142+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:22:26.908142+0000","last_undegraded":"2024-03-09T15:22:26.908142+0000","last_fullsized":"2024-03-09T15:22:26.908142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:01.184512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'270","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.842459+0000","last_change":"2024-03-09T14:22:00.386745+0000","last_active":"2024-03-09T15:24:30.842459+0000","last_peered":"2024-03-09T15:24:30.842459+0000","last_clean":"2024-03-09T15:24:30.842459+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:24:30.842459+0000","last_undegraded":"2024-03-09T15:24:30.842459+0000","last_fullsized":"2024-03-09T15:24:30.842459+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:58.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18542,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":394,"num_read_kb":518,"num_write":220,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166791+0000","last_change":"2024-03-09T14:22:02.400357+0000","last_active":"2024-03-09T15:22:27.166791+0000","last_peered":"2024-03-09T15:22:27.166791+0000","last_clean":"2024-03-09T15:22:27.166791+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:22:27.166791+0000","last_undegraded":"2024-03-09T15:22:27.166791+0000","last_fullsized":"2024-03-09T15:22:27.166791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:34.726729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'185","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.397957+0000","last_change":"2024-03-09T14:22:04.402392+0000","last_active":"2024-03-09T15:23:42.397957+0000","last_peered":"2024-03-09T15:23:42.397957+0000","last_clean":"2024-03-09T15:23:42.397957+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:23:42.397957+0000","last_undegraded":"2024-03-09T15:23:42.397957+0000","last_fullsized":"2024-03-09T15:23:42.397957+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:54.527353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'134","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:31.908737+0000","last_change":"2024-03-09T14:22:04.401080+0000","last_active":"2024-03-09T15:22:31.908737+0000","last_peered":"2024-03-09T15:22:31.908737+0000","last_clean":"2024-03-09T15:22:31.908737+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:22:31.908737+0000","last_undegraded":"2024-03-09T15:22:31.908737+0000","last_fullsized":"2024-03-09T15:22:31.908737+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:15.758082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4672,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.508782+0000","last_change":"2024-03-09T14:21:56.355418+0000","last_active":"2024-03-09T15:21:01.508782+0000","last_peered":"2024-03-09T15:21:01.508782+0000","last_clean":"2024-03-09T15:21:01.508782+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:21:01.508782+0000","last_undegraded":"2024-03-09T15:21:01.508782+0000","last_fullsized":"2024-03-09T15:21:01.508782+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:03.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'145","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.147275+0000","last_change":"2024-03-09T14:21:54.362232+0000","last_active":"2024-03-09T15:20:22.147275+0000","last_peered":"2024-03-09T15:20:22.147275+0000","last_clean":"2024-03-09T15:20:22.147275+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:20:22.147275+0000","last_undegraded":"2024-03-09T15:20:22.147275+0000","last_fullsized":"2024-03-09T15:20:22.147275+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:27.911421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8673473,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":270,"num_read_kb":29246,"num_write":811,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.993238+0000","last_change":"2024-03-09T14:21:58.371454+0000","last_active":"2024-03-09T15:20:21.993238+0000","last_peered":"2024-03-09T15:20:21.993238+0000","last_clean":"2024-03-09T15:20:21.993238+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:20:21.993238+0000","last_undegraded":"2024-03-09T15:20:21.993238+0000","last_fullsized":"2024-03-09T15:20:21.993238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:42.569021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'142","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:42.022643+0000","last_change":"2024-03-09T14:22:00.386530+0000","last_active":"2024-03-09T15:22:42.022643+0000","last_peered":"2024-03-09T15:22:42.022643+0000","last_clean":"2024-03-09T15:22:42.022643+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:22:42.022643+0000","last_undegraded":"2024-03-09T15:22:42.022643+0000","last_fullsized":"2024-03-09T15:22:42.022643+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:02.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14541,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":199,"num_read_kb":279,"num_write":110,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005572+0000","last_change":"2024-03-09T14:22:02.399358+0000","last_active":"2024-03-09T15:20:22.005572+0000","last_peered":"2024-03-09T15:20:22.005572+0000","last_clean":"2024-03-09T15:20:22.005572+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:20:22.005572+0000","last_undegraded":"2024-03-09T15:20:22.005572+0000","last_fullsized":"2024-03-09T15:20:22.005572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:26.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020178+0000","last_change":"2024-03-09T14:22:04.403191+0000","last_active":"2024-03-09T15:22:22.020178+0000","last_peered":"2024-03-09T15:22:22.020178+0000","last_clean":"2024-03-09T15:22:22.020178+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:22:22.020178+0000","last_undegraded":"2024-03-09T15:22:22.020178+0000","last_fullsized":"2024-03-09T15:22:22.020178+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:51.085844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4078","reported_seq":4649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992713+0000","last_change":"2024-03-09T14:21:56.365718+0000","last_active":"2024-03-09T15:20:16.992713+0000","last_peered":"2024-03-09T15:20:16.992713+0000","last_clean":"2024-03-09T15:20:16.992713+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:20:16.992713+0000","last_undegraded":"2024-03-09T15:20:16.992713+0000","last_fullsized":"2024-03-09T15:20:16.992713+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:52.273131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'199","reported_seq":818,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.158041+0000","last_change":"2024-03-09T14:21:54.370617+0000","last_active":"2024-03-09T15:19:57.158041+0000","last_peered":"2024-03-09T15:19:57.158041+0000","last_clean":"2024-03-09T15:19:57.158041+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:19:57.158041+0000","last_undegraded":"2024-03-09T15:19:57.158041+0000","last_fullsized":"2024-03-09T15:19:57.158041+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:10.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10559776,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":34556,"num_write":1088,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005680+0000","last_change":"2024-03-09T14:21:58.373073+0000","last_active":"2024-03-09T15:20:22.005680+0000","last_peered":"2024-03-09T15:20:22.005680+0000","last_clean":"2024-03-09T15:20:22.005680+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:20:22.005680+0000","last_undegraded":"2024-03-09T15:20:22.005680+0000","last_fullsized":"2024-03-09T15:20:22.005680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:00.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'44","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.028912+0000","last_change":"2024-03-09T14:22:00.389956+0000","last_active":"2024-03-09T15:22:36.028912+0000","last_peered":"2024-03-09T15:22:36.028912+0000","last_clean":"2024-03-09T15:22:36.028912+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:22:36.028912+0000","last_undegraded":"2024-03-09T15:22:36.028912+0000","last_fullsized":"2024-03-09T15:22:36.028912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:40.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161788+0000","last_change":"2024-03-09T14:22:02.397849+0000","last_active":"2024-03-09T15:20:22.161788+0000","last_peered":"2024-03-09T15:20:22.161788+0000","last_clean":"2024-03-09T15:20:22.161788+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:20:22.161788+0000","last_undegraded":"2024-03-09T15:20:22.161788+0000","last_fullsized":"2024-03-09T15:20:22.161788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:48.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'189","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.006224+0000","last_change":"2024-03-09T14:22:04.401057+0000","last_active":"2024-03-09T15:22:56.006224+0000","last_peered":"2024-03-09T15:22:56.006224+0000","last_clean":"2024-03-09T15:22:56.006224+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:22:56.006224+0000","last_undegraded":"2024-03-09T15:22:56.006224+0000","last_fullsized":"2024-03-09T15:22:56.006224+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:30.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004987+0000","last_change":"2024-03-09T14:21:56.360219+0000","last_active":"2024-03-09T15:20:17.004987+0000","last_peered":"2024-03-09T15:20:17.004987+0000","last_clean":"2024-03-09T15:20:17.004987+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:20:17.004987+0000","last_undegraded":"2024-03-09T15:20:17.004987+0000","last_fullsized":"2024-03-09T15:20:17.004987+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:44:55.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'138","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.610242+0000","last_change":"2024-03-09T14:21:54.360121+0000","last_active":"2024-03-09T15:20:13.610242+0000","last_peered":"2024-03-09T15:20:13.610242+0000","last_clean":"2024-03-09T15:20:13.610242+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:20:13.610242+0000","last_undegraded":"2024-03-09T15:20:13.610242+0000","last_fullsized":"2024-03-09T15:20:13.610242+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:23.649957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10522711,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":374,"num_read_kb":77468,"num_write":817,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161750+0000","last_change":"2024-03-09T14:21:58.371755+0000","last_active":"2024-03-09T15:20:22.161750+0000","last_peered":"2024-03-09T15:20:22.161750+0000","last_clean":"2024-03-09T15:20:22.161750+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:20:22.161750+0000","last_undegraded":"2024-03-09T15:20:22.161750+0000","last_fullsized":"2024-03-09T15:20:22.161750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:18.384428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'168","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.899211+0000","last_change":"2024-03-09T14:22:00.388758+0000","last_active":"2024-03-09T15:23:32.899211+0000","last_peered":"2024-03-09T15:23:32.899211+0000","last_clean":"2024-03-09T15:23:32.899211+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:23:32.899211+0000","last_undegraded":"2024-03-09T15:23:32.899211+0000","last_fullsized":"2024-03-09T15:23:32.899211+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:21.509939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12325,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":274,"num_write":134,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023321+0000","last_change":"2024-03-09T14:22:02.401182+0000","last_active":"2024-03-09T15:20:22.023321+0000","last_peered":"2024-03-09T15:20:22.023321+0000","last_clean":"2024-03-09T15:20:22.023321+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:20:22.023321+0000","last_undegraded":"2024-03-09T15:20:22.023321+0000","last_fullsized":"2024-03-09T15:20:22.023321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:34.573612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'123","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.171935+0000","last_change":"2024-03-09T14:22:04.400641+0000","last_active":"2024-03-09T15:23:15.171935+0000","last_peered":"2024-03-09T15:23:15.171935+0000","last_clean":"2024-03-09T15:23:15.171935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:23:15.171935+0000","last_undegraded":"2024-03-09T15:23:15.171935+0000","last_fullsized":"2024-03-09T15:23:15.171935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:41.104332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004952+0000","last_change":"2024-03-09T14:21:56.353346+0000","last_active":"2024-03-09T15:20:17.004952+0000","last_peered":"2024-03-09T15:20:17.004952+0000","last_clean":"2024-03-09T15:20:17.004952+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:20:17.004952+0000","last_undegraded":"2024-03-09T15:20:17.004952+0000","last_fullsized":"2024-03-09T15:20:17.004952+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:34.741252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'173","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:14.741970+0000","last_change":"2024-03-09T14:21:54.368774+0000","last_active":"2024-03-09T15:24:14.741970+0000","last_peered":"2024-03-09T15:24:14.741970+0000","last_clean":"2024-03-09T15:24:14.741970+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:24:14.741970+0000","last_undegraded":"2024-03-09T15:24:14.741970+0000","last_fullsized":"2024-03-09T15:24:14.741970+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:07.130860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28356633,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":367,"num_read_kb":57120,"num_write":926,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023278+0000","last_change":"2024-03-09T14:21:58.371834+0000","last_active":"2024-03-09T15:20:22.023278+0000","last_peered":"2024-03-09T15:20:22.023278+0000","last_clean":"2024-03-09T15:20:22.023278+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:20:22.023278+0000","last_undegraded":"2024-03-09T15:20:22.023278+0000","last_fullsized":"2024-03-09T15:20:22.023278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:41.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'143","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.057027+0000","last_change":"2024-03-09T14:22:00.383681+0000","last_active":"2024-03-09T15:22:58.057027+0000","last_peered":"2024-03-09T15:22:58.057027+0000","last_clean":"2024-03-09T15:22:58.057027+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:22:58.057027+0000","last_undegraded":"2024-03-09T15:22:58.057027+0000","last_fullsized":"2024-03-09T15:22:58.057027+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:07.824315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13459,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":242,"num_write":96,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.998738+0000","last_change":"2024-03-09T14:22:02.402801+0000","last_active":"2024-03-09T15:20:21.998738+0000","last_peered":"2024-03-09T15:20:21.998738+0000","last_clean":"2024-03-09T15:20:21.998738+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:20:21.998738+0000","last_undegraded":"2024-03-09T15:20:21.998738+0000","last_fullsized":"2024-03-09T15:20:21.998738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:42.052921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.177922+0000","last_change":"2024-03-09T14:21:56.355621+0000","last_active":"2024-03-09T15:23:15.177922+0000","last_peered":"2024-03-09T15:23:15.177922+0000","last_clean":"2024-03-09T15:23:15.177922+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:23:15.177922+0000","last_undegraded":"2024-03-09T15:23:15.177922+0000","last_fullsized":"2024-03-09T15:23:15.177922+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:48:40.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'186","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002294+0000","last_change":"2024-03-09T14:21:54.361543+0000","last_active":"2024-03-09T15:19:57.002294+0000","last_peered":"2024-03-09T15:19:57.002294+0000","last_clean":"2024-03-09T15:19:57.002294+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:19:57.002294+0000","last_undegraded":"2024-03-09T15:19:57.002294+0000","last_fullsized":"2024-03-09T15:19:57.002294+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:42.544106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11056654,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":29766,"num_write":1069,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907526+0000","last_change":"2024-03-09T14:21:58.370949+0000","last_active":"2024-03-09T15:22:21.907526+0000","last_peered":"2024-03-09T15:22:21.907526+0000","last_clean":"2024-03-09T15:22:21.907526+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:22:21.907526+0000","last_undegraded":"2024-03-09T15:22:21.907526+0000","last_fullsized":"2024-03-09T15:22:21.907526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:55.442426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'213","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.862351+0000","last_change":"2024-03-09T14:22:00.386952+0000","last_active":"2024-03-09T15:24:30.862351+0000","last_peered":"2024-03-09T15:24:30.862351+0000","last_clean":"2024-03-09T15:24:30.862351+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:24:30.862351+0000","last_undegraded":"2024-03-09T15:24:30.862351+0000","last_fullsized":"2024-03-09T15:24:30.862351+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:12.101312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23073,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":315,"num_read_kb":453,"num_write":204,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038100+0000","last_change":"2024-03-09T14:22:02.402061+0000","last_active":"2024-03-09T15:22:02.038100+0000","last_peered":"2024-03-09T15:22:02.038100+0000","last_clean":"2024-03-09T15:22:02.038100+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:22:02.038100+0000","last_undegraded":"2024-03-09T15:22:02.038100+0000","last_fullsized":"2024-03-09T15:22:02.038100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:24.862935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'174","reported_seq":686,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.819989+0000","last_change":"2024-03-09T14:22:04.404476+0000","last_active":"2024-03-09T15:23:33.819989+0000","last_peered":"2024-03-09T15:23:33.819989+0000","last_clean":"2024-03-09T15:23:33.819989+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:23:33.819989+0000","last_undegraded":"2024-03-09T15:23:33.819989+0000","last_fullsized":"2024-03-09T15:23:33.819989+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:11.852013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:16.906878+0000","last_change":"2024-03-09T14:21:56.366627+0000","last_active":"2024-03-09T15:22:16.906878+0000","last_peered":"2024-03-09T15:22:16.906878+0000","last_clean":"2024-03-09T15:22:16.906878+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:22:16.906878+0000","last_undegraded":"2024-03-09T15:22:16.906878+0000","last_fullsized":"2024-03-09T15:22:16.906878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:53.735520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'314","reported_seq":1044,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.991593+0000","last_change":"2024-03-09T14:21:54.370005+0000","last_active":"2024-03-09T15:20:06.991593+0000","last_peered":"2024-03-09T15:20:06.991593+0000","last_clean":"2024-03-09T15:20:06.991593+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:20:06.991593+0000","last_undegraded":"2024-03-09T15:20:06.991593+0000","last_fullsized":"2024-03-09T15:20:06.991593+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:34.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19923144,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":20523,"num_write":1603,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041888+0000","last_change":"2024-03-09T14:21:58.372204+0000","last_active":"2024-03-09T15:22:27.041888+0000","last_peered":"2024-03-09T15:22:27.041888+0000","last_clean":"2024-03-09T15:22:27.041888+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:22:27.041888+0000","last_undegraded":"2024-03-09T15:22:27.041888+0000","last_fullsized":"2024-03-09T15:22:27.041888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:24.041345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'177","reported_seq":767,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.838251+0000","last_change":"2024-03-09T14:22:00.384248+0000","last_active":"2024-03-09T15:24:30.838251+0000","last_peered":"2024-03-09T15:24:30.838251+0000","last_clean":"2024-03-09T15:24:30.838251+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:24:30.838251+0000","last_undegraded":"2024-03-09T15:24:30.838251+0000","last_fullsized":"2024-03-09T15:24:30.838251+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:27.943625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":255,"num_read_kb":321,"num_write":172,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003643+0000","last_change":"2024-03-09T14:22:02.397994+0000","last_active":"2024-03-09T15:22:02.003643+0000","last_peered":"2024-03-09T15:22:02.003643+0000","last_clean":"2024-03-09T15:22:02.003643+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:22:02.003643+0000","last_undegraded":"2024-03-09T15:22:02.003643+0000","last_fullsized":"2024-03-09T15:22:02.003643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:49.447597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'169","reported_seq":1359,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:29.026404+0000","last_change":"2024-03-09T14:22:04.398055+0000","last_active":"2024-03-09T15:24:29.026404+0000","last_peered":"2024-03-09T15:24:29.026404+0000","last_clean":"2024-03-09T15:24:29.026404+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:24:29.026404+0000","last_undegraded":"2024-03-09T15:24:29.026404+0000","last_fullsized":"2024-03-09T15:24:29.026404+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:45:27.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.795535+0000","last_change":"2024-03-09T14:21:56.352420+0000","last_active":"2024-03-09T15:22:38.795535+0000","last_peered":"2024-03-09T15:22:38.795535+0000","last_clean":"2024-03-09T15:22:38.795535+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:22:38.795535+0000","last_undegraded":"2024-03-09T15:22:38.795535+0000","last_fullsized":"2024-03-09T15:22:38.795535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:39.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'178","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.989620+0000","last_change":"2024-03-09T14:22:31.509702+0000","last_active":"2024-03-09T15:20:01.989620+0000","last_peered":"2024-03-09T15:20:01.989620+0000","last_clean":"2024-03-09T15:20:01.989620+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:20:01.989620+0000","last_undegraded":"2024-03-09T15:20:01.989620+0000","last_fullsized":"2024-03-09T15:20:01.989620+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:06.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324902,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":395,"num_read_kb":42859,"num_write":1105,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163221+0000","last_change":"2024-03-09T14:21:58.373433+0000","last_active":"2024-03-09T15:22:02.163221+0000","last_peered":"2024-03-09T15:22:02.163221+0000","last_clean":"2024-03-09T15:22:02.163221+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:22:02.163221+0000","last_undegraded":"2024-03-09T15:22:02.163221+0000","last_fullsized":"2024-03-09T15:22:02.163221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:25.282408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'141","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.859792+0000","last_change":"2024-03-09T14:22:00.493124+0000","last_active":"2024-03-09T15:24:30.859792+0000","last_peered":"2024-03-09T15:24:30.859792+0000","last_clean":"2024-03-09T15:24:30.859792+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:24:30.859792+0000","last_undegraded":"2024-03-09T15:24:30.859792+0000","last_fullsized":"2024-03-09T15:24:30.859792+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:05.031002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7694,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":195,"num_read_kb":253,"num_write":106,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.004846+0000","last_change":"2024-03-09T14:22:02.402300+0000","last_active":"2024-03-09T15:22:12.004846+0000","last_peered":"2024-03-09T15:22:12.004846+0000","last_clean":"2024-03-09T15:22:12.004846+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:22:12.004846+0000","last_undegraded":"2024-03-09T15:22:12.004846+0000","last_fullsized":"2024-03-09T15:22:12.004846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:54.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'107","reported_seq":599,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.867392+0000","last_change":"2024-03-09T14:22:04.400295+0000","last_active":"2024-03-09T15:24:30.867392+0000","last_peered":"2024-03-09T15:24:30.867392+0000","last_clean":"2024-03-09T15:24:30.867392+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:30.867392+0000","last_undegraded":"2024-03-09T15:24:30.867392+0000","last_fullsized":"2024-03-09T15:24:30.867392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:31.557973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.001414+0000","last_change":"2024-03-09T14:21:56.368701+0000","last_active":"2024-03-09T15:21:57.001414+0000","last_peered":"2024-03-09T15:21:57.001414+0000","last_clean":"2024-03-09T15:21:57.001414+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:21:57.001414+0000","last_undegraded":"2024-03-09T15:21:57.001414+0000","last_fullsized":"2024-03-09T15:21:57.001414+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:17.172991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'194","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904492+0000","last_change":"2024-03-09T14:22:31.527571+0000","last_active":"2024-03-09T15:21:56.904492+0000","last_peered":"2024-03-09T15:21:56.904492+0000","last_clean":"2024-03-09T15:21:56.904492+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:21:56.904492+0000","last_undegraded":"2024-03-09T15:21:56.904492+0000","last_fullsized":"2024-03-09T15:21:56.904492+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:45.724834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14734205,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":417,"num_read_kb":96221,"num_write":1017,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003663+0000","last_change":"2024-03-09T14:21:58.369956+0000","last_active":"2024-03-09T15:22:02.003663+0000","last_peered":"2024-03-09T15:22:02.003663+0000","last_clean":"2024-03-09T15:22:02.003663+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:22:02.003663+0000","last_undegraded":"2024-03-09T15:22:02.003663+0000","last_fullsized":"2024-03-09T15:22:02.003663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:20.111905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'103","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.471989+0000","last_change":"2024-03-09T14:22:00.492818+0000","last_active":"2024-03-09T15:22:36.471989+0000","last_peered":"2024-03-09T15:22:36.471989+0000","last_clean":"2024-03-09T15:22:36.471989+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:22:36.471989+0000","last_undegraded":"2024-03-09T15:22:36.471989+0000","last_fullsized":"2024-03-09T15:22:36.471989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:19:37.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'504","reported_seq":2243,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.060051+0000","last_change":"2024-03-09T14:22:02.396058+0000","last_active":"2024-03-09T15:24:32.060051+0000","last_peered":"2024-03-09T15:24:32.060051+0000","last_clean":"2024-03-09T15:24:32.060051+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:32.060051+0000","last_undegraded":"2024-03-09T15:24:32.060051+0000","last_fullsized":"2024-03-09T15:24:32.060051+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:28:12.304576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.043783+0000","last_change":"2024-03-09T14:22:04.400380+0000","last_active":"2024-03-09T15:23:16.043783+0000","last_peered":"2024-03-09T15:23:16.043783+0000","last_clean":"2024-03-09T15:23:16.043783+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:23:16.043783+0000","last_undegraded":"2024-03-09T15:23:16.043783+0000","last_fullsized":"2024-03-09T15:23:16.043783+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:28.603631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.417821+0000","last_change":"2024-03-09T14:21:56.352673+0000","last_active":"2024-03-09T15:23:44.417821+0000","last_peered":"2024-03-09T15:23:44.417821+0000","last_clean":"2024-03-09T15:23:44.417821+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:23:44.417821+0000","last_undegraded":"2024-03-09T15:23:44.417821+0000","last_fullsized":"2024-03-09T15:23:44.417821+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:05.415890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'145","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.037245+0000","last_change":"2024-03-09T14:21:54.361414+0000","last_active":"2024-03-09T15:21:57.037245+0000","last_peered":"2024-03-09T15:21:57.037245+0000","last_clean":"2024-03-09T15:21:57.037245+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:21:57.037245+0000","last_undegraded":"2024-03-09T15:21:57.037245+0000","last_fullsized":"2024-03-09T15:21:57.037245+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:31.236227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11643525,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":322,"num_read_kb":36416,"num_write":865,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047170+0000","last_change":"2024-03-09T14:21:58.368512+0000","last_active":"2024-03-09T15:22:02.047170+0000","last_peered":"2024-03-09T15:22:02.047170+0000","last_clean":"2024-03-09T15:22:02.047170+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:22:02.047170+0000","last_undegraded":"2024-03-09T15:22:02.047170+0000","last_fullsized":"2024-03-09T15:22:02.047170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:42.028813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'171","reported_seq":761,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.181529+0000","last_change":"2024-03-09T14:22:00.386165+0000","last_active":"2024-03-09T15:22:50.181529+0000","last_peered":"2024-03-09T15:22:50.181529+0000","last_clean":"2024-03-09T15:22:50.181529+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:22:50.181529+0000","last_undegraded":"2024-03-09T15:22:50.181529+0000","last_fullsized":"2024-03-09T15:22:50.181529+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:03.010266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8115,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":286,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996260+0000","last_change":"2024-03-09T14:22:02.398377+0000","last_active":"2024-03-09T15:20:01.996260+0000","last_peered":"2024-03-09T15:20:01.996260+0000","last_clean":"2024-03-09T15:20:01.996260+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:20:01.996260+0000","last_undegraded":"2024-03-09T15:20:01.996260+0000","last_fullsized":"2024-03-09T15:20:01.996260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:14:54.574464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'108","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:43.269705+0000","last_change":"2024-03-09T14:22:04.405953+0000","last_active":"2024-03-09T15:23:43.269705+0000","last_peered":"2024-03-09T15:23:43.269705+0000","last_clean":"2024-03-09T15:23:43.269705+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:23:43.269705+0000","last_undegraded":"2024-03-09T15:23:43.269705+0000","last_fullsized":"2024-03-09T15:23:43.269705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:28:15.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162368+0000","last_change":"2024-03-09T14:21:56.352123+0000","last_active":"2024-03-09T15:21:57.162368+0000","last_peered":"2024-03-09T15:21:57.162368+0000","last_clean":"2024-03-09T15:21:57.162368+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:21:57.162368+0000","last_undegraded":"2024-03-09T15:21:57.162368+0000","last_fullsized":"2024-03-09T15:21:57.162368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:01.770090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'163","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:15.251405+0000","last_change":"2024-03-09T14:21:54.371725+0000","last_active":"2024-03-09T15:24:15.251405+0000","last_peered":"2024-03-09T15:24:15.251405+0000","last_clean":"2024-03-09T15:24:15.251405+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:24:15.251405+0000","last_undegraded":"2024-03-09T15:24:15.251405+0000","last_fullsized":"2024-03-09T15:24:15.251405+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:57.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11077075,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":381,"num_read_kb":54818,"num_write":995,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038072+0000","last_change":"2024-03-09T14:21:58.374073+0000","last_active":"2024-03-09T15:22:02.038072+0000","last_peered":"2024-03-09T15:22:02.038072+0000","last_clean":"2024-03-09T15:22:02.038072+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:22:02.038072+0000","last_undegraded":"2024-03-09T15:22:02.038072+0000","last_fullsized":"2024-03-09T15:22:02.038072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:43.159760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'132","reported_seq":696,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:33.648119+0000","last_change":"2024-03-09T14:22:00.384316+0000","last_active":"2024-03-09T15:22:33.648119+0000","last_peered":"2024-03-09T15:22:33.648119+0000","last_clean":"2024-03-09T15:22:33.648119+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:22:33.648119+0000","last_undegraded":"2024-03-09T15:22:33.648119+0000","last_fullsized":"2024-03-09T15:22:33.648119+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:49.725490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6560,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":171,"num_read_kb":215,"num_write":90,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021797+0000","last_change":"2024-03-09T14:22:02.396214+0000","last_active":"2024-03-09T15:20:12.021797+0000","last_peered":"2024-03-09T15:20:12.021797+0000","last_clean":"2024-03-09T15:20:12.021797+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:20:12.021797+0000","last_undegraded":"2024-03-09T15:20:12.021797+0000","last_fullsized":"2024-03-09T15:20:12.021797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:36.788962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'96","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.124529+0000","last_change":"2024-03-09T14:22:04.402457+0000","last_active":"2024-03-09T15:22:43.124529+0000","last_peered":"2024-03-09T15:22:43.124529+0000","last_clean":"2024-03-09T15:22:43.124529+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:22:43.124529+0000","last_undegraded":"2024-03-09T15:22:43.124529+0000","last_fullsized":"2024-03-09T15:22:43.124529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:20.405079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":768,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.882808+0000","last_change":"2024-03-09T14:21:56.361858+0000","last_active":"2024-03-09T15:23:32.882808+0000","last_peered":"2024-03-09T15:23:32.882808+0000","last_clean":"2024-03-09T15:23:32.882808+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:23:32.882808+0000","last_undegraded":"2024-03-09T15:23:32.882808+0000","last_fullsized":"2024-03-09T15:23:32.882808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:19:13.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'225","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018958+0000","last_change":"2024-03-09T14:21:54.358944+0000","last_active":"2024-03-09T15:22:12.018958+0000","last_peered":"2024-03-09T15:22:12.018958+0000","last_clean":"2024-03-09T15:22:12.018958+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:22:12.018958+0000","last_undegraded":"2024-03-09T15:22:12.018958+0000","last_fullsized":"2024-03-09T15:22:12.018958+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:31.824683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5894290,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":472,"num_read_kb":44740,"num_write":1207,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144162+0000","last_change":"2024-03-09T14:21:58.368610+0000","last_active":"2024-03-09T15:20:02.144162+0000","last_peered":"2024-03-09T15:20:02.144162+0000","last_clean":"2024-03-09T15:20:02.144162+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:20:02.144162+0000","last_undegraded":"2024-03-09T15:20:02.144162+0000","last_fullsized":"2024-03-09T15:20:02.144162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:54.314632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'111","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.857610+0000","last_change":"2024-03-09T14:22:00.390046+0000","last_active":"2024-03-09T15:24:30.857610+0000","last_peered":"2024-03-09T15:24:30.857610+0000","last_clean":"2024-03-09T15:24:30.857610+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:24:30.857610+0000","last_undegraded":"2024-03-09T15:24:30.857610+0000","last_fullsized":"2024-03-09T15:24:30.857610+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:50.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8520,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":179,"num_write":66,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163173+0000","last_change":"2024-03-09T14:22:02.397881+0000","last_active":"2024-03-09T15:22:02.163173+0000","last_peered":"2024-03-09T15:22:02.163173+0000","last_clean":"2024-03-09T15:22:02.163173+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:22:02.163173+0000","last_undegraded":"2024-03-09T15:22:02.163173+0000","last_fullsized":"2024-03-09T15:22:02.163173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:13.863238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'148","reported_seq":1807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.936366+0000","last_change":"2024-03-09T14:22:04.399435+0000","last_active":"2024-03-09T15:24:28.936366+0000","last_peered":"2024-03-09T15:24:28.936366+0000","last_clean":"2024-03-09T15:24:28.936366+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:24:28.936366+0000","last_undegraded":"2024-03-09T15:24:28.936366+0000","last_fullsized":"2024-03-09T15:24:28.936366+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.710673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.686428+0000","last_change":"2024-03-09T14:21:56.356912+0000","last_active":"2024-03-09T15:20:13.686428+0000","last_peered":"2024-03-09T15:20:13.686428+0000","last_clean":"2024-03-09T15:20:13.686428+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:20:13.686428+0000","last_undegraded":"2024-03-09T15:20:13.686428+0000","last_fullsized":"2024-03-09T15:20:13.686428+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:30.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'204","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907568+0000","last_change":"2024-03-09T14:21:54.358595+0000","last_active":"2024-03-09T15:22:21.907568+0000","last_peered":"2024-03-09T15:22:21.907568+0000","last_clean":"2024-03-09T15:22:21.907568+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:22:21.907568+0000","last_undegraded":"2024-03-09T15:22:21.907568+0000","last_fullsized":"2024-03-09T15:22:21.907568+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:14.194545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16015484,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":689,"num_read_kb":64454,"num_write":1154,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"32'4","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.382657+0000","last_change":"2024-03-09T14:21:58.370687+0000","last_active":"2024-03-09T15:24:30.382657+0000","last_peered":"2024-03-09T15:24:30.382657+0000","last_clean":"2024-03-09T15:24:30.382657+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:30.382657+0000","last_undegraded":"2024-03-09T15:24:30.382657+0000","last_fullsized":"2024-03-09T15:24:30.382657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:27.059761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":476,"num_read_kb":474,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'162","reported_seq":754,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.861372+0000","last_change":"2024-03-09T14:22:00.381012+0000","last_active":"2024-03-09T15:24:30.861372+0000","last_peered":"2024-03-09T15:24:30.861372+0000","last_clean":"2024-03-09T15:24:30.861372+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:24:30.861372+0000","last_undegraded":"2024-03-09T15:24:30.861372+0000","last_fullsized":"2024-03-09T15:24:30.861372+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:29.659729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20695,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":310,"num_write":122,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:01.905044+0000","last_change":"2024-03-09T14:22:02.401394+0000","last_active":"2024-03-09T15:22:01.905044+0000","last_peered":"2024-03-09T15:22:01.905044+0000","last_clean":"2024-03-09T15:22:01.905044+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:22:01.905044+0000","last_undegraded":"2024-03-09T15:22:01.905044+0000","last_fullsized":"2024-03-09T15:22:01.905044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:36.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'106","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:24.040847+0000","last_change":"2024-03-09T14:22:04.402287+0000","last_active":"2024-03-09T15:23:24.040847+0000","last_peered":"2024-03-09T15:23:24.040847+0000","last_clean":"2024-03-09T15:23:24.040847+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:23:24.040847+0000","last_undegraded":"2024-03-09T15:23:24.040847+0000","last_fullsized":"2024-03-09T15:23:24.040847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:54.058990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993860+0000","last_change":"2024-03-09T14:21:56.357674+0000","last_active":"2024-03-09T15:20:26.993860+0000","last_peered":"2024-03-09T15:20:26.993860+0000","last_clean":"2024-03-09T15:20:26.993860+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:20:26.993860+0000","last_undegraded":"2024-03-09T15:20:26.993860+0000","last_fullsized":"2024-03-09T15:20:26.993860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:37.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'180","reported_seq":990,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040923+0000","last_change":"2024-03-09T14:21:54.367079+0000","last_active":"2024-03-09T15:22:22.040923+0000","last_peered":"2024-03-09T15:22:22.040923+0000","last_clean":"2024-03-09T15:22:22.040923+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:22:22.040923+0000","last_undegraded":"2024-03-09T15:22:22.040923+0000","last_fullsized":"2024-03-09T15:22:22.040923+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:51.408419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9730712,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":787,"num_read_kb":18311,"num_write":1111,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":855,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993837+0000","last_change":"2024-03-09T14:21:56.368289+0000","last_active":"2024-03-09T15:20:26.993837+0000","last_peered":"2024-03-09T15:20:26.993837+0000","last_clean":"2024-03-09T15:20:26.993837+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:20:26.993837+0000","last_undegraded":"2024-03-09T15:20:26.993837+0000","last_fullsized":"2024-03-09T15:20:26.993837+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:13.723494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'269","reported_seq":1081,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003736+0000","last_change":"2024-03-09T14:21:54.359757+0000","last_active":"2024-03-09T15:22:22.003736+0000","last_peered":"2024-03-09T15:22:22.003736+0000","last_clean":"2024-03-09T15:22:22.003736+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:22:22.003736+0000","last_undegraded":"2024-03-09T15:22:22.003736+0000","last_fullsized":"2024-03-09T15:22:22.003736+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:57.050243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351863,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1218,"num_read_kb":137737,"num_write":1248,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024150+0000","last_change":"2024-03-09T14:21:56.360003+0000","last_active":"2024-03-09T15:20:27.024150+0000","last_peered":"2024-03-09T15:20:27.024150+0000","last_clean":"2024-03-09T15:20:27.024150+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:20:27.024150+0000","last_undegraded":"2024-03-09T15:20:27.024150+0000","last_fullsized":"2024-03-09T15:20:27.024150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'162","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.331004+0000","last_change":"2024-03-09T14:21:54.370800+0000","last_active":"2024-03-09T15:23:42.331004+0000","last_peered":"2024-03-09T15:23:42.331004+0000","last_clean":"2024-03-09T15:23:42.331004+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:23:42.331004+0000","last_undegraded":"2024-03-09T15:23:42.331004+0000","last_fullsized":"2024-03-09T15:23:42.331004+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:44.318284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":5631,"num_write":925,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.967315+0000","last_change":"2024-03-09T14:21:56.364838+0000","last_active":"2024-03-09T15:23:37.967315+0000","last_peered":"2024-03-09T15:23:37.967315+0000","last_clean":"2024-03-09T15:23:37.967315+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:23:37.967315+0000","last_undegraded":"2024-03-09T15:23:37.967315+0000","last_fullsized":"2024-03-09T15:23:37.967315+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:10.284801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'145","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999945+0000","last_change":"2024-03-09T14:22:31.512263+0000","last_active":"2024-03-09T15:20:31.999945+0000","last_peered":"2024-03-09T15:20:31.999945+0000","last_clean":"2024-03-09T15:20:31.999945+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:20:31.999945+0000","last_undegraded":"2024-03-09T15:20:31.999945+0000","last_fullsized":"2024-03-09T15:20:31.999945+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:22.007571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9469459,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":249,"num_read_kb":2407,"num_write":835,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'203","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.006966+0000","last_change":"2024-03-09T14:21:56.356735+0000","last_active":"2024-03-09T15:20:32.006966+0000","last_peered":"2024-03-09T15:20:32.006966+0000","last_clean":"2024-03-09T15:20:32.006966+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:20:32.006966+0000","last_undegraded":"2024-03-09T15:20:32.006966+0000","last_fullsized":"2024-03-09T15:20:32.006966+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:40.763958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'222","reported_seq":959,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.301620+0000","last_change":"2024-03-09T14:21:54.360027+0000","last_active":"2024-03-09T15:21:18.301620+0000","last_peered":"2024-03-09T15:21:18.301620+0000","last_clean":"2024-03-09T15:21:18.301620+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:21:18.301620+0000","last_undegraded":"2024-03-09T15:21:18.301620+0000","last_fullsized":"2024-03-09T15:21:18.301620+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:39.068686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7319443,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":802,"num_read_kb":22283,"num_write":1149,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166084+0000","last_change":"2024-03-09T14:21:56.363506+0000","last_active":"2024-03-09T15:22:22.166084+0000","last_peered":"2024-03-09T15:22:22.166084+0000","last_clean":"2024-03-09T15:22:22.166084+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:22:22.166084+0000","last_undegraded":"2024-03-09T15:22:22.166084+0000","last_fullsized":"2024-03-09T15:22:22.166084+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:50.856855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'195","reported_seq":856,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993807+0000","last_change":"2024-03-09T14:21:54.371723+0000","last_active":"2024-03-09T15:20:26.993807+0000","last_peered":"2024-03-09T15:20:26.993807+0000","last_clean":"2024-03-09T15:20:26.993807+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:20:26.993807+0000","last_undegraded":"2024-03-09T15:20:26.993807+0000","last_fullsized":"2024-03-09T15:20:26.993807+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:20.005554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6324814,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":38599,"num_write":1105,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020078+0000","last_change":"2024-03-09T14:21:56.359970+0000","last_active":"2024-03-09T15:22:22.020078+0000","last_peered":"2024-03-09T15:22:22.020078+0000","last_clean":"2024-03-09T15:22:22.020078+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:22:22.020078+0000","last_undegraded":"2024-03-09T15:22:22.020078+0000","last_fullsized":"2024-03-09T15:22:22.020078+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:09.990655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'210","reported_seq":837,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024091+0000","last_change":"2024-03-09T14:21:54.364970+0000","last_active":"2024-03-09T15:20:27.024091+0000","last_peered":"2024-03-09T15:20:27.024091+0000","last_clean":"2024-03-09T15:20:27.024091+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:20:27.024091+0000","last_undegraded":"2024-03-09T15:20:27.024091+0000","last_fullsized":"2024-03-09T15:20:27.024091+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:09.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11397214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":471,"num_read_kb":1161,"num_write":1163,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040950+0000","last_change":"2024-03-09T14:21:56.360728+0000","last_active":"2024-03-09T15:22:22.040950+0000","last_peered":"2024-03-09T15:22:22.040950+0000","last_clean":"2024-03-09T15:22:22.040950+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:22:22.040950+0000","last_undegraded":"2024-03-09T15:22:22.040950+0000","last_fullsized":"2024-03-09T15:22:22.040950+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:03:35.870767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'183","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006364+0000","last_change":"2024-03-09T14:21:54.365980+0000","last_active":"2024-03-09T15:20:27.006364+0000","last_peered":"2024-03-09T15:20:27.006364+0000","last_clean":"2024-03-09T15:20:27.006364+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:20:27.006364+0000","last_undegraded":"2024-03-09T15:20:27.006364+0000","last_fullsized":"2024-03-09T15:20:27.006364+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:10.240743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12616287,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":15052,"num_write":1035,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998176+0000","last_change":"2024-03-09T14:23:32.139833+0000","last_active":"2024-03-09T15:20:16.998176+0000","last_peered":"2024-03-09T15:20:16.998176+0000","last_clean":"2024-03-09T15:20:16.998176+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:20:16.998176+0000","last_undegraded":"2024-03-09T15:20:16.998176+0000","last_fullsized":"2024-03-09T15:20:16.998176+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:24.028499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'173","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025532+0000","last_change":"2024-03-09T14:21:54.370760+0000","last_active":"2024-03-09T15:20:37.025532+0000","last_peered":"2024-03-09T15:20:37.025532+0000","last_clean":"2024-03-09T15:20:37.025532+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:20:37.025532+0000","last_undegraded":"2024-03-09T15:20:37.025532+0000","last_fullsized":"2024-03-09T15:20:37.025532+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:04:48.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7402673,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":2617,"num_write":1100,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'89","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.146608+0000","last_change":"2024-03-09T14:21:56.362263+0000","last_active":"2024-03-09T15:20:17.146608+0000","last_peered":"2024-03-09T15:20:17.146608+0000","last_clean":"2024-03-09T15:20:17.146608+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:20:17.146608+0000","last_undegraded":"2024-03-09T15:20:17.146608+0000","last_fullsized":"2024-03-09T15:20:17.146608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:54.785232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995931+0000","last_change":"2024-03-09T14:22:31.509909+0000","last_active":"2024-03-09T15:21:01.995931+0000","last_peered":"2024-03-09T15:21:01.995931+0000","last_clean":"2024-03-09T15:21:01.995931+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:21:01.995931+0000","last_undegraded":"2024-03-09T15:21:01.995931+0000","last_fullsized":"2024-03-09T15:21:01.995931+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:26.468991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993373+0000","last_change":"2024-03-09T14:21:56.361155+0000","last_active":"2024-03-09T15:20:36.993373+0000","last_peered":"2024-03-09T15:20:36.993373+0000","last_clean":"2024-03-09T15:20:36.993373+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:20:36.993373+0000","last_undegraded":"2024-03-09T15:20:36.993373+0000","last_fullsized":"2024-03-09T15:20:36.993373+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:24.944266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'153","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024078+0000","last_change":"2024-03-09T14:21:54.359540+0000","last_active":"2024-03-09T15:20:27.024078+0000","last_peered":"2024-03-09T15:20:27.024078+0000","last_clean":"2024-03-09T15:20:27.024078+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:20:27.024078+0000","last_undegraded":"2024-03-09T15:20:27.024078+0000","last_fullsized":"2024-03-09T15:20:27.024078+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:36.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5692335,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":368,"num_read_kb":3591,"num_write":915,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148046+0000","last_change":"2024-03-09T14:21:56.357637+0000","last_active":"2024-03-09T15:20:27.148046+0000","last_peered":"2024-03-09T15:20:27.148046+0000","last_clean":"2024-03-09T15:20:27.148046+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:20:27.148046+0000","last_undegraded":"2024-03-09T15:20:27.148046+0000","last_fullsized":"2024-03-09T15:20:27.148046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:40.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'227","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:30.558860+0000","last_change":"2024-03-09T14:21:54.361294+0000","last_active":"2024-03-09T15:20:30.558860+0000","last_peered":"2024-03-09T15:20:30.558860+0000","last_clean":"2024-03-09T15:20:30.558860+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:20:30.558860+0000","last_undegraded":"2024-03-09T15:20:30.558860+0000","last_fullsized":"2024-03-09T15:20:30.558860+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:03.466571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5751340,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":502,"num_read_kb":6366,"num_write":1239,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162762+0000","last_change":"2024-03-09T14:21:56.366542+0000","last_active":"2024-03-09T15:20:27.162762+0000","last_peered":"2024-03-09T15:20:27.162762+0000","last_clean":"2024-03-09T15:20:27.162762+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:20:27.162762+0000","last_undegraded":"2024-03-09T15:20:27.162762+0000","last_fullsized":"2024-03-09T15:20:27.162762+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:07.419936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'210","reported_seq":826,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995977+0000","last_change":"2024-03-09T14:22:31.512292+0000","last_active":"2024-03-09T15:21:01.995977+0000","last_peered":"2024-03-09T15:21:01.995977+0000","last_clean":"2024-03-09T15:21:01.995977+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:21:01.995977+0000","last_undegraded":"2024-03-09T15:21:01.995977+0000","last_fullsized":"2024-03-09T15:21:01.995977+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:33.917233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933588,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":457,"num_read_kb":30999,"num_write":1207,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999345+0000","last_change":"2024-03-09T14:21:56.371868+0000","last_active":"2024-03-09T15:20:26.999345+0000","last_peered":"2024-03-09T15:20:26.999345+0000","last_clean":"2024-03-09T15:20:26.999345+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:20:26.999345+0000","last_undegraded":"2024-03-09T15:20:26.999345+0000","last_fullsized":"2024-03-09T15:20:26.999345+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:15.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'185","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.057080+0000","last_change":"2024-03-09T14:21:54.364838+0000","last_active":"2024-03-09T15:22:43.057080+0000","last_peered":"2024-03-09T15:22:43.057080+0000","last_clean":"2024-03-09T15:22:43.057080+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:22:43.057080+0000","last_undegraded":"2024-03-09T15:22:43.057080+0000","last_fullsized":"2024-03-09T15:22:43.057080+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:49.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5287633,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":355,"num_read_kb":8057,"num_write":1055,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006259+0000","last_change":"2024-03-09T14:21:56.374875+0000","last_active":"2024-03-09T15:20:27.006259+0000","last_peered":"2024-03-09T15:20:27.006259+0000","last_clean":"2024-03-09T15:20:27.006259+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:20:27.006259+0000","last_undegraded":"2024-03-09T15:20:27.006259+0000","last_fullsized":"2024-03-09T15:20:27.006259+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:04.393658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'187","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.991193+0000","last_change":"2024-03-09T14:21:54.358572+0000","last_active":"2024-03-09T15:20:16.991193+0000","last_peered":"2024-03-09T15:20:16.991193+0000","last_clean":"2024-03-09T15:20:16.991193+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:20:16.991193+0000","last_undegraded":"2024-03-09T15:20:16.991193+0000","last_fullsized":"2024-03-09T15:20:16.991193+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:42.206920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12701674,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":370,"num_read_kb":1771,"num_write":1073,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.582786+0000","last_change":"2024-03-09T14:21:56.366749+0000","last_active":"2024-03-09T15:23:08.582786+0000","last_peered":"2024-03-09T15:23:08.582786+0000","last_clean":"2024-03-09T15:23:08.582786+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:23:08.582786+0000","last_undegraded":"2024-03-09T15:23:08.582786+0000","last_fullsized":"2024-03-09T15:23:08.582786+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:28.693682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022779+0000","last_change":"2024-03-09T14:21:54.362334+0000","last_active":"2024-03-09T15:20:17.022779+0000","last_peered":"2024-03-09T15:20:17.022779+0000","last_clean":"2024-03-09T15:20:17.022779+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:20:17.022779+0000","last_undegraded":"2024-03-09T15:20:17.022779+0000","last_fullsized":"2024-03-09T15:20:17.022779+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:07.779443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10747973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":6618,"num_write":997,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'203","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.022634+0000","last_change":"2024-03-09T14:22:31.500572+0000","last_active":"2024-03-09T15:20:17.022634+0000","last_peered":"2024-03-09T15:20:17.022634+0000","last_clean":"2024-03-09T15:20:17.022634+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:20:17.022634+0000","last_undegraded":"2024-03-09T15:20:17.022634+0000","last_fullsized":"2024-03-09T15:20:17.022634+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:04.341433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18506442,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":427,"num_read_kb":70161,"num_write":1218,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.091735+0000","last_change":"2024-03-09T14:21:56.373545+0000","last_active":"2024-03-09T15:23:23.091735+0000","last_peered":"2024-03-09T15:23:23.091735+0000","last_clean":"2024-03-09T15:23:23.091735+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:23:23.091735+0000","last_undegraded":"2024-03-09T15:23:23.091735+0000","last_fullsized":"2024-03-09T15:23:23.091735+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:55.978437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'189","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.902114+0000","last_change":"2024-03-09T14:21:54.366684+0000","last_active":"2024-03-09T15:23:37.902114+0000","last_peered":"2024-03-09T15:23:37.902114+0000","last_clean":"2024-03-09T15:23:37.902114+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:23:37.902114+0000","last_undegraded":"2024-03-09T15:23:37.902114+0000","last_fullsized":"2024-03-09T15:23:37.902114+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:50.065605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23102045,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":533,"num_read_kb":29809,"num_write":1050,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019819+0000","last_change":"2024-03-09T14:21:56.373920+0000","last_active":"2024-03-09T15:19:57.019819+0000","last_peered":"2024-03-09T15:19:57.019819+0000","last_clean":"2024-03-09T15:19:57.019819+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:19:57.019819+0000","last_undegraded":"2024-03-09T15:19:57.019819+0000","last_fullsized":"2024-03-09T15:19:57.019819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:31.026336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1226,"ondisk_log_size":1226,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":632,"ondisk_log_size":632,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":334127,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":8854,"num_read_kb":10560,"num_write":6413,"num_write_kb":2961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712704,"data_stored":178786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1868,"ondisk_log_size":1868,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1573,"num_read_kb":1873,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3747,"ondisk_log_size":3747,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":633895248,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":31765,"num_read_kb":2295828,"num_write":68028,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":953536512,"data_stored":953536512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4586,"ondisk_log_size":4586,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":80534719,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":113,"num_read_kb":170575,"num_write":132,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161079296,"data_stored":161069438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":80534719,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":114,"num_read_kb":174957,"num_write":132,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":161079296,"data_stored":161069438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575608,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451364,"kb_used_data":159196,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":93920476,"statfs":{"total":96636764160,"available":96174567424,"internally_reserved":0,"allocated":163016704,"data_stored":161020128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":299170250},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575608,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394184,"kb_used_data":156160,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93977656,"statfs":{"total":96636764160,"available":96233119744,"internally_reserved":0,"allocated":159907840,"data_stored":157991089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575609,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244964,"kb_used_data":159708,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94126876,"statfs":{"total":96636764160,"available":96385921024,"internally_reserved":0,"allocated":163540992,"data_stored":161520121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259136,"kb_used_data":183544,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94112704,"statfs":{"total":96636764160,"available":96371408896,"internally_reserved":0,"allocated":187949056,"data_stored":186062276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575611,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394820,"kb_used_data":183164,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93977020,"statfs":{"total":96636764160,"available":96232468480,"internally_reserved":0,"allocated":187559936,"data_stored":185582722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575610,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209948,"kb_used_data":124692,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94161892,"statfs":{"total":96636764160,"available":96421777408,"internally_reserved":0,"allocated":127684608,"data_stored":125769330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575609,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276512,"kb_used_data":169048,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94095328,"statfs":{"total":96636764160,"available":96353615872,"internally_reserved":0,"allocated":173105152,"data_stored":171158574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575607,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":364476,"kb_used_data":144500,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94007364,"statfs":{"total":96636764160,"available":96263540736,"internally_reserved":0,"allocated":147968000,"data_stored":145989418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":121610240,"data_stored":121610240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":115818496,"data_stored":115818496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":96149504,"data_stored":96149504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116727808,"data_stored":116727808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":135528448,"data_stored":135528448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":130207744,"data_stored":130207744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":118968320,"data_stored":118968320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":118525952,"data_stored":118525952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":20357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":23559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":9420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":20894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":28805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":26027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":47157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26255360,"data_stored":26254545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21737472,"data_stored":21734173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32546816,"data_stored":32546001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28069888,"data_stored":28065774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20013056,"data_stored":20011517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44847104,"data_stored":44842990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17491441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18915328,"data_stored":18914513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:24:40.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T15:24:40.794 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:40.795 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":260,"fsid":"89924d1c-8381-4c0c-aba2-532d86495bef","created":"2024-03-09T14:21:25.531865+0000","modified":"2024-03-09T14:50:04.647917+0000","last_up_change":"2024-03-09T14:21:36.275755+0000","last_in_change":"2024-03-09T14:21:27.940854+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-03-09T14:21:36.654759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-03-09T14:21:37.905367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-09T14:21:52.331452+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-09T14:21:54.692250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-09T14:21:56.529146+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-09T14:21:58.433674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-09T14:22:00.389569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-09T14:22:02.460005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-03-09T14:30:59.198450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"249","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-03-09T14:35:49.150114+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-03-09T14:35:53.611893+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-03-09T14:50:01.911990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a8de056-1d4c-4f3d-8586-238749c02150","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6809","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6812","nonce":3412775629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6815","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6818","nonce":3412775629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6829","nonce":3412775629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6821","nonce":3412775629},{"type":"v1","addr":"172.21.15.46:6823","nonce":3412775629}]},"public_addr":"172.21.15.46:6812/3412775629","cluster_addr":"172.21.15.46:6818/3412775629","heartbeat_back_addr":"172.21.15.46:6829/3412775629","heartbeat_front_addr":"172.21.15.46:6823/3412775629","state":["exists","up"]},{"osd":1,"uuid":"c885198f-13e0-4c5e-bfe9-6a282f8836c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6813","nonce":222930770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6820","nonce":222930770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6831","nonce":222930770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":222930770},{"type":"v1","addr":"172.21.15.46:6827","nonce":222930770}]},"public_addr":"172.21.15.46:6813/222930770","cluster_addr":"172.21.15.46:6820/222930770","heartbeat_back_addr":"172.21.15.46:6831/222930770","heartbeat_front_addr":"172.21.15.46:6827/222930770","state":["exists","up"]},{"osd":2,"uuid":"921d827a-3f2c-43e8-9b40-45f1c78dcb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6801","nonce":4147138312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6803","nonce":4147138312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6807","nonce":4147138312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4147138312},{"type":"v1","addr":"172.21.15.46:6805","nonce":4147138312}]},"public_addr":"172.21.15.46:6801/4147138312","cluster_addr":"172.21.15.46:6803/4147138312","heartbeat_back_addr":"172.21.15.46:6807/4147138312","heartbeat_front_addr":"172.21.15.46:6805/4147138312","state":["exists","up"]},{"osd":3,"uuid":"92109eeb-4d9e-40fd-b178-d2c555f0bc33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6811","nonce":2698338376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6817","nonce":2698338376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6825","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6828","nonce":2698338376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6819","nonce":2698338376},{"type":"v1","addr":"172.21.15.46:6822","nonce":2698338376}]},"public_addr":"172.21.15.46:6811/2698338376","cluster_addr":"172.21.15.46:6817/2698338376","heartbeat_back_addr":"172.21.15.46:6828/2698338376","heartbeat_front_addr":"172.21.15.46:6822/2698338376","state":["exists","up"]},{"osd":4,"uuid":"c45b0ce3-c175-4d1d-a330-2a1d1e0a1e64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6801","nonce":405397884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6803","nonce":405397884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6807","nonce":405397884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":405397884},{"type":"v1","addr":"172.21.15.159:6805","nonce":405397884}]},"public_addr":"172.21.15.159:6801/405397884","cluster_addr":"172.21.15.159:6803/405397884","heartbeat_back_addr":"172.21.15.159:6807/405397884","heartbeat_front_addr":"172.21.15.159:6805/405397884","state":["exists","up"]},{"osd":5,"uuid":"f2ab3d51-dcaf-4a02-a770-19d4f28e83f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6809","nonce":2219836914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6811","nonce":2219836914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6815","nonce":2219836914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2219836914},{"type":"v1","addr":"172.21.15.159:6813","nonce":2219836914}]},"public_addr":"172.21.15.159:6809/2219836914","cluster_addr":"172.21.15.159:6811/2219836914","heartbeat_back_addr":"172.21.15.159:6815/2219836914","heartbeat_front_addr":"172.21.15.159:6813/2219836914","state":["exists","up"]},{"osd":6,"uuid":"b8a1609f-2e25-4fdf-bdcc-529d13bb799e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6825","nonce":4253518115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6827","nonce":4253518115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6831","nonce":4253518115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":4253518115},{"type":"v1","addr":"172.21.15.159:6829","nonce":4253518115}]},"public_addr":"172.21.15.159:6825/4253518115","cluster_addr":"172.21.15.159:6827/4253518115","heartbeat_back_addr":"172.21.15.159:6831/4253518115","heartbeat_front_addr":"172.21.15.159:6829/4253518115","state":["exists","up"]},{"osd":7,"uuid":"3139dc31-a486-4cba-b9d6-0383b8db1857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":258,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6817","nonce":3641282602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6819","nonce":3641282602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6823","nonce":3641282602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3641282602},{"type":"v1","addr":"172.21.15.159:6821","nonce":3641282602}]},"public_addr":"172.21.15.159:6817/3641282602","cluster_addr":"172.21.15.159:6819/3641282602","heartbeat_back_addr":"172.21.15.159:6823/3641282602","heartbeat_front_addr":"172.21.15.159:6821/3641282602","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.075588+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.079403+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.045153+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.109902+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.178720+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.171691+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.197741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:21:33.194970+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.1b","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2c","mappings":[{"from":4,"to":1},{"from":6,"to":2}]},{"pgid":"3.30","mappings":[{"from":4,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"4.2f","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]},{"pgid":"67.c","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T15:24:41.808 INFO:tasks.ceph:Scrubbing osd.0 2024-03-09T15:24:41.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:41.960 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:41.960 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:41.960 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:41.971 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-09T15:24:42.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-09T15:24:42.280 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-03-09T15:24:42.293 INFO:tasks.ceph:Scrubbing osd.1 2024-03-09T15:24:42.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:42.432 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:42.433 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:42.433 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:42.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-09T15:24:42.754 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-03-09T15:24:42.768 INFO:tasks.ceph:Scrubbing osd.2 2024-03-09T15:24:42.768 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:42.908 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:42.908 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:42.908 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:42.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-09T15:24:43.228 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-03-09T15:24:43.242 INFO:tasks.ceph:Scrubbing osd.3 2024-03-09T15:24:43.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:43.381 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:43.382 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:43.382 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:43.393 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-09T15:24:43.703 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-03-09T15:24:43.716 INFO:tasks.ceph:Scrubbing osd.4 2024-03-09T15:24:43.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:43.857 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:43.857 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:43.857 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:43.868 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-09T15:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-03-09T15:24:44.190 INFO:tasks.ceph:Scrubbing osd.5 2024-03-09T15:24:44.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:44.329 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:44.330 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:44.340 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-09T15:24:44.649 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-03-09T15:24:44.662 INFO:tasks.ceph:Scrubbing osd.6 2024-03-09T15:24:44.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:44.802 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:44.803 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:44.803 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:44.813 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-09T15:24:45.121 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-03-09T15:24:45.134 INFO:tasks.ceph:Scrubbing osd.7 2024-03-09T15:24:45.134 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:24:45.274 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-03-09T15:24:45.275 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:24:45.275 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-03-09T15:24:45.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-09T15:24:45.594 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-03-09T15:24:45.608 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:24:45.948 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:24:45.961 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:24:45.963 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2147,"stamp":"2024-03-09T15:24:45.152264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":146582508,"num_objects":538,"num_object_clones":0,"num_object_copies":1298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":151082,"num_read_kb":2744375,"num_write":128593,"num_write_kb":2398318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13955,"ondisk_log_size":13955,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1585408,"kb_used_data":265432,"kb_used_omap":12,"kb_used_meta":1319475,"kb_avail":753389312,"statfs":{"total":773094113280,"available":771470655488,"internally_reserved":0,"allocated":271802368,"data_stored":256446248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1351142960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-649321139,"num_objects":-254,"num_object_clones":0,"num_object_copies":-726,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-254,"num_whiteouts":0,"num_read":591,"num_read_kb":665,"num_write":388,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005575"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.021041+0000","last_change":"2024-03-09T14:50:03.656802+0000","last_active":"2024-03-09T15:20:07.021041+0000","last_peered":"2024-03-09T15:20:07.021041+0000","last_clean":"2024-03-09T15:20:07.021041+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:20:07.021041+0000","last_undegraded":"2024-03-09T15:20:07.021041+0000","last_fullsized":"2024-03-09T15:20:07.021041+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:04.962196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'8","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.050624+0000","last_change":"2024-03-09T14:35:55.601961+0000","last_active":"2024-03-09T15:23:27.050624+0000","last_peered":"2024-03-09T15:23:27.050624+0000","last_clean":"2024-03-09T15:23:27.050624+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:23:27.050624+0000","last_undegraded":"2024-03-09T15:23:27.050624+0000","last_fullsized":"2024-03-09T15:23:27.050624+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:04:58.889343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009287+0000","last_change":"2024-03-09T14:35:50.589013+0000","last_active":"2024-03-09T15:20:52.009287+0000","last_peered":"2024-03-09T15:20:52.009287+0000","last_clean":"2024-03-09T15:20:52.009287+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:20:52.009287+0000","last_undegraded":"2024-03-09T15:20:52.009287+0000","last_fullsized":"2024-03-09T15:20:52.009287+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:23.606923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003320+0000","last_change":"2024-03-09T14:31:01.149135+0000","last_active":"2024-03-09T15:21:02.003320+0000","last_peered":"2024-03-09T15:21:02.003320+0000","last_clean":"2024-03-09T15:21:02.003320+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:21:02.003320+0000","last_undegraded":"2024-03-09T15:21:02.003320+0000","last_fullsized":"2024-03-09T15:21:02.003320+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:09.105678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:06.990155+0000","last_change":"2024-03-09T14:50:03.659762+0000","last_active":"2024-03-09T15:20:06.990155+0000","last_peered":"2024-03-09T15:20:06.990155+0000","last_clean":"2024-03-09T15:20:06.990155+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:20:06.990155+0000","last_undegraded":"2024-03-09T15:20:06.990155+0000","last_fullsized":"2024-03-09T15:20:06.990155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:14.705784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.151881+0000","last_change":"2024-03-09T14:35:55.598964+0000","last_active":"2024-03-09T15:20:57.151881+0000","last_peered":"2024-03-09T15:20:57.151881+0000","last_clean":"2024-03-09T15:20:57.151881+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:20:57.151881+0000","last_undegraded":"2024-03-09T15:20:57.151881+0000","last_fullsized":"2024-03-09T15:20:57.151881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:06:08.079908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:22.012101+0000","last_change":"2024-03-09T14:35:50.590196+0000","last_active":"2024-03-09T15:23:22.012101+0000","last_peered":"2024-03-09T15:23:22.012101+0000","last_clean":"2024-03-09T15:23:22.012101+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:23:22.012101+0000","last_undegraded":"2024-03-09T15:23:22.012101+0000","last_fullsized":"2024-03-09T15:23:22.012101+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:35.379415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":156,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:11.996933+0000","last_change":"2024-03-09T14:31:01.138966+0000","last_active":"2024-03-09T15:21:11.996933+0000","last_peered":"2024-03-09T15:21:11.996933+0000","last_clean":"2024-03-09T15:21:11.996933+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:21:11.996933+0000","last_undegraded":"2024-03-09T15:21:11.996933+0000","last_fullsized":"2024-03-09T15:21:11.996933+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:10.293011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.033437+0000","last_change":"2024-03-09T14:50:03.653730+0000","last_active":"2024-03-09T15:21:32.033437+0000","last_peered":"2024-03-09T15:21:32.033437+0000","last_clean":"2024-03-09T15:21:32.033437+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:21:32.033437+0000","last_undegraded":"2024-03-09T15:21:32.033437+0000","last_fullsized":"2024-03-09T15:21:32.033437+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:21.654055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:51.917834+0000","last_change":"2024-03-09T14:35:55.635024+0000","last_active":"2024-03-09T15:23:51.917834+0000","last_peered":"2024-03-09T15:23:51.917834+0000","last_clean":"2024-03-09T15:23:51.917834+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:23:51.917834+0000","last_undegraded":"2024-03-09T15:23:51.917834+0000","last_fullsized":"2024-03-09T15:23:51.917834+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:46.253263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'9","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.968121+0000","last_change":"2024-03-09T14:35:50.592237+0000","last_active":"2024-03-09T15:24:37.968121+0000","last_peered":"2024-03-09T15:24:37.968121+0000","last_clean":"2024-03-09T15:24:37.968121+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:24:37.968121+0000","last_undegraded":"2024-03-09T15:24:37.968121+0000","last_fullsized":"2024-03-09T15:24:37.968121+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:31.946306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":109,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.003270+0000","last_change":"2024-03-09T14:31:01.144121+0000","last_active":"2024-03-09T15:21:02.003270+0000","last_peered":"2024-03-09T15:21:02.003270+0000","last_clean":"2024-03-09T15:21:02.003270+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:21:02.003270+0000","last_undegraded":"2024-03-09T15:21:02.003270+0000","last_fullsized":"2024-03-09T15:21:02.003270+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:07.901302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.015382+0000","last_change":"2024-03-09T14:50:03.664715+0000","last_active":"2024-03-09T15:21:42.015382+0000","last_peered":"2024-03-09T15:21:42.015382+0000","last_clean":"2024-03-09T15:21:42.015382+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:21:42.015382+0000","last_undegraded":"2024-03-09T15:21:42.015382+0000","last_fullsized":"2024-03-09T15:21:42.015382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:17.457762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'4","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.044561+0000","last_change":"2024-03-09T14:35:55.633735+0000","last_active":"2024-03-09T15:24:38.044561+0000","last_peered":"2024-03-09T15:24:38.044561+0000","last_clean":"2024-03-09T15:24:38.044561+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:24:38.044561+0000","last_undegraded":"2024-03-09T15:24:38.044561+0000","last_fullsized":"2024-03-09T15:24:38.044561+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:58.258793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":4,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.160281+0000","last_change":"2024-03-09T14:35:50.588633+0000","last_active":"2024-03-09T15:21:42.160281+0000","last_peered":"2024-03-09T15:21:42.160281+0000","last_clean":"2024-03-09T15:21:42.160281+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:21:42.160281+0000","last_undegraded":"2024-03-09T15:21:42.160281+0000","last_fullsized":"2024-03-09T15:21:42.160281+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:47.842912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":154,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010493+0000","last_change":"2024-03-09T14:31:01.143564+0000","last_active":"2024-03-09T15:21:02.010493+0000","last_peered":"2024-03-09T15:21:02.010493+0000","last_clean":"2024-03-09T15:21:02.010493+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:21:02.010493+0000","last_undegraded":"2024-03-09T15:21:02.010493+0000","last_fullsized":"2024-03-09T15:21:02.010493+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:51:38.918335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019554+0000","last_change":"2024-03-09T14:50:03.656253+0000","last_active":"2024-03-09T15:22:17.019554+0000","last_peered":"2024-03-09T15:22:17.019554+0000","last_clean":"2024-03-09T15:22:17.019554+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:22:17.019554+0000","last_undegraded":"2024-03-09T15:22:17.019554+0000","last_fullsized":"2024-03-09T15:22:17.019554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:38.610391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059219+0000","last_change":"2024-03-09T14:35:55.603890+0000","last_active":"2024-03-09T15:24:27.059219+0000","last_peered":"2024-03-09T15:24:27.059219+0000","last_clean":"2024-03-09T15:24:27.059219+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:24:27.059219+0000","last_undegraded":"2024-03-09T15:24:27.059219+0000","last_fullsized":"2024-03-09T15:24:27.059219+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:40.989711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:11.919862+0000","last_change":"2024-03-09T14:35:50.586383+0000","last_active":"2024-03-09T15:24:11.919862+0000","last_peered":"2024-03-09T15:24:11.919862+0000","last_clean":"2024-03-09T15:24:11.919862+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:24:11.919862+0000","last_undegraded":"2024-03-09T15:24:11.919862+0000","last_fullsized":"2024-03-09T15:24:11.919862+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:58.715378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":164,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.010460+0000","last_change":"2024-03-09T14:31:01.141921+0000","last_active":"2024-03-09T15:21:02.010460+0000","last_peered":"2024-03-09T15:21:02.010460+0000","last_clean":"2024-03-09T15:21:02.010460+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:21:02.010460+0000","last_undegraded":"2024-03-09T15:21:02.010460+0000","last_fullsized":"2024-03-09T15:21:02.010460+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:28.572848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999640+0000","last_change":"2024-03-09T14:50:03.661504+0000","last_active":"2024-03-09T15:21:21.999640+0000","last_peered":"2024-03-09T15:21:21.999640+0000","last_clean":"2024-03-09T15:21:21.999640+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:21:21.999640+0000","last_undegraded":"2024-03-09T15:21:21.999640+0000","last_fullsized":"2024-03-09T15:21:21.999640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:16.731080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'3","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.057717+0000","last_change":"2024-03-09T14:35:55.603980+0000","last_active":"2024-03-09T15:24:17.057717+0000","last_peered":"2024-03-09T15:24:17.057717+0000","last_clean":"2024-03-09T15:24:17.057717+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:24:17.057717+0000","last_undegraded":"2024-03-09T15:24:17.057717+0000","last_fullsized":"2024-03-09T15:24:17.057717+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:36.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'11","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.182333+0000","last_change":"2024-03-09T14:35:50.584429+0000","last_active":"2024-03-09T15:24:17.182333+0000","last_peered":"2024-03-09T15:24:17.182333+0000","last_clean":"2024-03-09T15:24:17.182333+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:24:17.182333+0000","last_undegraded":"2024-03-09T15:24:17.182333+0000","last_fullsized":"2024-03-09T15:24:17.182333+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:35.785481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":107,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029279+0000","last_change":"2024-03-09T14:31:01.137869+0000","last_active":"2024-03-09T15:21:02.029279+0000","last_peered":"2024-03-09T15:21:02.029279+0000","last_clean":"2024-03-09T15:21:02.029279+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:21:02.029279+0000","last_undegraded":"2024-03-09T15:21:02.029279+0000","last_fullsized":"2024-03-09T15:21:02.029279+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:00.440659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159481+0000","last_change":"2024-03-09T14:50:03.659706+0000","last_active":"2024-03-09T15:20:07.159481+0000","last_peered":"2024-03-09T15:20:07.159481+0000","last_clean":"2024-03-09T15:20:07.159481+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:20:07.159481+0000","last_undegraded":"2024-03-09T15:20:07.159481+0000","last_fullsized":"2024-03-09T15:20:07.159481+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:01.960769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.051107+0000","last_change":"2024-03-09T14:35:55.605449+0000","last_active":"2024-03-09T15:23:27.051107+0000","last_peered":"2024-03-09T15:23:27.051107+0000","last_clean":"2024-03-09T15:23:27.051107+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:23:27.051107+0000","last_undegraded":"2024-03-09T15:23:27.051107+0000","last_fullsized":"2024-03-09T15:23:27.051107+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:43:08.518355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.151137+0000","last_change":"2024-03-09T14:35:50.585219+0000","last_active":"2024-03-09T15:20:52.151137+0000","last_peered":"2024-03-09T15:20:52.151137+0000","last_clean":"2024-03-09T15:20:52.151137+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:20:52.151137+0000","last_undegraded":"2024-03-09T15:20:52.151137+0000","last_fullsized":"2024-03-09T15:20:52.151137+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:40.696301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905562+0000","last_change":"2024-03-09T14:31:01.146419+0000","last_active":"2024-03-09T15:22:06.905562+0000","last_peered":"2024-03-09T15:22:06.905562+0000","last_clean":"2024-03-09T15:22:06.905562+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:22:06.905562+0000","last_undegraded":"2024-03-09T15:22:06.905562+0000","last_fullsized":"2024-03-09T15:22:06.905562+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:26.233793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.159538+0000","last_change":"2024-03-09T14:50:03.664828+0000","last_active":"2024-03-09T15:20:07.159538+0000","last_peered":"2024-03-09T15:20:07.159538+0000","last_clean":"2024-03-09T15:20:07.159538+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:20:07.159538+0000","last_undegraded":"2024-03-09T15:20:07.159538+0000","last_fullsized":"2024-03-09T15:20:07.159538+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:43:10.894912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:57.009850+0000","last_change":"2024-03-09T14:35:55.606688+0000","last_active":"2024-03-09T15:20:57.009850+0000","last_peered":"2024-03-09T15:20:57.009850+0000","last_clean":"2024-03-09T15:20:57.009850+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:20:57.009850+0000","last_undegraded":"2024-03-09T15:20:57.009850+0000","last_fullsized":"2024-03-09T15:20:57.009850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:27.128463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002039+0000","last_change":"2024-03-09T14:35:50.593904+0000","last_active":"2024-03-09T15:20:52.002039+0000","last_peered":"2024-03-09T15:20:52.002039+0000","last_clean":"2024-03-09T15:20:52.002039+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:20:52.002039+0000","last_undegraded":"2024-03-09T15:20:52.002039+0000","last_fullsized":"2024-03-09T15:20:52.002039+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:03.967997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.002072+0000","last_change":"2024-03-09T14:31:01.135095+0000","last_active":"2024-03-09T15:21:47.002072+0000","last_peered":"2024-03-09T15:21:47.002072+0000","last_clean":"2024-03-09T15:21:47.002072+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:21:47.002072+0000","last_undegraded":"2024-03-09T15:21:47.002072+0000","last_fullsized":"2024-03-09T15:21:47.002072+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:55.759399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993733+0000","last_change":"2024-03-09T14:50:03.657383+0000","last_active":"2024-03-09T15:20:26.993733+0000","last_peered":"2024-03-09T15:20:26.993733+0000","last_clean":"2024-03-09T15:20:26.993733+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:20:26.993733+0000","last_undegraded":"2024-03-09T15:20:26.993733+0000","last_fullsized":"2024-03-09T15:20:26.993733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:07.698784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"257'11","reported_seq":68,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.016714+0000","last_change":"2024-03-09T14:35:55.634050+0000","last_active":"2024-03-09T15:21:52.016714+0000","last_peered":"2024-03-09T15:21:52.016714+0000","last_clean":"2024-03-09T15:21:52.016714+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:21:52.016714+0000","last_undegraded":"2024-03-09T15:21:52.016714+0000","last_fullsized":"2024-03-09T15:21:52.016714+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:35.953944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"257'10","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023348+0000","last_change":"2024-03-09T14:35:50.582640+0000","last_active":"2024-03-09T15:20:22.023348+0000","last_peered":"2024-03-09T15:20:22.023348+0000","last_clean":"2024-03-09T15:20:22.023348+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:20:22.023348+0000","last_undegraded":"2024-03-09T15:20:22.023348+0000","last_fullsized":"2024-03-09T15:20:22.023348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:24:34.216433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903407+0000","last_change":"2024-03-09T14:31:01.148885+0000","last_active":"2024-03-09T15:21:46.903407+0000","last_peered":"2024-03-09T15:21:46.903407+0000","last_clean":"2024-03-09T15:21:46.903407+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:21:46.903407+0000","last_undegraded":"2024-03-09T15:21:46.903407+0000","last_fullsized":"2024-03-09T15:21:46.903407+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:02.222592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992120+0000","last_change":"2024-03-09T14:50:03.655189+0000","last_active":"2024-03-09T15:20:26.992120+0000","last_peered":"2024-03-09T15:20:26.992120+0000","last_clean":"2024-03-09T15:20:26.992120+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:20:26.992120+0000","last_undegraded":"2024-03-09T15:20:26.992120+0000","last_fullsized":"2024-03-09T15:20:26.992120+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:03.341531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.007023+0000","last_change":"2024-03-09T14:35:55.633676+0000","last_active":"2024-03-09T15:20:32.007023+0000","last_peered":"2024-03-09T15:20:32.007023+0000","last_clean":"2024-03-09T15:20:32.007023+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:20:32.007023+0000","last_undegraded":"2024-03-09T15:20:32.007023+0000","last_fullsized":"2024-03-09T15:20:32.007023+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:05:23.209750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.174264+0000","last_change":"2024-03-09T14:35:50.585080+0000","last_active":"2024-03-09T15:21:47.174264+0000","last_peered":"2024-03-09T15:21:47.174264+0000","last_clean":"2024-03-09T15:21:47.174264+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:21:47.174264+0000","last_undegraded":"2024-03-09T15:21:47.174264+0000","last_fullsized":"2024-03-09T15:21:47.174264+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.598130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":95,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.016119+0000","last_change":"2024-03-09T14:31:01.143022+0000","last_active":"2024-03-09T15:21:47.016119+0000","last_peered":"2024-03-09T15:21:47.016119+0000","last_clean":"2024-03-09T15:21:47.016119+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:21:47.016119+0000","last_undegraded":"2024-03-09T15:21:47.016119+0000","last_fullsized":"2024-03-09T15:21:47.016119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:37.958116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162669+0000","last_change":"2024-03-09T14:50:03.658035+0000","last_active":"2024-03-09T15:20:27.162669+0000","last_peered":"2024-03-09T15:20:27.162669+0000","last_clean":"2024-03-09T15:20:27.162669+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:20:27.162669+0000","last_undegraded":"2024-03-09T15:20:27.162669+0000","last_fullsized":"2024-03-09T15:20:27.162669+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:02.499788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'6","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.052909+0000","last_change":"2024-03-09T14:35:55.636071+0000","last_active":"2024-03-09T15:24:38.052909+0000","last_peered":"2024-03-09T15:24:38.052909+0000","last_clean":"2024-03-09T15:24:38.052909+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:24:38.052909+0000","last_undegraded":"2024-03-09T15:24:38.052909+0000","last_fullsized":"2024-03-09T15:24:38.052909+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:26.643965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000382+0000","last_change":"2024-03-09T14:35:50.592957+0000","last_active":"2024-03-09T15:21:47.000382+0000","last_peered":"2024-03-09T15:21:47.000382+0000","last_clean":"2024-03-09T15:21:47.000382+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:21:47.000382+0000","last_undegraded":"2024-03-09T15:21:47.000382+0000","last_fullsized":"2024-03-09T15:21:47.000382+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:17.607559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":168,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.000355+0000","last_change":"2024-03-09T14:31:01.134030+0000","last_active":"2024-03-09T15:21:47.000355+0000","last_peered":"2024-03-09T15:21:47.000355+0000","last_clean":"2024-03-09T15:21:47.000355+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:21:47.000355+0000","last_undegraded":"2024-03-09T15:21:47.000355+0000","last_fullsized":"2024-03-09T15:21:47.000355+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:28.544093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024030+0000","last_change":"2024-03-09T14:50:03.654352+0000","last_active":"2024-03-09T15:20:27.024030+0000","last_peered":"2024-03-09T15:20:27.024030+0000","last_clean":"2024-03-09T15:20:27.024030+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:20:27.024030+0000","last_undegraded":"2024-03-09T15:20:27.024030+0000","last_fullsized":"2024-03-09T15:20:27.024030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:36.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.161653+0000","last_change":"2024-03-09T14:35:55.604280+0000","last_active":"2024-03-09T15:21:52.161653+0000","last_peered":"2024-03-09T15:21:52.161653+0000","last_clean":"2024-03-09T15:21:52.161653+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:21:52.161653+0000","last_undegraded":"2024-03-09T15:21:52.161653+0000","last_fullsized":"2024-03-09T15:21:52.161653+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:12:34.983233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903393+0000","last_change":"2024-03-09T14:35:50.585309+0000","last_active":"2024-03-09T15:21:46.903393+0000","last_peered":"2024-03-09T15:21:46.903393+0000","last_clean":"2024-03-09T15:21:46.903393+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:21:46.903393+0000","last_undegraded":"2024-03-09T15:21:46.903393+0000","last_fullsized":"2024-03-09T15:21:46.903393+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:46:45.637003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":217,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.160203+0000","last_change":"2024-03-09T14:31:01.137671+0000","last_active":"2024-03-09T15:20:12.160203+0000","last_peered":"2024-03-09T15:20:12.160203+0000","last_clean":"2024-03-09T15:20:12.160203+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:20:12.160203+0000","last_undegraded":"2024-03-09T15:20:12.160203+0000","last_fullsized":"2024-03-09T15:20:12.160203+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:01.231496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014344+0000","last_change":"2024-03-09T14:50:03.655960+0000","last_active":"2024-03-09T15:21:32.014344+0000","last_peered":"2024-03-09T15:21:32.014344+0000","last_clean":"2024-03-09T15:21:32.014344+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:21:32.014344+0000","last_undegraded":"2024-03-09T15:21:32.014344+0000","last_fullsized":"2024-03-09T15:21:32.014344+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:11.272439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992699+0000","last_change":"2024-03-09T14:35:55.606840+0000","last_active":"2024-03-09T15:20:16.992699+0000","last_peered":"2024-03-09T15:20:16.992699+0000","last_clean":"2024-03-09T15:20:16.992699+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:20:16.992699+0000","last_undegraded":"2024-03-09T15:20:16.992699+0000","last_fullsized":"2024-03-09T15:20:16.992699+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.473637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.145659+0000","last_change":"2024-03-09T14:35:50.590700+0000","last_active":"2024-03-09T15:20:12.145659+0000","last_peered":"2024-03-09T15:20:12.145659+0000","last_clean":"2024-03-09T15:20:12.145659+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:20:12.145659+0000","last_undegraded":"2024-03-09T15:20:12.145659+0000","last_fullsized":"2024-03-09T15:20:12.145659+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:08.873263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":84,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.050402+0000","last_change":"2024-03-09T14:31:01.137580+0000","last_active":"2024-03-09T15:22:22.050402+0000","last_peered":"2024-03-09T15:22:22.050402+0000","last_clean":"2024-03-09T15:22:22.050402+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:22:22.050402+0000","last_undegraded":"2024-03-09T15:22:22.050402+0000","last_fullsized":"2024-03-09T15:22:22.050402+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:12.605404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.006645+0000","last_change":"2024-03-09T14:50:03.660277+0000","last_active":"2024-03-09T15:21:32.006645+0000","last_peered":"2024-03-09T15:21:32.006645+0000","last_clean":"2024-03-09T15:21:32.006645+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:21:32.006645+0000","last_undegraded":"2024-03-09T15:21:32.006645+0000","last_fullsized":"2024-03-09T15:21:32.006645+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:40.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992671+0000","last_change":"2024-03-09T14:35:55.600712+0000","last_active":"2024-03-09T15:20:16.992671+0000","last_peered":"2024-03-09T15:20:16.992671+0000","last_clean":"2024-03-09T15:20:16.992671+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:20:16.992671+0000","last_undegraded":"2024-03-09T15:20:16.992671+0000","last_fullsized":"2024-03-09T15:20:16.992671+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:03.894551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.004349+0000","last_change":"2024-03-09T14:35:50.590828+0000","last_active":"2024-03-09T15:20:12.004349+0000","last_peered":"2024-03-09T15:20:12.004349+0000","last_clean":"2024-03-09T15:20:12.004349+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:20:12.004349+0000","last_undegraded":"2024-03-09T15:20:12.004349+0000","last_fullsized":"2024-03-09T15:20:12.004349+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:47.297475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":108,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907426+0000","last_change":"2024-03-09T14:31:01.144397+0000","last_active":"2024-03-09T15:22:21.907426+0000","last_peered":"2024-03-09T15:22:21.907426+0000","last_clean":"2024-03-09T15:22:21.907426+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:22:21.907426+0000","last_undegraded":"2024-03-09T15:22:21.907426+0000","last_fullsized":"2024-03-09T15:22:21.907426+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:38.797574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000514+0000","last_change":"2024-03-09T14:50:03.662986+0000","last_active":"2024-03-09T15:20:37.000514+0000","last_peered":"2024-03-09T15:20:37.000514+0000","last_clean":"2024-03-09T15:20:37.000514+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:20:37.000514+0000","last_undegraded":"2024-03-09T15:20:37.000514+0000","last_fullsized":"2024-03-09T15:20:37.000514+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:12.215808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.005063+0000","last_change":"2024-03-09T14:35:55.606971+0000","last_active":"2024-03-09T15:20:17.005063+0000","last_peered":"2024-03-09T15:20:17.005063+0000","last_clean":"2024-03-09T15:20:17.005063+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:20:17.005063+0000","last_undegraded":"2024-03-09T15:20:17.005063+0000","last_fullsized":"2024-03-09T15:20:17.005063+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:59.770598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021829+0000","last_change":"2024-03-09T14:35:50.581340+0000","last_active":"2024-03-09T15:20:12.021829+0000","last_peered":"2024-03-09T15:20:12.021829+0000","last_clean":"2024-03-09T15:20:12.021829+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:20:12.021829+0000","last_undegraded":"2024-03-09T15:20:12.021829+0000","last_fullsized":"2024-03-09T15:20:12.021829+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:24:47.524610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'83","reported_seq":298,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166052+0000","last_change":"2024-03-09T14:31:01.140501+0000","last_active":"2024-03-09T15:22:22.166052+0000","last_peered":"2024-03-09T15:22:22.166052+0000","last_clean":"2024-03-09T15:22:22.166052+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:22:22.166052+0000","last_undegraded":"2024-03-09T15:22:22.166052+0000","last_fullsized":"2024-03-09T15:22:22.166052+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:25.600781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:32.014299+0000","last_change":"2024-03-09T14:50:03.654675+0000","last_active":"2024-03-09T15:21:32.014299+0000","last_peered":"2024-03-09T15:21:32.014299+0000","last_clean":"2024-03-09T15:21:32.014299+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:21:32.014299+0000","last_undegraded":"2024-03-09T15:21:32.014299+0000","last_fullsized":"2024-03-09T15:21:32.014299+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:16.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'5","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.957819+0000","last_change":"2024-03-09T14:35:55.607431+0000","last_active":"2024-03-09T15:24:37.957819+0000","last_peered":"2024-03-09T15:24:37.957819+0000","last_clean":"2024-03-09T15:24:37.957819+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:24:37.957819+0000","last_undegraded":"2024-03-09T15:24:37.957819+0000","last_fullsized":"2024-03-09T15:24:37.957819+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021909+0000","last_change":"2024-03-09T14:35:50.592140+0000","last_active":"2024-03-09T15:20:12.021909+0000","last_peered":"2024-03-09T15:20:12.021909+0000","last_clean":"2024-03-09T15:20:12.021909+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:20:12.021909+0000","last_undegraded":"2024-03-09T15:20:12.021909+0000","last_fullsized":"2024-03-09T15:20:12.021909+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:08.154255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020004+0000","last_change":"2024-03-09T14:31:01.141535+0000","last_active":"2024-03-09T15:22:22.020004+0000","last_peered":"2024-03-09T15:22:22.020004+0000","last_clean":"2024-03-09T15:22:22.020004+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:22:22.020004+0000","last_undegraded":"2024-03-09T15:22:22.020004+0000","last_fullsized":"2024-03-09T15:22:22.020004+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:30.104908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993313+0000","last_change":"2024-03-09T14:50:03.655565+0000","last_active":"2024-03-09T15:20:36.993313+0000","last_peered":"2024-03-09T15:20:36.993313+0000","last_clean":"2024-03-09T15:20:36.993313+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:20:36.993313+0000","last_undegraded":"2024-03-09T15:20:36.993313+0000","last_fullsized":"2024-03-09T15:20:36.993313+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:49.229016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'7","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:12.027918+0000","last_change":"2024-03-09T14:35:55.606305+0000","last_active":"2024-03-09T15:23:12.027918+0000","last_peered":"2024-03-09T15:23:12.027918+0000","last_clean":"2024-03-09T15:23:12.027918+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:23:12.027918+0000","last_undegraded":"2024-03-09T15:23:12.027918+0000","last_fullsized":"2024-03-09T15:23:12.027918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:34.509390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'8","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.968986+0000","last_change":"2024-03-09T14:35:50.588195+0000","last_active":"2024-03-09T15:24:37.968986+0000","last_peered":"2024-03-09T15:24:37.968986+0000","last_clean":"2024-03-09T15:24:37.968986+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:24:37.968986+0000","last_undegraded":"2024-03-09T15:24:37.968986+0000","last_fullsized":"2024-03-09T15:24:37.968986+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:50:18.644010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6842,"num_write":13,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008749+0000","last_change":"2024-03-09T14:31:01.145852+0000","last_active":"2024-03-09T15:20:47.008749+0000","last_peered":"2024-03-09T15:20:47.008749+0000","last_clean":"2024-03-09T15:20:47.008749+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:20:47.008749+0000","last_undegraded":"2024-03-09T15:20:47.008749+0000","last_fullsized":"2024-03-09T15:20:47.008749+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:57.994897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172868+0000","last_change":"2024-03-09T14:50:03.664102+0000","last_active":"2024-03-09T15:21:37.172868+0000","last_peered":"2024-03-09T15:21:37.172868+0000","last_clean":"2024-03-09T15:21:37.172868+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:21:37.172868+0000","last_undegraded":"2024-03-09T15:21:37.172868+0000","last_fullsized":"2024-03-09T15:21:37.172868+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:04.844692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.034355+0000","last_change":"2024-03-09T14:36:32.678035+0000","last_active":"2024-03-09T15:21:37.034355+0000","last_peered":"2024-03-09T15:21:37.034355+0000","last_clean":"2024-03-09T15:21:37.034355+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:21:37.034355+0000","last_undegraded":"2024-03-09T15:21:37.034355+0000","last_fullsized":"2024-03-09T15:21:37.034355+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:52.793827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:51.994913+0000","last_change":"2024-03-09T14:35:50.593689+0000","last_active":"2024-03-09T15:20:51.994913+0000","last_peered":"2024-03-09T15:20:51.994913+0000","last_clean":"2024-03-09T15:20:51.994913+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:20:51.994913+0000","last_undegraded":"2024-03-09T15:20:51.994913+0000","last_fullsized":"2024-03-09T15:20:51.994913+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:17.232581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":77,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024819+0000","last_change":"2024-03-09T14:31:01.138384+0000","last_active":"2024-03-09T15:20:32.024819+0000","last_peered":"2024-03-09T15:20:32.024819+0000","last_clean":"2024-03-09T15:20:32.024819+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:20:32.024819+0000","last_undegraded":"2024-03-09T15:20:32.024819+0000","last_fullsized":"2024-03-09T15:20:32.024819+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:52.676919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023996+0000","last_change":"2024-03-09T14:50:03.658657+0000","last_active":"2024-03-09T15:20:27.023996+0000","last_peered":"2024-03-09T15:20:27.023996+0000","last_clean":"2024-03-09T15:20:27.023996+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:20:27.023996+0000","last_undegraded":"2024-03-09T15:20:27.023996+0000","last_fullsized":"2024-03-09T15:20:27.023996+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:39:18.812497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:06.998034+0000","last_change":"2024-03-09T14:35:55.635179+0000","last_active":"2024-03-09T15:21:06.998034+0000","last_peered":"2024-03-09T15:21:06.998034+0000","last_clean":"2024-03-09T15:21:06.998034+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:21:06.998034+0000","last_undegraded":"2024-03-09T15:21:06.998034+0000","last_fullsized":"2024-03-09T15:21:06.998034+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:57.179285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002095+0000","last_change":"2024-03-09T14:35:50.588159+0000","last_active":"2024-03-09T15:20:52.002095+0000","last_peered":"2024-03-09T15:20:52.002095+0000","last_clean":"2024-03-09T15:20:52.002095+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:20:52.002095+0000","last_undegraded":"2024-03-09T15:20:52.002095+0000","last_fullsized":"2024-03-09T15:20:52.002095+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:42.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024744+0000","last_change":"2024-03-09T14:31:01.139440+0000","last_active":"2024-03-09T15:20:32.024744+0000","last_peered":"2024-03-09T15:20:32.024744+0000","last_clean":"2024-03-09T15:20:32.024744+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:20:32.024744+0000","last_undegraded":"2024-03-09T15:20:32.024744+0000","last_fullsized":"2024-03-09T15:20:32.024744+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:05.382467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162719+0000","last_change":"2024-03-09T14:50:03.657344+0000","last_active":"2024-03-09T15:20:27.162719+0000","last_peered":"2024-03-09T15:20:27.162719+0000","last_clean":"2024-03-09T15:20:27.162719+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:20:27.162719+0000","last_undegraded":"2024-03-09T15:20:27.162719+0000","last_fullsized":"2024-03-09T15:20:27.162719+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:00.699350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:12.027953+0000","last_change":"2024-03-09T14:35:55.603538+0000","last_active":"2024-03-09T15:23:12.027953+0000","last_peered":"2024-03-09T15:23:12.027953+0000","last_clean":"2024-03-09T15:23:12.027953+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:23:12.027953+0000","last_undegraded":"2024-03-09T15:23:12.027953+0000","last_fullsized":"2024-03-09T15:23:12.027953+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:48.904849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'2","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:17.011619+0000","last_change":"2024-03-09T14:35:50.587122+0000","last_active":"2024-03-09T15:23:17.011619+0000","last_peered":"2024-03-09T15:23:17.011619+0000","last_clean":"2024-03-09T15:23:17.011619+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:23:17.011619+0000","last_undegraded":"2024-03-09T15:23:17.011619+0000","last_fullsized":"2024-03-09T15:23:17.011619+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:59.885398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992702+0000","last_change":"2024-03-09T14:31:01.142302+0000","last_active":"2024-03-09T15:20:31.992702+0000","last_peered":"2024-03-09T15:20:31.992702+0000","last_clean":"2024-03-09T15:20:31.992702+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:20:31.992702+0000","last_undegraded":"2024-03-09T15:20:31.992702+0000","last_fullsized":"2024-03-09T15:20:31.992702+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:40.401950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.014916+0000","last_change":"2024-03-09T14:50:03.656718+0000","last_active":"2024-03-09T15:21:37.014916+0000","last_peered":"2024-03-09T15:21:37.014916+0000","last_clean":"2024-03-09T15:21:37.014916+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:21:37.014916+0000","last_undegraded":"2024-03-09T15:21:37.014916+0000","last_fullsized":"2024-03-09T15:21:37.014916+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:52.066966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'8","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.176822+0000","last_change":"2024-03-09T14:35:55.603262+0000","last_active":"2024-03-09T15:23:37.176822+0000","last_peered":"2024-03-09T15:23:37.176822+0000","last_clean":"2024-03-09T15:23:37.176822+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:23:37.176822+0000","last_undegraded":"2024-03-09T15:23:37.176822+0000","last_fullsized":"2024-03-09T15:23:37.176822+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:45.193657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005483+0000","last_change":"2024-03-09T14:35:50.586279+0000","last_active":"2024-03-09T15:21:22.005483+0000","last_peered":"2024-03-09T15:21:22.005483+0000","last_clean":"2024-03-09T15:21:22.005483+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:21:22.005483+0000","last_undegraded":"2024-03-09T15:21:22.005483+0000","last_fullsized":"2024-03-09T15:21:22.005483+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:50.461301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":215,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999932+0000","last_change":"2024-03-09T14:31:01.148313+0000","last_active":"2024-03-09T15:20:31.999932+0000","last_peered":"2024-03-09T15:20:31.999932+0000","last_clean":"2024-03-09T15:20:31.999932+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:20:31.999932+0000","last_undegraded":"2024-03-09T15:20:31.999932+0000","last_fullsized":"2024-03-09T15:20:31.999932+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:27.523628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173665+0000","last_change":"2024-03-09T14:50:03.659935+0000","last_active":"2024-03-09T15:21:42.173665+0000","last_peered":"2024-03-09T15:21:42.173665+0000","last_clean":"2024-03-09T15:21:42.173665+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:21:42.173665+0000","last_undegraded":"2024-03-09T15:21:42.173665+0000","last_fullsized":"2024-03-09T15:21:42.173665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:35.107226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171479+0000","last_change":"2024-03-09T14:35:55.633083+0000","last_active":"2024-03-09T15:21:27.171479+0000","last_peered":"2024-03-09T15:21:27.171479+0000","last_clean":"2024-03-09T15:21:27.171479+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:21:27.171479+0000","last_undegraded":"2024-03-09T15:21:27.171479+0000","last_fullsized":"2024-03-09T15:21:27.171479+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:21.416130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:21.999575+0000","last_change":"2024-03-09T14:35:50.583192+0000","last_active":"2024-03-09T15:21:21.999575+0000","last_peered":"2024-03-09T15:21:21.999575+0000","last_clean":"2024-03-09T15:21:21.999575+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:21:21.999575+0000","last_undegraded":"2024-03-09T15:21:21.999575+0000","last_fullsized":"2024-03-09T15:21:21.999575+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:36.010771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.167798+0000","last_change":"2024-03-09T14:31:01.138602+0000","last_active":"2024-03-09T15:21:02.167798+0000","last_peered":"2024-03-09T15:21:02.167798+0000","last_clean":"2024-03-09T15:21:02.167798+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:21:02.167798+0000","last_undegraded":"2024-03-09T15:21:02.167798+0000","last_fullsized":"2024-03-09T15:21:02.167798+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:22.514104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:37.172891+0000","last_change":"2024-03-09T14:50:03.659514+0000","last_active":"2024-03-09T15:21:37.172891+0000","last_peered":"2024-03-09T15:21:37.172891+0000","last_clean":"2024-03-09T15:21:37.172891+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:21:37.172891+0000","last_undegraded":"2024-03-09T15:21:37.172891+0000","last_fullsized":"2024-03-09T15:21:37.172891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:41.947406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:56.996980+0000","last_change":"2024-03-09T14:35:55.605840+0000","last_active":"2024-03-09T15:20:56.996980+0000","last_peered":"2024-03-09T15:20:56.996980+0000","last_clean":"2024-03-09T15:20:56.996980+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:20:56.996980+0000","last_undegraded":"2024-03-09T15:20:56.996980+0000","last_fullsized":"2024-03-09T15:20:56.996980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:02.619502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:51.917716+0000","last_change":"2024-03-09T14:35:50.584614+0000","last_active":"2024-03-09T15:23:51.917716+0000","last_peered":"2024-03-09T15:23:51.917716+0000","last_clean":"2024-03-09T15:23:51.917716+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:23:51.917716+0000","last_undegraded":"2024-03-09T15:23:51.917716+0000","last_fullsized":"2024-03-09T15:23:51.917716+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:53.029868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":80,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.009230+0000","last_change":"2024-03-09T14:31:01.141879+0000","last_active":"2024-03-09T15:20:52.009230+0000","last_peered":"2024-03-09T15:20:52.009230+0000","last_clean":"2024-03-09T15:20:52.009230+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:20:52.009230+0000","last_undegraded":"2024-03-09T15:20:52.009230+0000","last_fullsized":"2024-03-09T15:20:52.009230+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:28.690709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:36.902107+0000","last_change":"2024-03-09T14:50:03.659852+0000","last_active":"2024-03-09T15:21:36.902107+0000","last_peered":"2024-03-09T15:21:36.902107+0000","last_clean":"2024-03-09T15:21:36.902107+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:21:36.902107+0000","last_undegraded":"2024-03-09T15:21:36.902107+0000","last_fullsized":"2024-03-09T15:21:36.902107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:56.267905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.063049+0000","last_change":"2024-03-09T14:35:55.601630+0000","last_active":"2024-03-09T15:23:52.063049+0000","last_peered":"2024-03-09T15:23:52.063049+0000","last_clean":"2024-03-09T15:23:52.063049+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:23:52.063049+0000","last_undegraded":"2024-03-09T15:23:52.063049+0000","last_fullsized":"2024-03-09T15:23:52.063049+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:40.116666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'5","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.899466+0000","last_change":"2024-03-09T14:35:50.593430+0000","last_active":"2024-03-09T15:24:37.899466+0000","last_peered":"2024-03-09T15:24:37.899466+0000","last_clean":"2024-03-09T15:24:37.899466+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:24:37.899466+0000","last_undegraded":"2024-03-09T15:24:37.899466+0000","last_fullsized":"2024-03-09T15:24:37.899466+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:07.895578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10280,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027735+0000","last_change":"2024-03-09T14:31:01.140169+0000","last_active":"2024-03-09T15:20:52.027735+0000","last_peered":"2024-03-09T15:20:52.027735+0000","last_clean":"2024-03-09T15:20:52.027735+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:20:52.027735+0000","last_undegraded":"2024-03-09T15:20:52.027735+0000","last_fullsized":"2024-03-09T15:20:52.027735+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:33.984575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.170878+0000","last_change":"2024-03-09T14:50:03.660084+0000","last_active":"2024-03-09T15:21:22.170878+0000","last_peered":"2024-03-09T15:21:22.170878+0000","last_clean":"2024-03-09T15:21:22.170878+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:21:22.170878+0000","last_undegraded":"2024-03-09T15:21:22.170878+0000","last_fullsized":"2024-03-09T15:21:22.170878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:00.134823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:06.905652+0000","last_change":"2024-03-09T14:35:55.603484+0000","last_active":"2024-03-09T15:22:06.905652+0000","last_peered":"2024-03-09T15:22:06.905652+0000","last_clean":"2024-03-09T15:22:06.905652+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:22:06.905652+0000","last_undegraded":"2024-03-09T15:22:06.905652+0000","last_fullsized":"2024-03-09T15:22:06.905652+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:49.786326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.173621+0000","last_change":"2024-03-09T14:35:50.584143+0000","last_active":"2024-03-09T15:21:42.173621+0000","last_peered":"2024-03-09T15:21:42.173621+0000","last_clean":"2024-03-09T15:21:42.173621+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:21:42.173621+0000","last_undegraded":"2024-03-09T15:21:42.173621+0000","last_fullsized":"2024-03-09T15:21:42.173621+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:51.754061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":182,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.002119+0000","last_change":"2024-03-09T14:31:01.149003+0000","last_active":"2024-03-09T15:20:52.002119+0000","last_peered":"2024-03-09T15:20:52.002119+0000","last_clean":"2024-03-09T15:20:52.002119+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:20:52.002119+0000","last_undegraded":"2024-03-09T15:20:52.002119+0000","last_fullsized":"2024-03-09T15:20:52.002119+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:24.001646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.032229+0000","last_change":"2024-03-09T14:50:03.664606+0000","last_active":"2024-03-09T15:21:22.032229+0000","last_peered":"2024-03-09T15:21:22.032229+0000","last_clean":"2024-03-09T15:21:22.032229+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:21:22.032229+0000","last_undegraded":"2024-03-09T15:21:22.032229+0000","last_fullsized":"2024-03-09T15:21:22.032229+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.328351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:46.903317+0000","last_change":"2024-03-09T14:35:55.633776+0000","last_active":"2024-03-09T15:21:46.903317+0000","last_peered":"2024-03-09T15:21:46.903317+0000","last_clean":"2024-03-09T15:21:46.903317+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:21:46.903317+0000","last_undegraded":"2024-03-09T15:21:46.903317+0000","last_fullsized":"2024-03-09T15:21:46.903317+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:12:36.318597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:52.000932+0000","last_change":"2024-03-09T14:35:50.591618+0000","last_active":"2024-03-09T15:21:52.000932+0000","last_peered":"2024-03-09T15:21:52.000932+0000","last_clean":"2024-03-09T15:21:52.000932+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:21:52.000932+0000","last_undegraded":"2024-03-09T15:21:52.000932+0000","last_fullsized":"2024-03-09T15:21:52.000932+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:28.323159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:52.027822+0000","last_change":"2024-03-09T14:31:01.137572+0000","last_active":"2024-03-09T15:20:52.027822+0000","last_peered":"2024-03-09T15:20:52.027822+0000","last_clean":"2024-03-09T15:20:52.027822+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:20:52.027822+0000","last_undegraded":"2024-03-09T15:20:52.027822+0000","last_fullsized":"2024-03-09T15:20:52.027822+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:52.156798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.005314+0000","last_change":"2024-03-09T14:50:03.658082+0000","last_active":"2024-03-09T15:22:17.005314+0000","last_peered":"2024-03-09T15:22:17.005314+0000","last_clean":"2024-03-09T15:22:17.005314+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:22:17.005314+0000","last_undegraded":"2024-03-09T15:22:17.005314+0000","last_fullsized":"2024-03-09T15:22:17.005314+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:47.239990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171609+0000","last_change":"2024-03-09T14:35:55.634847+0000","last_active":"2024-03-09T15:21:27.171609+0000","last_peered":"2024-03-09T15:21:27.171609+0000","last_clean":"2024-03-09T15:21:27.171609+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:21:27.171609+0000","last_undegraded":"2024-03-09T15:21:27.171609+0000","last_fullsized":"2024-03-09T15:21:27.171609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:24.831161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.051256+0000","last_change":"2024-03-09T14:35:50.590046+0000","last_active":"2024-03-09T15:23:32.051256+0000","last_peered":"2024-03-09T15:23:32.051256+0000","last_clean":"2024-03-09T15:23:32.051256+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:23:32.051256+0000","last_undegraded":"2024-03-09T15:23:32.051256+0000","last_fullsized":"2024-03-09T15:23:32.051256+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:09.975491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":121,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169286+0000","last_change":"2024-03-09T14:31:01.145294+0000","last_active":"2024-03-09T15:21:12.169286+0000","last_peered":"2024-03-09T15:21:12.169286+0000","last_clean":"2024-03-09T15:21:12.169286+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:21:12.169286+0000","last_undegraded":"2024-03-09T15:21:12.169286+0000","last_fullsized":"2024-03-09T15:21:12.169286+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:45.565527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.157206+0000","last_change":"2024-03-09T14:50:03.664652+0000","last_active":"2024-03-09T15:21:22.157206+0000","last_peered":"2024-03-09T15:21:22.157206+0000","last_clean":"2024-03-09T15:21:22.157206+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:21:22.157206+0000","last_undegraded":"2024-03-09T15:21:22.157206+0000","last_fullsized":"2024-03-09T15:21:22.157206+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:54:30.997877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.176939+0000","last_change":"2024-03-09T14:35:55.606581+0000","last_active":"2024-03-09T15:23:37.176939+0000","last_peered":"2024-03-09T15:23:37.176939+0000","last_clean":"2024-03-09T15:23:37.176939+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:23:37.176939+0000","last_undegraded":"2024-03-09T15:23:37.176939+0000","last_fullsized":"2024-03-09T15:23:37.176939+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:53:40.747872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'7","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.145963+0000","last_change":"2024-03-09T14:35:50.588264+0000","last_active":"2024-03-09T15:24:38.145963+0000","last_peered":"2024-03-09T15:24:38.145963+0000","last_clean":"2024-03-09T15:24:38.145963+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:24:38.145963+0000","last_undegraded":"2024-03-09T15:24:38.145963+0000","last_fullsized":"2024-03-09T15:24:38.145963+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:37.262134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":232,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.997471+0000","last_change":"2024-03-09T14:31:01.140875+0000","last_active":"2024-03-09T15:21:01.997471+0000","last_peered":"2024-03-09T15:21:01.997471+0000","last_clean":"2024-03-09T15:21:01.997471+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:21:01.997471+0000","last_undegraded":"2024-03-09T15:21:01.997471+0000","last_fullsized":"2024-03-09T15:21:01.997471+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:48:41.613699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.992174+0000","last_change":"2024-03-09T14:50:03.659231+0000","last_active":"2024-03-09T15:20:26.992174+0000","last_peered":"2024-03-09T15:20:26.992174+0000","last_clean":"2024-03-09T15:20:26.992174+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:20:26.992174+0000","last_undegraded":"2024-03-09T15:20:26.992174+0000","last_fullsized":"2024-03-09T15:20:26.992174+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:29.158875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'6","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.988739+0000","last_change":"2024-03-09T14:35:55.596692+0000","last_active":"2024-03-09T15:24:37.988739+0000","last_peered":"2024-03-09T15:24:37.988739+0000","last_clean":"2024-03-09T15:24:37.988739+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:24:37.988739+0000","last_undegraded":"2024-03-09T15:24:37.988739+0000","last_fullsized":"2024-03-09T15:24:37.988739+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:12.701527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'7","reported_seq":66,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.065293+0000","last_change":"2024-03-09T14:35:50.591561+0000","last_active":"2024-03-09T15:24:07.065293+0000","last_peered":"2024-03-09T15:24:07.065293+0000","last_clean":"2024-03-09T15:24:07.065293+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:24:07.065293+0000","last_undegraded":"2024-03-09T15:24:07.065293+0000","last_fullsized":"2024-03-09T15:24:07.065293+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:32.145049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":11,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'95","reported_seq":333,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029266+0000","last_change":"2024-03-09T14:31:01.135715+0000","last_active":"2024-03-09T15:21:02.029266+0000","last_peered":"2024-03-09T15:21:02.029266+0000","last_clean":"2024-03-09T15:21:02.029266+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:21:02.029266+0000","last_undegraded":"2024-03-09T15:21:02.029266+0000","last_fullsized":"2024-03-09T15:21:02.029266+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.951180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999435+0000","last_change":"2024-03-09T14:50:03.655635+0000","last_active":"2024-03-09T15:20:26.999435+0000","last_peered":"2024-03-09T15:20:26.999435+0000","last_clean":"2024-03-09T15:20:26.999435+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:20:26.999435+0000","last_undegraded":"2024-03-09T15:20:26.999435+0000","last_fullsized":"2024-03-09T15:20:26.999435+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:27.965268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038744+0000","last_change":"2024-03-09T14:35:55.599321+0000","last_active":"2024-03-09T15:22:07.038744+0000","last_peered":"2024-03-09T15:22:07.038744+0000","last_clean":"2024-03-09T15:22:07.038744+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:22:07.038744+0000","last_undegraded":"2024-03-09T15:22:07.038744+0000","last_fullsized":"2024-03-09T15:22:07.038744+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:11.127875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'7","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.999443+0000","last_change":"2024-03-09T14:35:50.590738+0000","last_active":"2024-03-09T15:24:37.999443+0000","last_peered":"2024-03-09T15:24:37.999443+0000","last_clean":"2024-03-09T15:24:37.999443+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:24:37.999443+0000","last_undegraded":"2024-03-09T15:24:37.999443+0000","last_fullsized":"2024-03-09T15:24:37.999443+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:21.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10288,"num_write":7,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":174,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.152669+0000","last_change":"2024-03-09T14:31:01.141681+0000","last_active":"2024-03-09T15:21:02.152669+0000","last_peered":"2024-03-09T15:21:02.152669+0000","last_clean":"2024-03-09T15:21:02.152669+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:21:02.152669+0000","last_undegraded":"2024-03-09T15:21:02.152669+0000","last_fullsized":"2024-03-09T15:21:02.152669+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:15.144703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:22.005544+0000","last_change":"2024-03-09T14:50:03.658063+0000","last_active":"2024-03-09T15:21:22.005544+0000","last_peered":"2024-03-09T15:21:22.005544+0000","last_clean":"2024-03-09T15:21:22.005544+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:21:22.005544+0000","last_undegraded":"2024-03-09T15:21:22.005544+0000","last_fullsized":"2024-03-09T15:21:22.005544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:35.088953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.035791+0000","last_change":"2024-03-09T14:35:55.604413+0000","last_active":"2024-03-09T15:21:47.035791+0000","last_peered":"2024-03-09T15:21:47.035791+0000","last_clean":"2024-03-09T15:21:47.035791+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:21:47.035791+0000","last_undegraded":"2024-03-09T15:21:47.035791+0000","last_fullsized":"2024-03-09T15:21:47.035791+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:57.199079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'3","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:47.014845+0000","last_change":"2024-03-09T14:35:50.580849+0000","last_active":"2024-03-09T15:23:47.014845+0000","last_peered":"2024-03-09T15:23:47.014845+0000","last_clean":"2024-03-09T15:23:47.014845+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:23:47.014845+0000","last_undegraded":"2024-03-09T15:23:47.014845+0000","last_fullsized":"2024-03-09T15:23:47.014845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:35.776820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:02.029254+0000","last_change":"2024-03-09T14:31:01.141116+0000","last_active":"2024-03-09T15:21:02.029254+0000","last_peered":"2024-03-09T15:21:02.029254+0000","last_clean":"2024-03-09T15:21:02.029254+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:21:02.029254+0000","last_undegraded":"2024-03-09T15:21:02.029254+0000","last_fullsized":"2024-03-09T15:21:02.029254+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:23.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:27.171561+0000","last_change":"2024-03-09T14:50:03.662160+0000","last_active":"2024-03-09T15:21:27.171561+0000","last_peered":"2024-03-09T15:21:27.171561+0000","last_clean":"2024-03-09T15:21:27.171561+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:21:27.171561+0000","last_undegraded":"2024-03-09T15:21:27.171561+0000","last_fullsized":"2024-03-09T15:21:27.171561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:05.477257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":45,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:47.160855+0000","last_change":"2024-03-09T14:35:55.603267+0000","last_active":"2024-03-09T15:21:47.160855+0000","last_peered":"2024-03-09T15:21:47.160855+0000","last_clean":"2024-03-09T15:21:47.160855+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:21:47.160855+0000","last_undegraded":"2024-03-09T15:21:47.160855+0000","last_fullsized":"2024-03-09T15:21:47.160855+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:33.336533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:42.034960+0000","last_change":"2024-03-09T14:35:50.579692+0000","last_active":"2024-03-09T15:21:42.034960+0000","last_peered":"2024-03-09T15:21:42.034960+0000","last_clean":"2024-03-09T15:21:42.034960+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:21:42.034960+0000","last_undegraded":"2024-03-09T15:21:42.034960+0000","last_fullsized":"2024-03-09T15:21:42.034960+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:53.022221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":157,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:12.169202+0000","last_change":"2024-03-09T14:31:01.140181+0000","last_active":"2024-03-09T15:21:12.169202+0000","last_peered":"2024-03-09T15:21:12.169202+0000","last_clean":"2024-03-09T15:21:12.169202+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:21:12.169202+0000","last_undegraded":"2024-03-09T15:21:12.169202+0000","last_fullsized":"2024-03-09T15:21:12.169202+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:06.660569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'217","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.068276+0000","last_change":"2024-03-09T14:21:54.364507+0000","last_active":"2024-03-09T15:24:27.068276+0000","last_peered":"2024-03-09T15:24:27.068276+0000","last_clean":"2024-03-09T15:24:27.068276+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:24:27.068276+0000","last_undegraded":"2024-03-09T15:24:27.068276+0000","last_fullsized":"2024-03-09T15:24:27.068276+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:02.602654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097261,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":32250,"num_write":1232,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'370","reported_seq":1077,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.361437+0000","last_change":"2024-03-09T14:21:56.357692+0000","last_active":"2024-03-09T15:22:36.361437+0000","last_peered":"2024-03-09T15:22:36.361437+0000","last_clean":"2024-03-09T15:22:36.361437+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:22:36.361437+0000","last_undegraded":"2024-03-09T15:22:36.361437+0000","last_fullsized":"2024-03-09T15:22:36.361437+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:59.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'184","reported_seq":796,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.000105+0000","last_change":"2024-03-09T14:21:54.365933+0000","last_active":"2024-03-09T15:24:38.000105+0000","last_peered":"2024-03-09T15:24:38.000105+0000","last_clean":"2024-03-09T15:24:38.000105+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:24:38.000105+0000","last_undegraded":"2024-03-09T15:24:38.000105+0000","last_fullsized":"2024-03-09T15:24:38.000105+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:55:13.927594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10770133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":33432,"num_write":993,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046256+0000","last_change":"2024-03-09T14:21:56.371109+0000","last_active":"2024-03-09T15:21:57.046256+0000","last_peered":"2024-03-09T15:21:57.046256+0000","last_clean":"2024-03-09T15:21:57.046256+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:21:57.046256+0000","last_undegraded":"2024-03-09T15:21:57.046256+0000","last_fullsized":"2024-03-09T15:21:57.046256+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:07.830191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.103341+0000","last_change":"2024-03-09T14:21:54.357346+0000","last_active":"2024-03-09T15:22:50.103341+0000","last_peered":"2024-03-09T15:22:50.103341+0000","last_clean":"2024-03-09T15:22:50.103341+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:22:50.103341+0000","last_undegraded":"2024-03-09T15:22:50.103341+0000","last_fullsized":"2024-03-09T15:22:50.103341+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:26.965320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":700,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162411+0000","last_change":"2024-03-09T14:21:56.366924+0000","last_active":"2024-03-09T15:21:57.162411+0000","last_peered":"2024-03-09T15:21:57.162411+0000","last_clean":"2024-03-09T15:21:57.162411+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:21:57.162411+0000","last_undegraded":"2024-03-09T15:21:57.162411+0000","last_fullsized":"2024-03-09T15:21:57.162411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:20.210933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'193","reported_seq":894,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.074857+0000","last_change":"2024-03-09T14:21:54.371185+0000","last_active":"2024-03-09T15:24:38.074857+0000","last_peered":"2024-03-09T15:24:38.074857+0000","last_clean":"2024-03-09T15:24:38.074857+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:24:38.074857+0000","last_undegraded":"2024-03-09T15:24:38.074857+0000","last_fullsized":"2024-03-09T15:24:38.074857+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:56.928314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":557,"num_read_kb":57961,"num_write":1122,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:56.904523+0000","last_change":"2024-03-09T14:21:56.372686+0000","last_active":"2024-03-09T15:21:56.904523+0000","last_peered":"2024-03-09T15:21:56.904523+0000","last_clean":"2024-03-09T15:21:56.904523+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:21:56.904523+0000","last_undegraded":"2024-03-09T15:21:56.904523+0000","last_fullsized":"2024-03-09T15:21:56.904523+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:21.714174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'194","reported_seq":924,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.074700+0000","last_change":"2024-03-09T14:21:54.361340+0000","last_active":"2024-03-09T15:24:38.074700+0000","last_peered":"2024-03-09T15:24:38.074700+0000","last_clean":"2024-03-09T15:24:38.074700+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:24:38.074700+0000","last_undegraded":"2024-03-09T15:24:38.074700+0000","last_fullsized":"2024-03-09T15:24:38.074700+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:58:38.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":140946,"num_write":1106,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.038703+0000","last_change":"2024-03-09T14:21:56.367286+0000","last_active":"2024-03-09T15:22:07.038703+0000","last_peered":"2024-03-09T15:22:07.038703+0000","last_clean":"2024-03-09T15:22:07.038703+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:22:07.038703+0000","last_undegraded":"2024-03-09T15:22:07.038703+0000","last_fullsized":"2024-03-09T15:22:07.038703+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:57:52.107232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'194","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.068126+0000","last_change":"2024-03-09T14:21:54.369817+0000","last_active":"2024-03-09T15:24:38.068126+0000","last_peered":"2024-03-09T15:24:38.068126+0000","last_clean":"2024-03-09T15:24:38.068126+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:24:38.068126+0000","last_undegraded":"2024-03-09T15:24:38.068126+0000","last_fullsized":"2024-03-09T15:24:38.068126+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:45.301805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":400,"num_read_kb":13387,"num_write":1038,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166139+0000","last_change":"2024-03-09T14:21:56.359071+0000","last_active":"2024-03-09T15:22:22.166139+0000","last_peered":"2024-03-09T15:22:22.166139+0000","last_clean":"2024-03-09T15:22:22.166139+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:22:22.166139+0000","last_undegraded":"2024-03-09T15:22:22.166139+0000","last_fullsized":"2024-03-09T15:22:22.166139+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:29.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046242+0000","last_change":"2024-03-09T14:21:54.360895+0000","last_active":"2024-03-09T15:21:57.046242+0000","last_peered":"2024-03-09T15:21:57.046242+0000","last_clean":"2024-03-09T15:21:57.046242+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:21:57.046242+0000","last_undegraded":"2024-03-09T15:21:57.046242+0000","last_fullsized":"2024-03-09T15:21:57.046242+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:47.207849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":907,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:17.701829+0000","last_change":"2024-03-09T14:23:32.139848+0000","last_active":"2024-03-09T15:23:17.701829+0000","last_peered":"2024-03-09T15:23:17.701829+0000","last_clean":"2024-03-09T15:23:17.701829+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:23:17.701829+0000","last_undegraded":"2024-03-09T15:23:17.701829+0000","last_fullsized":"2024-03-09T15:23:17.701829+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:13:35.358584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'199","reported_seq":853,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.319905+0000","last_change":"2024-03-09T14:21:54.367692+0000","last_active":"2024-03-09T15:24:28.319905+0000","last_peered":"2024-03-09T15:24:28.319905+0000","last_clean":"2024-03-09T15:24:28.319905+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:24:28.319905+0000","last_undegraded":"2024-03-09T15:24:28.319905+0000","last_fullsized":"2024-03-09T15:24:28.319905+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:00:15.272460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":42906,"num_write":1255,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":785,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.003815+0000","last_change":"2024-03-09T14:21:56.362728+0000","last_active":"2024-03-09T15:22:22.003815+0000","last_peered":"2024-03-09T15:22:22.003815+0000","last_clean":"2024-03-09T15:22:22.003815+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:22:22.003815+0000","last_undegraded":"2024-03-09T15:22:22.003815+0000","last_fullsized":"2024-03-09T15:22:22.003815+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:45.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'152","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:58.039856+0000","last_change":"2024-03-09T14:21:56.368382+0000","last_active":"2024-03-09T15:22:58.039856+0000","last_peered":"2024-03-09T15:22:58.039856+0000","last_clean":"2024-03-09T15:22:58.039856+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:22:58.039856+0000","last_undegraded":"2024-03-09T15:22:58.039856+0000","last_fullsized":"2024-03-09T15:22:58.039856+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:14.989000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'172","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.029748+0000","last_change":"2024-03-09T14:21:54.358160+0000","last_active":"2024-03-09T15:24:38.029748+0000","last_peered":"2024-03-09T15:24:38.029748+0000","last_clean":"2024-03-09T15:24:38.029748+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:24:38.029748+0000","last_undegraded":"2024-03-09T15:24:38.029748+0000","last_fullsized":"2024-03-09T15:24:38.029748+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:23:07.592095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":28832,"num_write":1019,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.160954+0000","last_change":"2024-03-09T14:21:56.371113+0000","last_active":"2024-03-09T15:20:17.160954+0000","last_peered":"2024-03-09T15:20:17.160954+0000","last_clean":"2024-03-09T15:20:17.160954+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:20:17.160954+0000","last_undegraded":"2024-03-09T15:20:17.160954+0000","last_fullsized":"2024-03-09T15:20:17.160954+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:56.161695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'203","reported_seq":820,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.922983+0000","last_change":"2024-03-09T14:21:54.366475+0000","last_active":"2024-03-09T15:24:37.922983+0000","last_peered":"2024-03-09T15:24:37.922983+0000","last_clean":"2024-03-09T15:24:37.922983+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:24:37.922983+0000","last_undegraded":"2024-03-09T15:24:37.922983+0000","last_fullsized":"2024-03-09T15:24:37.922983+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:47.826416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322934,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":20924,"num_write":1102,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.378336+0000","last_change":"2024-03-09T14:21:56.362335+0000","last_active":"2024-03-09T15:24:28.378336+0000","last_peered":"2024-03-09T15:24:28.378336+0000","last_clean":"2024-03-09T15:24:28.378336+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:24:28.378336+0000","last_undegraded":"2024-03-09T15:24:28.378336+0000","last_fullsized":"2024-03-09T15:24:28.378336+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:44:04.650448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'191","reported_seq":882,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.041004+0000","last_change":"2024-03-09T14:21:54.369118+0000","last_active":"2024-03-09T15:22:22.041004+0000","last_peered":"2024-03-09T15:22:22.041004+0000","last_clean":"2024-03-09T15:22:22.041004+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:22:22.041004+0000","last_undegraded":"2024-03-09T15:22:22.041004+0000","last_fullsized":"2024-03-09T15:22:22.041004+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:23.759764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661148,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":129688,"num_write":1091,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'327","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.988967+0000","last_change":"2024-03-09T14:21:56.363364+0000","last_active":"2024-03-09T15:19:56.988967+0000","last_peered":"2024-03-09T15:19:56.988967+0000","last_clean":"2024-03-09T15:19:56.988967+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:19:56.988967+0000","last_undegraded":"2024-03-09T15:19:56.988967+0000","last_fullsized":"2024-03-09T15:19:56.988967+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:59.653300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'188","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.976719+0000","last_change":"2024-03-09T14:22:31.545671+0000","last_active":"2024-03-09T15:24:37.976719+0000","last_peered":"2024-03-09T15:24:37.976719+0000","last_clean":"2024-03-09T15:24:37.976719+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:24:37.976719+0000","last_undegraded":"2024-03-09T15:24:37.976719+0000","last_fullsized":"2024-03-09T15:24:37.976719+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:41:17.161201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":533,"num_read_kb":17983,"num_write":1110,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":687,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.338240+0000","last_change":"2024-03-09T14:21:56.360414+0000","last_active":"2024-03-09T15:22:41.338240+0000","last_peered":"2024-03-09T15:22:41.338240+0000","last_clean":"2024-03-09T15:22:41.338240+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:22:41.338240+0000","last_undegraded":"2024-03-09T15:22:41.338240+0000","last_fullsized":"2024-03-09T15:22:41.338240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:09:32.887159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'193","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.044569+0000","last_change":"2024-03-09T14:21:54.371479+0000","last_active":"2024-03-09T15:24:38.044569+0000","last_peered":"2024-03-09T15:24:38.044569+0000","last_clean":"2024-03-09T15:24:38.044569+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:24:38.044569+0000","last_undegraded":"2024-03-09T15:24:38.044569+0000","last_fullsized":"2024-03-09T15:24:38.044569+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:29:20.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":27148,"num_write":1016,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":733,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.143484+0000","last_change":"2024-03-09T14:21:56.360518+0000","last_active":"2024-03-09T15:19:57.143484+0000","last_peered":"2024-03-09T15:19:57.143484+0000","last_clean":"2024-03-09T15:19:57.143484+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:19:57.143484+0000","last_undegraded":"2024-03-09T15:19:57.143484+0000","last_fullsized":"2024-03-09T15:19:57.143484+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:16.918503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":986,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.053252+0000","last_change":"2024-03-09T14:21:54.371089+0000","last_active":"2024-03-09T15:24:38.053252+0000","last_peered":"2024-03-09T15:24:38.053252+0000","last_clean":"2024-03-09T15:24:38.053252+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:24:38.053252+0000","last_undegraded":"2024-03-09T15:24:38.053252+0000","last_fullsized":"2024-03-09T15:24:38.053252+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:56.588140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262145,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1066,"num_read_kb":11712,"num_write":1257,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":603,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:07.145020+0000","last_change":"2024-03-09T14:22:04.407438+0000","last_active":"2024-03-09T15:20:07.145020+0000","last_peered":"2024-03-09T15:20:07.145020+0000","last_clean":"2024-03-09T15:20:07.145020+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:20:07.145020+0000","last_undegraded":"2024-03-09T15:20:07.145020+0000","last_fullsized":"2024-03-09T15:20:07.145020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:02.777937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'115","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:08.144676+0000","last_change":"2024-03-09T14:21:56.354345+0000","last_active":"2024-03-09T15:21:08.144676+0000","last_peered":"2024-03-09T15:21:08.144676+0000","last_clean":"2024-03-09T15:21:08.144676+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:21:08.144676+0000","last_undegraded":"2024-03-09T15:21:08.144676+0000","last_fullsized":"2024-03-09T15:21:08.144676+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:38.265091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'208","reported_seq":828,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.087020+0000","last_change":"2024-03-09T14:21:54.364329+0000","last_active":"2024-03-09T15:24:38.087020+0000","last_peered":"2024-03-09T15:24:38.087020+0000","last_clean":"2024-03-09T15:24:38.087020+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:24:38.087020+0000","last_undegraded":"2024-03-09T15:24:38.087020+0000","last_fullsized":"2024-03-09T15:24:38.087020+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:32.579399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537676,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":3008,"num_write":992,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020417+0000","last_change":"2024-03-09T14:21:58.369901+0000","last_active":"2024-03-09T15:20:02.020417+0000","last_peered":"2024-03-09T15:20:02.020417+0000","last_clean":"2024-03-09T15:20:02.020417+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:20:02.020417+0000","last_undegraded":"2024-03-09T15:20:02.020417+0000","last_fullsized":"2024-03-09T15:20:02.020417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:00.598181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'211","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.046408+0000","last_change":"2024-03-09T14:22:00.387965+0000","last_active":"2024-03-09T15:24:38.046408+0000","last_peered":"2024-03-09T15:24:38.046408+0000","last_clean":"2024-03-09T15:24:38.046408+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:24:38.046408+0000","last_undegraded":"2024-03-09T15:24:38.046408+0000","last_fullsized":"2024-03-09T15:24:38.046408+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:55.493455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":392,"num_write":172,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.158882+0000","last_change":"2024-03-09T14:22:02.391044+0000","last_active":"2024-03-09T15:20:02.158882+0000","last_peered":"2024-03-09T15:20:02.158882+0000","last_clean":"2024-03-09T15:20:02.158882+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:20:02.158882+0000","last_undegraded":"2024-03-09T15:20:02.158882+0000","last_fullsized":"2024-03-09T15:20:02.158882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:46.242039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2478","reported_seq":4903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.846417+0000","last_change":"2024-03-09T14:22:04.401509+0000","last_active":"2024-03-09T15:24:28.846417+0000","last_peered":"2024-03-09T15:24:28.846417+0000","last_clean":"2024-03-09T15:24:28.846417+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:28.846417+0000","last_undegraded":"2024-03-09T15:24:28.846417+0000","last_fullsized":"2024-03-09T15:24:28.846417+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":2400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:21.913278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.084519+0000","last_change":"2024-03-09T14:21:56.360757+0000","last_active":"2024-03-09T15:22:32.084519+0000","last_peered":"2024-03-09T15:22:32.084519+0000","last_clean":"2024-03-09T15:22:32.084519+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:22:32.084519+0000","last_undegraded":"2024-03-09T15:22:32.084519+0000","last_fullsized":"2024-03-09T15:22:32.084519+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:11.828260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'187","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.903020+0000","last_change":"2024-03-09T14:21:54.370606+0000","last_active":"2024-03-09T15:24:37.903020+0000","last_peered":"2024-03-09T15:24:37.903020+0000","last_clean":"2024-03-09T15:24:37.903020+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:24:37.903020+0000","last_undegraded":"2024-03-09T15:24:37.903020+0000","last_fullsized":"2024-03-09T15:24:37.903020+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:07.279208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":36262,"num_write":1057,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.007681+0000","last_change":"2024-03-09T14:21:58.370142+0000","last_active":"2024-03-09T15:20:37.007681+0000","last_peered":"2024-03-09T15:20:37.007681+0000","last_clean":"2024-03-09T15:20:37.007681+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:20:37.007681+0000","last_undegraded":"2024-03-09T15:20:37.007681+0000","last_fullsized":"2024-03-09T15:20:37.007681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:26.942518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'108","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.364936+0000","last_change":"2024-03-09T14:22:00.383851+0000","last_active":"2024-03-09T15:22:36.364936+0000","last_peered":"2024-03-09T15:22:36.364936+0000","last_clean":"2024-03-09T15:22:36.364936+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:22:36.364936+0000","last_undegraded":"2024-03-09T15:22:36.364936+0000","last_fullsized":"2024-03-09T15:22:36.364936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:38.700465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144268+0000","last_change":"2024-03-09T14:22:02.401387+0000","last_active":"2024-03-09T15:20:02.144268+0000","last_peered":"2024-03-09T15:20:02.144268+0000","last_clean":"2024-03-09T15:20:02.144268+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:20:02.144268+0000","last_undegraded":"2024-03-09T15:20:02.144268+0000","last_fullsized":"2024-03-09T15:20:02.144268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:17:02.585085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'114","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.784543+0000","last_change":"2024-03-09T14:22:04.401757+0000","last_active":"2024-03-09T15:22:38.784543+0000","last_peered":"2024-03-09T15:22:38.784543+0000","last_clean":"2024-03-09T15:22:38.784543+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:22:38.784543+0000","last_undegraded":"2024-03-09T15:22:38.784543+0000","last_fullsized":"2024-03-09T15:22:38.784543+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:00.751890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1095,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:56.995723+0000","last_change":"2024-03-09T14:21:56.372711+0000","last_active":"2024-03-09T15:19:56.995723+0000","last_peered":"2024-03-09T15:19:56.995723+0000","last_clean":"2024-03-09T15:19:56.995723+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:19:56.995723+0000","last_undegraded":"2024-03-09T15:19:56.995723+0000","last_fullsized":"2024-03-09T15:19:56.995723+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'173","reported_seq":802,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.121835+0000","last_change":"2024-03-09T14:21:54.365114+0000","last_active":"2024-03-09T15:24:38.121835+0000","last_peered":"2024-03-09T15:24:38.121835+0000","last_clean":"2024-03-09T15:24:38.121835+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:24:38.121835+0000","last_undegraded":"2024-03-09T15:24:38.121835+0000","last_fullsized":"2024-03-09T15:24:38.121835+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:25.691680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269857,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":24289,"num_write":907,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.003117+0000","last_change":"2024-03-09T14:21:58.372340+0000","last_active":"2024-03-09T15:20:02.003117+0000","last_peered":"2024-03-09T15:20:02.003117+0000","last_clean":"2024-03-09T15:20:02.003117+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:20:02.003117+0000","last_undegraded":"2024-03-09T15:20:02.003117+0000","last_fullsized":"2024-03-09T15:20:02.003117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:20.284463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'131","reported_seq":673,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.440694+0000","last_change":"2024-03-09T14:22:00.384182+0000","last_active":"2024-03-09T15:22:36.440694+0000","last_peered":"2024-03-09T15:22:36.440694+0000","last_clean":"2024-03-09T15:22:36.440694+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:22:36.440694+0000","last_undegraded":"2024-03-09T15:22:36.440694+0000","last_fullsized":"2024-03-09T15:22:36.440694+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:22.730875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'505","reported_seq":2180,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.844631+0000","last_change":"2024-03-09T14:22:02.394468+0000","last_active":"2024-03-09T15:24:37.844631+0000","last_peered":"2024-03-09T15:24:37.844631+0000","last_clean":"2024-03-09T15:24:37.844631+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:24:37.844631+0000","last_undegraded":"2024-03-09T15:24:37.844631+0000","last_fullsized":"2024-03-09T15:24:37.844631+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:21.183335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'198","reported_seq":1009,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:50.173166+0000","last_change":"2024-03-09T14:22:04.393662+0000","last_active":"2024-03-09T15:22:50.173166+0000","last_peered":"2024-03-09T15:22:50.173166+0000","last_clean":"2024-03-09T15:22:50.173166+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:22:50.173166+0000","last_undegraded":"2024-03-09T15:22:50.173166+0000","last_fullsized":"2024-03-09T15:22:50.173166+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:15:52.946807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":935,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.002403+0000","last_change":"2024-03-09T14:21:56.366895+0000","last_active":"2024-03-09T15:19:57.002403+0000","last_peered":"2024-03-09T15:19:57.002403+0000","last_clean":"2024-03-09T15:19:57.002403+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:19:57.002403+0000","last_undegraded":"2024-03-09T15:19:57.002403+0000","last_fullsized":"2024-03-09T15:19:57.002403+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:26.788549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'332","reported_seq":1055,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.948794+0000","last_change":"2024-03-09T14:21:54.366866+0000","last_active":"2024-03-09T15:24:37.948794+0000","last_peered":"2024-03-09T15:24:37.948794+0000","last_clean":"2024-03-09T15:24:37.948794+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:24:37.948794+0000","last_undegraded":"2024-03-09T15:24:37.948794+0000","last_fullsized":"2024-03-09T15:24:37.948794+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:51.068751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264989,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":889,"num_read_kb":69587,"num_write":1468,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.020448+0000","last_change":"2024-03-09T14:21:58.370760+0000","last_active":"2024-03-09T15:20:02.020448+0000","last_peered":"2024-03-09T15:20:02.020448+0000","last_clean":"2024-03-09T15:20:02.020448+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:20:02.020448+0000","last_undegraded":"2024-03-09T15:20:02.020448+0000","last_fullsized":"2024-03-09T15:20:02.020448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:30:41.151599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'139","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.008342+0000","last_change":"2024-03-09T14:22:00.494140+0000","last_active":"2024-03-09T15:24:38.008342+0000","last_peered":"2024-03-09T15:24:38.008342+0000","last_clean":"2024-03-09T15:24:38.008342+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:24:38.008342+0000","last_undegraded":"2024-03-09T15:24:38.008342+0000","last_fullsized":"2024-03-09T15:24:38.008342+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:14:56.507586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4492,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":259,"num_write":96,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'547","reported_seq":2342,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.849156+0000","last_change":"2024-03-09T14:22:02.399618+0000","last_active":"2024-03-09T15:24:37.849156+0000","last_peered":"2024-03-09T15:24:37.849156+0000","last_clean":"2024-03-09T15:24:37.849156+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:24:37.849156+0000","last_undegraded":"2024-03-09T15:24:37.849156+0000","last_fullsized":"2024-03-09T15:24:37.849156+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:16.944105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'167","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.023997+0000","last_change":"2024-03-09T14:21:56.361954+0000","last_active":"2024-03-09T15:20:27.023997+0000","last_peered":"2024-03-09T15:20:27.023997+0000","last_clean":"2024-03-09T15:20:27.023997+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:20:27.023997+0000","last_undegraded":"2024-03-09T15:20:27.023997+0000","last_fullsized":"2024-03-09T15:20:27.023997+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:31.594273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'214","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.086450+0000","last_change":"2024-03-09T14:21:54.363733+0000","last_active":"2024-03-09T15:24:38.086450+0000","last_peered":"2024-03-09T15:24:38.086450+0000","last_clean":"2024-03-09T15:24:38.086450+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:24:38.086450+0000","last_undegraded":"2024-03-09T15:24:38.086450+0000","last_fullsized":"2024-03-09T15:24:38.086450+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:17.383801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102541,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":2831,"num_write":1215,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163560+0000","last_change":"2024-03-09T14:21:58.368654+0000","last_active":"2024-03-09T15:20:32.163560+0000","last_peered":"2024-03-09T15:20:32.163560+0000","last_clean":"2024-03-09T15:20:32.163560+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:20:32.163560+0000","last_undegraded":"2024-03-09T15:20:32.163560+0000","last_fullsized":"2024-03-09T15:20:32.163560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:49:21.594710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'232","reported_seq":858,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.076735+0000","last_change":"2024-03-09T14:22:00.493626+0000","last_active":"2024-03-09T15:24:38.076735+0000","last_peered":"2024-03-09T15:24:38.076735+0000","last_clean":"2024-03-09T15:24:38.076735+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:24:38.076735+0000","last_undegraded":"2024-03-09T15:24:38.076735+0000","last_fullsized":"2024-03-09T15:24:38.076735+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:35.801230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":331,"num_read_kb":401,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994431+0000","last_change":"2024-03-09T14:22:02.394441+0000","last_active":"2024-03-09T15:20:31.994431+0000","last_peered":"2024-03-09T15:20:31.994431+0000","last_clean":"2024-03-09T15:20:31.994431+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:20:31.994431+0000","last_undegraded":"2024-03-09T15:20:31.994431+0000","last_fullsized":"2024-03-09T15:20:31.994431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:20.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'547","reported_seq":1355,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.875337+0000","last_change":"2024-03-09T14:22:04.401516+0000","last_active":"2024-03-09T15:24:30.875337+0000","last_peered":"2024-03-09T15:24:30.875337+0000","last_clean":"2024-03-09T15:24:30.875337+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:30.875337+0000","last_undegraded":"2024-03-09T15:24:30.875337+0000","last_fullsized":"2024-03-09T15:24:30.875337+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:42:22.487334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'160","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.147996+0000","last_change":"2024-03-09T14:21:56.360517+0000","last_active":"2024-03-09T15:20:27.147996+0000","last_peered":"2024-03-09T15:20:27.147996+0000","last_clean":"2024-03-09T15:20:27.147996+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:20:27.147996+0000","last_undegraded":"2024-03-09T15:20:27.147996+0000","last_fullsized":"2024-03-09T15:20:27.147996+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:05.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162818+0000","last_change":"2024-03-09T14:21:54.361313+0000","last_active":"2024-03-09T15:20:27.162818+0000","last_peered":"2024-03-09T15:20:27.162818+0000","last_clean":"2024-03-09T15:20:27.162818+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:20:27.162818+0000","last_undegraded":"2024-03-09T15:20:27.162818+0000","last_fullsized":"2024-03-09T15:20:27.162818+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:49:23.800324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992640+0000","last_change":"2024-03-09T14:21:58.373445+0000","last_active":"2024-03-09T15:20:31.992640+0000","last_peered":"2024-03-09T15:20:31.992640+0000","last_clean":"2024-03-09T15:20:31.992640+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:20:31.992640+0000","last_undegraded":"2024-03-09T15:20:31.992640+0000","last_fullsized":"2024-03-09T15:20:31.992640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:12:36.728172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'137","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.170682+0000","last_change":"2024-03-09T14:22:00.387422+0000","last_active":"2024-03-09T15:24:38.170682+0000","last_peered":"2024-03-09T15:24:38.170682+0000","last_clean":"2024-03-09T15:24:38.170682+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:24:38.170682+0000","last_undegraded":"2024-03-09T15:24:38.170682+0000","last_fullsized":"2024-03-09T15:24:38.170682+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:44.158848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":254,"num_write":98,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.008667+0000","last_change":"2024-03-09T14:22:02.399383+0000","last_active":"2024-03-09T15:20:47.008667+0000","last_peered":"2024-03-09T15:20:47.008667+0000","last_clean":"2024-03-09T15:20:47.008667+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:20:47.008667+0000","last_undegraded":"2024-03-09T15:20:47.008667+0000","last_fullsized":"2024-03-09T15:20:47.008667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:46.573953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'154","reported_seq":651,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.051056+0000","last_change":"2024-03-09T14:22:04.401728+0000","last_active":"2024-03-09T15:23:16.051056+0000","last_peered":"2024-03-09T15:23:16.051056+0000","last_clean":"2024-03-09T15:23:16.051056+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:23:16.051056+0000","last_undegraded":"2024-03-09T15:23:16.051056+0000","last_fullsized":"2024-03-09T15:23:16.051056+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:36.044586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1068,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.025573+0000","last_change":"2024-03-09T14:21:56.363935+0000","last_active":"2024-03-09T15:20:37.025573+0000","last_peered":"2024-03-09T15:20:37.025573+0000","last_clean":"2024-03-09T15:20:37.025573+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:20:37.025573+0000","last_undegraded":"2024-03-09T15:20:37.025573+0000","last_fullsized":"2024-03-09T15:20:37.025573+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:22.924584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'207","reported_seq":895,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.087742+0000","last_change":"2024-03-09T14:21:54.370752+0000","last_active":"2024-03-09T15:24:38.087742+0000","last_peered":"2024-03-09T15:24:38.087742+0000","last_clean":"2024-03-09T15:24:38.087742+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:24:38.087742+0000","last_undegraded":"2024-03-09T15:24:38.087742+0000","last_fullsized":"2024-03-09T15:24:38.087742+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:38:42.260194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102580,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":99411,"num_write":1014,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992670+0000","last_change":"2024-03-09T14:21:58.373407+0000","last_active":"2024-03-09T15:20:31.992670+0000","last_peered":"2024-03-09T15:20:31.992670+0000","last_clean":"2024-03-09T15:20:31.992670+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:20:31.992670+0000","last_undegraded":"2024-03-09T15:20:31.992670+0000","last_fullsized":"2024-03-09T15:20:31.992670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:40.360322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'185","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.089909+0000","last_change":"2024-03-09T14:22:00.384337+0000","last_active":"2024-03-09T15:24:38.089909+0000","last_peered":"2024-03-09T15:24:38.089909+0000","last_clean":"2024-03-09T15:24:38.089909+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:24:38.089909+0000","last_undegraded":"2024-03-09T15:24:38.089909+0000","last_fullsized":"2024-03-09T15:24:38.089909+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:43.164450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":304,"num_write":138,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'511","reported_seq":2134,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.850307+0000","last_change":"2024-03-09T14:22:02.399057+0000","last_active":"2024-03-09T15:24:37.850307+0000","last_peered":"2024-03-09T15:24:37.850307+0000","last_clean":"2024-03-09T15:24:37.850307+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:24:37.850307+0000","last_undegraded":"2024-03-09T15:24:37.850307+0000","last_fullsized":"2024-03-09T15:24:37.850307+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:12.179503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'144","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.791883+0000","last_change":"2024-03-09T14:22:04.402136+0000","last_active":"2024-03-09T15:23:55.791883+0000","last_peered":"2024-03-09T15:23:55.791883+0000","last_clean":"2024-03-09T15:23:55.791883+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:23:55.791883+0000","last_undegraded":"2024-03-09T15:23:55.791883+0000","last_fullsized":"2024-03-09T15:23:55.791883+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:19.283035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":710,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:18.377637+0000","last_change":"2024-03-09T14:21:56.371534+0000","last_active":"2024-03-09T15:21:18.377637+0000","last_peered":"2024-03-09T15:21:18.377637+0000","last_clean":"2024-03-09T15:21:18.377637+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:21:18.377637+0000","last_undegraded":"2024-03-09T15:21:18.377637+0000","last_fullsized":"2024-03-09T15:21:18.377637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:24.972146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'165","reported_seq":788,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.005824+0000","last_change":"2024-03-09T14:21:54.369550+0000","last_active":"2024-03-09T15:24:38.005824+0000","last_peered":"2024-03-09T15:24:38.005824+0000","last_clean":"2024-03-09T15:24:38.005824+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:24:38.005824+0000","last_undegraded":"2024-03-09T15:24:38.005824+0000","last_fullsized":"2024-03-09T15:24:38.005824+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:28.659325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":41462,"num_write":961,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:41.993861+0000","last_change":"2024-03-09T14:21:58.372864+0000","last_active":"2024-03-09T15:20:41.993861+0000","last_peered":"2024-03-09T15:20:41.993861+0000","last_clean":"2024-03-09T15:20:41.993861+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:20:41.993861+0000","last_undegraded":"2024-03-09T15:20:41.993861+0000","last_fullsized":"2024-03-09T15:20:41.993861+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:02.146801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'217","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.102514+0000","last_change":"2024-03-09T14:22:00.383682+0000","last_active":"2024-03-09T15:24:38.102514+0000","last_peered":"2024-03-09T15:24:38.102514+0000","last_clean":"2024-03-09T15:24:38.102514+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:24:38.102514+0000","last_undegraded":"2024-03-09T15:24:38.102514+0000","last_fullsized":"2024-03-09T15:24:38.102514+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:15.223090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11412,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":306,"num_read_kb":453,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992613+0000","last_change":"2024-03-09T14:22:02.391676+0000","last_active":"2024-03-09T15:20:31.992613+0000","last_peered":"2024-03-09T15:20:31.992613+0000","last_clean":"2024-03-09T15:20:31.992613+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:20:31.992613+0000","last_undegraded":"2024-03-09T15:20:31.992613+0000","last_fullsized":"2024-03-09T15:20:31.992613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:52.125960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'95","reported_seq":602,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995021+0000","last_change":"2024-03-09T14:22:04.407155+0000","last_active":"2024-03-09T15:20:36.995021+0000","last_peered":"2024-03-09T15:20:36.995021+0000","last_clean":"2024-03-09T15:20:36.995021+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:20:36.995021+0000","last_undegraded":"2024-03-09T15:20:36.995021+0000","last_fullsized":"2024-03-09T15:20:36.995021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:01.212835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":598,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148074+0000","last_change":"2024-03-09T14:21:56.352377+0000","last_active":"2024-03-09T15:20:27.148074+0000","last_peered":"2024-03-09T15:20:27.148074+0000","last_clean":"2024-03-09T15:20:27.148074+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:20:27.148074+0000","last_undegraded":"2024-03-09T15:20:27.148074+0000","last_fullsized":"2024-03-09T15:20:27.148074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:26.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'163","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.043875+0000","last_change":"2024-03-09T14:22:31.502194+0000","last_active":"2024-03-09T15:24:38.043875+0000","last_peered":"2024-03-09T15:24:38.043875+0000","last_clean":"2024-03-09T15:24:38.043875+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:24:38.043875+0000","last_undegraded":"2024-03-09T15:24:38.043875+0000","last_fullsized":"2024-03-09T15:24:38.043875+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:07:53.358348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":87296,"num_write":884,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992720+0000","last_change":"2024-03-09T14:21:58.373193+0000","last_active":"2024-03-09T15:20:31.992720+0000","last_peered":"2024-03-09T15:20:31.992720+0000","last_clean":"2024-03-09T15:20:31.992720+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:20:31.992720+0000","last_undegraded":"2024-03-09T15:20:31.992720+0000","last_fullsized":"2024-03-09T15:20:31.992720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:54:43.726744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'169","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.939680+0000","last_change":"2024-03-09T14:22:00.383871+0000","last_active":"2024-03-09T15:24:37.939680+0000","last_peered":"2024-03-09T15:24:37.939680+0000","last_clean":"2024-03-09T15:24:37.939680+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:24:37.939680+0000","last_undegraded":"2024-03-09T15:24:37.939680+0000","last_fullsized":"2024-03-09T15:24:37.939680+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.715476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":307,"num_write":178,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:47.001564+0000","last_change":"2024-03-09T14:22:02.404397+0000","last_active":"2024-03-09T15:20:47.001564+0000","last_peered":"2024-03-09T15:20:47.001564+0000","last_clean":"2024-03-09T15:20:47.001564+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:20:47.001564+0000","last_undegraded":"2024-03-09T15:20:47.001564+0000","last_fullsized":"2024-03-09T15:20:47.001564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:30.954615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'103","reported_seq":596,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.585805+0000","last_change":"2024-03-09T14:22:04.407840+0000","last_active":"2024-03-09T15:23:08.585805+0000","last_peered":"2024-03-09T15:23:08.585805+0000","last_clean":"2024-03-09T15:23:08.585805+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:23:08.585805+0000","last_undegraded":"2024-03-09T15:23:08.585805+0000","last_fullsized":"2024-03-09T15:23:08.585805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:20:34.107387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148090+0000","last_change":"2024-03-09T14:21:56.363858+0000","last_active":"2024-03-09T15:20:27.148090+0000","last_peered":"2024-03-09T15:20:27.148090+0000","last_clean":"2024-03-09T15:20:27.148090+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:20:27.148090+0000","last_undegraded":"2024-03-09T15:20:27.148090+0000","last_fullsized":"2024-03-09T15:20:27.148090+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:13.291056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'175","reported_seq":796,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.905193+0000","last_change":"2024-03-09T14:21:54.361281+0000","last_active":"2024-03-09T15:24:37.905193+0000","last_peered":"2024-03-09T15:24:37.905193+0000","last_clean":"2024-03-09T15:24:37.905193+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:24:37.905193+0000","last_undegraded":"2024-03-09T15:24:37.905193+0000","last_fullsized":"2024-03-09T15:24:37.905193+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:46.098501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":31184,"num_write":930,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.994467+0000","last_change":"2024-03-09T14:21:58.376298+0000","last_active":"2024-03-09T15:20:31.994467+0000","last_peered":"2024-03-09T15:20:31.994467+0000","last_clean":"2024-03-09T15:20:31.994467+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:20:31.994467+0000","last_undegraded":"2024-03-09T15:20:31.994467+0000","last_fullsized":"2024-03-09T15:20:31.994467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:16:22.147321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'197","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.147060+0000","last_change":"2024-03-09T14:22:00.389792+0000","last_active":"2024-03-09T15:24:38.147060+0000","last_peered":"2024-03-09T15:24:38.147060+0000","last_clean":"2024-03-09T15:24:38.147060+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:24:38.147060+0000","last_undegraded":"2024-03-09T15:24:38.147060+0000","last_fullsized":"2024-03-09T15:24:38.147060+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:30.722738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9198,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":342,"num_write":152,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'490","reported_seq":4303,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.845723+0000","last_change":"2024-03-09T14:22:02.395597+0000","last_active":"2024-03-09T15:24:37.845723+0000","last_peered":"2024-03-09T15:24:37.845723+0000","last_clean":"2024-03-09T15:24:37.845723+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:37.845723+0000","last_undegraded":"2024-03-09T15:24:37.845723+0000","last_fullsized":"2024-03-09T15:24:37.845723+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:37.933532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'203","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.269247+0000","last_change":"2024-03-09T14:22:04.405779+0000","last_active":"2024-03-09T15:23:23.269247+0000","last_peered":"2024-03-09T15:23:23.269247+0000","last_clean":"2024-03-09T15:23:23.269247+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:23:23.269247+0000","last_undegraded":"2024-03-09T15:23:23.269247+0000","last_fullsized":"2024-03-09T15:23:23.269247+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:22:23.514316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148107+0000","last_change":"2024-03-09T14:21:56.356981+0000","last_active":"2024-03-09T15:20:27.148107+0000","last_peered":"2024-03-09T15:20:27.148107+0000","last_clean":"2024-03-09T15:20:27.148107+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:20:27.148107+0000","last_undegraded":"2024-03-09T15:20:27.148107+0000","last_fullsized":"2024-03-09T15:20:27.148107+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:14.495068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'173","reported_seq":915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.138855+0000","last_change":"2024-03-09T14:21:54.363849+0000","last_active":"2024-03-09T15:24:38.138855+0000","last_peered":"2024-03-09T15:24:38.138855+0000","last_clean":"2024-03-09T15:24:38.138855+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:24:38.138855+0000","last_undegraded":"2024-03-09T15:24:38.138855+0000","last_fullsized":"2024-03-09T15:24:38.138855+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:31.144563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":987,"num_read_kb":38802,"num_write":973,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1125,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.620921+0000","last_change":"2024-03-09T14:21:58.370397+0000","last_active":"2024-03-09T15:24:37.620921+0000","last_peered":"2024-03-09T15:24:37.620921+0000","last_clean":"2024-03-09T15:24:37.620921+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:24:37.620921+0000","last_undegraded":"2024-03-09T15:24:37.620921+0000","last_fullsized":"2024-03-09T15:24:37.620921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:58:50.562611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'90","reported_seq":622,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.298945+0000","last_change":"2024-03-09T14:22:00.492690+0000","last_active":"2024-03-09T15:22:36.298945+0000","last_peered":"2024-03-09T15:22:36.298945+0000","last_clean":"2024-03-09T15:22:36.298945+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:22:36.298945+0000","last_undegraded":"2024-03-09T15:22:36.298945+0000","last_fullsized":"2024-03-09T15:22:36.298945+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:31.845945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'507","reported_seq":2213,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.847173+0000","last_change":"2024-03-09T14:22:02.396378+0000","last_active":"2024-03-09T15:24:37.847173+0000","last_peered":"2024-03-09T15:24:37.847173+0000","last_clean":"2024-03-09T15:24:37.847173+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:37.847173+0000","last_undegraded":"2024-03-09T15:24:37.847173+0000","last_fullsized":"2024-03-09T15:24:37.847173+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:11.751936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":611,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.167412+0000","last_change":"2024-03-09T14:22:04.402603+0000","last_active":"2024-03-09T15:22:32.167412+0000","last_peered":"2024-03-09T15:22:32.167412+0000","last_clean":"2024-03-09T15:22:32.167412+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:22:32.167412+0000","last_undegraded":"2024-03-09T15:22:32.167412+0000","last_fullsized":"2024-03-09T15:22:32.167412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:25.906429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":609,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.995042+0000","last_change":"2024-03-09T14:21:56.368142+0000","last_active":"2024-03-09T15:20:36.995042+0000","last_peered":"2024-03-09T15:20:36.995042+0000","last_clean":"2024-03-09T15:20:36.995042+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:20:36.995042+0000","last_undegraded":"2024-03-09T15:20:36.995042+0000","last_fullsized":"2024-03-09T15:20:36.995042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:27.948389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'191","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.052545+0000","last_change":"2024-03-09T14:21:54.368543+0000","last_active":"2024-03-09T15:24:38.052545+0000","last_peered":"2024-03-09T15:24:38.052545+0000","last_clean":"2024-03-09T15:24:38.052545+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:24:38.052545+0000","last_undegraded":"2024-03-09T15:24:38.052545+0000","last_fullsized":"2024-03-09T15:24:38.052545+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:57.264929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":26998,"num_write":1069,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'4","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.609849+0000","last_change":"2024-03-09T14:21:58.371279+0000","last_active":"2024-03-09T15:24:37.609849+0000","last_peered":"2024-03-09T15:24:37.609849+0000","last_clean":"2024-03-09T15:24:37.609849+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:24:37.609849+0000","last_undegraded":"2024-03-09T15:24:37.609849+0000","last_fullsized":"2024-03-09T15:24:37.609849+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:34.948133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'288","reported_seq":906,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.055095+0000","last_change":"2024-03-09T14:22:00.386117+0000","last_active":"2024-03-09T15:24:38.055095+0000","last_peered":"2024-03-09T15:24:38.055095+0000","last_clean":"2024-03-09T15:24:38.055095+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:24:38.055095+0000","last_undegraded":"2024-03-09T15:24:38.055095+0000","last_fullsized":"2024-03-09T15:24:38.055095+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:21.453812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6907,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1015,"num_read_kb":1081,"num_write":1596,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024722+0000","last_change":"2024-03-09T14:22:02.404333+0000","last_active":"2024-03-09T15:20:32.024722+0000","last_peered":"2024-03-09T15:20:32.024722+0000","last_clean":"2024-03-09T15:20:32.024722+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:20:32.024722+0000","last_undegraded":"2024-03-09T15:20:32.024722+0000","last_fullsized":"2024-03-09T15:20:32.024722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:37.735785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'157","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.405174+0000","last_change":"2024-03-09T14:22:04.400519+0000","last_active":"2024-03-09T15:23:44.405174+0000","last_peered":"2024-03-09T15:23:44.405174+0000","last_clean":"2024-03-09T15:23:44.405174+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:23:44.405174+0000","last_undegraded":"2024-03-09T15:23:44.405174+0000","last_fullsized":"2024-03-09T15:23:44.405174+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:16.309063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:32.042466+0000","last_change":"2024-03-09T14:21:56.359275+0000","last_active":"2024-03-09T15:22:32.042466+0000","last_peered":"2024-03-09T15:22:32.042466+0000","last_clean":"2024-03-09T15:22:32.042466+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:22:32.042466+0000","last_undegraded":"2024-03-09T15:22:32.042466+0000","last_fullsized":"2024-03-09T15:22:32.042466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:10.778385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046197+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T15:21:57.046197+0000","last_peered":"2024-03-09T15:21:57.046197+0000","last_clean":"2024-03-09T15:21:57.046197+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:21:57.046197+0000","last_undegraded":"2024-03-09T15:21:57.046197+0000","last_fullsized":"2024-03-09T15:21:57.046197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:25:33.507624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'155","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.978154+0000","last_change":"2024-03-09T14:21:54.358849+0000","last_active":"2024-03-09T15:24:37.978154+0000","last_peered":"2024-03-09T15:24:37.978154+0000","last_clean":"2024-03-09T15:24:37.978154+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:24:37.978154+0000","last_undegraded":"2024-03-09T15:24:37.978154+0000","last_fullsized":"2024-03-09T15:24:37.978154+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:39.818710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244523,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":7813,"num_write":928,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.051219+0000","last_change":"2024-03-09T14:21:58.372665+0000","last_active":"2024-03-09T15:22:27.051219+0000","last_peered":"2024-03-09T15:22:27.051219+0000","last_clean":"2024-03-09T15:22:27.051219+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:22:27.051219+0000","last_undegraded":"2024-03-09T15:22:27.051219+0000","last_fullsized":"2024-03-09T15:22:27.051219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:20.394198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'300","reported_seq":1006,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.134005+0000","last_change":"2024-03-09T14:22:00.387288+0000","last_active":"2024-03-09T15:24:38.134005+0000","last_peered":"2024-03-09T15:24:38.134005+0000","last_clean":"2024-03-09T15:24:38.134005+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:24:38.134005+0000","last_undegraded":"2024-03-09T15:24:38.134005+0000","last_fullsized":"2024-03-09T15:24:38.134005+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:13.322082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":594,"num_write":476,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.999998+0000","last_change":"2024-03-09T14:22:02.403697+0000","last_active":"2024-03-09T15:20:31.999998+0000","last_peered":"2024-03-09T15:20:31.999998+0000","last_clean":"2024-03-09T15:20:31.999998+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:20:31.999998+0000","last_undegraded":"2024-03-09T15:20:31.999998+0000","last_fullsized":"2024-03-09T15:20:31.999998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:19:46.922962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'215","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:55.799050+0000","last_change":"2024-03-09T14:22:04.400948+0000","last_active":"2024-03-09T15:23:55.799050+0000","last_peered":"2024-03-09T15:23:55.799050+0000","last_clean":"2024-03-09T15:23:55.799050+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:23:55.799050+0000","last_undegraded":"2024-03-09T15:23:55.799050+0000","last_fullsized":"2024-03-09T15:23:55.799050+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:37.990701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'338","reported_seq":983,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.006035+0000","last_change":"2024-03-09T14:21:56.364183+0000","last_active":"2024-03-09T15:22:22.006035+0000","last_peered":"2024-03-09T15:22:22.006035+0000","last_clean":"2024-03-09T15:22:22.006035+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:22:22.006035+0000","last_undegraded":"2024-03-09T15:22:22.006035+0000","last_fullsized":"2024-03-09T15:22:22.006035+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:20.353413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038029+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T15:22:02.038029+0000","last_peered":"2024-03-09T15:22:02.038029+0000","last_clean":"2024-03-09T15:22:02.038029+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:22:02.038029+0000","last_undegraded":"2024-03-09T15:22:02.038029+0000","last_fullsized":"2024-03-09T15:22:02.038029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.331820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'156","reported_seq":749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183906+0000","last_change":"2024-03-09T14:21:54.357687+0000","last_active":"2024-03-09T15:24:27.183906+0000","last_peered":"2024-03-09T15:24:27.183906+0000","last_clean":"2024-03-09T15:24:27.183906+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:24:27.183906+0000","last_undegraded":"2024-03-09T15:24:27.183906+0000","last_fullsized":"2024-03-09T15:24:27.183906+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:07.591910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081389,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":315,"num_read_kb":1406,"num_write":852,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:37.000526+0000","last_change":"2024-03-09T14:21:58.373133+0000","last_active":"2024-03-09T15:20:37.000526+0000","last_peered":"2024-03-09T15:20:37.000526+0000","last_clean":"2024-03-09T15:20:37.000526+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:20:37.000526+0000","last_undegraded":"2024-03-09T15:20:37.000526+0000","last_fullsized":"2024-03-09T15:20:37.000526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:53.176970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'144","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.207457+0000","last_change":"2024-03-09T14:22:00.388917+0000","last_active":"2024-03-09T15:22:36.207457+0000","last_peered":"2024-03-09T15:22:36.207457+0000","last_clean":"2024-03-09T15:22:36.207457+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:22:36.207457+0000","last_undegraded":"2024-03-09T15:22:36.207457+0000","last_fullsized":"2024-03-09T15:22:36.207457+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:48:20.768721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024785+0000","last_change":"2024-03-09T14:22:02.401190+0000","last_active":"2024-03-09T15:20:32.024785+0000","last_peered":"2024-03-09T15:20:32.024785+0000","last_clean":"2024-03-09T15:20:32.024785+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:20:32.024785+0000","last_undegraded":"2024-03-09T15:20:32.024785+0000","last_fullsized":"2024-03-09T15:20:32.024785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:59.946005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'103","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.267023+0000","last_change":"2024-03-09T14:22:04.408883+0000","last_active":"2024-03-09T15:23:23.267023+0000","last_peered":"2024-03-09T15:23:23.267023+0000","last_clean":"2024-03-09T15:23:23.267023+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:23:23.267023+0000","last_undegraded":"2024-03-09T15:23:23.267023+0000","last_fullsized":"2024-03-09T15:23:23.267023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:20.342826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":623,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.115078+0000","last_change":"2024-03-09T14:21:56.362977+0000","last_active":"2024-03-09T15:22:43.115078+0000","last_peered":"2024-03-09T15:22:43.115078+0000","last_clean":"2024-03-09T15:22:43.115078+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:22:43.115078+0000","last_undegraded":"2024-03-09T15:22:43.115078+0000","last_fullsized":"2024-03-09T15:22:43.115078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:56.941578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047191+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T15:22:02.047191+0000","last_peered":"2024-03-09T15:22:02.047191+0000","last_clean":"2024-03-09T15:22:02.047191+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:22:02.047191+0000","last_undegraded":"2024-03-09T15:22:02.047191+0000","last_fullsized":"2024-03-09T15:22:02.047191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:15.297369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'209","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.074350+0000","last_change":"2024-03-09T14:21:54.371651+0000","last_active":"2024-03-09T15:24:38.074350+0000","last_peered":"2024-03-09T15:24:38.074350+0000","last_clean":"2024-03-09T15:24:38.074350+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:24:38.074350+0000","last_undegraded":"2024-03-09T15:24:38.074350+0000","last_fullsized":"2024-03-09T15:24:38.074350+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:50.559760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343543,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":33193,"num_write":1185,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:31.992747+0000","last_change":"2024-03-09T14:21:58.371500+0000","last_active":"2024-03-09T15:20:31.992747+0000","last_peered":"2024-03-09T15:20:31.992747+0000","last_clean":"2024-03-09T15:20:31.992747+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:20:31.992747+0000","last_undegraded":"2024-03-09T15:20:31.992747+0000","last_fullsized":"2024-03-09T15:20:31.992747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:29:26.928736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'282","reported_seq":1581,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.033091+0000","last_change":"2024-03-09T14:22:00.494298+0000","last_active":"2024-03-09T15:24:31.033091+0000","last_peered":"2024-03-09T15:24:31.033091+0000","last_clean":"2024-03-09T15:24:31.033091+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:24:31.033091+0000","last_undegraded":"2024-03-09T15:24:31.033091+0000","last_fullsized":"2024-03-09T15:24:31.033091+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:34.240386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908159+0000","last_change":"2024-03-09T14:22:02.400334+0000","last_active":"2024-03-09T15:22:26.908159+0000","last_peered":"2024-03-09T15:22:26.908159+0000","last_clean":"2024-03-09T15:22:26.908159+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:22:26.908159+0000","last_undegraded":"2024-03-09T15:22:26.908159+0000","last_fullsized":"2024-03-09T15:22:26.908159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:04.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'256","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:19.404283+0000","last_change":"2024-03-09T14:22:04.404883+0000","last_active":"2024-03-09T15:23:19.404283+0000","last_peered":"2024-03-09T15:23:19.404283+0000","last_clean":"2024-03-09T15:23:19.404283+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:23:19.404283+0000","last_undegraded":"2024-03-09T15:23:19.404283+0000","last_fullsized":"2024-03-09T15:23:19.404283+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:39.148958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":584,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999417+0000","last_change":"2024-03-09T14:21:56.371601+0000","last_active":"2024-03-09T15:20:26.999417+0000","last_peered":"2024-03-09T15:20:26.999417+0000","last_clean":"2024-03-09T15:20:26.999417+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:20:26.999417+0000","last_undegraded":"2024-03-09T15:20:26.999417+0000","last_fullsized":"2024-03-09T15:20:26.999417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:04.533578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.004180+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T15:22:07.004180+0000","last_peered":"2024-03-09T15:22:07.004180+0000","last_clean":"2024-03-09T15:22:07.004180+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:22:07.004180+0000","last_undegraded":"2024-03-09T15:22:07.004180+0000","last_fullsized":"2024-03-09T15:22:07.004180+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:14.047597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":669,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.046218+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T15:21:57.046218+0000","last_peered":"2024-03-09T15:21:57.046218+0000","last_clean":"2024-03-09T15:21:57.046218+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:21:57.046218+0000","last_undegraded":"2024-03-09T15:21:57.046218+0000","last_fullsized":"2024-03-09T15:21:57.046218+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:25:40.528352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'146","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.968158+0000","last_change":"2024-03-09T14:21:54.370907+0000","last_active":"2024-03-09T15:24:37.968158+0000","last_peered":"2024-03-09T15:24:37.968158+0000","last_clean":"2024-03-09T15:24:37.968158+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:24:37.968158+0000","last_undegraded":"2024-03-09T15:24:37.968158+0000","last_fullsized":"2024-03-09T15:24:37.968158+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:47:00.830027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":13701,"num_write":831,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.024862+0000","last_change":"2024-03-09T14:21:58.370284+0000","last_active":"2024-03-09T15:20:32.024862+0000","last_peered":"2024-03-09T15:20:32.024862+0000","last_clean":"2024-03-09T15:20:32.024862+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:20:32.024862+0000","last_undegraded":"2024-03-09T15:20:32.024862+0000","last_fullsized":"2024-03-09T15:20:32.024862+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:59.246060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'734","reported_seq":2349,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.179070+0000","last_change":"2024-03-09T14:22:00.388074+0000","last_active":"2024-03-09T15:24:38.179070+0000","last_peered":"2024-03-09T15:24:38.179070+0000","last_clean":"2024-03-09T15:24:38.179070+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:24:38.179070+0000","last_undegraded":"2024-03-09T15:24:38.179070+0000","last_fullsized":"2024-03-09T15:24:38.179070+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:01.562367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17200,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":996,"num_read_kb":1152,"num_write":364,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:32.163647+0000","last_change":"2024-03-09T14:22:02.392515+0000","last_active":"2024-03-09T15:20:32.163647+0000","last_peered":"2024-03-09T15:20:32.163647+0000","last_clean":"2024-03-09T15:20:32.163647+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:20:32.163647+0000","last_undegraded":"2024-03-09T15:20:32.163647+0000","last_fullsized":"2024-03-09T15:20:32.163647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:41.546333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'158","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:46.996025+0000","last_change":"2024-03-09T14:22:04.397452+0000","last_active":"2024-03-09T15:20:46.996025+0000","last_peered":"2024-03-09T15:20:46.996025+0000","last_clean":"2024-03-09T15:20:46.996025+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:20:46.996025+0000","last_undegraded":"2024-03-09T15:20:46.996025+0000","last_fullsized":"2024-03-09T15:20:46.996025+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:18:25.696387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":803,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.018038+0000","last_change":"2024-03-09T14:21:56.356659+0000","last_active":"2024-03-09T15:22:56.018038+0000","last_peered":"2024-03-09T15:22:56.018038+0000","last_clean":"2024-03-09T15:22:56.018038+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:22:56.018038+0000","last_undegraded":"2024-03-09T15:22:56.018038+0000","last_fullsized":"2024-03-09T15:22:56.018038+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.345499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'133","reported_seq":693,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.955907+0000","last_change":"2024-03-09T14:22:31.510611+0000","last_active":"2024-03-09T15:24:37.955907+0000","last_peered":"2024-03-09T15:24:37.955907+0000","last_clean":"2024-03-09T15:24:37.955907+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:24:37.955907+0000","last_undegraded":"2024-03-09T15:24:37.955907+0000","last_fullsized":"2024-03-09T15:24:37.955907+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:42.545379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506641,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":4172,"num_write":719,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:07.018367+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T15:22:07.018367+0000","last_peered":"2024-03-09T15:22:07.018367+0000","last_clean":"2024-03-09T15:22:07.018367+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:22:07.018367+0000","last_undegraded":"2024-03-09T15:22:07.018367+0000","last_fullsized":"2024-03-09T15:22:07.018367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:30:24.157808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.019477+0000","last_change":"2024-03-09T14:21:58.372306+0000","last_active":"2024-03-09T15:22:17.019477+0000","last_peered":"2024-03-09T15:22:17.019477+0000","last_clean":"2024-03-09T15:22:17.019477+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:22:17.019477+0000","last_undegraded":"2024-03-09T15:22:17.019477+0000","last_fullsized":"2024-03-09T15:22:17.019477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:31.060450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'346","reported_seq":1075,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.038705+0000","last_change":"2024-03-09T14:22:00.492596+0000","last_active":"2024-03-09T15:24:38.038705+0000","last_peered":"2024-03-09T15:24:38.038705+0000","last_clean":"2024-03-09T15:24:38.038705+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:24:38.038705+0000","last_undegraded":"2024-03-09T15:24:38.038705+0000","last_fullsized":"2024-03-09T15:24:38.038705+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:55.986088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24501,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":711,"num_write":258,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.020677+0000","last_change":"2024-03-09T14:22:02.401629+0000","last_active":"2024-03-09T15:22:27.020677+0000","last_peered":"2024-03-09T15:22:27.020677+0000","last_clean":"2024-03-09T15:22:27.020677+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:22:27.020677+0000","last_undegraded":"2024-03-09T15:22:27.020677+0000","last_fullsized":"2024-03-09T15:22:27.020677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:36:24.413226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'144","reported_seq":634,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.827582+0000","last_change":"2024-03-09T14:22:04.400992+0000","last_active":"2024-03-09T15:23:33.827582+0000","last_peered":"2024-03-09T15:23:33.827582+0000","last_clean":"2024-03-09T15:23:33.827582+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:23:33.827582+0000","last_undegraded":"2024-03-09T15:23:33.827582+0000","last_fullsized":"2024-03-09T15:23:33.827582+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:22.181899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":758,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.018863+0000","last_change":"2024-03-09T14:21:56.367601+0000","last_active":"2024-03-09T15:22:12.018863+0000","last_peered":"2024-03-09T15:22:12.018863+0000","last_clean":"2024-03-09T15:22:12.018863+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:22:12.018863+0000","last_undegraded":"2024-03-09T15:22:12.018863+0000","last_fullsized":"2024-03-09T15:22:12.018863+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:27:01.153520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'187","reported_seq":839,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.924717+0000","last_change":"2024-03-09T14:21:54.358356+0000","last_active":"2024-03-09T15:24:37.924717+0000","last_peered":"2024-03-09T15:24:37.924717+0000","last_clean":"2024-03-09T15:24:37.924717+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:24:37.924717+0000","last_undegraded":"2024-03-09T15:24:37.924717+0000","last_fullsized":"2024-03-09T15:24:37.924717+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:19.858694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":496,"num_read_kb":43067,"num_write":1018,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.164751+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T15:22:12.164751+0000","last_peered":"2024-03-09T15:22:12.164751+0000","last_clean":"2024-03-09T15:22:12.164751+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:22:12.164751+0000","last_undegraded":"2024-03-09T15:22:12.164751+0000","last_fullsized":"2024-03-09T15:22:12.164751+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.418285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166771+0000","last_change":"2024-03-09T14:21:58.373524+0000","last_active":"2024-03-09T15:22:27.166771+0000","last_peered":"2024-03-09T15:22:27.166771+0000","last_clean":"2024-03-09T15:22:27.166771+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:22:27.166771+0000","last_undegraded":"2024-03-09T15:22:27.166771+0000","last_fullsized":"2024-03-09T15:22:27.166771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:39.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'122","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.450139+0000","last_change":"2024-03-09T14:22:00.386056+0000","last_active":"2024-03-09T15:22:36.450139+0000","last_peered":"2024-03-09T15:22:36.450139+0000","last_clean":"2024-03-09T15:22:36.450139+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:22:36.450139+0000","last_undegraded":"2024-03-09T15:22:36.450139+0000","last_fullsized":"2024-03-09T15:22:36.450139+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:40.186793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'548","reported_seq":4161,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.847912+0000","last_change":"2024-03-09T14:22:02.399139+0000","last_active":"2024-03-09T15:24:37.847912+0000","last_peered":"2024-03-09T15:24:37.847912+0000","last_clean":"2024-03-09T15:24:37.847912+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:24:37.847912+0000","last_undegraded":"2024-03-09T15:24:37.847912+0000","last_fullsized":"2024-03-09T15:24:37.847912+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:34.998650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'182","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.340909+0000","last_change":"2024-03-09T14:22:04.405073+0000","last_active":"2024-03-09T15:22:41.340909+0000","last_peered":"2024-03-09T15:22:41.340909+0000","last_clean":"2024-03-09T15:22:41.340909+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:22:41.340909+0000","last_undegraded":"2024-03-09T15:22:41.340909+0000","last_fullsized":"2024-03-09T15:22:41.340909+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:37.566660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1014,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:04.421696+0000","last_change":"2024-03-09T14:21:56.370846+0000","last_active":"2024-03-09T15:23:04.421696+0000","last_peered":"2024-03-09T15:23:04.421696+0000","last_clean":"2024-03-09T15:23:04.421696+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:23:04.421696+0000","last_undegraded":"2024-03-09T15:23:04.421696+0000","last_fullsized":"2024-03-09T15:23:04.421696+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:27:16.582369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'211","reported_seq":888,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.121362+0000","last_change":"2024-03-09T14:21:54.370705+0000","last_active":"2024-03-09T15:24:38.121362+0000","last_peered":"2024-03-09T15:24:38.121362+0000","last_clean":"2024-03-09T15:24:38.121362+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:24:38.121362+0000","last_undegraded":"2024-03-09T15:24:38.121362+0000","last_fullsized":"2024-03-09T15:24:38.121362+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:30:43.848851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117883,"num_write":1122,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040120+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T15:22:17.040120+0000","last_peered":"2024-03-09T15:22:17.040120+0000","last_clean":"2024-03-09T15:22:17.040120+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:22:17.040120+0000","last_undegraded":"2024-03-09T15:22:17.040120+0000","last_fullsized":"2024-03-09T15:22:17.040120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:18:38.232466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041830+0000","last_change":"2024-03-09T14:21:58.371830+0000","last_active":"2024-03-09T15:22:27.041830+0000","last_peered":"2024-03-09T15:22:27.041830+0000","last_clean":"2024-03-09T15:22:27.041830+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:22:27.041830+0000","last_undegraded":"2024-03-09T15:22:27.041830+0000","last_fullsized":"2024-03-09T15:22:27.041830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:28.230483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'237","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.056546+0000","last_change":"2024-03-09T14:22:00.492643+0000","last_active":"2024-03-09T15:24:31.056546+0000","last_peered":"2024-03-09T15:24:31.056546+0000","last_clean":"2024-03-09T15:24:31.056546+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:24:31.056546+0000","last_undegraded":"2024-03-09T15:24:31.056546+0000","last_fullsized":"2024-03-09T15:24:31.056546+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:59.553996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'541","reported_seq":2692,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.843378+0000","last_change":"2024-03-09T14:22:02.395536+0000","last_active":"2024-03-09T15:24:37.843378+0000","last_peered":"2024-03-09T15:24:37.843378+0000","last_clean":"2024-03-09T15:24:37.843378+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:37.843378+0000","last_undegraded":"2024-03-09T15:24:37.843378+0000","last_fullsized":"2024-03-09T15:24:37.843378+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:29:34.982079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'116","reported_seq":608,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:07.027423+0000","last_change":"2024-03-09T14:22:04.405236+0000","last_active":"2024-03-09T15:23:07.027423+0000","last_peered":"2024-03-09T15:23:07.027423+0000","last_clean":"2024-03-09T15:23:07.027423+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:23:07.027423+0000","last_undegraded":"2024-03-09T15:23:07.027423+0000","last_fullsized":"2024-03-09T15:23:07.027423+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:17.271331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.005976+0000","last_change":"2024-03-09T14:21:56.359311+0000","last_active":"2024-03-09T15:22:22.005976+0000","last_peered":"2024-03-09T15:22:22.005976+0000","last_clean":"2024-03-09T15:22:22.005976+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:22:22.005976+0000","last_undegraded":"2024-03-09T15:22:22.005976+0000","last_fullsized":"2024-03-09T15:22:22.005976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:45.357583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'197","reported_seq":850,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.152613+0000","last_change":"2024-03-09T14:21:54.371711+0000","last_active":"2024-03-09T15:24:38.152613+0000","last_peered":"2024-03-09T15:24:38.152613+0000","last_clean":"2024-03-09T15:24:38.152613+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:24:38.152613+0000","last_undegraded":"2024-03-09T15:24:38.152613+0000","last_fullsized":"2024-03-09T15:24:38.152613+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:21.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":52342,"num_write":1104,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":519,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:17.040153+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T15:22:17.040153+0000","last_peered":"2024-03-09T15:22:17.040153+0000","last_clean":"2024-03-09T15:22:17.040153+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:22:17.040153+0000","last_undegraded":"2024-03-09T15:22:17.040153+0000","last_fullsized":"2024-03-09T15:22:17.040153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:58.533776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:26.908142+0000","last_change":"2024-03-09T14:21:58.369587+0000","last_active":"2024-03-09T15:22:26.908142+0000","last_peered":"2024-03-09T15:22:26.908142+0000","last_clean":"2024-03-09T15:22:26.908142+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:22:26.908142+0000","last_undegraded":"2024-03-09T15:22:26.908142+0000","last_fullsized":"2024-03-09T15:22:26.908142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:01.184512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'278","reported_seq":949,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.140506+0000","last_change":"2024-03-09T14:22:00.386745+0000","last_active":"2024-03-09T15:24:38.140506+0000","last_peered":"2024-03-09T15:24:38.140506+0000","last_clean":"2024-03-09T15:24:38.140506+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:24:38.140506+0000","last_undegraded":"2024-03-09T15:24:38.140506+0000","last_fullsized":"2024-03-09T15:24:38.140506+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:58.663053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15555,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":412,"num_read_kb":552,"num_write":228,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.166791+0000","last_change":"2024-03-09T14:22:02.400357+0000","last_active":"2024-03-09T15:22:27.166791+0000","last_peered":"2024-03-09T15:22:27.166791+0000","last_clean":"2024-03-09T15:22:27.166791+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:22:27.166791+0000","last_undegraded":"2024-03-09T15:22:27.166791+0000","last_fullsized":"2024-03-09T15:22:27.166791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:34.726729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'185","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:42.397957+0000","last_change":"2024-03-09T14:22:04.402392+0000","last_active":"2024-03-09T15:23:42.397957+0000","last_peered":"2024-03-09T15:23:42.397957+0000","last_clean":"2024-03-09T15:23:42.397957+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:23:42.397957+0000","last_undegraded":"2024-03-09T15:23:42.397957+0000","last_fullsized":"2024-03-09T15:23:42.397957+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:54.527353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'134","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:31.908737+0000","last_change":"2024-03-09T14:22:04.401080+0000","last_active":"2024-03-09T15:22:31.908737+0000","last_peered":"2024-03-09T15:22:31.908737+0000","last_clean":"2024-03-09T15:22:31.908737+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:22:31.908737+0000","last_undegraded":"2024-03-09T15:22:31.908737+0000","last_fullsized":"2024-03-09T15:22:31.908737+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:15.758082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4672,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.508782+0000","last_change":"2024-03-09T14:21:56.355418+0000","last_active":"2024-03-09T15:21:01.508782+0000","last_peered":"2024-03-09T15:21:01.508782+0000","last_clean":"2024-03-09T15:21:01.508782+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:21:01.508782+0000","last_undegraded":"2024-03-09T15:21:01.508782+0000","last_fullsized":"2024-03-09T15:21:01.508782+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:03.909589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'149","reported_seq":749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.021274+0000","last_change":"2024-03-09T14:21:54.362232+0000","last_active":"2024-03-09T15:24:38.021274+0000","last_peered":"2024-03-09T15:24:38.021274+0000","last_clean":"2024-03-09T15:24:38.021274+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:24:38.021274+0000","last_undegraded":"2024-03-09T15:24:38.021274+0000","last_fullsized":"2024-03-09T15:24:38.021274+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:27.911421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":29246,"num_write":815,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.993238+0000","last_change":"2024-03-09T14:21:58.371454+0000","last_active":"2024-03-09T15:20:21.993238+0000","last_peered":"2024-03-09T15:20:21.993238+0000","last_clean":"2024-03-09T15:20:21.993238+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:20:21.993238+0000","last_undegraded":"2024-03-09T15:20:21.993238+0000","last_fullsized":"2024-03-09T15:20:21.993238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:42.569021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'146","reported_seq":731,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.081901+0000","last_change":"2024-03-09T14:22:00.386530+0000","last_active":"2024-03-09T15:24:38.081901+0000","last_peered":"2024-03-09T15:24:38.081901+0000","last_clean":"2024-03-09T15:24:38.081901+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:24:38.081901+0000","last_undegraded":"2024-03-09T15:24:38.081901+0000","last_fullsized":"2024-03-09T15:24:38.081901+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:02.609915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":294,"num_write":114,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005572+0000","last_change":"2024-03-09T14:22:02.399358+0000","last_active":"2024-03-09T15:20:22.005572+0000","last_peered":"2024-03-09T15:20:22.005572+0000","last_clean":"2024-03-09T15:20:22.005572+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:20:22.005572+0000","last_undegraded":"2024-03-09T15:20:22.005572+0000","last_fullsized":"2024-03-09T15:20:22.005572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:59:26.716851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":654,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020178+0000","last_change":"2024-03-09T14:22:04.403191+0000","last_active":"2024-03-09T15:22:22.020178+0000","last_peered":"2024-03-09T15:22:22.020178+0000","last_clean":"2024-03-09T15:22:22.020178+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:22:22.020178+0000","last_undegraded":"2024-03-09T15:22:22.020178+0000","last_fullsized":"2024-03-09T15:22:22.020178+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:51.085844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4078","reported_seq":4649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.992713+0000","last_change":"2024-03-09T14:21:56.365718+0000","last_active":"2024-03-09T15:20:16.992713+0000","last_peered":"2024-03-09T15:20:16.992713+0000","last_clean":"2024-03-09T15:20:16.992713+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:20:16.992713+0000","last_undegraded":"2024-03-09T15:20:16.992713+0000","last_fullsized":"2024-03-09T15:20:16.992713+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":3000,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:52.273131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'214","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.167192+0000","last_change":"2024-03-09T14:21:54.370617+0000","last_active":"2024-03-09T15:24:38.167192+0000","last_peered":"2024-03-09T15:24:38.167192+0000","last_clean":"2024-03-09T15:24:38.167192+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:24:38.167192+0000","last_undegraded":"2024-03-09T15:24:38.167192+0000","last_fullsized":"2024-03-09T15:24:38.167192+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:10.455019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34568,"num_write":1093,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.005680+0000","last_change":"2024-03-09T14:21:58.373073+0000","last_active":"2024-03-09T15:20:22.005680+0000","last_peered":"2024-03-09T15:20:22.005680+0000","last_clean":"2024-03-09T15:20:22.005680+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:20:22.005680+0000","last_undegraded":"2024-03-09T15:20:22.005680+0000","last_fullsized":"2024-03-09T15:20:22.005680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:00.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'44","reported_seq":545,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.028912+0000","last_change":"2024-03-09T14:22:00.389956+0000","last_active":"2024-03-09T15:22:36.028912+0000","last_peered":"2024-03-09T15:22:36.028912+0000","last_clean":"2024-03-09T15:22:36.028912+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:22:36.028912+0000","last_undegraded":"2024-03-09T15:22:36.028912+0000","last_fullsized":"2024-03-09T15:22:36.028912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:40.424088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161788+0000","last_change":"2024-03-09T14:22:02.397849+0000","last_active":"2024-03-09T15:20:22.161788+0000","last_peered":"2024-03-09T15:20:22.161788+0000","last_clean":"2024-03-09T15:20:22.161788+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:20:22.161788+0000","last_undegraded":"2024-03-09T15:20:22.161788+0000","last_fullsized":"2024-03-09T15:20:22.161788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:59:48.170799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'189","reported_seq":708,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:56.006224+0000","last_change":"2024-03-09T14:22:04.401057+0000","last_active":"2024-03-09T15:22:56.006224+0000","last_peered":"2024-03-09T15:22:56.006224+0000","last_clean":"2024-03-09T15:22:56.006224+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:22:56.006224+0000","last_undegraded":"2024-03-09T15:22:56.006224+0000","last_fullsized":"2024-03-09T15:22:56.006224+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:30.406135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004987+0000","last_change":"2024-03-09T14:21:56.360219+0000","last_active":"2024-03-09T15:20:17.004987+0000","last_peered":"2024-03-09T15:20:17.004987+0000","last_clean":"2024-03-09T15:20:17.004987+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:20:17.004987+0000","last_undegraded":"2024-03-09T15:20:17.004987+0000","last_fullsized":"2024-03-09T15:20:17.004987+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:44:55.717497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'142","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.029439+0000","last_change":"2024-03-09T14:21:54.360121+0000","last_active":"2024-03-09T15:24:38.029439+0000","last_peered":"2024-03-09T15:24:38.029439+0000","last_clean":"2024-03-09T15:24:38.029439+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:24:38.029439+0000","last_undegraded":"2024-03-09T15:24:38.029439+0000","last_fullsized":"2024-03-09T15:24:38.029439+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:23.649957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7716,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":77468,"num_write":821,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.161750+0000","last_change":"2024-03-09T14:21:58.371755+0000","last_active":"2024-03-09T15:20:22.161750+0000","last_peered":"2024-03-09T15:20:22.161750+0000","last_clean":"2024-03-09T15:20:22.161750+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:20:22.161750+0000","last_undegraded":"2024-03-09T15:20:22.161750+0000","last_fullsized":"2024-03-09T15:20:22.161750+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:18.384428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'172","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.994285+0000","last_change":"2024-03-09T14:22:00.388758+0000","last_active":"2024-03-09T15:24:37.994285+0000","last_peered":"2024-03-09T15:24:37.994285+0000","last_clean":"2024-03-09T15:24:37.994285+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:24:37.994285+0000","last_undegraded":"2024-03-09T15:24:37.994285+0000","last_fullsized":"2024-03-09T15:24:37.994285+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:21.509939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":299,"num_write":138,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023321+0000","last_change":"2024-03-09T14:22:02.401182+0000","last_active":"2024-03-09T15:20:22.023321+0000","last_peered":"2024-03-09T15:20:22.023321+0000","last_clean":"2024-03-09T15:20:22.023321+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:20:22.023321+0000","last_undegraded":"2024-03-09T15:20:22.023321+0000","last_fullsized":"2024-03-09T15:20:22.023321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:34.573612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'123","reported_seq":616,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.171935+0000","last_change":"2024-03-09T14:22:04.400641+0000","last_active":"2024-03-09T15:23:15.171935+0000","last_peered":"2024-03-09T15:23:15.171935+0000","last_clean":"2024-03-09T15:23:15.171935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:23:15.171935+0000","last_undegraded":"2024-03-09T15:23:15.171935+0000","last_fullsized":"2024-03-09T15:23:15.171935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:41.104332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1185,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.004952+0000","last_change":"2024-03-09T14:21:56.353346+0000","last_active":"2024-03-09T15:20:17.004952+0000","last_peered":"2024-03-09T15:20:17.004952+0000","last_clean":"2024-03-09T15:20:17.004952+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:20:17.004952+0000","last_undegraded":"2024-03-09T15:20:17.004952+0000","last_fullsized":"2024-03-09T15:20:17.004952+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:32:34.741252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'178","reported_seq":784,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.005361+0000","last_change":"2024-03-09T14:21:54.368774+0000","last_active":"2024-03-09T15:24:38.005361+0000","last_peered":"2024-03-09T15:24:38.005361+0000","last_clean":"2024-03-09T15:24:38.005361+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:24:38.005361+0000","last_undegraded":"2024-03-09T15:24:38.005361+0000","last_fullsized":"2024-03-09T15:24:38.005361+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:07.130860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507990,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":372,"num_read_kb":57120,"num_write":931,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:22.023278+0000","last_change":"2024-03-09T14:21:58.371834+0000","last_active":"2024-03-09T15:20:22.023278+0000","last_peered":"2024-03-09T15:20:22.023278+0000","last_clean":"2024-03-09T15:20:22.023278+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:20:22.023278+0000","last_undegraded":"2024-03-09T15:20:22.023278+0000","last_fullsized":"2024-03-09T15:20:22.023278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:41.491809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'147","reported_seq":721,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.962990+0000","last_change":"2024-03-09T14:22:00.383681+0000","last_active":"2024-03-09T15:24:37.962990+0000","last_peered":"2024-03-09T15:24:37.962990+0000","last_clean":"2024-03-09T15:24:37.962990+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:24:37.962990+0000","last_undegraded":"2024-03-09T15:24:37.962990+0000","last_fullsized":"2024-03-09T15:24:37.962990+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:07.824315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8269,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":267,"num_write":100,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:21.998738+0000","last_change":"2024-03-09T14:22:02.402801+0000","last_active":"2024-03-09T15:20:21.998738+0000","last_peered":"2024-03-09T15:20:21.998738+0000","last_clean":"2024-03-09T15:20:21.998738+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:20:21.998738+0000","last_undegraded":"2024-03-09T15:20:21.998738+0000","last_fullsized":"2024-03-09T15:20:21.998738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:42.052921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":777,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:15.177922+0000","last_change":"2024-03-09T14:21:56.355621+0000","last_active":"2024-03-09T15:23:15.177922+0000","last_peered":"2024-03-09T15:23:15.177922+0000","last_clean":"2024-03-09T15:23:15.177922+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:23:15.177922+0000","last_undegraded":"2024-03-09T15:23:15.177922+0000","last_fullsized":"2024-03-09T15:23:15.177922+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:48:40.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'190","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.012852+0000","last_change":"2024-03-09T14:21:54.361543+0000","last_active":"2024-03-09T15:24:38.012852+0000","last_peered":"2024-03-09T15:24:38.012852+0000","last_clean":"2024-03-09T15:24:38.012852+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:24:38.012852+0000","last_undegraded":"2024-03-09T15:24:38.012852+0000","last_fullsized":"2024-03-09T15:24:38.012852+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:42.544106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":29766,"num_write":1073,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:21.907526+0000","last_change":"2024-03-09T14:21:58.370949+0000","last_active":"2024-03-09T15:22:21.907526+0000","last_peered":"2024-03-09T15:22:21.907526+0000","last_clean":"2024-03-09T15:22:21.907526+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:22:21.907526+0000","last_undegraded":"2024-03-09T15:22:21.907526+0000","last_fullsized":"2024-03-09T15:22:21.907526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:55.442426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'221","reported_seq":857,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.126142+0000","last_change":"2024-03-09T14:22:00.386952+0000","last_active":"2024-03-09T15:24:38.126142+0000","last_peered":"2024-03-09T15:24:38.126142+0000","last_clean":"2024-03-09T15:24:38.126142+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:24:38.126142+0000","last_undegraded":"2024-03-09T15:24:38.126142+0000","last_fullsized":"2024-03-09T15:24:38.126142+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:12.101312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15733,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":333,"num_read_kb":495,"num_write":212,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038100+0000","last_change":"2024-03-09T14:22:02.402061+0000","last_active":"2024-03-09T15:22:02.038100+0000","last_peered":"2024-03-09T15:22:02.038100+0000","last_clean":"2024-03-09T15:22:02.038100+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:22:02.038100+0000","last_undegraded":"2024-03-09T15:22:02.038100+0000","last_fullsized":"2024-03-09T15:22:02.038100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:24.862935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'174","reported_seq":686,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:33.819989+0000","last_change":"2024-03-09T14:22:04.404476+0000","last_active":"2024-03-09T15:23:33.819989+0000","last_peered":"2024-03-09T15:23:33.819989+0000","last_clean":"2024-03-09T15:23:33.819989+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:23:33.819989+0000","last_undegraded":"2024-03-09T15:23:33.819989+0000","last_fullsized":"2024-03-09T15:23:33.819989+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:11.852013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:16.906878+0000","last_change":"2024-03-09T14:21:56.366627+0000","last_active":"2024-03-09T15:22:16.906878+0000","last_peered":"2024-03-09T15:22:16.906878+0000","last_clean":"2024-03-09T15:22:16.906878+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:22:16.906878+0000","last_undegraded":"2024-03-09T15:22:16.906878+0000","last_fullsized":"2024-03-09T15:22:16.906878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:53.735520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'317","reported_seq":1047,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.935527+0000","last_change":"2024-03-09T14:21:54.370005+0000","last_active":"2024-03-09T15:24:37.935527+0000","last_peered":"2024-03-09T15:24:37.935527+0000","last_clean":"2024-03-09T15:24:37.935527+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:24:37.935527+0000","last_undegraded":"2024-03-09T15:24:37.935527+0000","last_fullsized":"2024-03-09T15:24:37.935527+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:02:34.868755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243080,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":990,"num_read_kb":20523,"num_write":1606,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:27.041888+0000","last_change":"2024-03-09T14:21:58.372204+0000","last_active":"2024-03-09T15:22:27.041888+0000","last_peered":"2024-03-09T15:22:27.041888+0000","last_clean":"2024-03-09T15:22:27.041888+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:22:27.041888+0000","last_undegraded":"2024-03-09T15:22:27.041888+0000","last_fullsized":"2024-03-09T15:22:27.041888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:24.041345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'181","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.970544+0000","last_change":"2024-03-09T14:22:00.384248+0000","last_active":"2024-03-09T15:24:37.970544+0000","last_peered":"2024-03-09T15:24:37.970544+0000","last_clean":"2024-03-09T15:24:37.970544+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:24:37.970544+0000","last_undegraded":"2024-03-09T15:24:37.970544+0000","last_fullsized":"2024-03-09T15:24:37.970544+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:27.943625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9600,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":340,"num_write":176,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003643+0000","last_change":"2024-03-09T14:22:02.397994+0000","last_active":"2024-03-09T15:22:02.003643+0000","last_peered":"2024-03-09T15:22:02.003643+0000","last_clean":"2024-03-09T15:22:02.003643+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:22:02.003643+0000","last_undegraded":"2024-03-09T15:22:02.003643+0000","last_fullsized":"2024-03-09T15:22:02.003643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:49.447597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'169","reported_seq":1359,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:29.026404+0000","last_change":"2024-03-09T14:22:04.398055+0000","last_active":"2024-03-09T15:24:29.026404+0000","last_peered":"2024-03-09T15:24:29.026404+0000","last_clean":"2024-03-09T15:24:29.026404+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:24:29.026404+0000","last_undegraded":"2024-03-09T15:24:29.026404+0000","last_fullsized":"2024-03-09T15:24:29.026404+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:45:27.485253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:38.795535+0000","last_change":"2024-03-09T14:21:56.352420+0000","last_active":"2024-03-09T15:22:38.795535+0000","last_peered":"2024-03-09T15:22:38.795535+0000","last_clean":"2024-03-09T15:22:38.795535+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:22:38.795535+0000","last_undegraded":"2024-03-09T15:22:38.795535+0000","last_fullsized":"2024-03-09T15:22:38.795535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:39.394716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'180","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.924557+0000","last_change":"2024-03-09T14:22:31.509702+0000","last_active":"2024-03-09T15:24:37.924557+0000","last_peered":"2024-03-09T15:24:37.924557+0000","last_clean":"2024-03-09T15:24:37.924557+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:24:37.924557+0000","last_undegraded":"2024-03-09T15:24:37.924557+0000","last_fullsized":"2024-03-09T15:24:37.924557+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:38:06.659151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079970,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":42859,"num_write":1107,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163221+0000","last_change":"2024-03-09T14:21:58.373433+0000","last_active":"2024-03-09T15:22:02.163221+0000","last_peered":"2024-03-09T15:22:02.163221+0000","last_clean":"2024-03-09T15:22:02.163221+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:22:02.163221+0000","last_undegraded":"2024-03-09T15:22:02.163221+0000","last_fullsized":"2024-03-09T15:22:02.163221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:25.282408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'145","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.109790+0000","last_change":"2024-03-09T14:22:00.493124+0000","last_active":"2024-03-09T15:24:38.109790+0000","last_peered":"2024-03-09T15:24:38.109790+0000","last_clean":"2024-03-09T15:24:38.109790+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:24:38.109790+0000","last_undegraded":"2024-03-09T15:24:38.109790+0000","last_fullsized":"2024-03-09T15:24:38.109790+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:05.031002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":204,"num_read_kb":270,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:12.004846+0000","last_change":"2024-03-09T14:22:02.402300+0000","last_active":"2024-03-09T15:22:12.004846+0000","last_peered":"2024-03-09T15:22:12.004846+0000","last_clean":"2024-03-09T15:22:12.004846+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:22:12.004846+0000","last_undegraded":"2024-03-09T15:22:12.004846+0000","last_fullsized":"2024-03-09T15:22:12.004846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:54.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'107","reported_seq":599,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:30.867392+0000","last_change":"2024-03-09T14:22:04.400295+0000","last_active":"2024-03-09T15:24:30.867392+0000","last_peered":"2024-03-09T15:24:30.867392+0000","last_clean":"2024-03-09T15:24:30.867392+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:30.867392+0000","last_undegraded":"2024-03-09T15:24:30.867392+0000","last_fullsized":"2024-03-09T15:24:30.867392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:27:31.557973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.001414+0000","last_change":"2024-03-09T14:21:56.368701+0000","last_active":"2024-03-09T15:21:57.001414+0000","last_peered":"2024-03-09T15:21:57.001414+0000","last_clean":"2024-03-09T15:21:57.001414+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:21:57.001414+0000","last_undegraded":"2024-03-09T15:21:57.001414+0000","last_fullsized":"2024-03-09T15:21:57.001414+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:17.172991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'197","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.036018+0000","last_change":"2024-03-09T14:22:31.527571+0000","last_active":"2024-03-09T15:24:38.036018+0000","last_peered":"2024-03-09T15:24:38.036018+0000","last_clean":"2024-03-09T15:24:38.036018+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:24:38.036018+0000","last_undegraded":"2024-03-09T15:24:38.036018+0000","last_fullsized":"2024-03-09T15:24:38.036018+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:45.724834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322946,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":96221,"num_write":1020,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.003663+0000","last_change":"2024-03-09T14:21:58.369956+0000","last_active":"2024-03-09T15:22:02.003663+0000","last_peered":"2024-03-09T15:22:02.003663+0000","last_clean":"2024-03-09T15:22:02.003663+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:22:02.003663+0000","last_undegraded":"2024-03-09T15:22:02.003663+0000","last_fullsized":"2024-03-09T15:22:02.003663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:20.111905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'103","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:36.471989+0000","last_change":"2024-03-09T14:22:00.492818+0000","last_active":"2024-03-09T15:22:36.471989+0000","last_peered":"2024-03-09T15:22:36.471989+0000","last_clean":"2024-03-09T15:22:36.471989+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:22:36.471989+0000","last_undegraded":"2024-03-09T15:22:36.471989+0000","last_fullsized":"2024-03-09T15:22:36.471989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:19:37.095099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'507","reported_seq":2246,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.842078+0000","last_change":"2024-03-09T14:22:02.396058+0000","last_active":"2024-03-09T15:24:37.842078+0000","last_peered":"2024-03-09T15:24:37.842078+0000","last_clean":"2024-03-09T15:24:37.842078+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:37.842078+0000","last_undegraded":"2024-03-09T15:24:37.842078+0000","last_fullsized":"2024-03-09T15:24:37.842078+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:28:12.304576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'118","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:16.043783+0000","last_change":"2024-03-09T14:22:04.400380+0000","last_active":"2024-03-09T15:23:16.043783+0000","last_peered":"2024-03-09T15:23:16.043783+0000","last_clean":"2024-03-09T15:23:16.043783+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:23:16.043783+0000","last_undegraded":"2024-03-09T15:23:16.043783+0000","last_fullsized":"2024-03-09T15:23:16.043783+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:28.603631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:44.417821+0000","last_change":"2024-03-09T14:21:56.352673+0000","last_active":"2024-03-09T15:23:44.417821+0000","last_peered":"2024-03-09T15:23:44.417821+0000","last_clean":"2024-03-09T15:23:44.417821+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:23:44.417821+0000","last_undegraded":"2024-03-09T15:23:44.417821+0000","last_fullsized":"2024-03-09T15:23:44.417821+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:05.415890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'150","reported_seq":764,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.991891+0000","last_change":"2024-03-09T14:21:54.361414+0000","last_active":"2024-03-09T15:24:37.991891+0000","last_peered":"2024-03-09T15:24:37.991891+0000","last_clean":"2024-03-09T15:24:37.991891+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:24:37.991891+0000","last_undegraded":"2024-03-09T15:24:37.991891+0000","last_fullsized":"2024-03-09T15:24:37.991891+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:23:31.236227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":327,"num_read_kb":36416,"num_write":870,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.047170+0000","last_change":"2024-03-09T14:21:58.368512+0000","last_active":"2024-03-09T15:22:02.047170+0000","last_peered":"2024-03-09T15:22:02.047170+0000","last_clean":"2024-03-09T15:22:02.047170+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:22:02.047170+0000","last_undegraded":"2024-03-09T15:22:02.047170+0000","last_fullsized":"2024-03-09T15:22:02.047170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:23:42.028813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'175","reported_seq":769,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.155369+0000","last_change":"2024-03-09T14:22:00.386165+0000","last_active":"2024-03-09T15:24:38.155369+0000","last_peered":"2024-03-09T15:24:38.155369+0000","last_clean":"2024-03-09T15:24:38.155369+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:24:38.155369+0000","last_undegraded":"2024-03-09T15:24:38.155369+0000","last_fullsized":"2024-03-09T15:24:38.155369+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:03.010266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":241,"num_read_kb":303,"num_write":134,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:01.996260+0000","last_change":"2024-03-09T14:22:02.398377+0000","last_active":"2024-03-09T15:20:01.996260+0000","last_peered":"2024-03-09T15:20:01.996260+0000","last_clean":"2024-03-09T15:20:01.996260+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:20:01.996260+0000","last_undegraded":"2024-03-09T15:20:01.996260+0000","last_fullsized":"2024-03-09T15:20:01.996260+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:14:54.574464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'108","reported_seq":604,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:43.269705+0000","last_change":"2024-03-09T14:22:04.405953+0000","last_active":"2024-03-09T15:23:43.269705+0000","last_peered":"2024-03-09T15:23:43.269705+0000","last_clean":"2024-03-09T15:23:43.269705+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:23:43.269705+0000","last_undegraded":"2024-03-09T15:23:43.269705+0000","last_fullsized":"2024-03-09T15:23:43.269705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:28:15.166779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":605,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:57.162368+0000","last_change":"2024-03-09T14:21:56.352123+0000","last_active":"2024-03-09T15:21:57.162368+0000","last_peered":"2024-03-09T15:21:57.162368+0000","last_clean":"2024-03-09T15:21:57.162368+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:21:57.162368+0000","last_undegraded":"2024-03-09T15:21:57.162368+0000","last_fullsized":"2024-03-09T15:21:57.162368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:01.770090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'167","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.002458+0000","last_change":"2024-03-09T14:21:54.371725+0000","last_active":"2024-03-09T15:24:38.002458+0000","last_peered":"2024-03-09T15:24:38.002458+0000","last_clean":"2024-03-09T15:24:38.002458+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:24:38.002458+0000","last_undegraded":"2024-03-09T15:24:38.002458+0000","last_fullsized":"2024-03-09T15:24:38.002458+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:57.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":54818,"num_write":999,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.038072+0000","last_change":"2024-03-09T14:21:58.374073+0000","last_active":"2024-03-09T15:22:02.038072+0000","last_peered":"2024-03-09T15:22:02.038072+0000","last_clean":"2024-03-09T15:22:02.038072+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:22:02.038072+0000","last_undegraded":"2024-03-09T15:22:02.038072+0000","last_fullsized":"2024-03-09T15:22:02.038072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:24:43.159760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'136","reported_seq":704,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.161509+0000","last_change":"2024-03-09T14:22:00.384316+0000","last_active":"2024-03-09T15:24:38.161509+0000","last_peered":"2024-03-09T15:24:38.161509+0000","last_clean":"2024-03-09T15:24:38.161509+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:24:38.161509+0000","last_undegraded":"2024-03-09T15:24:38.161509+0000","last_fullsized":"2024-03-09T15:24:38.161509+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:49.725490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":230,"num_write":94,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:12.021797+0000","last_change":"2024-03-09T14:22:02.396214+0000","last_active":"2024-03-09T15:20:12.021797+0000","last_peered":"2024-03-09T15:20:12.021797+0000","last_clean":"2024-03-09T15:20:12.021797+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:20:12.021797+0000","last_undegraded":"2024-03-09T15:20:12.021797+0000","last_fullsized":"2024-03-09T15:20:12.021797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:36.788962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'96","reported_seq":643,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:43.124529+0000","last_change":"2024-03-09T14:22:04.402457+0000","last_active":"2024-03-09T15:22:43.124529+0000","last_peered":"2024-03-09T15:22:43.124529+0000","last_clean":"2024-03-09T15:22:43.124529+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:22:43.124529+0000","last_undegraded":"2024-03-09T15:22:43.124529+0000","last_fullsized":"2024-03-09T15:22:43.124529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:20.405079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":768,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:32.882808+0000","last_change":"2024-03-09T14:21:56.361858+0000","last_active":"2024-03-09T15:23:32.882808+0000","last_peered":"2024-03-09T15:23:32.882808+0000","last_clean":"2024-03-09T15:23:32.882808+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:23:32.882808+0000","last_undegraded":"2024-03-09T15:23:32.882808+0000","last_fullsized":"2024-03-09T15:23:32.882808+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:19:13.165526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'229","reported_seq":896,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.029490+0000","last_change":"2024-03-09T14:21:54.358944+0000","last_active":"2024-03-09T15:24:38.029490+0000","last_peered":"2024-03-09T15:24:38.029490+0000","last_clean":"2024-03-09T15:24:38.029490+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:24:38.029490+0000","last_undegraded":"2024-03-09T15:24:38.029490+0000","last_fullsized":"2024-03-09T15:24:38.029490+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:31.824683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":44740,"num_write":1211,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":503,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:02.144162+0000","last_change":"2024-03-09T14:21:58.368610+0000","last_active":"2024-03-09T15:20:02.144162+0000","last_peered":"2024-03-09T15:20:02.144162+0000","last_clean":"2024-03-09T15:20:02.144162+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:20:02.144162+0000","last_undegraded":"2024-03-09T15:20:02.144162+0000","last_fullsized":"2024-03-09T15:20:02.144162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:54.314632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'115","reported_seq":678,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.095036+0000","last_change":"2024-03-09T14:22:00.390046+0000","last_active":"2024-03-09T15:24:38.095036+0000","last_peered":"2024-03-09T15:24:38.095036+0000","last_clean":"2024-03-09T15:24:38.095036+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:24:38.095036+0000","last_undegraded":"2024-03-09T15:24:38.095036+0000","last_fullsized":"2024-03-09T15:24:38.095036+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:50.370289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":194,"num_write":70,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:02.163173+0000","last_change":"2024-03-09T14:22:02.397881+0000","last_active":"2024-03-09T15:22:02.163173+0000","last_peered":"2024-03-09T15:22:02.163173+0000","last_clean":"2024-03-09T15:22:02.163173+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:22:02.163173+0000","last_undegraded":"2024-03-09T15:22:02.163173+0000","last_fullsized":"2024-03-09T15:22:02.163173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:13.863238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'148","reported_seq":1807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.936366+0000","last_change":"2024-03-09T14:22:04.399435+0000","last_active":"2024-03-09T15:24:28.936366+0000","last_peered":"2024-03-09T15:24:28.936366+0000","last_clean":"2024-03-09T15:24:28.936366+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:24:28.936366+0000","last_undegraded":"2024-03-09T15:24:28.936366+0000","last_fullsized":"2024-03-09T15:24:28.936366+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.710673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:13.686428+0000","last_change":"2024-03-09T14:21:56.356912+0000","last_active":"2024-03-09T15:20:13.686428+0000","last_peered":"2024-03-09T15:20:13.686428+0000","last_clean":"2024-03-09T15:20:13.686428+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:20:13.686428+0000","last_undegraded":"2024-03-09T15:20:13.686428+0000","last_fullsized":"2024-03-09T15:20:13.686428+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:30.020936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'214","reported_seq":978,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.167299+0000","last_change":"2024-03-09T14:21:54.358595+0000","last_active":"2024-03-09T15:24:38.167299+0000","last_peered":"2024-03-09T15:24:38.167299+0000","last_clean":"2024-03-09T15:24:38.167299+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:24:38.167299+0000","last_undegraded":"2024-03-09T15:24:38.167299+0000","last_fullsized":"2024-03-09T15:24:38.167299+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:14.194545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284795,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":699,"num_read_kb":64460,"num_write":1159,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"32'4","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.610235+0000","last_change":"2024-03-09T14:21:58.370687+0000","last_active":"2024-03-09T15:24:37.610235+0000","last_peered":"2024-03-09T15:24:37.610235+0000","last_clean":"2024-03-09T15:24:37.610235+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:37.610235+0000","last_undegraded":"2024-03-09T15:24:37.610235+0000","last_fullsized":"2024-03-09T15:24:37.610235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:27.059761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'166","reported_seq":762,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.115773+0000","last_change":"2024-03-09T14:22:00.381012+0000","last_active":"2024-03-09T15:24:38.115773+0000","last_peered":"2024-03-09T15:24:38.115773+0000","last_clean":"2024-03-09T15:24:38.115773+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:24:38.115773+0000","last_undegraded":"2024-03-09T15:24:38.115773+0000","last_fullsized":"2024-03-09T15:24:38.115773+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:29.659729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20360,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":325,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":482,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:01.905044+0000","last_change":"2024-03-09T14:22:02.401394+0000","last_active":"2024-03-09T15:22:01.905044+0000","last_peered":"2024-03-09T15:22:01.905044+0000","last_clean":"2024-03-09T15:22:01.905044+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:22:01.905044+0000","last_undegraded":"2024-03-09T15:22:01.905044+0000","last_fullsized":"2024-03-09T15:22:01.905044+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:18:36.187213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'106","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:24.040847+0000","last_change":"2024-03-09T14:22:04.402287+0000","last_active":"2024-03-09T15:23:24.040847+0000","last_peered":"2024-03-09T15:23:24.040847+0000","last_clean":"2024-03-09T15:23:24.040847+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:23:24.040847+0000","last_undegraded":"2024-03-09T15:23:24.040847+0000","last_fullsized":"2024-03-09T15:23:24.040847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:16:54.058990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":610,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993860+0000","last_change":"2024-03-09T14:21:56.357674+0000","last_active":"2024-03-09T15:20:26.993860+0000","last_peered":"2024-03-09T15:20:26.993860+0000","last_clean":"2024-03-09T15:20:26.993860+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:20:26.993860+0000","last_undegraded":"2024-03-09T15:20:26.993860+0000","last_fullsized":"2024-03-09T15:20:26.993860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:37.979185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'182","reported_seq":992,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.976103+0000","last_change":"2024-03-09T14:21:54.367079+0000","last_active":"2024-03-09T15:24:37.976103+0000","last_peered":"2024-03-09T15:24:37.976103+0000","last_clean":"2024-03-09T15:24:37.976103+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:24:37.976103+0000","last_undegraded":"2024-03-09T15:24:37.976103+0000","last_fullsized":"2024-03-09T15:24:37.976103+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:51.408419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342104,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":789,"num_read_kb":18311,"num_write":1113,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":855,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.993837+0000","last_change":"2024-03-09T14:21:56.368289+0000","last_active":"2024-03-09T15:20:26.993837+0000","last_peered":"2024-03-09T15:20:26.993837+0000","last_clean":"2024-03-09T15:20:26.993837+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:20:26.993837+0000","last_undegraded":"2024-03-09T15:20:26.993837+0000","last_fullsized":"2024-03-09T15:20:26.993837+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:13.723494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'271","reported_seq":1083,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.121519+0000","last_change":"2024-03-09T14:21:54.359757+0000","last_active":"2024-03-09T15:24:38.121519+0000","last_peered":"2024-03-09T15:24:38.121519+0000","last_clean":"2024-03-09T15:24:38.121519+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:24:38.121519+0000","last_undegraded":"2024-03-09T15:24:38.121519+0000","last_fullsized":"2024-03-09T15:24:38.121519+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:47:57.050243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1220,"num_read_kb":137737,"num_write":1250,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.024150+0000","last_change":"2024-03-09T14:21:56.360003+0000","last_active":"2024-03-09T15:20:27.024150+0000","last_peered":"2024-03-09T15:20:27.024150+0000","last_clean":"2024-03-09T15:20:27.024150+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:20:27.024150+0000","last_undegraded":"2024-03-09T15:20:27.024150+0000","last_fullsized":"2024-03-09T15:20:27.024150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:20.950316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'163","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059260+0000","last_change":"2024-03-09T14:21:54.370800+0000","last_active":"2024-03-09T15:24:27.059260+0000","last_peered":"2024-03-09T15:24:27.059260+0000","last_clean":"2024-03-09T15:24:27.059260+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:24:27.059260+0000","last_undegraded":"2024-03-09T15:24:27.059260+0000","last_fullsized":"2024-03-09T15:24:27.059260+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:44.318284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":5631,"num_write":926,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":749,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.967315+0000","last_change":"2024-03-09T14:21:56.364838+0000","last_active":"2024-03-09T15:23:37.967315+0000","last_peered":"2024-03-09T15:23:37.967315+0000","last_clean":"2024-03-09T15:23:37.967315+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:23:37.967315+0000","last_undegraded":"2024-03-09T15:23:37.967315+0000","last_fullsized":"2024-03-09T15:23:37.967315+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:32:10.284801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'146","reported_seq":717,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:41.909791+0000","last_change":"2024-03-09T14:22:31.512263+0000","last_active":"2024-03-09T15:22:41.909791+0000","last_peered":"2024-03-09T15:22:41.909791+0000","last_clean":"2024-03-09T15:22:41.909791+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:22:41.909791+0000","last_undegraded":"2024-03-09T15:22:41.909791+0000","last_fullsized":"2024-03-09T15:22:41.909791+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:22.007571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4226579,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":2407,"num_write":836,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'203","reported_seq":834,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:37.021968+0000","last_change":"2024-03-09T14:21:56.356735+0000","last_active":"2024-03-09T15:22:37.021968+0000","last_peered":"2024-03-09T15:22:37.021968+0000","last_clean":"2024-03-09T15:22:37.021968+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:22:37.021968+0000","last_undegraded":"2024-03-09T15:22:37.021968+0000","last_fullsized":"2024-03-09T15:22:37.021968+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:40.763958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'227","reported_seq":964,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.114236+0000","last_change":"2024-03-09T14:21:54.360027+0000","last_active":"2024-03-09T15:24:38.114236+0000","last_peered":"2024-03-09T15:24:38.114236+0000","last_clean":"2024-03-09T15:24:38.114236+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:24:38.114236+0000","last_undegraded":"2024-03-09T15:24:38.114236+0000","last_fullsized":"2024-03-09T15:24:38.114236+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:39.068686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079971,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":807,"num_read_kb":22283,"num_write":1154,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.166084+0000","last_change":"2024-03-09T14:21:56.363506+0000","last_active":"2024-03-09T15:22:22.166084+0000","last_peered":"2024-03-09T15:22:22.166084+0000","last_clean":"2024-03-09T15:22:22.166084+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:22:22.166084+0000","last_undegraded":"2024-03-09T15:22:22.166084+0000","last_fullsized":"2024-03-09T15:22:22.166084+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:50.856855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'197","reported_seq":858,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.899203+0000","last_change":"2024-03-09T14:21:54.371723+0000","last_active":"2024-03-09T15:24:37.899203+0000","last_peered":"2024-03-09T15:24:37.899203+0000","last_clean":"2024-03-09T15:24:37.899203+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:24:37.899203+0000","last_undegraded":"2024-03-09T15:24:37.899203+0000","last_fullsized":"2024-03-09T15:24:37.899203+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:20.005554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":38599,"num_write":1107,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1016,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.020078+0000","last_change":"2024-03-09T14:21:56.359970+0000","last_active":"2024-03-09T15:22:22.020078+0000","last_peered":"2024-03-09T15:22:22.020078+0000","last_clean":"2024-03-09T15:22:22.020078+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:22:22.020078+0000","last_undegraded":"2024-03-09T15:22:22.020078+0000","last_fullsized":"2024-03-09T15:22:22.020078+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:09.990655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'214","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.123242+0000","last_change":"2024-03-09T14:21:54.364970+0000","last_active":"2024-03-09T15:24:38.123242+0000","last_peered":"2024-03-09T15:24:38.123242+0000","last_clean":"2024-03-09T15:24:38.123242+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:24:38.123242+0000","last_undegraded":"2024-03-09T15:24:38.123242+0000","last_fullsized":"2024-03-09T15:24:38.123242+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:09.393205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":1161,"num_write":1167,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:22.040950+0000","last_change":"2024-03-09T14:21:56.360728+0000","last_active":"2024-03-09T15:22:22.040950+0000","last_peered":"2024-03-09T15:22:22.040950+0000","last_clean":"2024-03-09T15:22:22.040950+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:22:22.040950+0000","last_undegraded":"2024-03-09T15:22:22.040950+0000","last_fullsized":"2024-03-09T15:22:22.040950+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:03:35.870767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'187","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.919978+0000","last_change":"2024-03-09T14:21:54.365980+0000","last_active":"2024-03-09T15:24:37.919978+0000","last_peered":"2024-03-09T15:24:37.919978+0000","last_clean":"2024-03-09T15:24:37.919978+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:24:37.919978+0000","last_undegraded":"2024-03-09T15:24:37.919978+0000","last_fullsized":"2024-03-09T15:24:37.919978+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:10.240743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":434,"num_read_kb":15052,"num_write":1039,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:16.998176+0000","last_change":"2024-03-09T14:23:32.139833+0000","last_active":"2024-03-09T15:20:16.998176+0000","last_peered":"2024-03-09T15:20:16.998176+0000","last_clean":"2024-03-09T15:20:16.998176+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:20:16.998176+0000","last_undegraded":"2024-03-09T15:20:16.998176+0000","last_fullsized":"2024-03-09T15:20:16.998176+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:24.028499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'174","reported_seq":806,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.044514+0000","last_change":"2024-03-09T14:21:54.370760+0000","last_active":"2024-03-09T15:22:47.044514+0000","last_peered":"2024-03-09T15:22:47.044514+0000","last_clean":"2024-03-09T15:22:47.044514+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:22:47.044514+0000","last_undegraded":"2024-03-09T15:22:47.044514+0000","last_fullsized":"2024-03-09T15:22:47.044514+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:04:48.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":2617,"num_write":1101,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'89","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:17.146608+0000","last_change":"2024-03-09T14:21:56.362263+0000","last_active":"2024-03-09T15:20:17.146608+0000","last_peered":"2024-03-09T15:20:17.146608+0000","last_clean":"2024-03-09T15:20:17.146608+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:20:17.146608+0000","last_undegraded":"2024-03-09T15:20:17.146608+0000","last_fullsized":"2024-03-09T15:20:17.146608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:54.785232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:21:01.995931+0000","last_change":"2024-03-09T14:22:31.509909+0000","last_active":"2024-03-09T15:21:01.995931+0000","last_peered":"2024-03-09T15:21:01.995931+0000","last_clean":"2024-03-09T15:21:01.995931+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:21:01.995931+0000","last_undegraded":"2024-03-09T15:21:01.995931+0000","last_fullsized":"2024-03-09T15:21:01.995931+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:26.468991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":724,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:36.993373+0000","last_change":"2024-03-09T14:21:56.361155+0000","last_active":"2024-03-09T15:20:36.993373+0000","last_peered":"2024-03-09T15:20:36.993373+0000","last_clean":"2024-03-09T15:20:36.993373+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:20:36.993373+0000","last_undegraded":"2024-03-09T15:20:36.993373+0000","last_fullsized":"2024-03-09T15:20:36.993373+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:24.944266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'157","reported_seq":763,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.029521+0000","last_change":"2024-03-09T14:21:54.359540+0000","last_active":"2024-03-09T15:24:38.029521+0000","last_peered":"2024-03-09T15:24:38.029521+0000","last_clean":"2024-03-09T15:24:38.029521+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:24:38.029521+0000","last_undegraded":"2024-03-09T15:24:38.029521+0000","last_fullsized":"2024-03-09T15:24:38.029521+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:36.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262239,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":372,"num_read_kb":3591,"num_write":919,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":615,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.148046+0000","last_change":"2024-03-09T14:21:56.357637+0000","last_active":"2024-03-09T15:20:27.148046+0000","last_peered":"2024-03-09T15:20:27.148046+0000","last_clean":"2024-03-09T15:20:27.148046+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:20:27.148046+0000","last_undegraded":"2024-03-09T15:20:27.148046+0000","last_fullsized":"2024-03-09T15:20:27.148046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:40.650943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'229","reported_seq":868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.902925+0000","last_change":"2024-03-09T14:21:54.361294+0000","last_active":"2024-03-09T15:24:37.902925+0000","last_peered":"2024-03-09T15:24:37.902925+0000","last_clean":"2024-03-09T15:24:37.902925+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:24:37.902925+0000","last_undegraded":"2024-03-09T15:24:37.902925+0000","last_fullsized":"2024-03-09T15:24:37.902925+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:03.466571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":6366,"num_write":1241,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'192","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.162762+0000","last_change":"2024-03-09T14:21:56.366542+0000","last_active":"2024-03-09T15:20:27.162762+0000","last_peered":"2024-03-09T15:20:27.162762+0000","last_clean":"2024-03-09T15:20:27.162762+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:20:27.162762+0000","last_undegraded":"2024-03-09T15:20:27.162762+0000","last_fullsized":"2024-03-09T15:20:27.162762+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:07.419936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'213","reported_seq":829,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.990601+0000","last_change":"2024-03-09T14:22:31.512292+0000","last_active":"2024-03-09T15:24:37.990601+0000","last_peered":"2024-03-09T15:24:37.990601+0000","last_clean":"2024-03-09T15:24:37.990601+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:24:37.990601+0000","last_undegraded":"2024-03-09T15:24:37.990601+0000","last_fullsized":"2024-03-09T15:24:37.990601+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:53:33.917233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343410,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":30999,"num_write":1210,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:26.999345+0000","last_change":"2024-03-09T14:21:56.371868+0000","last_active":"2024-03-09T15:20:26.999345+0000","last_peered":"2024-03-09T15:20:26.999345+0000","last_clean":"2024-03-09T15:20:26.999345+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:20:26.999345+0000","last_undegraded":"2024-03-09T15:20:26.999345+0000","last_fullsized":"2024-03-09T15:20:26.999345+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:15.221303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'188","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.022335+0000","last_change":"2024-03-09T14:21:54.364838+0000","last_active":"2024-03-09T15:24:38.022335+0000","last_peered":"2024-03-09T15:24:38.022335+0000","last_clean":"2024-03-09T15:24:38.022335+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:24:38.022335+0000","last_undegraded":"2024-03-09T15:24:38.022335+0000","last_fullsized":"2024-03-09T15:24:38.022335+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:54:49.289002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":358,"num_read_kb":8057,"num_write":1058,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:20:27.006259+0000","last_change":"2024-03-09T14:21:56.374875+0000","last_active":"2024-03-09T15:20:27.006259+0000","last_peered":"2024-03-09T15:20:27.006259+0000","last_clean":"2024-03-09T15:20:27.006259+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:20:27.006259+0000","last_undegraded":"2024-03-09T15:20:27.006259+0000","last_fullsized":"2024-03-09T15:20:27.006259+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:04.393658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'194","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.169159+0000","last_change":"2024-03-09T14:21:54.358572+0000","last_active":"2024-03-09T15:24:38.169159+0000","last_peered":"2024-03-09T15:24:38.169159+0000","last_clean":"2024-03-09T15:24:38.169159+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:24:38.169159+0000","last_undegraded":"2024-03-09T15:24:38.169159+0000","last_fullsized":"2024-03-09T15:24:38.169159+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:46:42.206920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867857,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":1771,"num_write":1080,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:08.582786+0000","last_change":"2024-03-09T14:21:56.366749+0000","last_active":"2024-03-09T15:23:08.582786+0000","last_peered":"2024-03-09T15:23:08.582786+0000","last_clean":"2024-03-09T15:23:08.582786+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:23:08.582786+0000","last_undegraded":"2024-03-09T15:23:08.582786+0000","last_fullsized":"2024-03-09T15:23:08.582786+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:28.693682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'195","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.060526+0000","last_change":"2024-03-09T14:21:54.362334+0000","last_active":"2024-03-09T15:24:38.060526+0000","last_peered":"2024-03-09T15:24:38.060526+0000","last_clean":"2024-03-09T15:24:38.060526+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:24:38.060526+0000","last_undegraded":"2024-03-09T15:24:38.060526+0000","last_fullsized":"2024-03-09T15:24:38.060526+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:07.779443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":6618,"num_write":1000,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'208","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.139077+0000","last_change":"2024-03-09T14:22:31.500572+0000","last_active":"2024-03-09T15:24:38.139077+0000","last_peered":"2024-03-09T15:24:38.139077+0000","last_clean":"2024-03-09T15:24:38.139077+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:24:38.139077+0000","last_undegraded":"2024-03-09T15:24:38.139077+0000","last_fullsized":"2024-03-09T15:24:38.139077+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:04.341433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":70161,"num_write":1223,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":919,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.091735+0000","last_change":"2024-03-09T14:21:56.373545+0000","last_active":"2024-03-09T15:23:23.091735+0000","last_peered":"2024-03-09T15:23:23.091735+0000","last_clean":"2024-03-09T15:23:23.091735+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:23:23.091735+0000","last_undegraded":"2024-03-09T15:23:23.091735+0000","last_fullsized":"2024-03-09T15:23:23.091735+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:55.978437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'195","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.005018+0000","last_change":"2024-03-09T14:21:54.366684+0000","last_active":"2024-03-09T15:24:38.005018+0000","last_peered":"2024-03-09T15:24:38.005018+0000","last_clean":"2024-03-09T15:24:38.005018+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:24:38.005018+0000","last_undegraded":"2024-03-09T15:24:38.005018+0000","last_fullsized":"2024-03-09T15:24:38.005018+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:10:50.065605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":29809,"num_write":1056,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":647,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:19:57.019819+0000","last_change":"2024-03-09T14:21:56.373920+0000","last_active":"2024-03-09T15:19:57.019819+0000","last_peered":"2024-03-09T15:19:57.019819+0000","last_clean":"2024-03-09T15:19:57.019819+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:19:57.019819+0000","last_undegraded":"2024-03-09T15:19:57.019819+0000","last_fullsized":"2024-03-09T15:19:57.019819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:31.026336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1226,"ondisk_log_size":1226,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2166,"ondisk_log_size":2166,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":556,"ondisk_log_size":556,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":248436,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":9145,"num_read_kb":11177,"num_write":6541,"num_write_kb":2993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1798,"ondisk_log_size":1798,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3747,"ondisk_log_size":3747,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":112174806,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":32019,"num_read_kb":2295864,"num_write":68252,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170090496,"data_stored":170090496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4240,"ondisk_log_size":4240,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":170575,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":174957,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575609,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319784,"kb_used_data":23364,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94052056,"statfs":{"total":96636764160,"available":96309305344,"internally_reserved":0,"allocated":23924736,"data_stored":21980799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":303430090},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575609,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276012,"kb_used_data":37944,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94095828,"statfs":{"total":96636764160,"available":96354127872,"internally_reserved":0,"allocated":38854656,"data_stored":36958563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575610,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122820,"kb_used_data":37484,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94249020,"statfs":{"total":96636764160,"available":96510996480,"internally_reserved":0,"allocated":38383616,"data_stored":36419893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575611,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118916,"kb_used_data":43312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94252924,"statfs":{"total":96636764160,"available":96514994176,"internally_reserved":0,"allocated":44351488,"data_stored":42475464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575612,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241236,"kb_used_data":29516,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94130604,"statfs":{"total":96636764160,"available":96389738496,"internally_reserved":0,"allocated":30224384,"data_stored":28300435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575611,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110268,"kb_used_data":24992,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94261572,"statfs":{"total":96636764160,"available":96523849728,"internally_reserved":0,"allocated":25591808,"data_stored":23689459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575610,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141912,"kb_used_data":34392,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94229928,"statfs":{"total":96636764160,"available":96491446272,"internally_reserved":0,"allocated":35217408,"data_stored":33306448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575608,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254460,"kb_used_data":34428,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94117380,"statfs":{"total":96636764160,"available":96376197120,"internally_reserved":0,"allocated":35254272,"data_stored":33315187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30007296,"data_stored":30007296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16187392,"data_stored":16187392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23441408,"data_stored":23441408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18432000,"data_stored":18432000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24215552,"data_stored":24215552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18083840,"data_stored":18083840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:24:45.982 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.982 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.982 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.982 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.983 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.983 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.983 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.983 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.983 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.984 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.984 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.984 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.984 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.984 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.984 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.985 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.985 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.985 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.985 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.985 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.986 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.986 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.986 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.986 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.987 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.988 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.988 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.989 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.990 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.991 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.991 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.991 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.992 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.992 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.992 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.992 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.992 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.993 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.993 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.993 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.993 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.993 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.994 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.994 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.994 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.994 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.995 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.995 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.995 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.995 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.995 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.996 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.996 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.996 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.996 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.997 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.997 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.997 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.997 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.997 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.998 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.998 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.998 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.998 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.998 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.998 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.999 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.999 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:45.999 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.000 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.000 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.000 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.000 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.000 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.000 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.001 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.001 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.001 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.001 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.001 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.002 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.002 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.002 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.002 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.002 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.002 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.003 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.003 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.003 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.003 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.004 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.004 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.004 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.004 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.004 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.005 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.005 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.005 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.005 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.005 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.006 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.006 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.006 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.006 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.006 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.006 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.007 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.007 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.007 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.007 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.007 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.007 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.008 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.008 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.008 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.008 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.008 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.008 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.009 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.009 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.009 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.009 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.009 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.009 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.010 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.010 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.010 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.010 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.010 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.011 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.011 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.011 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.011 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.012 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.012 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.012 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.013 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.013 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.013 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.014 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.014 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.015 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.015 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.015 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.015 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.015 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.015 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.016 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.016 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.016 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.016 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.016 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.016 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.017 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.017 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.017 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.017 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.017 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.018 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.018 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.018 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.018 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.018 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.018 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.019 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.019 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.020 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.020 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.020 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.020 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.020 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.021 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.021 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.021 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.021 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.021 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.021 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.022 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.022 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.022 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.022 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.022 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.022 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.023 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.023 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.023 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.023 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.023 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.023 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.024 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.025 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.025 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.025 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.025 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.025 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.025 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.026 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.026 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.026 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.026 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.026 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.026 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.027 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.027 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.027 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.027 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.027 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.027 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.028 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.028 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.028 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.028 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.028 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.028 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.029 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.029 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.029 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.029 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.029 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.029 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.030 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.030 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.030 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.030 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.030 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.030 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.031 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.032 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.032 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.032 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.032 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.032 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.032 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.033 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:21:38.278811+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=38, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.034 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.034 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.034 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.034 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.034 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.034 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.035 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.036 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.036 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.036 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.036 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.036 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.036 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.037 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.038 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.038 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.038 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.038 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.038 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.039 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.040 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.040 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.040 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.040 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.040 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.040 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.041 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.042 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.042 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.042 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.042 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.042 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.042 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.043 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.044 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.044 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.044 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.044 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.044 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.044 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.045 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.046 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.046 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.046 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.046 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.046 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.046 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.047 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.047 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.047 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.047 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.047 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.047 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.048 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.049 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.049 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.049 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.049 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.049 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.049 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.050 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.051 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.051 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.051 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.051 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.051 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.051 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.052 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.053 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.053 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.053 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.053 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.053 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.053 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.054 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.055 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.055 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.055 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.055 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.055 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.055 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:24:46.056 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:25:06.057 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:25:06.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:25:06.421 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:25:06.423 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2157,"stamp":"2024-03-09T15:25:05.160856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":146582508,"num_objects":538,"num_object_clones":0,"num_object_copies":1298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":151082,"num_read_kb":2744375,"num_write":128593,"num_write_kb":2398318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":144278,"num_omap_keys":342,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13778,"ondisk_log_size":13778,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1584984,"kb_used_data":265432,"kb_used_omap":12,"kb_used_meta":1319475,"kb_avail":753389736,"statfs":{"total":773094113280,"available":771471089664,"internally_reserved":0,"allocated":271802368,"data_stored":256446248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1351142960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":137847,"num_omap_keys":325,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005651"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:37.043210+0000","last_change":"2024-03-09T14:50:03.656802+0000","last_active":"2024-03-09T15:22:37.043210+0000","last_peered":"2024-03-09T15:22:37.043210+0000","last_clean":"2024-03-09T15:22:37.043210+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:22:37.043210+0000","last_undegraded":"2024-03-09T15:22:37.043210+0000","last_fullsized":"2024-03-09T15:22:37.043210+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'8","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.053042+0000","last_change":"2024-03-09T14:35:55.601961+0000","last_active":"2024-03-09T15:24:38.053042+0000","last_peered":"2024-03-09T15:24:38.053042+0000","last_clean":"2024-03-09T15:24:38.053042+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:24:38.053042+0000","last_undegraded":"2024-03-09T15:24:38.053042+0000","last_fullsized":"2024-03-09T15:24:38.053042+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.522125+0000","last_change":"2024-03-09T15:24:45.522159+0000","last_active":"2024-03-09T15:24:45.522125+0000","last_peered":"2024-03-09T15:24:45.522125+0000","last_clean":"2024-03-09T15:24:45.522125+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:24:45.522125+0000","last_undegraded":"2024-03-09T15:24:45.522125+0000","last_fullsized":"2024-03-09T15:24:45.522125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:45.522026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:45.522026+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.522026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:01.025473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":96,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.400622+0000","last_change":"2024-03-09T15:24:42.400651+0000","last_active":"2024-03-09T15:24:42.400622+0000","last_peered":"2024-03-09T15:24:42.400622+0000","last_clean":"2024-03-09T15:24:42.400622+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:24:42.400622+0000","last_undegraded":"2024-03-09T15:24:42.400622+0000","last_fullsized":"2024-03-09T15:24:42.400622+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:42.400547+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:42.400547+0000","last_clean_scrub_stamp":"2024-03-09T15:24:42.400547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:59.057207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:37.005188+0000","last_change":"2024-03-09T14:50:03.659762+0000","last_active":"2024-03-09T15:22:37.005188+0000","last_peered":"2024-03-09T15:22:37.005188+0000","last_clean":"2024-03-09T15:22:37.005188+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:22:37.005188+0000","last_undegraded":"2024-03-09T15:22:37.005188+0000","last_fullsized":"2024-03-09T15:22:37.005188+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.175523+0000","last_change":"2024-03-09T14:35:55.598964+0000","last_active":"2024-03-09T15:23:27.175523+0000","last_peered":"2024-03-09T15:23:27.175523+0000","last_clean":"2024-03-09T15:23:27.175523+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:23:27.175523+0000","last_undegraded":"2024-03-09T15:23:27.175523+0000","last_fullsized":"2024-03-09T15:23:27.175523+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.419467+0000","last_change":"2024-03-09T15:24:48.419511+0000","last_active":"2024-03-09T15:24:48.419467+0000","last_peered":"2024-03-09T15:24:48.419467+0000","last_clean":"2024-03-09T15:24:48.419467+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:24:48.419467+0000","last_undegraded":"2024-03-09T15:24:48.419467+0000","last_fullsized":"2024-03-09T15:24:48.419467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:48.419366+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:48.419366+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.419366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:11.692358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.717425+0000","last_change":"2024-03-09T15:24:58.717456+0000","last_active":"2024-03-09T15:24:58.717425+0000","last_peered":"2024-03-09T15:24:58.717425+0000","last_clean":"2024-03-09T15:24:58.717425+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:24:58.717425+0000","last_undegraded":"2024-03-09T15:24:58.717425+0000","last_fullsized":"2024-03-09T15:24:58.717425+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'41","last_scrub_stamp":"2024-03-09T15:24:58.717334+0000","last_deep_scrub":"260'41","last_deep_scrub_stamp":"2024-03-09T15:24:58.717334+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.717334+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:04.291118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.054863+0000","last_change":"2024-03-09T14:50:03.653730+0000","last_active":"2024-03-09T15:23:57.054863+0000","last_peered":"2024-03-09T15:23:57.054863+0000","last_clean":"2024-03-09T15:23:57.054863+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:23:57.054863+0000","last_undegraded":"2024-03-09T15:23:57.054863+0000","last_fullsized":"2024-03-09T15:23:57.054863+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.175527+0000","last_change":"2024-03-09T14:35:55.635024+0000","last_active":"2024-03-09T15:24:38.175527+0000","last_peered":"2024-03-09T15:24:38.175527+0000","last_clean":"2024-03-09T15:24:38.175527+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:24:38.175527+0000","last_undegraded":"2024-03-09T15:24:38.175527+0000","last_fullsized":"2024-03-09T15:24:38.175527+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'9","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.968985+0000","last_change":"2024-03-09T14:35:50.592237+0000","last_active":"2024-03-09T15:24:37.968985+0000","last_peered":"2024-03-09T15:24:37.968985+0000","last_clean":"2024-03-09T15:24:37.968985+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:24:37.968985+0000","last_undegraded":"2024-03-09T15:24:37.968985+0000","last_fullsized":"2024-03-09T15:24:37.968985+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.486516+0000","last_change":"2024-03-09T15:24:50.486571+0000","last_active":"2024-03-09T15:24:50.486516+0000","last_peered":"2024-03-09T15:24:50.486516+0000","last_clean":"2024-03-09T15:24:50.486516+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:24:50.486516+0000","last_undegraded":"2024-03-09T15:24:50.486516+0000","last_fullsized":"2024-03-09T15:24:50.486516+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-03-09T15:24:50.486408+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-03-09T15:24:50.486408+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.486408+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:55.168821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.035300+0000","last_change":"2024-03-09T14:50:03.664715+0000","last_active":"2024-03-09T15:24:07.035300+0000","last_peered":"2024-03-09T15:24:07.035300+0000","last_clean":"2024-03-09T15:24:07.035300+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:24:07.035300+0000","last_undegraded":"2024-03-09T15:24:07.035300+0000","last_fullsized":"2024-03-09T15:24:07.035300+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'4","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.060036+0000","last_change":"2024-03-09T14:35:55.633735+0000","last_active":"2024-03-09T15:24:38.060036+0000","last_peered":"2024-03-09T15:24:38.060036+0000","last_clean":"2024-03-09T15:24:38.060036+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:24:38.060036+0000","last_undegraded":"2024-03-09T15:24:38.060036+0000","last_fullsized":"2024-03-09T15:24:38.060036+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":4,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.097878+0000","last_change":"2024-03-09T15:24:56.097903+0000","last_active":"2024-03-09T15:24:56.097878+0000","last_peered":"2024-03-09T15:24:56.097878+0000","last_clean":"2024-03-09T15:24:56.097878+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:24:56.097878+0000","last_undegraded":"2024-03-09T15:24:56.097878+0000","last_fullsized":"2024-03-09T15:24:56.097878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.097789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.097789+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.097789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:38.020173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.524498+0000","last_change":"2024-03-09T15:24:46.524522+0000","last_active":"2024-03-09T15:24:46.524498+0000","last_peered":"2024-03-09T15:24:46.524498+0000","last_clean":"2024-03-09T15:24:46.524498+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:24:46.524498+0000","last_undegraded":"2024-03-09T15:24:46.524498+0000","last_fullsized":"2024-03-09T15:24:46.524498+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-03-09T15:24:46.524416+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-03-09T15:24:46.524416+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.524416+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:58.615066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.036509+0000","last_change":"2024-03-09T14:50:03.656253+0000","last_active":"2024-03-09T15:24:17.036509+0000","last_peered":"2024-03-09T15:24:17.036509+0000","last_clean":"2024-03-09T15:24:17.036509+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:24:17.036509+0000","last_undegraded":"2024-03-09T15:24:17.036509+0000","last_fullsized":"2024-03-09T15:24:17.036509+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.081093+0000","last_change":"2024-03-09T14:35:55.603890+0000","last_active":"2024-03-09T15:24:38.081093+0000","last_peered":"2024-03-09T15:24:38.081093+0000","last_clean":"2024-03-09T15:24:38.081093+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:24:38.081093+0000","last_undegraded":"2024-03-09T15:24:38.081093+0000","last_fullsized":"2024-03-09T15:24:38.081093+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.628724+0000","last_change":"2024-03-09T15:24:56.628747+0000","last_active":"2024-03-09T15:24:56.628724+0000","last_peered":"2024-03-09T15:24:56.628724+0000","last_clean":"2024-03-09T15:24:56.628724+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:24:56.628724+0000","last_undegraded":"2024-03-09T15:24:56.628724+0000","last_fullsized":"2024-03-09T15:24:56.628724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:56.628637+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:56.628637+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.628637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:17.119574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.565793+0000","last_change":"2024-03-09T15:24:48.565834+0000","last_active":"2024-03-09T15:24:48.565793+0000","last_peered":"2024-03-09T15:24:48.565793+0000","last_clean":"2024-03-09T15:24:48.565793+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:24:48.565793+0000","last_undegraded":"2024-03-09T15:24:48.565793+0000","last_fullsized":"2024-03-09T15:24:48.565793+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'46","last_scrub_stamp":"2024-03-09T15:24:48.565702+0000","last_deep_scrub":"257'46","last_deep_scrub_stamp":"2024-03-09T15:24:48.565702+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.565702+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:18:54.025559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.012636+0000","last_change":"2024-03-09T14:50:03.661504+0000","last_active":"2024-03-09T15:23:27.012636+0000","last_peered":"2024-03-09T15:23:27.012636+0000","last_clean":"2024-03-09T15:23:27.012636+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:23:27.012636+0000","last_undegraded":"2024-03-09T15:23:27.012636+0000","last_fullsized":"2024-03-09T15:23:27.012636+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'3","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.053626+0000","last_change":"2024-03-09T14:35:55.603980+0000","last_active":"2024-03-09T15:24:38.053626+0000","last_peered":"2024-03-09T15:24:38.053626+0000","last_clean":"2024-03-09T15:24:38.053626+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:24:38.053626+0000","last_undegraded":"2024-03-09T15:24:38.053626+0000","last_fullsized":"2024-03-09T15:24:38.053626+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'12","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.031565+0000","last_change":"2024-03-09T15:24:48.031610+0000","last_active":"2024-03-09T15:24:48.031565+0000","last_peered":"2024-03-09T15:24:48.031565+0000","last_clean":"2024-03-09T15:24:48.031565+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:24:48.031565+0000","last_undegraded":"2024-03-09T15:24:48.031565+0000","last_fullsized":"2024-03-09T15:24:48.031565+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:48.031477+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:48.031477+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.031477+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:27.977465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.827683+0000","last_change":"2024-03-09T15:24:48.827736+0000","last_active":"2024-03-09T15:24:48.827683+0000","last_peered":"2024-03-09T15:24:48.827683+0000","last_clean":"2024-03-09T15:24:48.827683+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:24:48.827683+0000","last_undegraded":"2024-03-09T15:24:48.827683+0000","last_fullsized":"2024-03-09T15:24:48.827683+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-03-09T15:24:48.827568+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-03-09T15:24:48.827568+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.827568+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:08.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:37.052597+0000","last_change":"2024-03-09T14:50:03.659706+0000","last_active":"2024-03-09T15:22:37.052597+0000","last_peered":"2024-03-09T15:22:37.052597+0000","last_clean":"2024-03-09T15:22:37.052597+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:22:37.052597+0000","last_undegraded":"2024-03-09T15:22:37.052597+0000","last_fullsized":"2024-03-09T15:22:37.052597+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'5","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.956623+0000","last_change":"2024-03-09T14:35:55.605449+0000","last_active":"2024-03-09T15:24:37.956623+0000","last_peered":"2024-03-09T15:24:37.956623+0000","last_clean":"2024-03-09T15:24:37.956623+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:24:37.956623+0000","last_undegraded":"2024-03-09T15:24:37.956623+0000","last_fullsized":"2024-03-09T15:24:37.956623+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.083859+0000","last_change":"2024-03-09T15:24:52.083889+0000","last_active":"2024-03-09T15:24:52.083859+0000","last_peered":"2024-03-09T15:24:52.083859+0000","last_clean":"2024-03-09T15:24:52.083859+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:24:52.083859+0000","last_undegraded":"2024-03-09T15:24:52.083859+0000","last_fullsized":"2024-03-09T15:24:52.083859+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:24:52.083766+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:24:52.083766+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.083766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:41:18.001798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.479353+0000","last_change":"2024-03-09T15:24:47.479381+0000","last_active":"2024-03-09T15:24:47.479353+0000","last_peered":"2024-03-09T15:24:47.479353+0000","last_clean":"2024-03-09T15:24:47.479353+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:24:47.479353+0000","last_undegraded":"2024-03-09T15:24:47.479353+0000","last_fullsized":"2024-03-09T15:24:47.479353+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'51","last_scrub_stamp":"2024-03-09T15:24:47.479255+0000","last_deep_scrub":"260'51","last_deep_scrub_stamp":"2024-03-09T15:24:47.479255+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.479255+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:59.761444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:37.052637+0000","last_change":"2024-03-09T14:50:03.664828+0000","last_active":"2024-03-09T15:22:37.052637+0000","last_peered":"2024-03-09T15:22:37.052637+0000","last_clean":"2024-03-09T15:22:37.052637+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:22:37.052637+0000","last_undegraded":"2024-03-09T15:22:37.052637+0000","last_fullsized":"2024-03-09T15:22:37.052637+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.419331+0000","last_change":"2024-03-09T15:25:01.419369+0000","last_active":"2024-03-09T15:25:01.419331+0000","last_peered":"2024-03-09T15:25:01.419331+0000","last_clean":"2024-03-09T15:25:01.419331+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:25:01.419331+0000","last_undegraded":"2024-03-09T15:25:01.419331+0000","last_fullsized":"2024-03-09T15:25:01.419331+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:01.419231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:01.419231+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.419231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:30.487865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:21.914272+0000","last_change":"2024-03-09T14:35:50.593904+0000","last_active":"2024-03-09T15:23:21.914272+0000","last_peered":"2024-03-09T15:23:21.914272+0000","last_clean":"2024-03-09T15:23:21.914272+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:23:21.914272+0000","last_undegraded":"2024-03-09T15:23:21.914272+0000","last_fullsized":"2024-03-09T15:23:21.914272+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.406552+0000","last_change":"2024-03-09T15:24:47.406588+0000","last_active":"2024-03-09T15:24:47.406552+0000","last_peered":"2024-03-09T15:24:47.406552+0000","last_clean":"2024-03-09T15:24:47.406552+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:24:47.406552+0000","last_undegraded":"2024-03-09T15:24:47.406552+0000","last_fullsized":"2024-03-09T15:24:47.406552+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'58","last_scrub_stamp":"2024-03-09T15:24:47.406438+0000","last_deep_scrub":"260'58","last_deep_scrub_stamp":"2024-03-09T15:24:47.406438+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.406438+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:13.779948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.008621+0000","last_change":"2024-03-09T14:50:03.657383+0000","last_active":"2024-03-09T15:22:47.008621+0000","last_peered":"2024-03-09T15:22:47.008621+0000","last_clean":"2024-03-09T15:22:47.008621+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:22:47.008621+0000","last_undegraded":"2024-03-09T15:22:47.008621+0000","last_fullsized":"2024-03-09T15:22:47.008621+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"257'11","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.036494+0000","last_change":"2024-03-09T14:35:55.634050+0000","last_active":"2024-03-09T15:24:17.036494+0000","last_peered":"2024-03-09T15:24:17.036494+0000","last_clean":"2024-03-09T15:24:17.036494+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:24:17.036494+0000","last_undegraded":"2024-03-09T15:24:17.036494+0000","last_fullsized":"2024-03-09T15:24:17.036494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'12","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.650470+0000","last_change":"2024-03-09T15:24:52.650470+0000","last_active":"2024-03-09T15:24:52.650470+0000","last_peered":"2024-03-09T15:24:52.650470+0000","last_clean":"2024-03-09T15:24:52.650470+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:24:52.650470+0000","last_undegraded":"2024-03-09T15:24:52.650470+0000","last_fullsized":"2024-03-09T15:24:52.650470+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:52.650294+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:52.650294+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.650294+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:30.081533+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.450895+0000","last_change":"2024-03-09T15:24:45.450923+0000","last_active":"2024-03-09T15:24:45.450895+0000","last_peered":"2024-03-09T15:24:45.450895+0000","last_clean":"2024-03-09T15:24:45.450895+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:24:45.450895+0000","last_undegraded":"2024-03-09T15:24:45.450895+0000","last_fullsized":"2024-03-09T15:24:45.450895+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'33","last_scrub_stamp":"2024-03-09T15:24:45.450792+0000","last_deep_scrub":"260'33","last_deep_scrub_stamp":"2024-03-09T15:24:45.450792+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.450792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:44.369163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.006152+0000","last_change":"2024-03-09T14:50:03.655189+0000","last_active":"2024-03-09T15:22:47.006152+0000","last_peered":"2024-03-09T15:22:47.006152+0000","last_clean":"2024-03-09T15:22:47.006152+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:22:47.006152+0000","last_undegraded":"2024-03-09T15:22:47.006152+0000","last_fullsized":"2024-03-09T15:22:47.006152+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:52.024081+0000","last_change":"2024-03-09T14:35:55.633676+0000","last_active":"2024-03-09T15:22:52.024081+0000","last_peered":"2024-03-09T15:22:52.024081+0000","last_clean":"2024-03-09T15:22:52.024081+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:22:52.024081+0000","last_undegraded":"2024-03-09T15:22:52.024081+0000","last_fullsized":"2024-03-09T15:22:52.024081+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.481646+0000","last_change":"2024-03-09T15:24:49.481688+0000","last_active":"2024-03-09T15:24:49.481646+0000","last_peered":"2024-03-09T15:24:49.481646+0000","last_clean":"2024-03-09T15:24:49.481646+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:24:49.481646+0000","last_undegraded":"2024-03-09T15:24:49.481646+0000","last_fullsized":"2024-03-09T15:24:49.481646+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:24:49.481517+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:24:49.481517+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.481517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:43.451279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":104,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.537408+0000","last_change":"2024-03-09T15:24:47.537434+0000","last_active":"2024-03-09T15:24:47.537408+0000","last_peered":"2024-03-09T15:24:47.537408+0000","last_clean":"2024-03-09T15:24:47.537408+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:24:47.537408+0000","last_undegraded":"2024-03-09T15:24:47.537408+0000","last_fullsized":"2024-03-09T15:24:47.537408+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'20","last_scrub_stamp":"2024-03-09T15:24:47.537299+0000","last_deep_scrub":"260'20","last_deep_scrub_stamp":"2024-03-09T15:24:47.537299+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.537299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:09.169841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.053936+0000","last_change":"2024-03-09T14:50:03.658035+0000","last_active":"2024-03-09T15:22:47.053936+0000","last_peered":"2024-03-09T15:22:47.053936+0000","last_clean":"2024-03-09T15:22:47.053936+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:22:47.053936+0000","last_undegraded":"2024-03-09T15:22:47.053936+0000","last_fullsized":"2024-03-09T15:22:47.053936+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'6","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.108150+0000","last_change":"2024-03-09T14:35:55.636071+0000","last_active":"2024-03-09T15:24:38.108150+0000","last_peered":"2024-03-09T15:24:38.108150+0000","last_clean":"2024-03-09T15:24:38.108150+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:24:38.108150+0000","last_undegraded":"2024-03-09T15:24:38.108150+0000","last_fullsized":"2024-03-09T15:24:38.108150+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:12.014720+0000","last_change":"2024-03-09T14:35:50.592957+0000","last_active":"2024-03-09T15:24:12.014720+0000","last_peered":"2024-03-09T15:24:12.014720+0000","last_clean":"2024-03-09T15:24:12.014720+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:24:12.014720+0000","last_undegraded":"2024-03-09T15:24:12.014720+0000","last_fullsized":"2024-03-09T15:24:12.014720+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.717930+0000","last_change":"2024-03-09T15:24:56.717957+0000","last_active":"2024-03-09T15:24:56.717930+0000","last_peered":"2024-03-09T15:24:56.717930+0000","last_clean":"2024-03-09T15:24:56.717930+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:24:56.717930+0000","last_undegraded":"2024-03-09T15:24:56.717930+0000","last_fullsized":"2024-03-09T15:24:56.717930+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:56.717838+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:56.717838+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.717838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:47.629611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:47.044585+0000","last_change":"2024-03-09T14:50:03.654352+0000","last_active":"2024-03-09T15:22:47.044585+0000","last_peered":"2024-03-09T15:22:47.044585+0000","last_clean":"2024-03-09T15:22:47.044585+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:22:47.044585+0000","last_undegraded":"2024-03-09T15:22:47.044585+0000","last_fullsized":"2024-03-09T15:22:47.044585+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.182423+0000","last_change":"2024-03-09T14:35:55.604280+0000","last_active":"2024-03-09T15:24:17.182423+0000","last_peered":"2024-03-09T15:24:17.182423+0000","last_clean":"2024-03-09T15:24:17.182423+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:24:17.182423+0000","last_undegraded":"2024-03-09T15:24:17.182423+0000","last_fullsized":"2024-03-09T15:24:17.182423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.507131+0000","last_change":"2024-03-09T15:24:48.507155+0000","last_active":"2024-03-09T15:24:48.507131+0000","last_peered":"2024-03-09T15:24:48.507131+0000","last_clean":"2024-03-09T15:24:48.507131+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:24:48.507131+0000","last_undegraded":"2024-03-09T15:24:48.507131+0000","last_fullsized":"2024-03-09T15:24:48.507131+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:48.507040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:48.507040+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.507040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:49.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.632388+0000","last_change":"2024-03-09T15:24:56.632388+0000","last_active":"2024-03-09T15:24:56.632388+0000","last_peered":"2024-03-09T15:24:56.632388+0000","last_clean":"2024-03-09T15:24:56.632388+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:24:56.632388+0000","last_undegraded":"2024-03-09T15:24:56.632388+0000","last_fullsized":"2024-03-09T15:24:56.632388+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'68","last_scrub_stamp":"2024-03-09T15:24:56.632230+0000","last_deep_scrub":"260'68","last_deep_scrub_stamp":"2024-03-09T15:24:56.632230+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.632230+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:56:00.995890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.034269+0000","last_change":"2024-03-09T14:50:03.655960+0000","last_active":"2024-03-09T15:23:57.034269+0000","last_peered":"2024-03-09T15:23:57.034269+0000","last_clean":"2024-03-09T15:23:57.034269+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:23:57.034269+0000","last_undegraded":"2024-03-09T15:23:57.034269+0000","last_fullsized":"2024-03-09T15:23:57.034269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":48,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756581+0000","last_change":"2024-03-09T14:35:55.606840+0000","last_active":"2024-03-09T15:24:42.756581+0000","last_peered":"2024-03-09T15:24:42.756581+0000","last_clean":"2024-03-09T15:24:42.756581+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:24:42.756581+0000","last_undegraded":"2024-03-09T15:24:42.756581+0000","last_fullsized":"2024-03-09T15:24:42.756581+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.046238+0000","last_change":"2024-03-09T15:25:00.046263+0000","last_active":"2024-03-09T15:25:00.046238+0000","last_peered":"2024-03-09T15:25:00.046238+0000","last_clean":"2024-03-09T15:25:00.046238+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:25:00.046238+0000","last_undegraded":"2024-03-09T15:25:00.046238+0000","last_fullsized":"2024-03-09T15:25:00.046238+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.046150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.046150+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.046150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:06.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.658475+0000","last_change":"2024-03-09T15:24:57.658502+0000","last_active":"2024-03-09T15:24:57.658475+0000","last_peered":"2024-03-09T15:24:57.658475+0000","last_clean":"2024-03-09T15:24:57.658475+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:24:57.658475+0000","last_undegraded":"2024-03-09T15:24:57.658475+0000","last_fullsized":"2024-03-09T15:24:57.658475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:57.658385+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:57.658385+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.658385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:19.298012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:56.918361+0000","last_change":"2024-03-09T14:50:03.660277+0000","last_active":"2024-03-09T15:23:56.918361+0000","last_peered":"2024-03-09T15:23:56.918361+0000","last_clean":"2024-03-09T15:23:56.918361+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:23:56.918361+0000","last_undegraded":"2024-03-09T15:23:56.918361+0000","last_fullsized":"2024-03-09T15:23:56.918361+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756575+0000","last_change":"2024-03-09T14:35:55.600712+0000","last_active":"2024-03-09T15:24:42.756575+0000","last_peered":"2024-03-09T15:24:42.756575+0000","last_clean":"2024-03-09T15:24:42.756575+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:24:42.756575+0000","last_undegraded":"2024-03-09T15:24:42.756575+0000","last_fullsized":"2024-03-09T15:24:42.756575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.544199+0000","last_change":"2024-03-09T15:24:49.544199+0000","last_active":"2024-03-09T15:24:49.544199+0000","last_peered":"2024-03-09T15:24:49.544199+0000","last_clean":"2024-03-09T15:24:49.544199+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:24:49.544199+0000","last_undegraded":"2024-03-09T15:24:49.544199+0000","last_fullsized":"2024-03-09T15:24:49.544199+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:49.544081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:49.544081+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.544081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:56.633076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.514486+0000","last_change":"2024-03-09T15:24:49.514524+0000","last_active":"2024-03-09T15:24:49.514486+0000","last_peered":"2024-03-09T15:24:49.514486+0000","last_clean":"2024-03-09T15:24:49.514486+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:24:49.514486+0000","last_undegraded":"2024-03-09T15:24:49.514486+0000","last_fullsized":"2024-03-09T15:24:49.514486+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'26","last_scrub_stamp":"2024-03-09T15:24:49.514387+0000","last_deep_scrub":"260'26","last_deep_scrub_stamp":"2024-03-09T15:24:49.514387+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.514387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:53.197965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:01.912126+0000","last_change":"2024-03-09T14:50:03.662986+0000","last_active":"2024-03-09T15:23:01.912126+0000","last_peered":"2024-03-09T15:23:01.912126+0000","last_clean":"2024-03-09T15:23:01.912126+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:23:01.912126+0000","last_undegraded":"2024-03-09T15:23:01.912126+0000","last_fullsized":"2024-03-09T15:23:01.912126+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704583+0000","last_change":"2024-03-09T14:35:55.606971+0000","last_active":"2024-03-09T15:24:43.704583+0000","last_peered":"2024-03-09T15:24:43.704583+0000","last_clean":"2024-03-09T15:24:43.704583+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:24:43.704583+0000","last_undegraded":"2024-03-09T15:24:43.704583+0000","last_fullsized":"2024-03-09T15:24:43.704583+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.123435+0000","last_change":"2024-03-09T14:35:50.581340+0000","last_active":"2024-03-09T15:24:45.123435+0000","last_peered":"2024-03-09T15:24:45.123435+0000","last_clean":"2024-03-09T15:24:45.123435+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:24:45.123435+0000","last_undegraded":"2024-03-09T15:24:45.123435+0000","last_fullsized":"2024-03-09T15:24:45.123435+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'84","reported_seq":308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.084821+0000","last_change":"2024-03-09T15:24:46.084885+0000","last_active":"2024-03-09T15:24:46.084821+0000","last_peered":"2024-03-09T15:24:46.084821+0000","last_clean":"2024-03-09T15:24:46.084821+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:24:46.084821+0000","last_undegraded":"2024-03-09T15:24:46.084821+0000","last_fullsized":"2024-03-09T15:24:46.084821+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-03-09T15:24:46.084709+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-03-09T15:24:46.084709+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.084709+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:24.008976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":991,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.034225+0000","last_change":"2024-03-09T14:50:03.654675+0000","last_active":"2024-03-09T15:23:57.034225+0000","last_peered":"2024-03-09T15:23:57.034225+0000","last_clean":"2024-03-09T15:23:57.034225+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:23:57.034225+0000","last_undegraded":"2024-03-09T15:23:57.034225+0000","last_fullsized":"2024-03-09T15:23:57.034225+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'5","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.123488+0000","last_change":"2024-03-09T14:35:55.607431+0000","last_active":"2024-03-09T15:24:45.123488+0000","last_peered":"2024-03-09T15:24:45.123488+0000","last_clean":"2024-03-09T15:24:45.123488+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:24:45.123488+0000","last_undegraded":"2024-03-09T15:24:45.123488+0000","last_fullsized":"2024-03-09T15:24:45.123488+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.653606+0000","last_change":"2024-03-09T15:25:00.653633+0000","last_active":"2024-03-09T15:25:00.653606+0000","last_peered":"2024-03-09T15:25:00.653606+0000","last_clean":"2024-03-09T15:25:00.653606+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:25:00.653606+0000","last_undegraded":"2024-03-09T15:25:00.653606+0000","last_fullsized":"2024-03-09T15:25:00.653606+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.653510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.653510+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.653510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:05.772843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.484001+0000","last_change":"2024-03-09T15:24:51.484043+0000","last_active":"2024-03-09T15:24:51.484001+0000","last_peered":"2024-03-09T15:24:51.484001+0000","last_clean":"2024-03-09T15:24:51.484001+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:24:51.484001+0000","last_undegraded":"2024-03-09T15:24:51.484001+0000","last_fullsized":"2024-03-09T15:24:51.484001+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:24:51.483908+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:24:51.483908+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.483908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:36:33.766400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.230022+0000","last_change":"2024-03-09T14:50:03.655565+0000","last_active":"2024-03-09T15:24:43.230022+0000","last_peered":"2024-03-09T15:24:43.230022+0000","last_clean":"2024-03-09T15:24:43.230022+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:24:43.230022+0000","last_undegraded":"2024-03-09T15:24:43.230022+0000","last_fullsized":"2024-03-09T15:24:43.230022+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'8","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.435849+0000","last_change":"2024-03-09T15:24:57.435905+0000","last_active":"2024-03-09T15:24:57.435849+0000","last_peered":"2024-03-09T15:24:57.435849+0000","last_clean":"2024-03-09T15:24:57.435849+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:24:57.435849+0000","last_undegraded":"2024-03-09T15:24:57.435849+0000","last_fullsized":"2024-03-09T15:24:57.435849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:57.435719+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:57.435719+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.435719+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:31.333096+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'8","reported_seq":70,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.515879+0000","last_change":"2024-03-09T15:24:48.515906+0000","last_active":"2024-03-09T15:24:48.515879+0000","last_peered":"2024-03-09T15:24:48.515879+0000","last_clean":"2024-03-09T15:24:48.515879+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:24:48.515879+0000","last_undegraded":"2024-03-09T15:24:48.515879+0000","last_fullsized":"2024-03-09T15:24:48.515879+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:48.515771+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:48.515771+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.515771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:02.694004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6842,"num_write":13,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.498428+0000","last_change":"2024-03-09T15:24:44.498449+0000","last_active":"2024-03-09T15:24:44.498428+0000","last_peered":"2024-03-09T15:24:44.498428+0000","last_clean":"2024-03-09T15:24:44.498428+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:24:44.498428+0000","last_undegraded":"2024-03-09T15:24:44.498428+0000","last_fullsized":"2024-03-09T15:24:44.498428+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-03-09T15:24:44.498349+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-03-09T15:24:44.498349+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.498349+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:01.790715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.063082+0000","last_change":"2024-03-09T14:50:03.664102+0000","last_active":"2024-03-09T15:23:52.063082+0000","last_peered":"2024-03-09T15:23:52.063082+0000","last_clean":"2024-03-09T15:23:52.063082+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:23:52.063082+0000","last_undegraded":"2024-03-09T15:23:52.063082+0000","last_fullsized":"2024-03-09T15:23:52.063082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.054124+0000","last_change":"2024-03-09T14:36:32.678035+0000","last_active":"2024-03-09T15:23:52.054124+0000","last_peered":"2024-03-09T15:23:52.054124+0000","last_clean":"2024-03-09T15:23:52.054124+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:23:52.054124+0000","last_undegraded":"2024-03-09T15:23:52.054124+0000","last_fullsized":"2024-03-09T15:23:52.054124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:07.008304+0000","last_change":"2024-03-09T14:35:50.593689+0000","last_active":"2024-03-09T15:23:07.008304+0000","last_peered":"2024-03-09T15:23:07.008304+0000","last_clean":"2024-03-09T15:23:07.008304+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:23:07.008304+0000","last_undegraded":"2024-03-09T15:23:07.008304+0000","last_fullsized":"2024-03-09T15:23:07.008304+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.502021+0000","last_change":"2024-03-09T15:24:48.502021+0000","last_active":"2024-03-09T15:24:48.502021+0000","last_peered":"2024-03-09T15:24:48.502021+0000","last_clean":"2024-03-09T15:24:48.502021+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:24:48.502021+0000","last_undegraded":"2024-03-09T15:24:48.502021+0000","last_fullsized":"2024-03-09T15:24:48.502021+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:48.501862+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:48.501862+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.501862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:24:45.310952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.123501+0000","last_change":"2024-03-09T14:50:03.658657+0000","last_active":"2024-03-09T15:24:45.123501+0000","last_peered":"2024-03-09T15:24:45.123501+0000","last_clean":"2024-03-09T15:24:45.123501+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:24:45.123501+0000","last_undegraded":"2024-03-09T15:24:45.123501+0000","last_fullsized":"2024-03-09T15:24:45.123501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:22.012143+0000","last_change":"2024-03-09T14:35:55.635179+0000","last_active":"2024-03-09T15:23:22.012143+0000","last_peered":"2024-03-09T15:23:22.012143+0000","last_clean":"2024-03-09T15:23:22.012143+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:23:22.012143+0000","last_undegraded":"2024-03-09T15:23:22.012143+0000","last_fullsized":"2024-03-09T15:23:22.012143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.700378+0000","last_change":"2024-03-09T15:25:00.700402+0000","last_active":"2024-03-09T15:25:00.700378+0000","last_peered":"2024-03-09T15:25:00.700378+0000","last_clean":"2024-03-09T15:25:00.700378+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:25:00.700378+0000","last_undegraded":"2024-03-09T15:25:00.700378+0000","last_fullsized":"2024-03-09T15:25:00.700378+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.700284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.700284+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.700284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:43.428686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":100,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.820656+0000","last_change":"2024-03-09T15:24:47.820656+0000","last_active":"2024-03-09T15:24:47.820656+0000","last_peered":"2024-03-09T15:24:47.820656+0000","last_clean":"2024-03-09T15:24:47.820656+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:24:47.820656+0000","last_undegraded":"2024-03-09T15:24:47.820656+0000","last_fullsized":"2024-03-09T15:24:47.820656+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:47.820481+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:47.820481+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.820481+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:00:39.801312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.597217+0000","last_change":"2024-03-09T14:50:03.657344+0000","last_active":"2024-03-09T15:24:45.597217+0000","last_peered":"2024-03-09T15:24:45.597217+0000","last_clean":"2024-03-09T15:24:45.597217+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:24:45.597217+0000","last_undegraded":"2024-03-09T15:24:45.597217+0000","last_fullsized":"2024-03-09T15:24:45.597217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.511512+0000","last_change":"2024-03-09T15:24:53.511539+0000","last_active":"2024-03-09T15:24:53.511512+0000","last_peered":"2024-03-09T15:24:53.511512+0000","last_clean":"2024-03-09T15:24:53.511512+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:24:53.511512+0000","last_undegraded":"2024-03-09T15:24:53.511512+0000","last_fullsized":"2024-03-09T15:24:53.511512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:53.511424+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:53.511424+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.511424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:52:53.208885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'2","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.400000+0000","last_change":"2024-03-09T15:24:44.400023+0000","last_active":"2024-03-09T15:24:44.400000+0000","last_peered":"2024-03-09T15:24:44.400000+0000","last_clean":"2024-03-09T15:24:44.400000+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:24:44.400000+0000","last_undegraded":"2024-03-09T15:24:44.400000+0000","last_fullsized":"2024-03-09T15:24:44.400000+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:24:44.399922+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:24:44.399922+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.399922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:48.540054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.229953+0000","last_change":"2024-03-09T14:31:01.142302+0000","last_active":"2024-03-09T15:24:43.229953+0000","last_peered":"2024-03-09T15:24:43.229953+0000","last_clean":"2024-03-09T15:24:43.229953+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:24:43.229953+0000","last_undegraded":"2024-03-09T15:24:43.229953+0000","last_fullsized":"2024-03-09T15:24:43.229953+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:31:00.115106+0000","last_clean_scrub_stamp":"2024-03-09T14:31:00.115106+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.033585+0000","last_change":"2024-03-09T14:50:03.656718+0000","last_active":"2024-03-09T15:23:52.033585+0000","last_peered":"2024-03-09T15:23:52.033585+0000","last_clean":"2024-03-09T15:23:52.033585+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:23:52.033585+0000","last_undegraded":"2024-03-09T15:23:52.033585+0000","last_fullsized":"2024-03-09T15:23:52.033585+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'8","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.989095+0000","last_change":"2024-03-09T14:35:55.603262+0000","last_active":"2024-03-09T15:24:37.989095+0000","last_peered":"2024-03-09T15:24:37.989095+0000","last_clean":"2024-03-09T15:24:37.989095+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:24:37.989095+0000","last_undegraded":"2024-03-09T15:24:37.989095+0000","last_fullsized":"2024-03-09T15:24:37.989095+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.544155+0000","last_change":"2024-03-09T15:24:52.544179+0000","last_active":"2024-03-09T15:24:52.544155+0000","last_peered":"2024-03-09T15:24:52.544155+0000","last_clean":"2024-03-09T15:24:52.544155+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:24:52.544155+0000","last_undegraded":"2024-03-09T15:24:52.544155+0000","last_fullsized":"2024-03-09T15:24:52.544155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:52.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:52.544062+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:41.480469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.475071+0000","last_change":"2024-03-09T15:24:46.475071+0000","last_active":"2024-03-09T15:24:46.475071+0000","last_peered":"2024-03-09T15:24:46.475071+0000","last_clean":"2024-03-09T15:24:46.475071+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:24:46.475071+0000","last_undegraded":"2024-03-09T15:24:46.475071+0000","last_fullsized":"2024-03-09T15:24:46.475071+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'59","last_scrub_stamp":"2024-03-09T15:24:46.474945+0000","last_deep_scrub":"260'59","last_deep_scrub_stamp":"2024-03-09T15:24:46.474945+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.474945+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:55.520901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:02.064614+0000","last_change":"2024-03-09T14:50:03.659935+0000","last_active":"2024-03-09T15:24:02.064614+0000","last_peered":"2024-03-09T15:24:02.064614+0000","last_clean":"2024-03-09T15:24:02.064614+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:24:02.064614+0000","last_undegraded":"2024-03-09T15:24:02.064614+0000","last_fullsized":"2024-03-09T15:24:02.064614+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.681497+0000","last_change":"2024-03-09T15:24:58.681525+0000","last_active":"2024-03-09T15:24:58.681497+0000","last_peered":"2024-03-09T15:24:58.681497+0000","last_clean":"2024-03-09T15:24:58.681497+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:24:58.681497+0000","last_undegraded":"2024-03-09T15:24:58.681497+0000","last_fullsized":"2024-03-09T15:24:58.681497+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:58.681405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:58.681405+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.681405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:05.460441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.352678+0000","last_change":"2024-03-09T15:24:43.352717+0000","last_active":"2024-03-09T15:24:43.352678+0000","last_peered":"2024-03-09T15:24:43.352678+0000","last_clean":"2024-03-09T15:24:43.352678+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:24:43.352678+0000","last_undegraded":"2024-03-09T15:24:43.352678+0000","last_fullsized":"2024-03-09T15:24:43.352678+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:43.352488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:43.352488+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.352488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:16.403976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":95,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.621097+0000","last_change":"2024-03-09T15:24:55.621123+0000","last_active":"2024-03-09T15:24:55.621097+0000","last_peered":"2024-03-09T15:24:55.621097+0000","last_clean":"2024-03-09T15:24:55.621097+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:24:55.621097+0000","last_undegraded":"2024-03-09T15:24:55.621097+0000","last_fullsized":"2024-03-09T15:24:55.621097+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:55.621006+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:55.621006+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.621006+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:32.384038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.063106+0000","last_change":"2024-03-09T14:50:03.659514+0000","last_active":"2024-03-09T15:23:52.063106+0000","last_peered":"2024-03-09T15:23:52.063106+0000","last_clean":"2024-03-09T15:23:52.063106+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:23:52.063106+0000","last_undegraded":"2024-03-09T15:23:52.063106+0000","last_fullsized":"2024-03-09T15:23:52.063106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:12.011103+0000","last_change":"2024-03-09T14:35:55.605840+0000","last_active":"2024-03-09T15:23:12.011103+0000","last_peered":"2024-03-09T15:23:12.011103+0000","last_clean":"2024-03-09T15:23:12.011103+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:23:12.011103+0000","last_undegraded":"2024-03-09T15:23:12.011103+0000","last_fullsized":"2024-03-09T15:23:12.011103+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.421009+0000","last_change":"2024-03-09T15:24:44.421031+0000","last_active":"2024-03-09T15:24:44.421009+0000","last_peered":"2024-03-09T15:24:44.421009+0000","last_clean":"2024-03-09T15:24:44.421009+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:24:44.421009+0000","last_undegraded":"2024-03-09T15:24:44.421009+0000","last_fullsized":"2024-03-09T15:24:44.421009+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:24:44.420937+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:24:44.420937+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.420937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:44.572608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":89,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.495624+0000","last_change":"2024-03-09T15:24:50.495673+0000","last_active":"2024-03-09T15:24:50.495624+0000","last_peered":"2024-03-09T15:24:50.495624+0000","last_clean":"2024-03-09T15:24:50.495624+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:24:50.495624+0000","last_undegraded":"2024-03-09T15:24:50.495624+0000","last_fullsized":"2024-03-09T15:24:50.495624+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:50.495493+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:50.495493+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.495493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:52.491490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:51.917795+0000","last_change":"2024-03-09T14:50:03.659852+0000","last_active":"2024-03-09T15:23:51.917795+0000","last_peered":"2024-03-09T15:23:51.917795+0000","last_clean":"2024-03-09T15:23:51.917795+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:23:51.917795+0000","last_undegraded":"2024-03-09T15:23:51.917795+0000","last_fullsized":"2024-03-09T15:23:51.917795+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'3","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.571013+0000","last_change":"2024-03-09T15:24:54.571044+0000","last_active":"2024-03-09T15:24:54.571013+0000","last_peered":"2024-03-09T15:24:54.571013+0000","last_clean":"2024-03-09T15:24:54.571013+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:24:54.571013+0000","last_undegraded":"2024-03-09T15:24:54.571013+0000","last_fullsized":"2024-03-09T15:24:54.571013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:54.570920+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:54.570920+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.570920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:33:44.442956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'5","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.120720+0000","last_change":"2024-03-09T14:35:50.593430+0000","last_active":"2024-03-09T15:24:38.120720+0000","last_peered":"2024-03-09T15:24:38.120720+0000","last_clean":"2024-03-09T15:24:38.120720+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:24:38.120720+0000","last_undegraded":"2024-03-09T15:24:38.120720+0000","last_fullsized":"2024-03-09T15:24:38.120720+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10280,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.810064+0000","last_change":"2024-03-09T15:24:46.810112+0000","last_active":"2024-03-09T15:24:46.810064+0000","last_peered":"2024-03-09T15:24:46.810064+0000","last_clean":"2024-03-09T15:24:46.810064+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:24:46.810064+0000","last_undegraded":"2024-03-09T15:24:46.810064+0000","last_fullsized":"2024-03-09T15:24:46.810064+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:46.809971+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:46.809971+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.809971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:01.279230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.059621+0000","last_change":"2024-03-09T14:50:03.660084+0000","last_active":"2024-03-09T15:23:27.059621+0000","last_peered":"2024-03-09T15:23:27.059621+0000","last_clean":"2024-03-09T15:23:27.059621+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:23:27.059621+0000","last_undegraded":"2024-03-09T15:23:27.059621+0000","last_fullsized":"2024-03-09T15:23:27.059621+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:11.919938+0000","last_change":"2024-03-09T14:35:55.603484+0000","last_active":"2024-03-09T15:24:11.919938+0000","last_peered":"2024-03-09T15:24:11.919938+0000","last_clean":"2024-03-09T15:24:11.919938+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:24:11.919938+0000","last_undegraded":"2024-03-09T15:24:11.919938+0000","last_fullsized":"2024-03-09T15:24:11.919938+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.526291+0000","last_change":"2024-03-09T15:24:51.526317+0000","last_active":"2024-03-09T15:24:51.526291+0000","last_peered":"2024-03-09T15:24:51.526291+0000","last_clean":"2024-03-09T15:24:51.526291+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:24:51.526291+0000","last_undegraded":"2024-03-09T15:24:51.526291+0000","last_fullsized":"2024-03-09T15:24:51.526291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'6","last_scrub_stamp":"2024-03-09T15:24:51.526195+0000","last_deep_scrub":"257'6","last_deep_scrub_stamp":"2024-03-09T15:24:51.526195+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.526195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:49.267726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":191,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.416791+0000","last_change":"2024-03-09T15:24:43.416813+0000","last_active":"2024-03-09T15:24:43.416791+0000","last_peered":"2024-03-09T15:24:43.416791+0000","last_clean":"2024-03-09T15:24:43.416791+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:24:43.416791+0000","last_undegraded":"2024-03-09T15:24:43.416791+0000","last_fullsized":"2024-03-09T15:24:43.416791+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'55","last_scrub_stamp":"2024-03-09T15:24:43.416706+0000","last_deep_scrub":"260'55","last_deep_scrub_stamp":"2024-03-09T15:24:43.416706+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.416706+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:28.604905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.050574+0000","last_change":"2024-03-09T14:50:03.664606+0000","last_active":"2024-03-09T15:23:27.050574+0000","last_peered":"2024-03-09T15:23:27.050574+0000","last_clean":"2024-03-09T15:23:27.050574+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:23:27.050574+0000","last_undegraded":"2024-03-09T15:23:27.050574+0000","last_fullsized":"2024-03-09T15:23:27.050574+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:51.917769+0000","last_change":"2024-03-09T14:35:55.633776+0000","last_active":"2024-03-09T15:23:51.917769+0000","last_peered":"2024-03-09T15:23:51.917769+0000","last_clean":"2024-03-09T15:23:51.917769+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:23:51.917769+0000","last_undegraded":"2024-03-09T15:23:51.917769+0000","last_fullsized":"2024-03-09T15:23:51.917769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.921504+0000","last_change":"2024-03-09T15:24:43.921531+0000","last_active":"2024-03-09T15:24:43.921504+0000","last_peered":"2024-03-09T15:24:43.921504+0000","last_clean":"2024-03-09T15:24:43.921504+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:24:43.921504+0000","last_undegraded":"2024-03-09T15:24:43.921504+0000","last_fullsized":"2024-03-09T15:24:43.921504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:43.921413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:43.921413+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.921413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:09:22.833429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":198,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.865629+0000","last_change":"2024-03-09T15:24:50.865684+0000","last_active":"2024-03-09T15:24:50.865629+0000","last_peered":"2024-03-09T15:24:50.865629+0000","last_clean":"2024-03-09T15:24:50.865629+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:24:50.865629+0000","last_undegraded":"2024-03-09T15:24:50.865629+0000","last_fullsized":"2024-03-09T15:24:50.865629+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'52","last_scrub_stamp":"2024-03-09T15:24:50.865508+0000","last_deep_scrub":"260'52","last_deep_scrub_stamp":"2024-03-09T15:24:50.865508+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.865508+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:21.737646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.017884+0000","last_change":"2024-03-09T14:50:03.658082+0000","last_active":"2024-03-09T15:24:17.017884+0000","last_peered":"2024-03-09T15:24:17.017884+0000","last_clean":"2024-03-09T15:24:17.017884+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:24:17.017884+0000","last_undegraded":"2024-03-09T15:24:17.017884+0000","last_fullsized":"2024-03-09T15:24:17.017884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.061080+0000","last_change":"2024-03-09T14:35:55.634847+0000","last_active":"2024-03-09T15:23:37.061080+0000","last_peered":"2024-03-09T15:23:37.061080+0000","last_clean":"2024-03-09T15:23:37.061080+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:23:37.061080+0000","last_undegraded":"2024-03-09T15:23:37.061080+0000","last_fullsized":"2024-03-09T15:23:37.061080+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.673149+0000","last_change":"2024-03-09T15:24:56.673177+0000","last_active":"2024-03-09T15:24:56.673149+0000","last_peered":"2024-03-09T15:24:56.673149+0000","last_clean":"2024-03-09T15:24:56.673149+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:24:56.673149+0000","last_undegraded":"2024-03-09T15:24:56.673149+0000","last_fullsized":"2024-03-09T15:24:56.673149+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:56.673047+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:56.673047+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.673047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:22:51.958302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.573047+0000","last_change":"2024-03-09T15:24:52.573077+0000","last_active":"2024-03-09T15:24:52.573047+0000","last_peered":"2024-03-09T15:24:52.573047+0000","last_clean":"2024-03-09T15:24:52.573047+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:24:52.573047+0000","last_undegraded":"2024-03-09T15:24:52.573047+0000","last_fullsized":"2024-03-09T15:24:52.573047+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'22","last_scrub_stamp":"2024-03-09T15:24:52.572962+0000","last_deep_scrub":"257'22","last_deep_scrub_stamp":"2024-03-09T15:24:52.572962+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.572962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:31.114327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.175431+0000","last_change":"2024-03-09T14:50:03.664652+0000","last_active":"2024-03-09T15:23:27.175431+0000","last_peered":"2024-03-09T15:23:27.175431+0000","last_clean":"2024-03-09T15:23:27.175431+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:23:27.175431+0000","last_undegraded":"2024-03-09T15:23:27.175431+0000","last_fullsized":"2024-03-09T15:23:27.175431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.969209+0000","last_change":"2024-03-09T14:35:55.606581+0000","last_active":"2024-03-09T15:24:37.969209+0000","last_peered":"2024-03-09T15:24:37.969209+0000","last_clean":"2024-03-09T15:24:37.969209+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:24:37.969209+0000","last_undegraded":"2024-03-09T15:24:37.969209+0000","last_fullsized":"2024-03-09T15:24:37.969209+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'7","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.513630+0000","last_change":"2024-03-09T15:24:47.513654+0000","last_active":"2024-03-09T15:24:47.513630+0000","last_peered":"2024-03-09T15:24:47.513630+0000","last_clean":"2024-03-09T15:24:47.513630+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:24:47.513630+0000","last_undegraded":"2024-03-09T15:24:47.513630+0000","last_fullsized":"2024-03-09T15:24:47.513630+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-03-09T15:24:47.513517+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-03-09T15:24:47.513517+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.513517+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:21:32.580098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":241,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.380052+0000","last_change":"2024-03-09T15:24:46.380077+0000","last_active":"2024-03-09T15:24:46.380052+0000","last_peered":"2024-03-09T15:24:46.380052+0000","last_clean":"2024-03-09T15:24:46.380052+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:24:46.380052+0000","last_undegraded":"2024-03-09T15:24:46.380052+0000","last_fullsized":"2024-03-09T15:24:46.380052+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'71","last_scrub_stamp":"2024-03-09T15:24:46.379972+0000","last_deep_scrub":"260'71","last_deep_scrub_stamp":"2024-03-09T15:24:46.379972+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.379972+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:38.762567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"259'1","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.230068+0000","last_change":"2024-03-09T14:50:03.659231+0000","last_active":"2024-03-09T15:24:43.230068+0000","last_peered":"2024-03-09T15:24:43.230068+0000","last_clean":"2024-03-09T15:24:43.230068+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:24:43.230068+0000","last_undegraded":"2024-03-09T15:24:43.230068+0000","last_fullsized":"2024-03-09T15:24:43.230068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'6","reported_seq":66,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.437501+0000","last_change":"2024-03-09T15:24:52.437571+0000","last_active":"2024-03-09T15:24:52.437501+0000","last_peered":"2024-03-09T15:24:52.437501+0000","last_clean":"2024-03-09T15:24:52.437501+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:24:52.437501+0000","last_undegraded":"2024-03-09T15:24:52.437501+0000","last_fullsized":"2024-03-09T15:24:52.437501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:24:52.437394+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:24:52.437394+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.437394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:42:22.375542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.495488+0000","last_change":"2024-03-09T15:24:50.495520+0000","last_active":"2024-03-09T15:24:50.495488+0000","last_peered":"2024-03-09T15:24:50.495488+0000","last_clean":"2024-03-09T15:24:50.495488+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:24:50.495488+0000","last_undegraded":"2024-03-09T15:24:50.495488+0000","last_fullsized":"2024-03-09T15:24:50.495488+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:50.495402+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:50.495402+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.495402+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:41.138717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":11,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'96","reported_seq":343,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.514847+0000","last_change":"2024-03-09T15:24:45.514877+0000","last_active":"2024-03-09T15:24:45.514847+0000","last_peered":"2024-03-09T15:24:45.514847+0000","last_clean":"2024-03-09T15:24:45.514847+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:24:45.514847+0000","last_undegraded":"2024-03-09T15:24:45.514847+0000","last_fullsized":"2024-03-09T15:24:45.514847+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'96","last_scrub_stamp":"2024-03-09T15:24:45.514758+0000","last_deep_scrub":"260'96","last_deep_scrub_stamp":"2024-03-09T15:24:45.514758+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.514758+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:31:22.175081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4649,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281875+0000","last_change":"2024-03-09T14:50:03.655635+0000","last_active":"2024-03-09T15:24:42.281875+0000","last_peered":"2024-03-09T15:24:42.281875+0000","last_clean":"2024-03-09T15:24:42.281875+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:24:42.281875+0000","last_undegraded":"2024-03-09T15:24:42.281875+0000","last_fullsized":"2024-03-09T15:24:42.281875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.056215+0000","last_change":"2024-03-09T14:35:55.599321+0000","last_active":"2024-03-09T15:24:07.056215+0000","last_peered":"2024-03-09T15:24:07.056215+0000","last_clean":"2024-03-09T15:24:07.056215+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:24:07.056215+0000","last_undegraded":"2024-03-09T15:24:07.056215+0000","last_fullsized":"2024-03-09T15:24:07.056215+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'7","reported_seq":72,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.529280+0000","last_change":"2024-03-09T15:24:46.529305+0000","last_active":"2024-03-09T15:24:46.529280+0000","last_peered":"2024-03-09T15:24:46.529280+0000","last_clean":"2024-03-09T15:24:46.529280+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:24:46.529280+0000","last_undegraded":"2024-03-09T15:24:46.529280+0000","last_fullsized":"2024-03-09T15:24:46.529280+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-03-09T15:24:46.529187+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-03-09T15:24:46.529187+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.529187+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:48:47.943384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10288,"num_write":7,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":183,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.065341+0000","last_change":"2024-03-09T15:24:45.065367+0000","last_active":"2024-03-09T15:24:45.065341+0000","last_peered":"2024-03-09T15:24:45.065341+0000","last_clean":"2024-03-09T15:24:45.065341+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:24:45.065341+0000","last_undegraded":"2024-03-09T15:24:45.065341+0000","last_fullsized":"2024-03-09T15:24:45.065341+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:45.065248+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:45.065248+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.065248+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:23.682691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:26.914935+0000","last_change":"2024-03-09T14:50:03.658063+0000","last_active":"2024-03-09T15:23:26.914935+0000","last_peered":"2024-03-09T15:23:26.914935+0000","last_clean":"2024-03-09T15:23:26.914935+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:23:26.914935+0000","last_undegraded":"2024-03-09T15:23:26.914935+0000","last_fullsized":"2024-03-09T15:23:26.914935+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.054212+0000","last_change":"2024-03-09T14:35:55.604413+0000","last_active":"2024-03-09T15:23:52.054212+0000","last_peered":"2024-03-09T15:23:52.054212+0000","last_clean":"2024-03-09T15:23:52.054212+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:23:52.054212+0000","last_undegraded":"2024-03-09T15:23:52.054212+0000","last_fullsized":"2024-03-09T15:23:52.054212+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'3","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.382037+0000","last_change":"2024-03-09T15:24:45.382059+0000","last_active":"2024-03-09T15:24:45.382037+0000","last_peered":"2024-03-09T15:24:45.382037+0000","last_clean":"2024-03-09T15:24:45.382037+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:24:45.382037+0000","last_undegraded":"2024-03-09T15:24:45.382037+0000","last_fullsized":"2024-03-09T15:24:45.382037+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:45.381961+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:45.381961+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.381961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:23.774369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":174,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.778379+0000","last_change":"2024-03-09T15:24:45.778408+0000","last_active":"2024-03-09T15:24:45.778379+0000","last_peered":"2024-03-09T15:24:45.778379+0000","last_clean":"2024-03-09T15:24:45.778379+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:24:45.778379+0000","last_undegraded":"2024-03-09T15:24:45.778379+0000","last_fullsized":"2024-03-09T15:24:45.778379+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:45.778285+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:45.778285+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.778285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:42.822410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.061038+0000","last_change":"2024-03-09T14:50:03.662160+0000","last_active":"2024-03-09T15:23:37.061038+0000","last_peered":"2024-03-09T15:23:37.061038+0000","last_clean":"2024-03-09T15:23:37.061038+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:23:37.061038+0000","last_undegraded":"2024-03-09T15:23:37.061038+0000","last_fullsized":"2024-03-09T15:23:37.061038+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.178849+0000","last_change":"2024-03-09T14:35:55.603267+0000","last_active":"2024-03-09T15:23:52.178849+0000","last_peered":"2024-03-09T15:23:52.178849+0000","last_clean":"2024-03-09T15:23:52.178849+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:23:52.178849+0000","last_undegraded":"2024-03-09T15:23:52.178849+0000","last_fullsized":"2024-03-09T15:23:52.178849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.825903+0000","last_change":"2024-03-09T15:24:49.825928+0000","last_active":"2024-03-09T15:24:49.825903+0000","last_peered":"2024-03-09T15:24:49.825903+0000","last_clean":"2024-03-09T15:24:49.825903+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:24:49.825903+0000","last_undegraded":"2024-03-09T15:24:49.825903+0000","last_fullsized":"2024-03-09T15:24:49.825903+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:49.825815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:49.825815+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.825815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:32.539779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":166,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.584578+0000","last_change":"2024-03-09T15:24:53.584614+0000","last_active":"2024-03-09T15:24:53.584578+0000","last_peered":"2024-03-09T15:24:53.584578+0000","last_clean":"2024-03-09T15:24:53.584578+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:24:53.584578+0000","last_undegraded":"2024-03-09T15:24:53.584578+0000","last_fullsized":"2024-03-09T15:24:53.584578+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'42","last_scrub_stamp":"2024-03-09T15:24:53.584460+0000","last_deep_scrub":"257'42","last_deep_scrub_stamp":"2024-03-09T15:24:53.584460+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.584460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:12.250584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'217","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.152524+0000","last_change":"2024-03-09T14:21:54.364507+0000","last_active":"2024-03-09T15:24:38.152524+0000","last_peered":"2024-03-09T15:24:38.152524+0000","last_clean":"2024-03-09T15:24:38.152524+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:24:38.152524+0000","last_undegraded":"2024-03-09T15:24:38.152524+0000","last_fullsized":"2024-03-09T15:24:38.152524+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097261,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":32250,"num_write":1232,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'370","reported_seq":1078,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059190+0000","last_change":"2024-03-09T14:21:56.357692+0000","last_active":"2024-03-09T15:24:27.059190+0000","last_peered":"2024-03-09T15:24:27.059190+0000","last_clean":"2024-03-09T15:24:27.059190+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:24:27.059190+0000","last_undegraded":"2024-03-09T15:24:27.059190+0000","last_fullsized":"2024-03-09T15:24:27.059190+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'184","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.100478+0000","last_change":"2024-03-09T14:21:54.365933+0000","last_active":"2024-03-09T15:24:38.100478+0000","last_peered":"2024-03-09T15:24:38.100478+0000","last_clean":"2024-03-09T15:24:38.100478+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:24:38.100478+0000","last_undegraded":"2024-03-09T15:24:38.100478+0000","last_fullsized":"2024-03-09T15:24:38.100478+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10770133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":33432,"num_write":993,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":832,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.068182+0000","last_change":"2024-03-09T14:21:56.371109+0000","last_active":"2024-03-09T15:24:27.068182+0000","last_peered":"2024-03-09T15:24:27.068182+0000","last_clean":"2024-03-09T15:24:27.068182+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:24:27.068182+0000","last_undegraded":"2024-03-09T15:24:27.068182+0000","last_fullsized":"2024-03-09T15:24:27.068182+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:26.921583+0000","last_change":"2024-03-09T14:21:54.357346+0000","last_active":"2024-03-09T15:24:26.921583+0000","last_peered":"2024-03-09T15:24:26.921583+0000","last_clean":"2024-03-09T15:24:26.921583+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:24:26.921583+0000","last_undegraded":"2024-03-09T15:24:26.921583+0000","last_fullsized":"2024-03-09T15:24:26.921583+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":701,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183824+0000","last_change":"2024-03-09T14:21:56.366924+0000","last_active":"2024-03-09T15:24:27.183824+0000","last_peered":"2024-03-09T15:24:27.183824+0000","last_clean":"2024-03-09T15:24:27.183824+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:24:27.183824+0000","last_undegraded":"2024-03-09T15:24:27.183824+0000","last_fullsized":"2024-03-09T15:24:27.183824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'193","reported_seq":895,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.123161+0000","last_change":"2024-03-09T14:21:54.371185+0000","last_active":"2024-03-09T15:24:38.123161+0000","last_peered":"2024-03-09T15:24:38.123161+0000","last_clean":"2024-03-09T15:24:38.123161+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:24:38.123161+0000","last_undegraded":"2024-03-09T15:24:38.123161+0000","last_fullsized":"2024-03-09T15:24:38.123161+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":557,"num_read_kb":57961,"num_write":1122,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:26.921560+0000","last_change":"2024-03-09T14:21:56.372686+0000","last_active":"2024-03-09T15:24:26.921560+0000","last_peered":"2024-03-09T15:24:26.921560+0000","last_clean":"2024-03-09T15:24:26.921560+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:24:26.921560+0000","last_undegraded":"2024-03-09T15:24:26.921560+0000","last_fullsized":"2024-03-09T15:24:26.921560+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'194","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.121848+0000","last_change":"2024-03-09T14:21:54.361340+0000","last_active":"2024-03-09T15:24:38.121848+0000","last_peered":"2024-03-09T15:24:38.121848+0000","last_clean":"2024-03-09T15:24:38.121848+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:24:38.121848+0000","last_undegraded":"2024-03-09T15:24:38.121848+0000","last_fullsized":"2024-03-09T15:24:38.121848+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":140946,"num_write":1106,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.785712+0000","last_change":"2024-03-09T15:24:58.785759+0000","last_active":"2024-03-09T15:24:58.785712+0000","last_peered":"2024-03-09T15:24:58.785712+0000","last_clean":"2024-03-09T15:24:58.785712+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:24:58.785712+0000","last_undegraded":"2024-03-09T15:24:58.785712+0000","last_fullsized":"2024-03-09T15:24:58.785712+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-03-09T15:24:58.785614+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-03-09T15:24:58.785614+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.785614+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:45.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'194","reported_seq":836,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.101442+0000","last_change":"2024-03-09T14:21:54.369817+0000","last_active":"2024-03-09T15:24:38.101442+0000","last_peered":"2024-03-09T15:24:38.101442+0000","last_clean":"2024-03-09T15:24:38.101442+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:24:38.101442+0000","last_undegraded":"2024-03-09T15:24:38.101442+0000","last_fullsized":"2024-03-09T15:24:38.101442+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":400,"num_read_kb":13387,"num_write":1038,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183945+0000","last_change":"2024-03-09T14:21:56.359071+0000","last_active":"2024-03-09T15:24:27.183945+0000","last_peered":"2024-03-09T15:24:27.183945+0000","last_clean":"2024-03-09T15:24:27.183945+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:24:27.183945+0000","last_undegraded":"2024-03-09T15:24:27.183945+0000","last_fullsized":"2024-03-09T15:24:27.183945+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.068137+0000","last_change":"2024-03-09T14:21:54.360895+0000","last_active":"2024-03-09T15:24:27.068137+0000","last_peered":"2024-03-09T15:24:27.068137+0000","last_clean":"2024-03-09T15:24:27.068137+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:24:27.068137+0000","last_undegraded":"2024-03-09T15:24:27.068137+0000","last_fullsized":"2024-03-09T15:24:27.068137+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.477878+0000","last_change":"2024-03-09T15:24:46.477905+0000","last_active":"2024-03-09T15:24:46.477878+0000","last_peered":"2024-03-09T15:24:46.477878+0000","last_clean":"2024-03-09T15:24:46.477878+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:24:46.477878+0000","last_undegraded":"2024-03-09T15:24:46.477878+0000","last_fullsized":"2024-03-09T15:24:46.477878+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-03-09T15:24:46.477782+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-03-09T15:24:46.477782+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.477782+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:21.730641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'199","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.906647+0000","last_change":"2024-03-09T14:21:54.367692+0000","last_active":"2024-03-09T15:24:37.906647+0000","last_peered":"2024-03-09T15:24:37.906647+0000","last_clean":"2024-03-09T15:24:37.906647+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:24:37.906647+0000","last_undegraded":"2024-03-09T15:24:37.906647+0000","last_fullsized":"2024-03-09T15:24:37.906647+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":42906,"num_write":1255,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.016128+0000","last_change":"2024-03-09T14:21:56.362728+0000","last_active":"2024-03-09T15:24:27.016128+0000","last_peered":"2024-03-09T15:24:27.016128+0000","last_clean":"2024-03-09T15:24:27.016128+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:24:27.016128+0000","last_undegraded":"2024-03-09T15:24:27.016128+0000","last_fullsized":"2024-03-09T15:24:27.016128+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'152","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178939+0000","last_change":"2024-03-09T14:21:56.368382+0000","last_active":"2024-03-09T15:24:44.178939+0000","last_peered":"2024-03-09T15:24:44.178939+0000","last_clean":"2024-03-09T15:24:44.178939+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:24:44.178939+0000","last_undegraded":"2024-03-09T15:24:44.178939+0000","last_fullsized":"2024-03-09T15:24:44.178939+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'172","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596476+0000","last_change":"2024-03-09T14:21:54.358160+0000","last_active":"2024-03-09T15:24:45.596476+0000","last_peered":"2024-03-09T15:24:45.596476+0000","last_clean":"2024-03-09T15:24:45.596476+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:24:45.596476+0000","last_undegraded":"2024-03-09T15:24:45.596476+0000","last_fullsized":"2024-03-09T15:24:45.596476+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":28832,"num_write":1019,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":793,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596583+0000","last_change":"2024-03-09T14:21:56.371113+0000","last_active":"2024-03-09T15:24:45.596583+0000","last_peered":"2024-03-09T15:24:45.596583+0000","last_clean":"2024-03-09T15:24:45.596583+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:24:45.596583+0000","last_undegraded":"2024-03-09T15:24:45.596583+0000","last_fullsized":"2024-03-09T15:24:45.596583+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'203","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.122996+0000","last_change":"2024-03-09T14:21:54.366475+0000","last_active":"2024-03-09T15:24:45.122996+0000","last_peered":"2024-03-09T15:24:45.122996+0000","last_clean":"2024-03-09T15:24:45.122996+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:24:45.122996+0000","last_undegraded":"2024-03-09T15:24:45.122996+0000","last_fullsized":"2024-03-09T15:24:45.122996+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322934,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":20924,"num_write":1102,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":713,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:28.392609+0000","last_change":"2024-03-09T14:21:56.362335+0000","last_active":"2024-03-09T15:24:28.392609+0000","last_peered":"2024-03-09T15:24:28.392609+0000","last_clean":"2024-03-09T15:24:28.392609+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:24:28.392609+0000","last_undegraded":"2024-03-09T15:24:28.392609+0000","last_fullsized":"2024-03-09T15:24:28.392609+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'191","reported_seq":884,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.122928+0000","last_change":"2024-03-09T14:21:54.369118+0000","last_active":"2024-03-09T15:24:45.122928+0000","last_peered":"2024-03-09T15:24:45.122928+0000","last_clean":"2024-03-09T15:24:45.122928+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:24:45.122928+0000","last_undegraded":"2024-03-09T15:24:45.122928+0000","last_fullsized":"2024-03-09T15:24:45.122928+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661148,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":129688,"num_write":1091,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'327","reported_seq":995,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.229678+0000","last_change":"2024-03-09T14:21:56.363364+0000","last_active":"2024-03-09T15:24:43.229678+0000","last_peered":"2024-03-09T15:24:43.229678+0000","last_clean":"2024-03-09T15:24:43.229678+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:24:43.229678+0000","last_undegraded":"2024-03-09T15:24:43.229678+0000","last_fullsized":"2024-03-09T15:24:43.229678+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'188","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.744902+0000","last_change":"2024-03-09T15:24:54.744942+0000","last_active":"2024-03-09T15:24:54.744902+0000","last_peered":"2024-03-09T15:24:54.744902+0000","last_clean":"2024-03-09T15:24:54.744902+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:24:54.744902+0000","last_undegraded":"2024-03-09T15:24:54.744902+0000","last_fullsized":"2024-03-09T15:24:54.744902+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-03-09T15:24:54.744799+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-03-09T15:24:54.744799+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.744799+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:01.622856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":533,"num_read_kb":17983,"num_write":1110,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.229683+0000","last_change":"2024-03-09T14:21:56.360414+0000","last_active":"2024-03-09T15:24:43.229683+0000","last_peered":"2024-03-09T15:24:43.229683+0000","last_clean":"2024-03-09T15:24:43.229683+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:24:43.229683+0000","last_undegraded":"2024-03-09T15:24:43.229683+0000","last_fullsized":"2024-03-09T15:24:43.229683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'193","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703856+0000","last_change":"2024-03-09T14:21:54.371479+0000","last_active":"2024-03-09T15:24:43.703856+0000","last_peered":"2024-03-09T15:24:43.703856+0000","last_clean":"2024-03-09T15:24:43.703856+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:24:43.703856+0000","last_undegraded":"2024-03-09T15:24:43.703856+0000","last_fullsized":"2024-03-09T15:24:43.703856+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":27148,"num_write":1016,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178955+0000","last_change":"2024-03-09T14:21:56.360518+0000","last_active":"2024-03-09T15:24:44.178955+0000","last_peered":"2024-03-09T15:24:44.178955+0000","last_clean":"2024-03-09T15:24:44.178955+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:24:44.178955+0000","last_undegraded":"2024-03-09T15:24:44.178955+0000","last_fullsized":"2024-03-09T15:24:44.178955+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.138703+0000","last_change":"2024-03-09T14:21:54.371089+0000","last_active":"2024-03-09T15:24:38.138703+0000","last_peered":"2024-03-09T15:24:38.138703+0000","last_clean":"2024-03-09T15:24:38.138703+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:24:38.138703+0000","last_undegraded":"2024-03-09T15:24:38.138703+0000","last_fullsized":"2024-03-09T15:24:38.138703+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262145,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1066,"num_read_kb":11712,"num_write":1257,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.040044+0000","last_change":"2024-03-09T15:24:47.040044+0000","last_active":"2024-03-09T15:24:47.040044+0000","last_peered":"2024-03-09T15:24:47.040044+0000","last_clean":"2024-03-09T15:24:47.040044+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:24:47.040044+0000","last_undegraded":"2024-03-09T15:24:47.040044+0000","last_fullsized":"2024-03-09T15:24:47.040044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'102","last_scrub_stamp":"2024-03-09T15:24:47.039894+0000","last_deep_scrub":"260'102","last_deep_scrub_stamp":"2024-03-09T15:24:47.039894+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.039894+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:55.824228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'115","reported_seq":717,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:52.024107+0000","last_change":"2024-03-09T14:21:56.354345+0000","last_active":"2024-03-09T15:22:52.024107+0000","last_peered":"2024-03-09T15:22:52.024107+0000","last_clean":"2024-03-09T15:22:52.024107+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:22:52.024107+0000","last_undegraded":"2024-03-09T15:22:52.024107+0000","last_fullsized":"2024-03-09T15:22:52.024107+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'208","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596402+0000","last_change":"2024-03-09T14:21:54.364329+0000","last_active":"2024-03-09T15:24:45.596402+0000","last_peered":"2024-03-09T15:24:45.596402+0000","last_clean":"2024-03-09T15:24:45.596402+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:24:45.596402+0000","last_undegraded":"2024-03-09T15:24:45.596402+0000","last_fullsized":"2024-03-09T15:24:45.596402+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537676,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":3008,"num_write":992,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651236+0000","last_change":"2024-03-09T14:21:58.369901+0000","last_active":"2024-03-09T15:24:44.651236+0000","last_peered":"2024-03-09T15:24:44.651236+0000","last_clean":"2024-03-09T15:24:44.651236+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:24:44.651236+0000","last_undegraded":"2024-03-09T15:24:44.651236+0000","last_fullsized":"2024-03-09T15:24:44.651236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'211","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281294+0000","last_change":"2024-03-09T14:22:00.387965+0000","last_active":"2024-03-09T15:24:42.281294+0000","last_peered":"2024-03-09T15:24:42.281294+0000","last_clean":"2024-03-09T15:24:42.281294+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:24:42.281294+0000","last_undegraded":"2024-03-09T15:24:42.281294+0000","last_fullsized":"2024-03-09T15:24:42.281294+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":392,"num_write":172,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596821+0000","last_change":"2024-03-09T14:22:02.391044+0000","last_active":"2024-03-09T15:24:45.596821+0000","last_peered":"2024-03-09T15:24:45.596821+0000","last_clean":"2024-03-09T15:24:45.596821+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:24:45.596821+0000","last_undegraded":"2024-03-09T15:24:45.596821+0000","last_fullsized":"2024-03-09T15:24:45.596821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2480","reported_seq":4914,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.559114+0000","last_change":"2024-03-09T15:24:51.559182+0000","last_active":"2024-03-09T15:24:51.559114+0000","last_peered":"2024-03-09T15:24:51.559114+0000","last_clean":"2024-03-09T15:24:51.559114+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:51.559114+0000","last_undegraded":"2024-03-09T15:24:51.559114+0000","last_fullsized":"2024-03-09T15:24:51.559114+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2480","last_scrub_stamp":"2024-03-09T15:24:51.559016+0000","last_deep_scrub":"260'2480","last_deep_scrub_stamp":"2024-03-09T15:24:51.559016+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.559016+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":2400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:08.961543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":767,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651064+0000","last_change":"2024-03-09T14:21:56.360757+0000","last_active":"2024-03-09T15:24:44.651064+0000","last_peered":"2024-03-09T15:24:44.651064+0000","last_clean":"2024-03-09T15:24:44.651064+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:24:44.651064+0000","last_undegraded":"2024-03-09T15:24:44.651064+0000","last_fullsized":"2024-03-09T15:24:44.651064+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'187","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.280919+0000","last_change":"2024-03-09T14:21:54.370606+0000","last_active":"2024-03-09T15:24:42.280919+0000","last_peered":"2024-03-09T15:24:42.280919+0000","last_clean":"2024-03-09T15:24:42.280919+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:24:42.280919+0000","last_undegraded":"2024-03-09T15:24:42.280919+0000","last_fullsized":"2024-03-09T15:24:42.280919+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":36262,"num_write":1057,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.024674+0000","last_change":"2024-03-09T14:21:58.370142+0000","last_active":"2024-03-09T15:22:57.024674+0000","last_peered":"2024-03-09T15:22:57.024674+0000","last_clean":"2024-03-09T15:22:57.024674+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:22:57.024674+0000","last_undegraded":"2024-03-09T15:22:57.024674+0000","last_fullsized":"2024-03-09T15:22:57.024674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'111","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.041174+0000","last_change":"2024-03-09T15:25:01.041208+0000","last_active":"2024-03-09T15:25:01.041174+0000","last_peered":"2024-03-09T15:25:01.041174+0000","last_clean":"2024-03-09T15:25:01.041174+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:25:01.041174+0000","last_undegraded":"2024-03-09T15:25:01.041174+0000","last_fullsized":"2024-03-09T15:25:01.041174+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'111","last_scrub_stamp":"2024-03-09T15:25:01.041080+0000","last_deep_scrub":"260'111","last_deep_scrub_stamp":"2024-03-09T15:25:01.041080+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.041080+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:34.578856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.067706+0000","last_change":"2024-03-09T15:24:53.067728+0000","last_active":"2024-03-09T15:24:53.067706+0000","last_peered":"2024-03-09T15:24:53.067706+0000","last_clean":"2024-03-09T15:24:53.067706+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:24:53.067706+0000","last_undegraded":"2024-03-09T15:24:53.067706+0000","last_fullsized":"2024-03-09T15:24:53.067706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.067618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.067618+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.067618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:19.960545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'118","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.668933+0000","last_change":"2024-03-09T15:24:59.668977+0000","last_active":"2024-03-09T15:24:59.668933+0000","last_peered":"2024-03-09T15:24:59.668933+0000","last_clean":"2024-03-09T15:24:59.668933+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:24:59.668933+0000","last_undegraded":"2024-03-09T15:24:59.668933+0000","last_fullsized":"2024-03-09T15:24:59.668933+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-03-09T15:24:59.668844+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-03-09T15:24:59.668844+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.668844+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:39.551493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1097,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281092+0000","last_change":"2024-03-09T14:21:56.372711+0000","last_active":"2024-03-09T15:24:42.281092+0000","last_peered":"2024-03-09T15:24:42.281092+0000","last_clean":"2024-03-09T15:24:42.281092+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:24:42.281092+0000","last_undegraded":"2024-03-09T15:24:42.281092+0000","last_fullsized":"2024-03-09T15:24:42.281092+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'173","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596384+0000","last_change":"2024-03-09T14:21:54.365114+0000","last_active":"2024-03-09T15:24:45.596384+0000","last_peered":"2024-03-09T15:24:45.596384+0000","last_clean":"2024-03-09T15:24:45.596384+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:24:45.596384+0000","last_undegraded":"2024-03-09T15:24:45.596384+0000","last_fullsized":"2024-03-09T15:24:45.596384+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269857,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":24289,"num_write":907,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704025+0000","last_change":"2024-03-09T14:21:58.372340+0000","last_active":"2024-03-09T15:24:43.704025+0000","last_peered":"2024-03-09T15:24:43.704025+0000","last_clean":"2024-03-09T15:24:43.704025+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:24:43.704025+0000","last_undegraded":"2024-03-09T15:24:43.704025+0000","last_fullsized":"2024-03-09T15:24:43.704025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'138","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.864301+0000","last_change":"2024-03-09T15:24:51.864375+0000","last_active":"2024-03-09T15:24:51.864301+0000","last_peered":"2024-03-09T15:24:51.864301+0000","last_clean":"2024-03-09T15:24:51.864301+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:24:51.864301+0000","last_undegraded":"2024-03-09T15:24:51.864301+0000","last_fullsized":"2024-03-09T15:24:51.864301+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'138","last_scrub_stamp":"2024-03-09T15:24:51.864126+0000","last_deep_scrub":"260'138","last_deep_scrub_stamp":"2024-03-09T15:24:51.864126+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.864126+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:26.206830+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'505","reported_seq":2182,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596986+0000","last_change":"2024-03-09T14:22:02.394468+0000","last_active":"2024-03-09T15:24:45.596986+0000","last_peered":"2024-03-09T15:24:45.596986+0000","last_clean":"2024-03-09T15:24:45.596986+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:24:45.596986+0000","last_undegraded":"2024-03-09T15:24:45.596986+0000","last_fullsized":"2024-03-09T15:24:45.596986+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'202","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.070390+0000","last_change":"2024-03-09T15:24:51.070423+0000","last_active":"2024-03-09T15:24:51.070390+0000","last_peered":"2024-03-09T15:24:51.070390+0000","last_clean":"2024-03-09T15:24:51.070390+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:24:51.070390+0000","last_undegraded":"2024-03-09T15:24:51.070390+0000","last_fullsized":"2024-03-09T15:24:51.070390+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-03-09T15:24:51.070293+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-03-09T15:24:51.070293+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.070293+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:13.198924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":937,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703948+0000","last_change":"2024-03-09T14:21:56.366895+0000","last_active":"2024-03-09T15:24:43.703948+0000","last_peered":"2024-03-09T15:24:43.703948+0000","last_clean":"2024-03-09T15:24:43.703948+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:24:43.703948+0000","last_undegraded":"2024-03-09T15:24:43.703948+0000","last_fullsized":"2024-03-09T15:24:43.703948+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'332","reported_seq":1057,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.122822+0000","last_change":"2024-03-09T14:21:54.366866+0000","last_active":"2024-03-09T15:24:45.122822+0000","last_peered":"2024-03-09T15:24:45.122822+0000","last_clean":"2024-03-09T15:24:45.122822+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:24:45.122822+0000","last_undegraded":"2024-03-09T15:24:45.122822+0000","last_fullsized":"2024-03-09T15:24:45.122822+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264989,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":889,"num_read_kb":69587,"num_write":1468,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651306+0000","last_change":"2024-03-09T14:21:58.370760+0000","last_active":"2024-03-09T15:24:44.651306+0000","last_peered":"2024-03-09T15:24:44.651306+0000","last_clean":"2024-03-09T15:24:44.651306+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:24:44.651306+0000","last_undegraded":"2024-03-09T15:24:44.651306+0000","last_fullsized":"2024-03-09T15:24:44.651306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'139","reported_seq":714,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596895+0000","last_change":"2024-03-09T14:22:00.494140+0000","last_active":"2024-03-09T15:24:45.596895+0000","last_peered":"2024-03-09T15:24:45.596895+0000","last_clean":"2024-03-09T15:24:45.596895+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:24:45.596895+0000","last_undegraded":"2024-03-09T15:24:45.596895+0000","last_fullsized":"2024-03-09T15:24:45.596895+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4492,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":259,"num_write":96,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'547","reported_seq":2343,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.187880+0000","last_change":"2024-03-09T14:22:02.399618+0000","last_active":"2024-03-09T15:24:38.187880+0000","last_peered":"2024-03-09T15:24:38.187880+0000","last_clean":"2024-03-09T15:24:38.187880+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:24:38.187880+0000","last_undegraded":"2024-03-09T15:24:38.187880+0000","last_fullsized":"2024-03-09T15:24:38.187880+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'167","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651049+0000","last_change":"2024-03-09T14:21:56.361954+0000","last_active":"2024-03-09T15:24:44.651049+0000","last_peered":"2024-03-09T15:24:44.651049+0000","last_clean":"2024-03-09T15:24:44.651049+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:24:44.651049+0000","last_undegraded":"2024-03-09T15:24:44.651049+0000","last_fullsized":"2024-03-09T15:24:44.651049+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'214","reported_seq":858,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.167154+0000","last_change":"2024-03-09T14:21:54.363733+0000","last_active":"2024-03-09T15:24:38.167154+0000","last_peered":"2024-03-09T15:24:38.167154+0000","last_clean":"2024-03-09T15:24:38.167154+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:24:38.167154+0000","last_undegraded":"2024-03-09T15:24:38.167154+0000","last_fullsized":"2024-03-09T15:24:38.167154+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102541,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":2831,"num_write":1215,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596681+0000","last_change":"2024-03-09T14:21:58.368654+0000","last_active":"2024-03-09T15:24:45.596681+0000","last_peered":"2024-03-09T15:24:45.596681+0000","last_clean":"2024-03-09T15:24:45.596681+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:24:45.596681+0000","last_undegraded":"2024-03-09T15:24:45.596681+0000","last_fullsized":"2024-03-09T15:24:45.596681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'240","reported_seq":876,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.697323+0000","last_change":"2024-03-09T15:24:59.697323+0000","last_active":"2024-03-09T15:24:59.697323+0000","last_peered":"2024-03-09T15:24:59.697323+0000","last_clean":"2024-03-09T15:24:59.697323+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:24:59.697323+0000","last_undegraded":"2024-03-09T15:24:59.697323+0000","last_fullsized":"2024-03-09T15:24:59.697323+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'240","last_scrub_stamp":"2024-03-09T15:24:59.697180+0000","last_deep_scrub":"260'240","last_deep_scrub_stamp":"2024-03-09T15:24:59.697180+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.697180+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:56.073618+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":331,"num_read_kb":401,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756164+0000","last_change":"2024-03-09T14:22:02.394441+0000","last_active":"2024-03-09T15:24:42.756164+0000","last_peered":"2024-03-09T15:24:42.756164+0000","last_clean":"2024-03-09T15:24:42.756164+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:24:42.756164+0000","last_undegraded":"2024-03-09T15:24:42.756164+0000","last_fullsized":"2024-03-09T15:24:42.756164+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'550","reported_seq":1367,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.584620+0000","last_change":"2024-03-09T15:24:50.584659+0000","last_active":"2024-03-09T15:24:50.584620+0000","last_peered":"2024-03-09T15:24:50.584620+0000","last_clean":"2024-03-09T15:24:50.584620+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:50.584620+0000","last_undegraded":"2024-03-09T15:24:50.584620+0000","last_fullsized":"2024-03-09T15:24:50.584620+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'550","last_scrub_stamp":"2024-03-09T15:24:50.584505+0000","last_deep_scrub":"260'550","last_deep_scrub_stamp":"2024-03-09T15:24:50.584505+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.584505+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:19:35.935216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'160","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178738+0000","last_change":"2024-03-09T14:21:56.360517+0000","last_active":"2024-03-09T15:24:44.178738+0000","last_peered":"2024-03-09T15:24:44.178738+0000","last_clean":"2024-03-09T15:24:44.178738+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:24:44.178738+0000","last_undegraded":"2024-03-09T15:24:44.178738+0000","last_fullsized":"2024-03-09T15:24:44.178738+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596348+0000","last_change":"2024-03-09T14:21:54.361313+0000","last_active":"2024-03-09T15:24:45.596348+0000","last_peered":"2024-03-09T15:24:45.596348+0000","last_clean":"2024-03-09T15:24:45.596348+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:24:45.596348+0000","last_undegraded":"2024-03-09T15:24:45.596348+0000","last_fullsized":"2024-03-09T15:24:45.596348+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.787962+0000","last_change":"2024-03-09T15:24:53.787986+0000","last_active":"2024-03-09T15:24:53.787962+0000","last_peered":"2024-03-09T15:24:53.787962+0000","last_clean":"2024-03-09T15:24:53.787962+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:24:53.787962+0000","last_undegraded":"2024-03-09T15:24:53.787962+0000","last_fullsized":"2024-03-09T15:24:53.787962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.787868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.787868+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.787868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'137","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704111+0000","last_change":"2024-03-09T14:22:00.387422+0000","last_active":"2024-03-09T15:24:43.704111+0000","last_peered":"2024-03-09T15:24:43.704111+0000","last_clean":"2024-03-09T15:24:43.704111+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:24:43.704111+0000","last_undegraded":"2024-03-09T15:24:43.704111+0000","last_fullsized":"2024-03-09T15:24:43.704111+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":254,"num_write":98,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:57.024610+0000","last_change":"2024-03-09T14:22:02.399383+0000","last_active":"2024-03-09T15:22:57.024610+0000","last_peered":"2024-03-09T15:22:57.024610+0000","last_clean":"2024-03-09T15:22:57.024610+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:22:57.024610+0000","last_undegraded":"2024-03-09T15:22:57.024610+0000","last_fullsized":"2024-03-09T15:22:57.024610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'154","reported_seq":653,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.123228+0000","last_change":"2024-03-09T14:22:04.401728+0000","last_active":"2024-03-09T15:24:45.123228+0000","last_peered":"2024-03-09T15:24:45.123228+0000","last_clean":"2024-03-09T15:24:45.123228+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:24:45.123228+0000","last_undegraded":"2024-03-09T15:24:45.123228+0000","last_fullsized":"2024-03-09T15:24:45.123228+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1078,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.704075+0000","last_change":"2024-03-09T15:25:00.704124+0000","last_active":"2024-03-09T15:25:00.704075+0000","last_peered":"2024-03-09T15:25:00.704075+0000","last_clean":"2024-03-09T15:25:00.704075+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:25:00.704075+0000","last_undegraded":"2024-03-09T15:25:00.704075+0000","last_fullsized":"2024-03-09T15:25:00.704075+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'433","last_scrub_stamp":"2024-03-09T15:25:00.703976+0000","last_deep_scrub":"260'433","last_deep_scrub_stamp":"2024-03-09T15:25:00.703976+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.703976+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:03:12.179793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'207","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596364+0000","last_change":"2024-03-09T14:21:54.370752+0000","last_active":"2024-03-09T15:24:45.596364+0000","last_peered":"2024-03-09T15:24:45.596364+0000","last_clean":"2024-03-09T15:24:45.596364+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:24:45.596364+0000","last_undegraded":"2024-03-09T15:24:45.596364+0000","last_fullsized":"2024-03-09T15:24:45.596364+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102580,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":99411,"num_write":1014,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.729301+0000","last_change":"2024-03-09T15:24:55.729301+0000","last_active":"2024-03-09T15:24:55.729301+0000","last_peered":"2024-03-09T15:24:55.729301+0000","last_clean":"2024-03-09T15:24:55.729301+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:24:55.729301+0000","last_undegraded":"2024-03-09T15:24:55.729301+0000","last_fullsized":"2024-03-09T15:24:55.729301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.729162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.729162+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.729162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:18.756282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'185","reported_seq":784,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596761+0000","last_change":"2024-03-09T14:22:00.384337+0000","last_active":"2024-03-09T15:24:45.596761+0000","last_peered":"2024-03-09T15:24:45.596761+0000","last_clean":"2024-03-09T15:24:45.596761+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:24:45.596761+0000","last_undegraded":"2024-03-09T15:24:45.596761+0000","last_fullsized":"2024-03-09T15:24:45.596761+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":304,"num_write":138,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'511","reported_seq":2136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281337+0000","last_change":"2024-03-09T14:22:02.399057+0000","last_active":"2024-03-09T15:24:42.281337+0000","last_peered":"2024-03-09T15:24:42.281337+0000","last_clean":"2024-03-09T15:24:42.281337+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:24:42.281337+0000","last_undegraded":"2024-03-09T15:24:42.281337+0000","last_fullsized":"2024-03-09T15:24:42.281337+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'145","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.674375+0000","last_change":"2024-03-09T15:24:58.674451+0000","last_active":"2024-03-09T15:24:58.674375+0000","last_peered":"2024-03-09T15:24:58.674375+0000","last_clean":"2024-03-09T15:24:58.674375+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:24:58.674375+0000","last_undegraded":"2024-03-09T15:24:58.674375+0000","last_fullsized":"2024-03-09T15:24:58.674375+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-03-09T15:24:58.674272+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-03-09T15:24:58.674272+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.674272+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:54.303141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281099+0000","last_change":"2024-03-09T14:21:56.371534+0000","last_active":"2024-03-09T15:24:42.281099+0000","last_peered":"2024-03-09T15:24:42.281099+0000","last_clean":"2024-03-09T15:24:42.281099+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:24:42.281099+0000","last_undegraded":"2024-03-09T15:24:42.281099+0000","last_fullsized":"2024-03-09T15:24:42.281099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'165","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650791+0000","last_change":"2024-03-09T14:21:54.369550+0000","last_active":"2024-03-09T15:24:44.650791+0000","last_peered":"2024-03-09T15:24:44.650791+0000","last_clean":"2024-03-09T15:24:44.650791+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:24:44.650791+0000","last_undegraded":"2024-03-09T15:24:44.650791+0000","last_fullsized":"2024-03-09T15:24:44.650791+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":41462,"num_write":961,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.699157+0000","last_change":"2024-03-09T15:24:59.699157+0000","last_active":"2024-03-09T15:24:59.699157+0000","last_peered":"2024-03-09T15:24:59.699157+0000","last_clean":"2024-03-09T15:24:59.699157+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:24:59.699157+0000","last_undegraded":"2024-03-09T15:24:59.699157+0000","last_fullsized":"2024-03-09T15:24:59.699157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:59.699022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:59.699022+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.699022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:49.773254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'217","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281273+0000","last_change":"2024-03-09T14:22:00.383682+0000","last_active":"2024-03-09T15:24:42.281273+0000","last_peered":"2024-03-09T15:24:42.281273+0000","last_clean":"2024-03-09T15:24:42.281273+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:24:42.281273+0000","last_undegraded":"2024-03-09T15:24:42.281273+0000","last_fullsized":"2024-03-09T15:24:42.281273+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11412,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":306,"num_read_kb":453,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.904270+0000","last_change":"2024-03-09T15:24:47.904270+0000","last_active":"2024-03-09T15:24:47.904270+0000","last_peered":"2024-03-09T15:24:47.904270+0000","last_clean":"2024-03-09T15:24:47.904270+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:24:47.904270+0000","last_undegraded":"2024-03-09T15:24:47.904270+0000","last_fullsized":"2024-03-09T15:24:47.904270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:47.904093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:47.904093+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.904093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:28.926895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'97","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.421523+0000","last_change":"2024-03-09T15:24:49.421523+0000","last_active":"2024-03-09T15:24:49.421523+0000","last_peered":"2024-03-09T15:24:49.421523+0000","last_clean":"2024-03-09T15:24:49.421523+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:24:49.421523+0000","last_undegraded":"2024-03-09T15:24:49.421523+0000","last_fullsized":"2024-03-09T15:24:49.421523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'97","last_scrub_stamp":"2024-03-09T15:24:49.421394+0000","last_deep_scrub":"260'97","last_deep_scrub_stamp":"2024-03-09T15:24:49.421394+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.421394+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:26.790404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":600,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178717+0000","last_change":"2024-03-09T14:21:56.352377+0000","last_active":"2024-03-09T15:24:44.178717+0000","last_peered":"2024-03-09T15:24:44.178717+0000","last_clean":"2024-03-09T15:24:44.178717+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:24:44.178717+0000","last_undegraded":"2024-03-09T15:24:44.178717+0000","last_fullsized":"2024-03-09T15:24:44.178717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'163","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.886711+0000","last_change":"2024-03-09T15:24:44.886740+0000","last_active":"2024-03-09T15:24:44.886711+0000","last_peered":"2024-03-09T15:24:44.886711+0000","last_clean":"2024-03-09T15:24:44.886711+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:24:44.886711+0000","last_undegraded":"2024-03-09T15:24:44.886711+0000","last_fullsized":"2024-03-09T15:24:44.886711+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-03-09T15:24:44.886619+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-03-09T15:24:44.886619+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.886619+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:51.439361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":87296,"num_write":884,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.733968+0000","last_change":"2024-03-09T15:24:57.733968+0000","last_active":"2024-03-09T15:24:57.733968+0000","last_peered":"2024-03-09T15:24:57.733968+0000","last_clean":"2024-03-09T15:24:57.733968+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:24:57.733968+0000","last_undegraded":"2024-03-09T15:24:57.733968+0000","last_fullsized":"2024-03-09T15:24:57.733968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.733853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.733853+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.733853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:49.813483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'174","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.034667+0000","last_change":"2024-03-09T15:24:59.034667+0000","last_active":"2024-03-09T15:24:59.034667+0000","last_peered":"2024-03-09T15:24:59.034667+0000","last_clean":"2024-03-09T15:24:59.034667+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:24:59.034667+0000","last_undegraded":"2024-03-09T15:24:59.034667+0000","last_fullsized":"2024-03-09T15:24:59.034667+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'174","last_scrub_stamp":"2024-03-09T15:24:59.034541+0000","last_deep_scrub":"260'174","last_deep_scrub_stamp":"2024-03-09T15:24:59.034541+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.034541+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:16.852793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":307,"num_write":178,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:06.912755+0000","last_change":"2024-03-09T14:22:02.404397+0000","last_active":"2024-03-09T15:23:06.912755+0000","last_peered":"2024-03-09T15:23:06.912755+0000","last_clean":"2024-03-09T15:23:06.912755+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:23:06.912755+0000","last_undegraded":"2024-03-09T15:23:06.912755+0000","last_fullsized":"2024-03-09T15:23:06.912755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'105","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.492045+0000","last_change":"2024-03-09T15:24:52.492077+0000","last_active":"2024-03-09T15:24:52.492045+0000","last_peered":"2024-03-09T15:24:52.492045+0000","last_clean":"2024-03-09T15:24:52.492045+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:24:52.492045+0000","last_undegraded":"2024-03-09T15:24:52.492045+0000","last_fullsized":"2024-03-09T15:24:52.492045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'105","last_scrub_stamp":"2024-03-09T15:24:52.491966+0000","last_deep_scrub":"260'105","last_deep_scrub_stamp":"2024-03-09T15:24:52.491966+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.491966+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:27.870108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178719+0000","last_change":"2024-03-09T14:21:56.363858+0000","last_active":"2024-03-09T15:24:44.178719+0000","last_peered":"2024-03-09T15:24:44.178719+0000","last_clean":"2024-03-09T15:24:44.178719+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:24:44.178719+0000","last_undegraded":"2024-03-09T15:24:44.178719+0000","last_fullsized":"2024-03-09T15:24:44.178719+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'175","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.122841+0000","last_change":"2024-03-09T14:21:54.361281+0000","last_active":"2024-03-09T15:24:45.122841+0000","last_peered":"2024-03-09T15:24:45.122841+0000","last_clean":"2024-03-09T15:24:45.122841+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:24:45.122841+0000","last_undegraded":"2024-03-09T15:24:45.122841+0000","last_fullsized":"2024-03-09T15:24:45.122841+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":31184,"num_write":930,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.604965+0000","last_change":"2024-03-09T15:24:58.604965+0000","last_active":"2024-03-09T15:24:58.604965+0000","last_peered":"2024-03-09T15:24:58.604965+0000","last_clean":"2024-03-09T15:24:58.604965+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:24:58.604965+0000","last_undegraded":"2024-03-09T15:24:58.604965+0000","last_fullsized":"2024-03-09T15:24:58.604965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:58.604810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:58.604810+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.604810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:23.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'203","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.904055+0000","last_change":"2024-03-09T15:24:49.904105+0000","last_active":"2024-03-09T15:24:49.904055+0000","last_peered":"2024-03-09T15:24:49.904055+0000","last_clean":"2024-03-09T15:24:49.904055+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:24:49.904055+0000","last_undegraded":"2024-03-09T15:24:49.904055+0000","last_fullsized":"2024-03-09T15:24:49.904055+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-03-09T15:24:49.903932+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-03-09T15:24:49.903932+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.903932+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:42.211020+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9198,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":342,"num_write":152,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'490","reported_seq":4313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.886883+0000","last_change":"2024-03-09T15:24:45.886883+0000","last_active":"2024-03-09T15:24:45.886883+0000","last_peered":"2024-03-09T15:24:45.886883+0000","last_clean":"2024-03-09T15:24:45.886883+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:45.886883+0000","last_undegraded":"2024-03-09T15:24:45.886883+0000","last_fullsized":"2024-03-09T15:24:45.886883+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'490","last_scrub_stamp":"2024-03-09T15:24:45.886735+0000","last_deep_scrub":"260'490","last_deep_scrub_stamp":"2024-03-09T15:24:45.886735+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.886735+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:22.443324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'206","reported_seq":739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.404175+0000","last_change":"2024-03-09T15:24:50.404230+0000","last_active":"2024-03-09T15:24:50.404175+0000","last_peered":"2024-03-09T15:24:50.404175+0000","last_clean":"2024-03-09T15:24:50.404175+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:24:50.404175+0000","last_undegraded":"2024-03-09T15:24:50.404175+0000","last_fullsized":"2024-03-09T15:24:50.404175+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-03-09T15:24:50.404077+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-03-09T15:24:50.404077+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.404077+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:52.580530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178768+0000","last_change":"2024-03-09T14:21:56.356981+0000","last_active":"2024-03-09T15:24:44.178768+0000","last_peered":"2024-03-09T15:24:44.178768+0000","last_clean":"2024-03-09T15:24:44.178768+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:24:44.178768+0000","last_undegraded":"2024-03-09T15:24:44.178768+0000","last_fullsized":"2024-03-09T15:24:44.178768+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'173","reported_seq":917,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178576+0000","last_change":"2024-03-09T14:21:54.363849+0000","last_active":"2024-03-09T15:24:44.178576+0000","last_peered":"2024-03-09T15:24:44.178576+0000","last_clean":"2024-03-09T15:24:44.178576+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:24:44.178576+0000","last_undegraded":"2024-03-09T15:24:44.178576+0000","last_fullsized":"2024-03-09T15:24:44.178576+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":987,"num_read_kb":38802,"num_write":973,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":1126,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.837580+0000","last_change":"2024-03-09T14:21:58.370397+0000","last_active":"2024-03-09T15:24:37.837580+0000","last_peered":"2024-03-09T15:24:37.837580+0000","last_clean":"2024-03-09T15:24:37.837580+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:24:37.837580+0000","last_undegraded":"2024-03-09T15:24:37.837580+0000","last_fullsized":"2024-03-09T15:24:37.837580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'90","reported_seq":624,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704042+0000","last_change":"2024-03-09T14:22:00.492690+0000","last_active":"2024-03-09T15:24:43.704042+0000","last_peered":"2024-03-09T15:24:43.704042+0000","last_clean":"2024-03-09T15:24:43.704042+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:24:43.704042+0000","last_undegraded":"2024-03-09T15:24:43.704042+0000","last_fullsized":"2024-03-09T15:24:43.704042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'507","reported_seq":2223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.896169+0000","last_change":"2024-03-09T15:24:55.896169+0000","last_active":"2024-03-09T15:24:55.896169+0000","last_peered":"2024-03-09T15:24:55.896169+0000","last_clean":"2024-03-09T15:24:55.896169+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:55.896169+0000","last_undegraded":"2024-03-09T15:24:55.896169+0000","last_fullsized":"2024-03-09T15:24:55.896169+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'507","last_scrub_stamp":"2024-03-09T15:24:55.896044+0000","last_deep_scrub":"260'507","last_deep_scrub_stamp":"2024-03-09T15:24:55.896044+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.896044+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:53.777778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.985028+0000","last_change":"2024-03-09T15:24:48.985058+0000","last_active":"2024-03-09T15:24:48.985028+0000","last_peered":"2024-03-09T15:24:48.985028+0000","last_clean":"2024-03-09T15:24:48.985028+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:24:48.985028+0000","last_undegraded":"2024-03-09T15:24:48.985028+0000","last_fullsized":"2024-03-09T15:24:48.985028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-03-09T15:24:48.984934+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-03-09T15:24:48.984934+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.984934+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:04.370133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":618,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.572487+0000","last_change":"2024-03-09T15:24:59.572515+0000","last_active":"2024-03-09T15:24:59.572487+0000","last_peered":"2024-03-09T15:24:59.572487+0000","last_clean":"2024-03-09T15:24:59.572487+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:24:59.572487+0000","last_undegraded":"2024-03-09T15:24:59.572487+0000","last_fullsized":"2024-03-09T15:24:59.572487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'50","last_scrub_stamp":"2024-03-09T15:24:59.572399+0000","last_deep_scrub":"260'50","last_deep_scrub_stamp":"2024-03-09T15:24:59.572399+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.572399+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:43.118034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'191","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703707+0000","last_change":"2024-03-09T14:21:54.368543+0000","last_active":"2024-03-09T15:24:43.703707+0000","last_peered":"2024-03-09T15:24:43.703707+0000","last_clean":"2024-03-09T15:24:43.703707+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:24:43.703707+0000","last_undegraded":"2024-03-09T15:24:43.703707+0000","last_fullsized":"2024-03-09T15:24:43.703707+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":26998,"num_write":1069,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"32'4","reported_seq":823,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.179015+0000","last_change":"2024-03-09T14:21:58.371279+0000","last_active":"2024-03-09T15:24:44.179015+0000","last_peered":"2024-03-09T15:24:44.179015+0000","last_clean":"2024-03-09T15:24:44.179015+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:24:44.179015+0000","last_undegraded":"2024-03-09T15:24:44.179015+0000","last_fullsized":"2024-03-09T15:24:44.179015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'288","reported_seq":908,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651266+0000","last_change":"2024-03-09T14:22:00.386117+0000","last_active":"2024-03-09T15:24:44.651266+0000","last_peered":"2024-03-09T15:24:44.651266+0000","last_clean":"2024-03-09T15:24:44.651266+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:24:44.651266+0000","last_undegraded":"2024-03-09T15:24:44.651266+0000","last_fullsized":"2024-03-09T15:24:44.651266+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6907,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1015,"num_read_kb":1081,"num_write":1596,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.703264+0000","last_change":"2024-03-09T15:25:01.703264+0000","last_active":"2024-03-09T15:25:01.703264+0000","last_peered":"2024-03-09T15:25:01.703264+0000","last_clean":"2024-03-09T15:25:01.703264+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:25:01.703264+0000","last_undegraded":"2024-03-09T15:25:01.703264+0000","last_fullsized":"2024-03-09T15:25:01.703264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:01.703150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:01.703150+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.703150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:08.511551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'158","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.402684+0000","last_change":"2024-03-09T15:24:51.402738+0000","last_active":"2024-03-09T15:24:51.402684+0000","last_peered":"2024-03-09T15:24:51.402684+0000","last_clean":"2024-03-09T15:24:51.402684+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:24:51.402684+0000","last_undegraded":"2024-03-09T15:24:51.402684+0000","last_fullsized":"2024-03-09T15:24:51.402684+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'158","last_scrub_stamp":"2024-03-09T15:24:51.402553+0000","last_deep_scrub":"260'158","last_deep_scrub_stamp":"2024-03-09T15:24:51.402553+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.402553+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:26.705481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.060755+0000","last_change":"2024-03-09T14:21:56.359275+0000","last_active":"2024-03-09T15:24:37.060755+0000","last_peered":"2024-03-09T15:24:37.060755+0000","last_clean":"2024-03-09T15:24:37.060755+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:24:37.060755+0000","last_undegraded":"2024-03-09T15:24:37.060755+0000","last_fullsized":"2024-03-09T15:24:37.060755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.063707+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T15:23:57.063707+0000","last_peered":"2024-03-09T15:23:57.063707+0000","last_clean":"2024-03-09T15:23:57.063707+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:23:57.063707+0000","last_undegraded":"2024-03-09T15:23:57.063707+0000","last_fullsized":"2024-03-09T15:23:57.063707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'155","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.074851+0000","last_change":"2024-03-09T14:21:54.358849+0000","last_active":"2024-03-09T15:24:38.074851+0000","last_peered":"2024-03-09T15:24:38.074851+0000","last_clean":"2024-03-09T15:24:38.074851+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:24:38.074851+0000","last_undegraded":"2024-03-09T15:24:38.074851+0000","last_fullsized":"2024-03-09T15:24:38.074851+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244523,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":7813,"num_write":928,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.068988+0000","last_change":"2024-03-09T14:21:58.372665+0000","last_active":"2024-03-09T15:24:32.068988+0000","last_peered":"2024-03-09T15:24:32.068988+0000","last_clean":"2024-03-09T15:24:32.068988+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:24:32.068988+0000","last_undegraded":"2024-03-09T15:24:32.068988+0000","last_fullsized":"2024-03-09T15:24:32.068988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'304","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.693795+0000","last_change":"2024-03-09T15:25:01.693832+0000","last_active":"2024-03-09T15:25:01.693795+0000","last_peered":"2024-03-09T15:25:01.693795+0000","last_clean":"2024-03-09T15:25:01.693795+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:25:01.693795+0000","last_undegraded":"2024-03-09T15:25:01.693795+0000","last_fullsized":"2024-03-09T15:25:01.693795+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'304","last_scrub_stamp":"2024-03-09T15:25:01.693710+0000","last_deep_scrub":"260'304","last_deep_scrub_stamp":"2024-03-09T15:25:01.693710+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.693710+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:21.881360+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":594,"num_write":476,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89360,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":487,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281331+0000","last_change":"2024-03-09T14:22:02.403697+0000","last_active":"2024-03-09T15:24:42.281331+0000","last_peered":"2024-03-09T15:24:42.281331+0000","last_clean":"2024-03-09T15:24:42.281331+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:24:42.281331+0000","last_undegraded":"2024-03-09T15:24:42.281331+0000","last_fullsized":"2024-03-09T15:24:42.281331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'215","reported_seq":899,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.123298+0000","last_change":"2024-03-09T14:22:04.400948+0000","last_active":"2024-03-09T15:24:45.123298+0000","last_peered":"2024-03-09T15:24:45.123298+0000","last_clean":"2024-03-09T15:24:45.123298+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:24:45.123298+0000","last_undegraded":"2024-03-09T15:24:45.123298+0000","last_fullsized":"2024-03-09T15:24:45.123298+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'338","reported_seq":984,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.018951+0000","last_change":"2024-03-09T14:21:56.364183+0000","last_active":"2024-03-09T15:24:27.018951+0000","last_peered":"2024-03-09T15:24:27.018951+0000","last_clean":"2024-03-09T15:24:27.018951+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:24:27.018951+0000","last_undegraded":"2024-03-09T15:24:27.018951+0000","last_fullsized":"2024-03-09T15:24:27.018951+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.056266+0000","last_change":"2024-03-09T14:21:39.159819+0000","last_active":"2024-03-09T15:24:07.056266+0000","last_peered":"2024-03-09T15:24:07.056266+0000","last_clean":"2024-03-09T15:24:07.056266+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:24:07.056266+0000","last_undegraded":"2024-03-09T15:24:07.056266+0000","last_fullsized":"2024-03-09T15:24:07.056266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'156","reported_seq":750,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.960112+0000","last_change":"2024-03-09T14:21:54.357687+0000","last_active":"2024-03-09T15:24:37.960112+0000","last_peered":"2024-03-09T15:24:37.960112+0000","last_clean":"2024-03-09T15:24:37.960112+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:24:37.960112+0000","last_undegraded":"2024-03-09T15:24:37.960112+0000","last_fullsized":"2024-03-09T15:24:37.960112+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081389,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":315,"num_read_kb":1406,"num_write":852,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281257+0000","last_change":"2024-03-09T14:21:58.373133+0000","last_active":"2024-03-09T15:24:42.281257+0000","last_peered":"2024-03-09T15:24:42.281257+0000","last_clean":"2024-03-09T15:24:42.281257+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:24:42.281257+0000","last_undegraded":"2024-03-09T15:24:42.281257+0000","last_fullsized":"2024-03-09T15:24:42.281257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'144","reported_seq":701,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704038+0000","last_change":"2024-03-09T14:22:00.388917+0000","last_active":"2024-03-09T15:24:43.704038+0000","last_peered":"2024-03-09T15:24:43.704038+0000","last_clean":"2024-03-09T15:24:43.704038+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:24:43.704038+0000","last_undegraded":"2024-03-09T15:24:43.704038+0000","last_fullsized":"2024-03-09T15:24:43.704038+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.817739+0000","last_change":"2024-03-09T15:24:57.817762+0000","last_active":"2024-03-09T15:24:57.817739+0000","last_peered":"2024-03-09T15:24:57.817739+0000","last_clean":"2024-03-09T15:24:57.817739+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:24:57.817739+0000","last_undegraded":"2024-03-09T15:24:57.817739+0000","last_fullsized":"2024-03-09T15:24:57.817739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.817646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.817646+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.817646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:44.573136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'104","reported_seq":621,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.552490+0000","last_change":"2024-03-09T15:24:49.552490+0000","last_active":"2024-03-09T15:24:49.552490+0000","last_peered":"2024-03-09T15:24:49.552490+0000","last_clean":"2024-03-09T15:24:49.552490+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:24:49.552490+0000","last_undegraded":"2024-03-09T15:24:49.552490+0000","last_fullsized":"2024-03-09T15:24:49.552490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'104","last_scrub_stamp":"2024-03-09T15:24:49.552331+0000","last_deep_scrub":"260'104","last_deep_scrub_stamp":"2024-03-09T15:24:49.552331+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.552331+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.826402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756023+0000","last_change":"2024-03-09T14:21:56.362977+0000","last_active":"2024-03-09T15:24:42.756023+0000","last_peered":"2024-03-09T15:24:42.756023+0000","last_clean":"2024-03-09T15:24:42.756023+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:24:42.756023+0000","last_undegraded":"2024-03-09T15:24:42.756023+0000","last_fullsized":"2024-03-09T15:24:42.756023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.065367+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T15:24:07.065367+0000","last_peered":"2024-03-09T15:24:07.065367+0000","last_clean":"2024-03-09T15:24:07.065367+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:24:07.065367+0000","last_undegraded":"2024-03-09T15:24:07.065367+0000","last_fullsized":"2024-03-09T15:24:07.065367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'209","reported_seq":858,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.087126+0000","last_change":"2024-03-09T14:21:54.371651+0000","last_active":"2024-03-09T15:24:38.087126+0000","last_peered":"2024-03-09T15:24:38.087126+0000","last_clean":"2024-03-09T15:24:38.087126+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:24:38.087126+0000","last_undegraded":"2024-03-09T15:24:38.087126+0000","last_fullsized":"2024-03-09T15:24:38.087126+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343543,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":33193,"num_write":1185,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.229700+0000","last_change":"2024-03-09T14:21:58.371500+0000","last_active":"2024-03-09T15:24:43.229700+0000","last_peered":"2024-03-09T15:24:43.229700+0000","last_clean":"2024-03-09T15:24:43.229700+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:24:43.229700+0000","last_undegraded":"2024-03-09T15:24:43.229700+0000","last_fullsized":"2024-03-09T15:24:43.229700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'282","reported_seq":1583,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596862+0000","last_change":"2024-03-09T14:22:00.494298+0000","last_active":"2024-03-09T15:24:45.596862+0000","last_peered":"2024-03-09T15:24:45.596862+0000","last_clean":"2024-03-09T15:24:45.596862+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:24:45.596862+0000","last_undegraded":"2024-03-09T15:24:45.596862+0000","last_fullsized":"2024-03-09T15:24:45.596862+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":488,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.922161+0000","last_change":"2024-03-09T14:22:02.400334+0000","last_active":"2024-03-09T15:24:31.922161+0000","last_peered":"2024-03-09T15:24:31.922161+0000","last_clean":"2024-03-09T15:24:31.922161+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:24:31.922161+0000","last_undegraded":"2024-03-09T15:24:31.922161+0000","last_fullsized":"2024-03-09T15:24:31.922161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'258","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.453575+0000","last_change":"2024-03-09T15:24:55.453607+0000","last_active":"2024-03-09T15:24:55.453575+0000","last_peered":"2024-03-09T15:24:55.453575+0000","last_clean":"2024-03-09T15:24:55.453575+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:24:55.453575+0000","last_undegraded":"2024-03-09T15:24:55.453575+0000","last_fullsized":"2024-03-09T15:24:55.453575+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'258","last_scrub_stamp":"2024-03-09T15:24:55.453479+0000","last_deep_scrub":"260'258","last_deep_scrub_stamp":"2024-03-09T15:24:55.453479+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.453479+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:17:21.907096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":586,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281072+0000","last_change":"2024-03-09T14:21:56.371601+0000","last_active":"2024-03-09T15:24:42.281072+0000","last_peered":"2024-03-09T15:24:42.281072+0000","last_clean":"2024-03-09T15:24:42.281072+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:24:42.281072+0000","last_undegraded":"2024-03-09T15:24:42.281072+0000","last_fullsized":"2024-03-09T15:24:42.281072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":523,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:12.017416+0000","last_change":"2024-03-09T14:21:38.292025+0000","last_active":"2024-03-09T15:24:12.017416+0000","last_peered":"2024-03-09T15:24:12.017416+0000","last_clean":"2024-03-09T15:24:12.017416+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:24:12.017416+0000","last_undegraded":"2024-03-09T15:24:12.017416+0000","last_fullsized":"2024-03-09T15:24:12.017416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.063728+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T15:23:57.063728+0000","last_peered":"2024-03-09T15:23:57.063728+0000","last_clean":"2024-03-09T15:23:57.063728+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:23:57.063728+0000","last_undegraded":"2024-03-09T15:23:57.063728+0000","last_fullsized":"2024-03-09T15:23:57.063728+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'146","reported_seq":738,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.979799+0000","last_change":"2024-03-09T14:21:54.370907+0000","last_active":"2024-03-09T15:24:37.979799+0000","last_peered":"2024-03-09T15:24:37.979799+0000","last_clean":"2024-03-09T15:24:37.979799+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:24:37.979799+0000","last_undegraded":"2024-03-09T15:24:37.979799+0000","last_fullsized":"2024-03-09T15:24:37.979799+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":13701,"num_write":831,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651134+0000","last_change":"2024-03-09T14:21:58.370284+0000","last_active":"2024-03-09T15:24:44.651134+0000","last_peered":"2024-03-09T15:24:44.651134+0000","last_clean":"2024-03-09T15:24:44.651134+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:24:44.651134+0000","last_undegraded":"2024-03-09T15:24:44.651134+0000","last_fullsized":"2024-03-09T15:24:44.651134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'734","reported_seq":2350,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.180755+0000","last_change":"2024-03-09T14:22:00.388074+0000","last_active":"2024-03-09T15:24:38.180755+0000","last_peered":"2024-03-09T15:24:38.180755+0000","last_clean":"2024-03-09T15:24:38.180755+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:24:38.180755+0000","last_undegraded":"2024-03-09T15:24:38.180755+0000","last_fullsized":"2024-03-09T15:24:38.180755+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17200,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":996,"num_read_kb":1152,"num_write":364,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596983+0000","last_change":"2024-03-09T14:22:02.392515+0000","last_active":"2024-03-09T15:24:45.596983+0000","last_peered":"2024-03-09T15:24:45.596983+0000","last_clean":"2024-03-09T15:24:45.596983+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:24:45.596983+0000","last_undegraded":"2024-03-09T15:24:45.596983+0000","last_fullsized":"2024-03-09T15:24:45.596983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'162","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.466123+0000","last_change":"2024-03-09T15:24:53.466183+0000","last_active":"2024-03-09T15:24:53.466123+0000","last_peered":"2024-03-09T15:24:53.466123+0000","last_clean":"2024-03-09T15:24:53.466123+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:24:53.466123+0000","last_undegraded":"2024-03-09T15:24:53.466123+0000","last_fullsized":"2024-03-09T15:24:53.466123+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'162","last_scrub_stamp":"2024-03-09T15:24:53.466019+0000","last_deep_scrub":"260'162","last_deep_scrub_stamp":"2024-03-09T15:24:53.466019+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.466019+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:47.577441+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":804,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183768+0000","last_change":"2024-03-09T14:21:56.356659+0000","last_active":"2024-03-09T15:24:27.183768+0000","last_peered":"2024-03-09T15:24:27.183768+0000","last_clean":"2024-03-09T15:24:27.183768+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:24:27.183768+0000","last_undegraded":"2024-03-09T15:24:27.183768+0000","last_fullsized":"2024-03-09T15:24:27.183768+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'133","reported_seq":702,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.872972+0000","last_change":"2024-03-09T15:24:50.873015+0000","last_active":"2024-03-09T15:24:50.872972+0000","last_peered":"2024-03-09T15:24:50.872972+0000","last_clean":"2024-03-09T15:24:50.872972+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:24:50.872972+0000","last_undegraded":"2024-03-09T15:24:50.872972+0000","last_fullsized":"2024-03-09T15:24:50.872972+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-03-09T15:24:50.872869+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-03-09T15:24:50.872869+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.872869+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:54.055792+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506641,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":4172,"num_write":719,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":524,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:12.035866+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T15:24:12.035866+0000","last_peered":"2024-03-09T15:24:12.035866+0000","last_clean":"2024-03-09T15:24:12.035866+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:24:12.035866+0000","last_undegraded":"2024-03-09T15:24:12.035866+0000","last_fullsized":"2024-03-09T15:24:12.035866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.036412+0000","last_change":"2024-03-09T14:21:58.372306+0000","last_active":"2024-03-09T15:24:17.036412+0000","last_peered":"2024-03-09T15:24:17.036412+0000","last_clean":"2024-03-09T15:24:17.036412+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:24:17.036412+0000","last_undegraded":"2024-03-09T15:24:17.036412+0000","last_fullsized":"2024-03-09T15:24:17.036412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'346","reported_seq":1076,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.039649+0000","last_change":"2024-03-09T14:22:00.492596+0000","last_active":"2024-03-09T15:24:38.039649+0000","last_peered":"2024-03-09T15:24:38.039649+0000","last_clean":"2024-03-09T15:24:38.039649+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:24:38.039649+0000","last_undegraded":"2024-03-09T15:24:38.039649+0000","last_fullsized":"2024-03-09T15:24:38.039649+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24501,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":711,"num_write":258,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.418462+0000","last_change":"2024-03-09T15:25:00.418498+0000","last_active":"2024-03-09T15:25:00.418462+0000","last_peered":"2024-03-09T15:25:00.418462+0000","last_clean":"2024-03-09T15:25:00.418462+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:25:00.418462+0000","last_undegraded":"2024-03-09T15:25:00.418462+0000","last_fullsized":"2024-03-09T15:25:00.418462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.418360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.418360+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.418360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:58.612049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'146","reported_seq":645,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.642963+0000","last_change":"2024-03-09T15:24:53.642995+0000","last_active":"2024-03-09T15:24:53.642963+0000","last_peered":"2024-03-09T15:24:53.642963+0000","last_clean":"2024-03-09T15:24:53.642963+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:24:53.642963+0000","last_undegraded":"2024-03-09T15:24:53.642963+0000","last_fullsized":"2024-03-09T15:24:53.642963+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:24:53.642875+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:24:53.642875+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.642875+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:43:16.650237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:12.035797+0000","last_change":"2024-03-09T14:21:56.367601+0000","last_active":"2024-03-09T15:24:12.035797+0000","last_peered":"2024-03-09T15:24:12.035797+0000","last_clean":"2024-03-09T15:24:12.035797+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:24:12.035797+0000","last_undegraded":"2024-03-09T15:24:12.035797+0000","last_fullsized":"2024-03-09T15:24:12.035797+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'187","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703707+0000","last_change":"2024-03-09T14:21:54.358356+0000","last_active":"2024-03-09T15:24:43.703707+0000","last_peered":"2024-03-09T15:24:43.703707+0000","last_clean":"2024-03-09T15:24:43.703707+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:24:43.703707+0000","last_undegraded":"2024-03-09T15:24:43.703707+0000","last_fullsized":"2024-03-09T15:24:43.703707+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":496,"num_read_kb":43067,"num_write":1018,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":529,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.182405+0000","last_change":"2024-03-09T14:21:39.068076+0000","last_active":"2024-03-09T15:24:17.182405+0000","last_peered":"2024-03-09T15:24:17.182405+0000","last_clean":"2024-03-09T15:24:17.182405+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:24:17.182405+0000","last_undegraded":"2024-03-09T15:24:17.182405+0000","last_fullsized":"2024-03-09T15:24:17.182405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.184771+0000","last_change":"2024-03-09T14:21:58.373524+0000","last_active":"2024-03-09T15:24:32.184771+0000","last_peered":"2024-03-09T15:24:32.184771+0000","last_clean":"2024-03-09T15:24:32.184771+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:24:32.184771+0000","last_undegraded":"2024-03-09T15:24:32.184771+0000","last_fullsized":"2024-03-09T15:24:32.184771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'128","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.082977+0000","last_change":"2024-03-09T15:24:58.083018+0000","last_active":"2024-03-09T15:24:58.082977+0000","last_peered":"2024-03-09T15:24:58.082977+0000","last_clean":"2024-03-09T15:24:58.082977+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:24:58.082977+0000","last_undegraded":"2024-03-09T15:24:58.082977+0000","last_fullsized":"2024-03-09T15:24:58.082977+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'128","last_scrub_stamp":"2024-03-09T15:24:58.082889+0000","last_deep_scrub":"260'128","last_deep_scrub_stamp":"2024-03-09T15:24:58.082889+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.082889+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:51.050199+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'548","reported_seq":4162,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.186951+0000","last_change":"2024-03-09T14:22:02.399139+0000","last_active":"2024-03-09T15:24:38.186951+0000","last_peered":"2024-03-09T15:24:38.186951+0000","last_clean":"2024-03-09T15:24:38.186951+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:24:38.186951+0000","last_undegraded":"2024-03-09T15:24:38.186951+0000","last_fullsized":"2024-03-09T15:24:38.186951+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'184","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.604685+0000","last_change":"2024-03-09T15:24:55.604719+0000","last_active":"2024-03-09T15:24:55.604685+0000","last_peered":"2024-03-09T15:24:55.604685+0000","last_clean":"2024-03-09T15:24:55.604685+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:24:55.604685+0000","last_undegraded":"2024-03-09T15:24:55.604685+0000","last_fullsized":"2024-03-09T15:24:55.604685+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-03-09T15:24:55.604578+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-03-09T15:24:55.604578+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.604578+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:15.803844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1015,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:26.921550+0000","last_change":"2024-03-09T14:21:56.370846+0000","last_active":"2024-03-09T15:24:26.921550+0000","last_peered":"2024-03-09T15:24:26.921550+0000","last_clean":"2024-03-09T15:24:26.921550+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:24:26.921550+0000","last_undegraded":"2024-03-09T15:24:26.921550+0000","last_fullsized":"2024-03-09T15:24:26.921550+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'211","reported_seq":889,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.132195+0000","last_change":"2024-03-09T14:21:54.370705+0000","last_active":"2024-03-09T15:24:38.132195+0000","last_peered":"2024-03-09T15:24:38.132195+0000","last_clean":"2024-03-09T15:24:38.132195+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:24:38.132195+0000","last_undegraded":"2024-03-09T15:24:38.132195+0000","last_fullsized":"2024-03-09T15:24:38.132195+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117883,"num_write":1122,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059324+0000","last_change":"2024-03-09T14:21:39.159694+0000","last_active":"2024-03-09T15:24:27.059324+0000","last_peered":"2024-03-09T15:24:27.059324+0000","last_clean":"2024-03-09T15:24:27.059324+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:24:27.059324+0000","last_undegraded":"2024-03-09T15:24:27.059324+0000","last_fullsized":"2024-03-09T15:24:27.059324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.865681+0000","last_change":"2024-03-09T15:24:56.865719+0000","last_active":"2024-03-09T15:24:56.865681+0000","last_peered":"2024-03-09T15:24:56.865681+0000","last_clean":"2024-03-09T15:24:56.865681+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:24:56.865681+0000","last_undegraded":"2024-03-09T15:24:56.865681+0000","last_fullsized":"2024-03-09T15:24:56.865681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.865592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.865592+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.865592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:13.969932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'237","reported_seq":815,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.019378+0000","last_change":"2024-03-09T14:22:00.492643+0000","last_active":"2024-03-09T15:24:32.019378+0000","last_peered":"2024-03-09T15:24:32.019378+0000","last_clean":"2024-03-09T15:24:32.019378+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:24:32.019378+0000","last_undegraded":"2024-03-09T15:24:32.019378+0000","last_fullsized":"2024-03-09T15:24:32.019378+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'541","reported_seq":2701,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.661233+0000","last_change":"2024-03-09T15:24:58.661257+0000","last_active":"2024-03-09T15:24:58.661233+0000","last_peered":"2024-03-09T15:24:58.661233+0000","last_clean":"2024-03-09T15:24:58.661233+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:58.661233+0000","last_undegraded":"2024-03-09T15:24:58.661233+0000","last_fullsized":"2024-03-09T15:24:58.661233+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'541","last_scrub_stamp":"2024-03-09T15:24:58.661130+0000","last_deep_scrub":"260'541","last_deep_scrub_stamp":"2024-03-09T15:24:58.661130+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.661130+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:40.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'118","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.502343+0000","last_change":"2024-03-09T15:24:54.502386+0000","last_active":"2024-03-09T15:24:54.502343+0000","last_peered":"2024-03-09T15:24:54.502343+0000","last_clean":"2024-03-09T15:24:54.502343+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:24:54.502343+0000","last_undegraded":"2024-03-09T15:24:54.502343+0000","last_fullsized":"2024-03-09T15:24:54.502343+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-03-09T15:24:54.502257+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-03-09T15:24:54.502257+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.502257+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:35.717063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":675,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.018913+0000","last_change":"2024-03-09T14:21:56.359311+0000","last_active":"2024-03-09T15:24:27.018913+0000","last_peered":"2024-03-09T15:24:27.018913+0000","last_clean":"2024-03-09T15:24:27.018913+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:24:27.018913+0000","last_undegraded":"2024-03-09T15:24:27.018913+0000","last_fullsized":"2024-03-09T15:24:27.018913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'197","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.176335+0000","last_change":"2024-03-09T14:21:54.371711+0000","last_active":"2024-03-09T15:24:38.176335+0000","last_peered":"2024-03-09T15:24:38.176335+0000","last_clean":"2024-03-09T15:24:38.176335+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:24:38.176335+0000","last_undegraded":"2024-03-09T15:24:38.176335+0000","last_fullsized":"2024-03-09T15:24:38.176335+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":52342,"num_write":1104,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":520,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059361+0000","last_change":"2024-03-09T14:21:38.291462+0000","last_active":"2024-03-09T15:24:27.059361+0000","last_peered":"2024-03-09T15:24:27.059361+0000","last_clean":"2024-03-09T15:24:27.059361+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:24:27.059361+0000","last_undegraded":"2024-03-09T15:24:27.059361+0000","last_fullsized":"2024-03-09T15:24:27.059361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.922143+0000","last_change":"2024-03-09T14:21:58.369587+0000","last_active":"2024-03-09T15:24:31.922143+0000","last_peered":"2024-03-09T15:24:31.922143+0000","last_clean":"2024-03-09T15:24:31.922143+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:24:31.922143+0000","last_undegraded":"2024-03-09T15:24:31.922143+0000","last_fullsized":"2024-03-09T15:24:31.922143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'278","reported_seq":950,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.141402+0000","last_change":"2024-03-09T14:22:00.386745+0000","last_active":"2024-03-09T15:24:38.141402+0000","last_peered":"2024-03-09T15:24:38.141402+0000","last_clean":"2024-03-09T15:24:38.141402+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:24:38.141402+0000","last_undegraded":"2024-03-09T15:24:38.141402+0000","last_fullsized":"2024-03-09T15:24:38.141402+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15555,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":412,"num_read_kb":552,"num_write":228,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.080772+0000","last_change":"2024-03-09T15:24:54.080795+0000","last_active":"2024-03-09T15:24:54.080772+0000","last_peered":"2024-03-09T15:24:54.080772+0000","last_clean":"2024-03-09T15:24:54.080772+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:24:54.080772+0000","last_undegraded":"2024-03-09T15:24:54.080772+0000","last_fullsized":"2024-03-09T15:24:54.080772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:54.080680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:54.080680+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.080680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:08:50.163746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'189","reported_seq":692,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.667105+0000","last_change":"2024-03-09T15:24:57.667141+0000","last_active":"2024-03-09T15:24:57.667105+0000","last_peered":"2024-03-09T15:24:57.667105+0000","last_clean":"2024-03-09T15:24:57.667105+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:24:57.667105+0000","last_undegraded":"2024-03-09T15:24:57.667105+0000","last_fullsized":"2024-03-09T15:24:57.667105+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'189","last_scrub_stamp":"2024-03-09T15:24:57.667023+0000","last_deep_scrub":"260'189","last_deep_scrub_stamp":"2024-03-09T15:24:57.667023+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.667023+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:01.539204+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'135","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.677121+0000","last_change":"2024-03-09T15:25:01.677151+0000","last_active":"2024-03-09T15:25:01.677121+0000","last_peered":"2024-03-09T15:25:01.677121+0000","last_clean":"2024-03-09T15:25:01.677121+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:25:01.677121+0000","last_undegraded":"2024-03-09T15:25:01.677121+0000","last_fullsized":"2024-03-09T15:25:01.677121+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'135","last_scrub_stamp":"2024-03-09T15:25:01.677031+0000","last_deep_scrub":"260'135","last_deep_scrub_stamp":"2024-03-09T15:25:01.677031+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.677031+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:22.411149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178783+0000","last_change":"2024-03-09T14:21:56.355418+0000","last_active":"2024-03-09T15:24:44.178783+0000","last_peered":"2024-03-09T15:24:44.178783+0000","last_clean":"2024-03-09T15:24:44.178783+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:24:44.178783+0000","last_undegraded":"2024-03-09T15:24:44.178783+0000","last_fullsized":"2024-03-09T15:24:44.178783+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'149","reported_seq":751,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178555+0000","last_change":"2024-03-09T14:21:54.362232+0000","last_active":"2024-03-09T15:24:44.178555+0000","last_peered":"2024-03-09T15:24:44.178555+0000","last_clean":"2024-03-09T15:24:44.178555+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:24:44.178555+0000","last_undegraded":"2024-03-09T15:24:44.178555+0000","last_fullsized":"2024-03-09T15:24:44.178555+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":29246,"num_write":815,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.533737+0000","last_change":"2024-03-09T15:24:56.533737+0000","last_active":"2024-03-09T15:24:56.533737+0000","last_peered":"2024-03-09T15:24:56.533737+0000","last_clean":"2024-03-09T15:24:56.533737+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:24:56.533737+0000","last_undegraded":"2024-03-09T15:24:56.533737+0000","last_fullsized":"2024-03-09T15:24:56.533737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.533621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.533621+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.533621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:17.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'146","reported_seq":733,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704237+0000","last_change":"2024-03-09T14:22:00.386530+0000","last_active":"2024-03-09T15:24:43.704237+0000","last_peered":"2024-03-09T15:24:43.704237+0000","last_clean":"2024-03-09T15:24:43.704237+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:24:43.704237+0000","last_undegraded":"2024-03-09T15:24:43.704237+0000","last_fullsized":"2024-03-09T15:24:43.704237+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":294,"num_write":114,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704237+0000","last_change":"2024-03-09T14:22:02.399358+0000","last_active":"2024-03-09T15:24:43.704237+0000","last_peered":"2024-03-09T15:24:43.704237+0000","last_clean":"2024-03-09T15:24:43.704237+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:24:43.704237+0000","last_undegraded":"2024-03-09T15:24:43.704237+0000","last_fullsized":"2024-03-09T15:24:43.704237+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.410479+0000","last_change":"2024-03-09T15:24:58.410504+0000","last_active":"2024-03-09T15:24:58.410479+0000","last_peered":"2024-03-09T15:24:58.410479+0000","last_clean":"2024-03-09T15:24:58.410479+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:24:58.410479+0000","last_undegraded":"2024-03-09T15:24:58.410479+0000","last_fullsized":"2024-03-09T15:24:58.410479+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'134","last_scrub_stamp":"2024-03-09T15:24:58.410391+0000","last_deep_scrub":"260'134","last_deep_scrub_stamp":"2024-03-09T15:24:58.410391+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.410391+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:52.946147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4079","reported_seq":4660,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.645255+0000","last_change":"2024-03-09T15:25:01.645309+0000","last_active":"2024-03-09T15:25:01.645255+0000","last_peered":"2024-03-09T15:25:01.645255+0000","last_clean":"2024-03-09T15:25:01.645255+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:25:01.645255+0000","last_undegraded":"2024-03-09T15:25:01.645255+0000","last_fullsized":"2024-03-09T15:25:01.645255+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4079","last_scrub_stamp":"2024-03-09T15:25:01.645158+0000","last_deep_scrub":"260'4079","last_deep_scrub_stamp":"2024-03-09T15:25:01.645158+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.645158+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":3000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:47.461607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'214","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596447+0000","last_change":"2024-03-09T14:21:54.370617+0000","last_active":"2024-03-09T15:24:45.596447+0000","last_peered":"2024-03-09T15:24:45.596447+0000","last_clean":"2024-03-09T15:24:45.596447+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:24:45.596447+0000","last_undegraded":"2024-03-09T15:24:45.596447+0000","last_fullsized":"2024-03-09T15:24:45.596447+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34568,"num_write":1093,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704047+0000","last_change":"2024-03-09T14:21:58.373073+0000","last_active":"2024-03-09T15:24:43.704047+0000","last_peered":"2024-03-09T15:24:43.704047+0000","last_clean":"2024-03-09T15:24:43.704047+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:24:43.704047+0000","last_undegraded":"2024-03-09T15:24:43.704047+0000","last_fullsized":"2024-03-09T15:24:43.704047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'44","reported_seq":547,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281347+0000","last_change":"2024-03-09T14:22:00.389956+0000","last_active":"2024-03-09T15:24:42.281347+0000","last_peered":"2024-03-09T15:24:42.281347+0000","last_clean":"2024-03-09T15:24:42.281347+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:24:42.281347+0000","last_undegraded":"2024-03-09T15:24:42.281347+0000","last_fullsized":"2024-03-09T15:24:42.281347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596819+0000","last_change":"2024-03-09T14:22:02.397849+0000","last_active":"2024-03-09T15:24:45.596819+0000","last_peered":"2024-03-09T15:24:45.596819+0000","last_clean":"2024-03-09T15:24:45.596819+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:24:45.596819+0000","last_undegraded":"2024-03-09T15:24:45.596819+0000","last_fullsized":"2024-03-09T15:24:45.596819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'189","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:36.922961+0000","last_change":"2024-03-09T14:22:04.401057+0000","last_active":"2024-03-09T15:24:36.922961+0000","last_peered":"2024-03-09T15:24:36.922961+0000","last_clean":"2024-03-09T15:24:36.922961+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:24:36.922961+0000","last_undegraded":"2024-03-09T15:24:36.922961+0000","last_fullsized":"2024-03-09T15:24:36.922961+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4677,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703769+0000","last_change":"2024-03-09T14:21:56.360219+0000","last_active":"2024-03-09T15:24:43.703769+0000","last_peered":"2024-03-09T15:24:43.703769+0000","last_clean":"2024-03-09T15:24:43.703769+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:24:43.703769+0000","last_undegraded":"2024-03-09T15:24:43.703769+0000","last_fullsized":"2024-03-09T15:24:43.703769+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'142","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650795+0000","last_change":"2024-03-09T14:21:54.360121+0000","last_active":"2024-03-09T15:24:44.650795+0000","last_peered":"2024-03-09T15:24:44.650795+0000","last_clean":"2024-03-09T15:24:44.650795+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:24:44.650795+0000","last_undegraded":"2024-03-09T15:24:44.650795+0000","last_fullsized":"2024-03-09T15:24:44.650795+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7716,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":77468,"num_write":821,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596648+0000","last_change":"2024-03-09T14:21:58.371755+0000","last_active":"2024-03-09T15:24:45.596648+0000","last_peered":"2024-03-09T15:24:45.596648+0000","last_clean":"2024-03-09T15:24:45.596648+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:24:45.596648+0000","last_undegraded":"2024-03-09T15:24:45.596648+0000","last_fullsized":"2024-03-09T15:24:45.596648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'172","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704133+0000","last_change":"2024-03-09T14:22:00.388758+0000","last_active":"2024-03-09T15:24:43.704133+0000","last_peered":"2024-03-09T15:24:43.704133+0000","last_clean":"2024-03-09T15:24:43.704133+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:24:43.704133+0000","last_undegraded":"2024-03-09T15:24:43.704133+0000","last_fullsized":"2024-03-09T15:24:43.704133+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":299,"num_write":138,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.738952+0000","last_change":"2024-03-09T15:24:59.738952+0000","last_active":"2024-03-09T15:24:59.738952+0000","last_peered":"2024-03-09T15:24:59.738952+0000","last_clean":"2024-03-09T15:24:59.738952+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:24:59.738952+0000","last_undegraded":"2024-03-09T15:24:59.738952+0000","last_fullsized":"2024-03-09T15:24:59.738952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:59.738850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:59.738850+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.738850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:08:10.311280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'125","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.649935+0000","last_change":"2024-03-09T15:24:54.649967+0000","last_active":"2024-03-09T15:24:54.649935+0000","last_peered":"2024-03-09T15:24:54.649935+0000","last_clean":"2024-03-09T15:24:54.649935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:24:54.649935+0000","last_undegraded":"2024-03-09T15:24:54.649935+0000","last_fullsized":"2024-03-09T15:24:54.649935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'125","last_scrub_stamp":"2024-03-09T15:24:54.649852+0000","last_deep_scrub":"260'125","last_deep_scrub_stamp":"2024-03-09T15:24:54.649852+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.649852+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:06.812371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1187,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703855+0000","last_change":"2024-03-09T14:21:56.353346+0000","last_active":"2024-03-09T15:24:43.703855+0000","last_peered":"2024-03-09T15:24:43.703855+0000","last_clean":"2024-03-09T15:24:43.703855+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:24:43.703855+0000","last_undegraded":"2024-03-09T15:24:43.703855+0000","last_fullsized":"2024-03-09T15:24:43.703855+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'178","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.280928+0000","last_change":"2024-03-09T14:21:54.368774+0000","last_active":"2024-03-09T15:24:42.280928+0000","last_peered":"2024-03-09T15:24:42.280928+0000","last_clean":"2024-03-09T15:24:42.280928+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:24:42.280928+0000","last_undegraded":"2024-03-09T15:24:42.280928+0000","last_fullsized":"2024-03-09T15:24:42.280928+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507990,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":372,"num_read_kb":57120,"num_write":931,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.896790+0000","last_change":"2024-03-09T15:24:54.896790+0000","last_active":"2024-03-09T15:24:54.896790+0000","last_peered":"2024-03-09T15:24:54.896790+0000","last_clean":"2024-03-09T15:24:54.896790+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:24:54.896790+0000","last_undegraded":"2024-03-09T15:24:54.896790+0000","last_fullsized":"2024-03-09T15:24:54.896790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:54.896671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:54.896671+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.896671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:02.977300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'147","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596772+0000","last_change":"2024-03-09T14:22:00.383681+0000","last_active":"2024-03-09T15:24:45.596772+0000","last_peered":"2024-03-09T15:24:45.596772+0000","last_clean":"2024-03-09T15:24:45.596772+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:24:45.596772+0000","last_undegraded":"2024-03-09T15:24:45.596772+0000","last_fullsized":"2024-03-09T15:24:45.596772+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8269,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":267,"num_write":100,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":485,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281404+0000","last_change":"2024-03-09T14:22:02.402801+0000","last_active":"2024-03-09T15:24:42.281404+0000","last_peered":"2024-03-09T15:24:42.281404+0000","last_clean":"2024-03-09T15:24:42.281404+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:24:42.281404+0000","last_undegraded":"2024-03-09T15:24:42.281404+0000","last_fullsized":"2024-03-09T15:24:42.281404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":778,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059343+0000","last_change":"2024-03-09T14:21:56.355621+0000","last_active":"2024-03-09T15:24:27.059343+0000","last_peered":"2024-03-09T15:24:27.059343+0000","last_clean":"2024-03-09T15:24:27.059343+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:24:27.059343+0000","last_undegraded":"2024-03-09T15:24:27.059343+0000","last_fullsized":"2024-03-09T15:24:27.059343+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'190","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703768+0000","last_change":"2024-03-09T14:21:54.361543+0000","last_active":"2024-03-09T15:24:43.703768+0000","last_peered":"2024-03-09T15:24:43.703768+0000","last_clean":"2024-03-09T15:24:43.703768+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:24:43.703768+0000","last_undegraded":"2024-03-09T15:24:43.703768+0000","last_fullsized":"2024-03-09T15:24:43.703768+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":29766,"num_write":1073,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:21.921043+0000","last_change":"2024-03-09T14:21:58.370949+0000","last_active":"2024-03-09T15:24:21.921043+0000","last_peered":"2024-03-09T15:24:21.921043+0000","last_clean":"2024-03-09T15:24:21.921043+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:24:21.921043+0000","last_undegraded":"2024-03-09T15:24:21.921043+0000","last_fullsized":"2024-03-09T15:24:21.921043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'226","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.617210+0000","last_change":"2024-03-09T15:25:00.617246+0000","last_active":"2024-03-09T15:25:00.617210+0000","last_peered":"2024-03-09T15:25:00.617210+0000","last_clean":"2024-03-09T15:25:00.617210+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:25:00.617210+0000","last_undegraded":"2024-03-09T15:25:00.617210+0000","last_fullsized":"2024-03-09T15:25:00.617210+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-03-09T15:25:00.617126+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-03-09T15:25:00.617126+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.617126+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:40.866463+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15733,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":333,"num_read_kb":495,"num_write":212,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.696961+0000","last_change":"2024-03-09T15:24:57.696994+0000","last_active":"2024-03-09T15:24:57.696961+0000","last_peered":"2024-03-09T15:24:57.696961+0000","last_clean":"2024-03-09T15:24:57.696961+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:24:57.696961+0000","last_undegraded":"2024-03-09T15:24:57.696961+0000","last_fullsized":"2024-03-09T15:24:57.696961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.696839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.696839+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.696839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:10.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'177","reported_seq":698,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.412891+0000","last_change":"2024-03-09T15:24:56.412926+0000","last_active":"2024-03-09T15:24:56.412891+0000","last_peered":"2024-03-09T15:24:56.412891+0000","last_clean":"2024-03-09T15:24:56.412891+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:24:56.412891+0000","last_undegraded":"2024-03-09T15:24:56.412891+0000","last_fullsized":"2024-03-09T15:24:56.412891+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-03-09T15:24:56.412779+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-03-09T15:24:56.412779+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.412779+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.170082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:16.920475+0000","last_change":"2024-03-09T14:21:56.366627+0000","last_active":"2024-03-09T15:24:16.920475+0000","last_peered":"2024-03-09T15:24:16.920475+0000","last_clean":"2024-03-09T15:24:16.920475+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:24:16.920475+0000","last_undegraded":"2024-03-09T15:24:16.920475+0000","last_fullsized":"2024-03-09T15:24:16.920475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'317","reported_seq":1049,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.755971+0000","last_change":"2024-03-09T14:21:54.370005+0000","last_active":"2024-03-09T15:24:42.755971+0000","last_peered":"2024-03-09T15:24:42.755971+0000","last_clean":"2024-03-09T15:24:42.755971+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:24:42.755971+0000","last_undegraded":"2024-03-09T15:24:42.755971+0000","last_fullsized":"2024-03-09T15:24:42.755971+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243080,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":990,"num_read_kb":20523,"num_write":1606,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.874942+0000","last_change":"2024-03-09T15:24:52.874964+0000","last_active":"2024-03-09T15:24:52.874942+0000","last_peered":"2024-03-09T15:24:52.874942+0000","last_clean":"2024-03-09T15:24:52.874942+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:24:52.874942+0000","last_undegraded":"2024-03-09T15:24:52.874942+0000","last_fullsized":"2024-03-09T15:24:52.874942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:52.874873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:52.874873+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.874873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:49.190884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'181","reported_seq":776,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.971456+0000","last_change":"2024-03-09T14:22:00.384248+0000","last_active":"2024-03-09T15:24:37.971456+0000","last_peered":"2024-03-09T15:24:37.971456+0000","last_clean":"2024-03-09T15:24:37.971456+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:24:37.971456+0000","last_undegraded":"2024-03-09T15:24:37.971456+0000","last_fullsized":"2024-03-09T15:24:37.971456+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9600,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":340,"num_write":176,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.019456+0000","last_change":"2024-03-09T14:22:02.397994+0000","last_active":"2024-03-09T15:24:32.019456+0000","last_peered":"2024-03-09T15:24:32.019456+0000","last_clean":"2024-03-09T15:24:32.019456+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:24:32.019456+0000","last_undegraded":"2024-03-09T15:24:32.019456+0000","last_fullsized":"2024-03-09T15:24:32.019456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'169","reported_seq":1360,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:29.313335+0000","last_change":"2024-03-09T14:22:04.398055+0000","last_active":"2024-03-09T15:24:29.313335+0000","last_peered":"2024-03-09T15:24:29.313335+0000","last_clean":"2024-03-09T15:24:29.313335+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:24:29.313335+0000","last_undegraded":"2024-03-09T15:24:29.313335+0000","last_fullsized":"2024-03-09T15:24:29.313335+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:03.382113+0000","last_clean_scrub_stamp":"2024-03-09T14:22:03.382113+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.037745+0000","last_change":"2024-03-09T14:21:56.352420+0000","last_active":"2024-03-09T15:24:27.037745+0000","last_peered":"2024-03-09T15:24:27.037745+0000","last_clean":"2024-03-09T15:24:27.037745+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:24:27.037745+0000","last_undegraded":"2024-03-09T15:24:27.037745+0000","last_fullsized":"2024-03-09T15:24:27.037745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'180","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.874089+0000","last_change":"2024-03-09T15:24:46.874089+0000","last_active":"2024-03-09T15:24:46.874089+0000","last_peered":"2024-03-09T15:24:46.874089+0000","last_clean":"2024-03-09T15:24:46.874089+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:24:46.874089+0000","last_undegraded":"2024-03-09T15:24:46.874089+0000","last_fullsized":"2024-03-09T15:24:46.874089+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'180","last_scrub_stamp":"2024-03-09T15:24:46.873902+0000","last_deep_scrub":"260'180","last_deep_scrub_stamp":"2024-03-09T15:24:46.873902+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.873902+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:58.769545+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079970,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":42859,"num_write":1107,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.184919+0000","last_change":"2024-03-09T14:21:58.373433+0000","last_active":"2024-03-09T15:24:32.184919+0000","last_peered":"2024-03-09T15:24:32.184919+0000","last_clean":"2024-03-09T15:24:32.184919+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:24:32.184919+0000","last_undegraded":"2024-03-09T15:24:32.184919+0000","last_fullsized":"2024-03-09T15:24:32.184919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'145","reported_seq":736,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.110624+0000","last_change":"2024-03-09T14:22:00.493124+0000","last_active":"2024-03-09T15:24:38.110624+0000","last_peered":"2024-03-09T15:24:38.110624+0000","last_clean":"2024-03-09T15:24:38.110624+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:24:38.110624+0000","last_undegraded":"2024-03-09T15:24:38.110624+0000","last_fullsized":"2024-03-09T15:24:38.110624+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":204,"num_read_kb":270,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:12.017447+0000","last_change":"2024-03-09T14:22:02.402300+0000","last_active":"2024-03-09T15:24:12.017447+0000","last_peered":"2024-03-09T15:24:12.017447+0000","last_clean":"2024-03-09T15:24:12.017447+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:24:12.017447+0000","last_undegraded":"2024-03-09T15:24:12.017447+0000","last_fullsized":"2024-03-09T15:24:12.017447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'111","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.678392+0000","last_change":"2024-03-09T15:24:55.678427+0000","last_active":"2024-03-09T15:24:55.678392+0000","last_peered":"2024-03-09T15:24:55.678392+0000","last_clean":"2024-03-09T15:24:55.678392+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:55.678392+0000","last_undegraded":"2024-03-09T15:24:55.678392+0000","last_fullsized":"2024-03-09T15:24:55.678392+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'111","last_scrub_stamp":"2024-03-09T15:24:55.678295+0000","last_deep_scrub":"260'111","last_deep_scrub_stamp":"2024-03-09T15:24:55.678295+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.678295+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:19.579572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":772,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.016081+0000","last_change":"2024-03-09T14:21:56.368701+0000","last_active":"2024-03-09T15:24:27.016081+0000","last_peered":"2024-03-09T15:24:27.016081+0000","last_clean":"2024-03-09T15:24:27.016081+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:24:27.016081+0000","last_undegraded":"2024-03-09T15:24:27.016081+0000","last_fullsized":"2024-03-09T15:24:27.016081+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'197","reported_seq":839,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.589642+0000","last_change":"2024-03-09T15:24:53.589692+0000","last_active":"2024-03-09T15:24:53.589642+0000","last_peered":"2024-03-09T15:24:53.589642+0000","last_clean":"2024-03-09T15:24:53.589642+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:24:53.589642+0000","last_undegraded":"2024-03-09T15:24:53.589642+0000","last_fullsized":"2024-03-09T15:24:53.589642+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:24:53.589537+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:24:53.589537+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.589537+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:24.871040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322946,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":96221,"num_write":1020,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.501649+0000","last_change":"2024-03-09T15:24:55.501674+0000","last_active":"2024-03-09T15:24:55.501649+0000","last_peered":"2024-03-09T15:24:55.501649+0000","last_clean":"2024-03-09T15:24:55.501649+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:24:55.501649+0000","last_undegraded":"2024-03-09T15:24:55.501649+0000","last_fullsized":"2024-03-09T15:24:55.501649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.501552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.501552+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.501552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:49.656602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'110","reported_seq":659,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.069174+0000","last_change":"2024-03-09T15:24:57.069220+0000","last_active":"2024-03-09T15:24:57.069174+0000","last_peered":"2024-03-09T15:24:57.069174+0000","last_clean":"2024-03-09T15:24:57.069174+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:24:57.069174+0000","last_undegraded":"2024-03-09T15:24:57.069174+0000","last_fullsized":"2024-03-09T15:24:57.069174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'110","last_scrub_stamp":"2024-03-09T15:24:57.069084+0000","last_deep_scrub":"260'110","last_deep_scrub_stamp":"2024-03-09T15:24:57.069084+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.069084+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:48.543598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'507","reported_seq":2255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.884269+0000","last_change":"2024-03-09T15:24:51.884295+0000","last_active":"2024-03-09T15:24:51.884269+0000","last_peered":"2024-03-09T15:24:51.884269+0000","last_clean":"2024-03-09T15:24:51.884269+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:51.884269+0000","last_undegraded":"2024-03-09T15:24:51.884269+0000","last_fullsized":"2024-03-09T15:24:51.884269+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'507","last_scrub_stamp":"2024-03-09T15:24:51.884180+0000","last_deep_scrub":"260'507","last_deep_scrub_stamp":"2024-03-09T15:24:51.884180+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.884180+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:19.318327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'119","reported_seq":645,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.655714+0000","last_change":"2024-03-09T15:25:00.655743+0000","last_active":"2024-03-09T15:25:00.655714+0000","last_peered":"2024-03-09T15:25:00.655714+0000","last_clean":"2024-03-09T15:25:00.655714+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:25:00.655714+0000","last_undegraded":"2024-03-09T15:25:00.655714+0000","last_fullsized":"2024-03-09T15:25:00.655714+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-03-09T15:25:00.655625+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-03-09T15:25:00.655625+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.655625+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:34.048316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183884+0000","last_change":"2024-03-09T14:21:56.352673+0000","last_active":"2024-03-09T15:24:27.183884+0000","last_peered":"2024-03-09T15:24:27.183884+0000","last_clean":"2024-03-09T15:24:27.183884+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:24:27.183884+0000","last_undegraded":"2024-03-09T15:24:27.183884+0000","last_fullsized":"2024-03-09T15:24:27.183884+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'150","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.152234+0000","last_change":"2024-03-09T14:21:54.361414+0000","last_active":"2024-03-09T15:24:38.152234+0000","last_peered":"2024-03-09T15:24:38.152234+0000","last_clean":"2024-03-09T15:24:38.152234+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:24:38.152234+0000","last_undegraded":"2024-03-09T15:24:38.152234+0000","last_fullsized":"2024-03-09T15:24:38.152234+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":327,"num_read_kb":36416,"num_write":870,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.068924+0000","last_change":"2024-03-09T14:21:58.368512+0000","last_active":"2024-03-09T15:24:32.068924+0000","last_peered":"2024-03-09T15:24:32.068924+0000","last_clean":"2024-03-09T15:24:32.068924+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:24:32.068924+0000","last_undegraded":"2024-03-09T15:24:32.068924+0000","last_fullsized":"2024-03-09T15:24:32.068924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'175","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651235+0000","last_change":"2024-03-09T14:22:00.386165+0000","last_active":"2024-03-09T15:24:44.651235+0000","last_peered":"2024-03-09T15:24:44.651235+0000","last_clean":"2024-03-09T15:24:44.651235+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:24:44.651235+0000","last_undegraded":"2024-03-09T15:24:44.651235+0000","last_fullsized":"2024-03-09T15:24:44.651235+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":241,"num_read_kb":303,"num_write":134,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281407+0000","last_change":"2024-03-09T14:22:02.398377+0000","last_active":"2024-03-09T15:24:42.281407+0000","last_peered":"2024-03-09T15:24:42.281407+0000","last_clean":"2024-03-09T15:24:42.281407+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:24:42.281407+0000","last_undegraded":"2024-03-09T15:24:42.281407+0000","last_fullsized":"2024-03-09T15:24:42.281407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'112","reported_seq":618,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.702326+0000","last_change":"2024-03-09T15:24:59.702360+0000","last_active":"2024-03-09T15:24:59.702326+0000","last_peered":"2024-03-09T15:24:59.702326+0000","last_clean":"2024-03-09T15:24:59.702326+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:24:59.702326+0000","last_undegraded":"2024-03-09T15:24:59.702326+0000","last_fullsized":"2024-03-09T15:24:59.702326+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'112","last_scrub_stamp":"2024-03-09T15:24:59.702244+0000","last_deep_scrub":"260'112","last_deep_scrub_stamp":"2024-03-09T15:24:59.702244+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.702244+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:16.961678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183807+0000","last_change":"2024-03-09T14:21:56.352123+0000","last_active":"2024-03-09T15:24:27.183807+0000","last_peered":"2024-03-09T15:24:27.183807+0000","last_clean":"2024-03-09T15:24:27.183807+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:24:27.183807+0000","last_undegraded":"2024-03-09T15:24:27.183807+0000","last_fullsized":"2024-03-09T15:24:27.183807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'167","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.167405+0000","last_change":"2024-03-09T14:21:54.371725+0000","last_active":"2024-03-09T15:24:38.167405+0000","last_peered":"2024-03-09T15:24:38.167405+0000","last_clean":"2024-03-09T15:24:38.167405+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:24:38.167405+0000","last_undegraded":"2024-03-09T15:24:38.167405+0000","last_fullsized":"2024-03-09T15:24:38.167405+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":54818,"num_write":999,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.059993+0000","last_change":"2024-03-09T14:21:58.374073+0000","last_active":"2024-03-09T15:24:32.059993+0000","last_peered":"2024-03-09T15:24:32.059993+0000","last_clean":"2024-03-09T15:24:32.059993+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:24:32.059993+0000","last_undegraded":"2024-03-09T15:24:32.059993+0000","last_fullsized":"2024-03-09T15:24:32.059993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'136","reported_seq":706,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281365+0000","last_change":"2024-03-09T14:22:00.384316+0000","last_active":"2024-03-09T15:24:42.281365+0000","last_peered":"2024-03-09T15:24:42.281365+0000","last_clean":"2024-03-09T15:24:42.281365+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:24:42.281365+0000","last_undegraded":"2024-03-09T15:24:42.281365+0000","last_fullsized":"2024-03-09T15:24:42.281365+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":230,"num_write":94,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.879148+0000","last_change":"2024-03-09T15:24:53.879148+0000","last_active":"2024-03-09T15:24:53.879148+0000","last_peered":"2024-03-09T15:24:53.879148+0000","last_clean":"2024-03-09T15:24:53.879148+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:24:53.879148+0000","last_undegraded":"2024-03-09T15:24:53.879148+0000","last_fullsized":"2024-03-09T15:24:53.879148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.878965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.878965+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.878965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:10.584696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'99","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.415079+0000","last_change":"2024-03-09T15:24:59.415115+0000","last_active":"2024-03-09T15:24:59.415079+0000","last_peered":"2024-03-09T15:24:59.415079+0000","last_clean":"2024-03-09T15:24:59.415079+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:24:59.415079+0000","last_undegraded":"2024-03-09T15:24:59.415079+0000","last_fullsized":"2024-03-09T15:24:59.415079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'99","last_scrub_stamp":"2024-03-09T15:24:59.414984+0000","last_deep_scrub":"260'99","last_deep_scrub_stamp":"2024-03-09T15:24:59.414984+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.414984+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:31:06.423310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":770,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703949+0000","last_change":"2024-03-09T14:21:56.361858+0000","last_active":"2024-03-09T15:24:43.703949+0000","last_peered":"2024-03-09T15:24:43.703949+0000","last_clean":"2024-03-09T15:24:43.703949+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:24:43.703949+0000","last_undegraded":"2024-03-09T15:24:43.703949+0000","last_fullsized":"2024-03-09T15:24:43.703949+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'229","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.044122+0000","last_change":"2024-03-09T14:21:54.358944+0000","last_active":"2024-03-09T15:24:38.044122+0000","last_peered":"2024-03-09T15:24:38.044122+0000","last_clean":"2024-03-09T15:24:38.044122+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:24:38.044122+0000","last_undegraded":"2024-03-09T15:24:38.044122+0000","last_fullsized":"2024-03-09T15:24:38.044122+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":44740,"num_write":1211,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.179027+0000","last_change":"2024-03-09T14:21:58.368610+0000","last_active":"2024-03-09T15:24:44.179027+0000","last_peered":"2024-03-09T15:24:44.179027+0000","last_clean":"2024-03-09T15:24:44.179027+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:24:44.179027+0000","last_undegraded":"2024-03-09T15:24:44.179027+0000","last_fullsized":"2024-03-09T15:24:44.179027+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'115","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.096009+0000","last_change":"2024-03-09T14:22:00.390046+0000","last_active":"2024-03-09T15:24:38.096009+0000","last_peered":"2024-03-09T15:24:38.096009+0000","last_clean":"2024-03-09T15:24:38.096009+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:24:38.096009+0000","last_undegraded":"2024-03-09T15:24:38.096009+0000","last_fullsized":"2024-03-09T15:24:38.096009+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":194,"num_write":70,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.053602+0000","last_change":"2024-03-09T15:24:55.053626+0000","last_active":"2024-03-09T15:24:55.053602+0000","last_peered":"2024-03-09T15:24:55.053602+0000","last_clean":"2024-03-09T15:24:55.053602+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:24:55.053602+0000","last_undegraded":"2024-03-09T15:24:55.053602+0000","last_fullsized":"2024-03-09T15:24:55.053602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.053498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.053498+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.053498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:38.275368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'150","reported_seq":1819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.611849+0000","last_change":"2024-03-09T15:25:01.611893+0000","last_active":"2024-03-09T15:25:01.611849+0000","last_peered":"2024-03-09T15:25:01.611849+0000","last_clean":"2024-03-09T15:25:01.611849+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:25:01.611849+0000","last_undegraded":"2024-03-09T15:25:01.611849+0000","last_fullsized":"2024-03-09T15:25:01.611849+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'150","last_scrub_stamp":"2024-03-09T15:25:01.611770+0000","last_deep_scrub":"260'150","last_deep_scrub_stamp":"2024-03-09T15:25:01.611770+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.611770+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:25.632376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178825+0000","last_change":"2024-03-09T14:21:56.356912+0000","last_active":"2024-03-09T15:24:44.178825+0000","last_peered":"2024-03-09T15:24:44.178825+0000","last_clean":"2024-03-09T15:24:44.178825+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:24:44.178825+0000","last_undegraded":"2024-03-09T15:24:44.178825+0000","last_fullsized":"2024-03-09T15:24:44.178825+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'214","reported_seq":979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.167481+0000","last_change":"2024-03-09T14:21:54.358595+0000","last_active":"2024-03-09T15:24:38.167481+0000","last_peered":"2024-03-09T15:24:38.167481+0000","last_clean":"2024-03-09T15:24:38.167481+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:24:38.167481+0000","last_undegraded":"2024-03-09T15:24:38.167481+0000","last_fullsized":"2024-03-09T15:24:38.167481+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284795,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":699,"num_read_kb":64460,"num_write":1159,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'6","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.466144+0000","last_change":"2024-03-09T15:24:54.466144+0000","last_active":"2024-03-09T15:24:54.466144+0000","last_peered":"2024-03-09T15:24:54.466144+0000","last_clean":"2024-03-09T15:24:54.466144+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:54.466144+0000","last_undegraded":"2024-03-09T15:24:54.466144+0000","last_fullsized":"2024-03-09T15:24:54.466144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:24:54.466003+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:24:54.466003+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.466003+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:49:13.636187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'166","reported_seq":763,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.116848+0000","last_change":"2024-03-09T14:22:00.381012+0000","last_active":"2024-03-09T15:24:38.116848+0000","last_peered":"2024-03-09T15:24:38.116848+0000","last_clean":"2024-03-09T15:24:38.116848+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:24:38.116848+0000","last_undegraded":"2024-03-09T15:24:38.116848+0000","last_fullsized":"2024-03-09T15:24:38.116848+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20360,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":325,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":483,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:31.922118+0000","last_change":"2024-03-09T14:22:02.401394+0000","last_active":"2024-03-09T15:24:31.922118+0000","last_peered":"2024-03-09T15:24:31.922118+0000","last_clean":"2024-03-09T15:24:31.922118+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:24:31.922118+0000","last_undegraded":"2024-03-09T15:24:31.922118+0000","last_fullsized":"2024-03-09T15:24:31.922118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'109","reported_seq":629,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.022366+0000","last_change":"2024-03-09T15:24:50.022419+0000","last_active":"2024-03-09T15:24:50.022366+0000","last_peered":"2024-03-09T15:24:50.022366+0000","last_clean":"2024-03-09T15:24:50.022366+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:24:50.022366+0000","last_undegraded":"2024-03-09T15:24:50.022366+0000","last_fullsized":"2024-03-09T15:24:50.022366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-03-09T15:24:50.022263+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-03-09T15:24:50.022263+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.022263+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:01:53.310008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":612,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756105+0000","last_change":"2024-03-09T14:21:56.357674+0000","last_active":"2024-03-09T15:24:42.756105+0000","last_peered":"2024-03-09T15:24:42.756105+0000","last_clean":"2024-03-09T15:24:42.756105+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:24:42.756105+0000","last_undegraded":"2024-03-09T15:24:42.756105+0000","last_fullsized":"2024-03-09T15:24:42.756105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'182","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.100852+0000","last_change":"2024-03-09T14:21:54.367079+0000","last_active":"2024-03-09T15:24:38.100852+0000","last_peered":"2024-03-09T15:24:38.100852+0000","last_clean":"2024-03-09T15:24:38.100852+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:24:38.100852+0000","last_undegraded":"2024-03-09T15:24:38.100852+0000","last_fullsized":"2024-03-09T15:24:38.100852+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342104,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":789,"num_read_kb":18311,"num_write":1113,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.575183+0000","last_change":"2024-03-09T15:24:57.575211+0000","last_active":"2024-03-09T15:24:57.575183+0000","last_peered":"2024-03-09T15:24:57.575183+0000","last_clean":"2024-03-09T15:24:57.575183+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:24:57.575183+0000","last_undegraded":"2024-03-09T15:24:57.575183+0000","last_fullsized":"2024-03-09T15:24:57.575183+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'231","last_scrub_stamp":"2024-03-09T15:24:57.575095+0000","last_deep_scrub":"260'231","last_deep_scrub_stamp":"2024-03-09T15:24:57.575095+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.575095+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:22:23.882512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'271","reported_seq":1092,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.676663+0000","last_change":"2024-03-09T15:25:01.676707+0000","last_active":"2024-03-09T15:25:01.676663+0000","last_peered":"2024-03-09T15:25:01.676663+0000","last_clean":"2024-03-09T15:25:01.676663+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:25:01.676663+0000","last_undegraded":"2024-03-09T15:25:01.676663+0000","last_fullsized":"2024-03-09T15:25:01.676663+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'271","last_scrub_stamp":"2024-03-09T15:25:01.676568+0000","last_deep_scrub":"260'271","last_deep_scrub_stamp":"2024-03-09T15:25:01.676568+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.676568+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:03.427239+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1220,"num_read_kb":137737,"num_write":1250,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651152+0000","last_change":"2024-03-09T14:21:56.360003+0000","last_active":"2024-03-09T15:24:44.651152+0000","last_peered":"2024-03-09T15:24:44.651152+0000","last_clean":"2024-03-09T15:24:44.651152+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:24:44.651152+0000","last_undegraded":"2024-03-09T15:24:44.651152+0000","last_fullsized":"2024-03-09T15:24:44.651152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'163","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.061949+0000","last_change":"2024-03-09T14:21:54.370800+0000","last_active":"2024-03-09T15:24:38.061949+0000","last_peered":"2024-03-09T15:24:38.061949+0000","last_clean":"2024-03-09T15:24:38.061949+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:24:38.061949+0000","last_undegraded":"2024-03-09T15:24:38.061949+0000","last_fullsized":"2024-03-09T15:24:38.061949+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":5631,"num_write":926,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":751,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756187+0000","last_change":"2024-03-09T14:21:56.364838+0000","last_active":"2024-03-09T15:24:42.756187+0000","last_peered":"2024-03-09T15:24:42.756187+0000","last_clean":"2024-03-09T15:24:42.756187+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:24:42.756187+0000","last_undegraded":"2024-03-09T15:24:42.756187+0000","last_fullsized":"2024-03-09T15:24:42.756187+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'146","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.598133+0000","last_change":"2024-03-09T15:24:54.598212+0000","last_active":"2024-03-09T15:24:54.598133+0000","last_peered":"2024-03-09T15:24:54.598133+0000","last_clean":"2024-03-09T15:24:54.598133+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:24:54.598133+0000","last_undegraded":"2024-03-09T15:24:54.598133+0000","last_fullsized":"2024-03-09T15:24:54.598133+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:24:54.598022+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:24:54.598022+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.598022+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:02.821961+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4226579,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":2407,"num_write":836,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'203","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.039544+0000","last_change":"2024-03-09T14:21:56.356735+0000","last_active":"2024-03-09T15:24:42.039544+0000","last_peered":"2024-03-09T15:24:42.039544+0000","last_clean":"2024-03-09T15:24:42.039544+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:24:42.039544+0000","last_undegraded":"2024-03-09T15:24:42.039544+0000","last_fullsized":"2024-03-09T15:24:42.039544+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'227","reported_seq":966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703764+0000","last_change":"2024-03-09T14:21:54.360027+0000","last_active":"2024-03-09T15:24:43.703764+0000","last_peered":"2024-03-09T15:24:43.703764+0000","last_clean":"2024-03-09T15:24:43.703764+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:24:43.703764+0000","last_undegraded":"2024-03-09T15:24:43.703764+0000","last_fullsized":"2024-03-09T15:24:43.703764+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079971,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":807,"num_read_kb":22283,"num_write":1154,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.082767+0000","last_change":"2024-03-09T15:25:02.082809+0000","last_active":"2024-03-09T15:25:02.082767+0000","last_peered":"2024-03-09T15:25:02.082767+0000","last_clean":"2024-03-09T15:25:02.082767+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:25:02.082767+0000","last_undegraded":"2024-03-09T15:25:02.082767+0000","last_fullsized":"2024-03-09T15:25:02.082767+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'143","last_scrub_stamp":"2024-03-09T15:25:02.082645+0000","last_deep_scrub":"260'143","last_deep_scrub_stamp":"2024-03-09T15:25:02.082645+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.082645+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:08.396801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'197","reported_seq":860,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.755976+0000","last_change":"2024-03-09T14:21:54.371723+0000","last_active":"2024-03-09T15:24:42.755976+0000","last_peered":"2024-03-09T15:24:42.755976+0000","last_clean":"2024-03-09T15:24:42.755976+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:24:42.755976+0000","last_undegraded":"2024-03-09T15:24:42.755976+0000","last_fullsized":"2024-03-09T15:24:42.755976+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":38599,"num_write":1107,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1017,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.037641+0000","last_change":"2024-03-09T14:21:56.359970+0000","last_active":"2024-03-09T15:24:27.037641+0000","last_peered":"2024-03-09T15:24:27.037641+0000","last_clean":"2024-03-09T15:24:27.037641+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:24:27.037641+0000","last_undegraded":"2024-03-09T15:24:27.037641+0000","last_fullsized":"2024-03-09T15:24:27.037641+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'214","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.122922+0000","last_change":"2024-03-09T14:21:54.364970+0000","last_active":"2024-03-09T15:24:45.122922+0000","last_peered":"2024-03-09T15:24:45.122922+0000","last_clean":"2024-03-09T15:24:45.122922+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:24:45.122922+0000","last_undegraded":"2024-03-09T15:24:45.122922+0000","last_fullsized":"2024-03-09T15:24:45.122922+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":1161,"num_write":1167,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":968,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.059239+0000","last_change":"2024-03-09T14:21:56.360728+0000","last_active":"2024-03-09T15:24:27.059239+0000","last_peered":"2024-03-09T15:24:27.059239+0000","last_clean":"2024-03-09T15:24:27.059239+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:24:27.059239+0000","last_undegraded":"2024-03-09T15:24:27.059239+0000","last_fullsized":"2024-03-09T15:24:27.059239+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'187","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703740+0000","last_change":"2024-03-09T14:21:54.365980+0000","last_active":"2024-03-09T15:24:43.703740+0000","last_peered":"2024-03-09T15:24:43.703740+0000","last_clean":"2024-03-09T15:24:43.703740+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:24:43.703740+0000","last_undegraded":"2024-03-09T15:24:43.703740+0000","last_fullsized":"2024-03-09T15:24:43.703740+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":434,"num_read_kb":15052,"num_write":1039,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":728,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.526029+0000","last_change":"2024-03-09T15:24:51.526029+0000","last_active":"2024-03-09T15:24:51.526029+0000","last_peered":"2024-03-09T15:24:51.526029+0000","last_clean":"2024-03-09T15:24:51.526029+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:24:51.526029+0000","last_undegraded":"2024-03-09T15:24:51.526029+0000","last_fullsized":"2024-03-09T15:24:51.526029+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'131","last_scrub_stamp":"2024-03-09T15:24:51.525912+0000","last_deep_scrub":"260'131","last_deep_scrub_stamp":"2024-03-09T15:24:51.525912+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.525912+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:26.494362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'174","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650867+0000","last_change":"2024-03-09T14:21:54.370760+0000","last_active":"2024-03-09T15:24:44.650867+0000","last_peered":"2024-03-09T15:24:44.650867+0000","last_clean":"2024-03-09T15:24:44.650867+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:24:44.650867+0000","last_undegraded":"2024-03-09T15:24:44.650867+0000","last_fullsized":"2024-03-09T15:24:44.650867+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":2617,"num_write":1101,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'89","reported_seq":664,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178896+0000","last_change":"2024-03-09T14:21:56.362263+0000","last_active":"2024-03-09T15:24:44.178896+0000","last_peered":"2024-03-09T15:24:44.178896+0000","last_clean":"2024-03-09T15:24:44.178896+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:24:44.178896+0000","last_undegraded":"2024-03-09T15:24:44.178896+0000","last_fullsized":"2024-03-09T15:24:44.178896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.869479+0000","last_change":"2024-03-09T15:24:48.869520+0000","last_active":"2024-03-09T15:24:48.869479+0000","last_peered":"2024-03-09T15:24:48.869479+0000","last_clean":"2024-03-09T15:24:48.869479+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:24:48.869479+0000","last_undegraded":"2024-03-09T15:24:48.869479+0000","last_fullsized":"2024-03-09T15:24:48.869479+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'212","last_scrub_stamp":"2024-03-09T15:24:48.869376+0000","last_deep_scrub":"260'212","last_deep_scrub_stamp":"2024-03-09T15:24:48.869376+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.869376+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:06.455688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":725,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:22:52.006698+0000","last_change":"2024-03-09T14:21:56.361155+0000","last_active":"2024-03-09T15:22:52.006698+0000","last_peered":"2024-03-09T15:22:52.006698+0000","last_clean":"2024-03-09T15:22:52.006698+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:22:52.006698+0000","last_undegraded":"2024-03-09T15:22:52.006698+0000","last_fullsized":"2024-03-09T15:22:52.006698+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'157","reported_seq":765,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650903+0000","last_change":"2024-03-09T14:21:54.359540+0000","last_active":"2024-03-09T15:24:44.650903+0000","last_peered":"2024-03-09T15:24:44.650903+0000","last_clean":"2024-03-09T15:24:44.650903+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:24:44.650903+0000","last_undegraded":"2024-03-09T15:24:44.650903+0000","last_fullsized":"2024-03-09T15:24:44.650903+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262239,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":372,"num_read_kb":3591,"num_write":919,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":617,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178874+0000","last_change":"2024-03-09T14:21:56.357637+0000","last_active":"2024-03-09T15:24:44.178874+0000","last_peered":"2024-03-09T15:24:44.178874+0000","last_clean":"2024-03-09T15:24:44.178874+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:24:44.178874+0000","last_undegraded":"2024-03-09T15:24:44.178874+0000","last_fullsized":"2024-03-09T15:24:44.178874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'229","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281028+0000","last_change":"2024-03-09T14:21:54.361294+0000","last_active":"2024-03-09T15:24:42.281028+0000","last_peered":"2024-03-09T15:24:42.281028+0000","last_clean":"2024-03-09T15:24:42.281028+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:24:42.281028+0000","last_undegraded":"2024-03-09T15:24:42.281028+0000","last_fullsized":"2024-03-09T15:24:42.281028+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":6366,"num_write":1241,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'192","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596582+0000","last_change":"2024-03-09T14:21:56.366542+0000","last_active":"2024-03-09T15:24:45.596582+0000","last_peered":"2024-03-09T15:24:45.596582+0000","last_clean":"2024-03-09T15:24:45.596582+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:24:45.596582+0000","last_undegraded":"2024-03-09T15:24:45.596582+0000","last_fullsized":"2024-03-09T15:24:45.596582+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'213","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.835888+0000","last_change":"2024-03-09T15:24:52.836015+0000","last_active":"2024-03-09T15:24:52.835888+0000","last_peered":"2024-03-09T15:24:52.835888+0000","last_clean":"2024-03-09T15:24:52.835888+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:24:52.835888+0000","last_undegraded":"2024-03-09T15:24:52.835888+0000","last_fullsized":"2024-03-09T15:24:52.835888+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-03-09T15:24:52.835746+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-03-09T15:24:52.835746+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.835746+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:24.034553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343410,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":30999,"num_write":1210,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":861,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281164+0000","last_change":"2024-03-09T14:21:56.371868+0000","last_active":"2024-03-09T15:24:42.281164+0000","last_peered":"2024-03-09T15:24:42.281164+0000","last_clean":"2024-03-09T15:24:42.281164+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:24:42.281164+0000","last_undegraded":"2024-03-09T15:24:42.281164+0000","last_fullsized":"2024-03-09T15:24:42.281164+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'188","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.052495+0000","last_change":"2024-03-09T14:21:54.364838+0000","last_active":"2024-03-09T15:24:38.052495+0000","last_peered":"2024-03-09T15:24:38.052495+0000","last_clean":"2024-03-09T15:24:38.052495+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:24:38.052495+0000","last_undegraded":"2024-03-09T15:24:38.052495+0000","last_fullsized":"2024-03-09T15:24:38.052495+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":358,"num_read_kb":8057,"num_write":1058,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704089+0000","last_change":"2024-03-09T14:21:56.374875+0000","last_active":"2024-03-09T15:24:43.704089+0000","last_peered":"2024-03-09T15:24:43.704089+0000","last_clean":"2024-03-09T15:24:43.704089+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:24:43.704089+0000","last_undegraded":"2024-03-09T15:24:43.704089+0000","last_fullsized":"2024-03-09T15:24:43.704089+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'194","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.701458+0000","last_change":"2024-03-09T15:25:00.701513+0000","last_active":"2024-03-09T15:25:00.701458+0000","last_peered":"2024-03-09T15:25:00.701458+0000","last_clean":"2024-03-09T15:25:00.701458+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:25:00.701458+0000","last_undegraded":"2024-03-09T15:25:00.701458+0000","last_fullsized":"2024-03-09T15:25:00.701458+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-03-09T15:25:00.701355+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-03-09T15:25:00.701355+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.701355+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:44.493825+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867857,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":1771,"num_write":1080,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":737,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596554+0000","last_change":"2024-03-09T14:21:56.366749+0000","last_active":"2024-03-09T15:24:45.596554+0000","last_peered":"2024-03-09T15:24:45.596554+0000","last_clean":"2024-03-09T15:24:45.596554+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:24:45.596554+0000","last_undegraded":"2024-03-09T15:24:45.596554+0000","last_fullsized":"2024-03-09T15:24:45.596554+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'195","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650921+0000","last_change":"2024-03-09T14:21:54.362334+0000","last_active":"2024-03-09T15:24:44.650921+0000","last_peered":"2024-03-09T15:24:44.650921+0000","last_clean":"2024-03-09T15:24:44.650921+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:24:44.650921+0000","last_undegraded":"2024-03-09T15:24:44.650921+0000","last_fullsized":"2024-03-09T15:24:44.650921+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":6618,"num_write":1000,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'208","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.458832+0000","last_change":"2024-03-09T15:24:47.458832+0000","last_active":"2024-03-09T15:24:47.458832+0000","last_peered":"2024-03-09T15:24:47.458832+0000","last_clean":"2024-03-09T15:24:47.458832+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:24:47.458832+0000","last_undegraded":"2024-03-09T15:24:47.458832+0000","last_fullsized":"2024-03-09T15:24:47.458832+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'208","last_scrub_stamp":"2024-03-09T15:24:47.458581+0000","last_deep_scrub":"260'208","last_deep_scrub_stamp":"2024-03-09T15:24:47.458581+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.458581+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:31:30.767151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":70161,"num_write":1223,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":920,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:23.105591+0000","last_change":"2024-03-09T14:21:56.373545+0000","last_active":"2024-03-09T15:23:23.105591+0000","last_peered":"2024-03-09T15:23:23.105591+0000","last_clean":"2024-03-09T15:23:23.105591+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:23:23.105591+0000","last_undegraded":"2024-03-09T15:23:23.105591+0000","last_fullsized":"2024-03-09T15:23:23.105591+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'195","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756050+0000","last_change":"2024-03-09T14:21:54.366684+0000","last_active":"2024-03-09T15:24:42.756050+0000","last_peered":"2024-03-09T15:24:42.756050+0000","last_clean":"2024-03-09T15:24:42.756050+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:24:42.756050+0000","last_undegraded":"2024-03-09T15:24:42.756050+0000","last_fullsized":"2024-03-09T15:24:42.756050+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":29809,"num_write":1056,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":649,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651129+0000","last_change":"2024-03-09T14:21:56.373920+0000","last_active":"2024-03-09T15:24:44.651129+0000","last_peered":"2024-03-09T15:24:44.651129+0000","last_clean":"2024-03-09T15:24:44.651129+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:24:44.651129+0000","last_undegraded":"2024-03-09T15:24:44.651129+0000","last_fullsized":"2024-03-09T15:24:44.651129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5640,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1228,"ondisk_log_size":1228,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1642,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2028,"ondisk_log_size":2028,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":556,"ondisk_log_size":556,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":248436,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":9145,"num_read_kb":11177,"num_write":6541,"num_write_kb":2993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":136996,"num_omap_keys":320,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1749,"ondisk_log_size":1749,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3748,"ondisk_log_size":3748,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":112174806,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":32019,"num_read_kb":2295864,"num_write":68252,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170090496,"data_stored":170090496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4240,"ondisk_log_size":4240,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":170575,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":174957,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575613,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319692,"kb_used_data":23364,"kb_used_omap":1,"kb_used_meta":296318,"kb_avail":94052148,"statfs":{"total":96636764160,"available":96309399552,"internally_reserved":0,"allocated":23924736,"data_stored":21980799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":303430090},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575613,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275968,"kb_used_data":37944,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94095872,"statfs":{"total":96636764160,"available":96354172928,"internally_reserved":0,"allocated":38854656,"data_stored":36958563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575614,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122740,"kb_used_data":37484,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94249100,"statfs":{"total":96636764160,"available":96511078400,"internally_reserved":0,"allocated":38383616,"data_stored":36419893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575615,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118904,"kb_used_data":43312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94252936,"statfs":{"total":96636764160,"available":96515006464,"internally_reserved":0,"allocated":44351488,"data_stored":42475464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575616,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241172,"kb_used_data":29516,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94130668,"statfs":{"total":96636764160,"available":96389804032,"internally_reserved":0,"allocated":30224384,"data_stored":28300435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575615,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110248,"kb_used_data":24992,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94261592,"statfs":{"total":96636764160,"available":96523870208,"internally_reserved":0,"allocated":25591808,"data_stored":23689459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575614,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141856,"kb_used_data":34392,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94229984,"statfs":{"total":96636764160,"available":96491503616,"internally_reserved":0,"allocated":35217408,"data_stored":33306448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575612,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254404,"kb_used_data":34428,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94117436,"statfs":{"total":96636764160,"available":96376254464,"internally_reserved":0,"allocated":35254272,"data_stored":33315187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30007296,"data_stored":30007296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16187392,"data_stored":16187392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23441408,"data_stored":23441408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18432000,"data_stored":18432000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24215552,"data_stored":24215552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18083840,"data_stored":18083840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:25:06.439 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.439 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.439 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.439 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.440 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.440 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.440 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.440 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.440 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.440 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.441 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.441 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.441 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.441 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.441 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.442 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.442 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.442 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.442 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.442 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.442 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.443 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.443 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.443 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.443 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.443 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.444 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.444 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.444 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.444 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.444 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.444 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.445 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.445 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.445 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.445 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.445 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.445 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.446 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.446 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.446 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.446 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.446 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-09T14:31:00.115106+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=31, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.447 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.447 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.447 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.447 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.447 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.447 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.448 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.448 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.448 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.448 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.448 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.449 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.449 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.449 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.449 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.449 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.450 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.450 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.450 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.450 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.450 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.451 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.451 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.451 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.451 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.451 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.452 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.453 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.453 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.453 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.453 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.453 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.453 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.454 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.454 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.454 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.454 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.454 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.455 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.456 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.456 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.456 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.456 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.456 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.456 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.457 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.457 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.457 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.457 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.457 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.457 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.458 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.458 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.458 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.458 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.458 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.458 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.459 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.459 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.459 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.459 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.459 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.459 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.460 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.460 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.460 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.460 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.460 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.460 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.461 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.461 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.461 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.461 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.461 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.461 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.462 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.462 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.462 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.462 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.462 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.462 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.463 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.463 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.463 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.463 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.463 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.463 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.464 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.464 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.464 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.464 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.464 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.464 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.465 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.465 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.465 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.465 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.465 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:21:38.278811+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=38, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.465 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.466 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.466 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.466 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.466 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.466 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.466 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.467 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.467 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.467 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.467 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.467 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.467 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.468 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.468 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.468 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.468 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.468 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.468 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.469 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.469 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.469 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.469 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.469 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.469 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.470 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.470 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.470 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.470 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.470 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.470 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.471 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.471 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.471 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.471 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.471 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.471 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.472 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.472 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.472 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.472 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.472 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.472 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-09T14:22:03.382113+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=3, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.473 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.474 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.474 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.474 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.474 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.474 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.474 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.475 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.475 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.475 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.475 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.475 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.475 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.476 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.476 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.476 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.476 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.476 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.476 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.477 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.477 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.477 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.477 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.477 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.477 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.478 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.478 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.478 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.478 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.478 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.478 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.479 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.480 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.480 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.480 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.480 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.480 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.480 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.481 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.481 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.481 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:06.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:25:26.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:25:26.832 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:25:26.844 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:25:26.847 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2167,"stamp":"2024-03-09T15:25:25.169386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":146582508,"num_objects":538,"num_object_clones":0,"num_object_copies":1298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":151082,"num_read_kb":2744375,"num_write":128593,"num_write_kb":2398318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":708074,"num_omap_keys":1713,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13900,"ondisk_log_size":13900,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1572504,"kb_used_data":265432,"kb_used_omap":12,"kb_used_meta":1306995,"kb_avail":753402216,"statfs":{"total":773094113280,"available":771483869184,"internally_reserved":0,"allocated":271802368,"data_stored":256446248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1338363440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":514509,"num_omap_keys":1196,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005496"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651659+0000","last_change":"2024-03-09T14:50:03.656802+0000","last_active":"2024-03-09T15:24:44.651659+0000","last_peered":"2024-03-09T15:24:44.651659+0000","last_clean":"2024-03-09T15:24:44.651659+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:24:44.651659+0000","last_undegraded":"2024-03-09T15:24:44.651659+0000","last_fullsized":"2024-03-09T15:24:44.651659+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'8","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.053042+0000","last_change":"2024-03-09T14:35:55.601961+0000","last_active":"2024-03-09T15:24:38.053042+0000","last_peered":"2024-03-09T15:24:38.053042+0000","last_clean":"2024-03-09T15:24:38.053042+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:24:38.053042+0000","last_undegraded":"2024-03-09T15:24:38.053042+0000","last_fullsized":"2024-03-09T15:24:38.053042+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.522125+0000","last_change":"2024-03-09T15:24:45.522159+0000","last_active":"2024-03-09T15:24:45.522125+0000","last_peered":"2024-03-09T15:24:45.522125+0000","last_clean":"2024-03-09T15:24:45.522125+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:24:45.522125+0000","last_undegraded":"2024-03-09T15:24:45.522125+0000","last_fullsized":"2024-03-09T15:24:45.522125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:45.522026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:45.522026+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.522026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:01.025473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.400651+0000","last_change":"2024-03-09T15:24:42.400651+0000","last_active":"2024-03-09T15:24:42.400651+0000","last_peered":"2024-03-09T15:24:42.400651+0000","last_clean":"2024-03-09T15:24:42.400651+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:24:42.400651+0000","last_undegraded":"2024-03-09T15:24:42.400651+0000","last_fullsized":"2024-03-09T15:24:42.400651+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:42.400547+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:42.400547+0000","last_clean_scrub_stamp":"2024-03-09T15:24:42.400547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:59.057207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.684578+0000","last_change":"2024-03-09T15:25:15.684621+0000","last_active":"2024-03-09T15:25:15.684578+0000","last_peered":"2024-03-09T15:25:15.684578+0000","last_clean":"2024-03-09T15:25:15.684578+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:25:15.684578+0000","last_undegraded":"2024-03-09T15:25:15.684578+0000","last_fullsized":"2024-03-09T15:25:15.684578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:15.684464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:15.684464+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.684464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:26.930217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":42,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.175523+0000","last_change":"2024-03-09T14:35:55.598964+0000","last_active":"2024-03-09T15:23:27.175523+0000","last_peered":"2024-03-09T15:23:27.175523+0000","last_clean":"2024-03-09T15:23:27.175523+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:23:27.175523+0000","last_undegraded":"2024-03-09T15:23:27.175523+0000","last_fullsized":"2024-03-09T15:23:27.175523+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.419467+0000","last_change":"2024-03-09T15:24:48.419511+0000","last_active":"2024-03-09T15:24:48.419467+0000","last_peered":"2024-03-09T15:24:48.419467+0000","last_clean":"2024-03-09T15:24:48.419467+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:24:48.419467+0000","last_undegraded":"2024-03-09T15:24:48.419467+0000","last_fullsized":"2024-03-09T15:24:48.419467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:48.419366+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:48.419366+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.419366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:11.692358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":166,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.717456+0000","last_change":"2024-03-09T15:24:58.717456+0000","last_active":"2024-03-09T15:24:58.717456+0000","last_peered":"2024-03-09T15:24:58.717456+0000","last_clean":"2024-03-09T15:24:58.717456+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:24:58.717456+0000","last_undegraded":"2024-03-09T15:24:58.717456+0000","last_fullsized":"2024-03-09T15:24:58.717456+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'41","last_scrub_stamp":"2024-03-09T15:24:58.717334+0000","last_deep_scrub":"260'41","last_deep_scrub_stamp":"2024-03-09T15:24:58.717334+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.717334+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:04.291118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.739701+0000","last_change":"2024-03-09T15:25:21.739728+0000","last_active":"2024-03-09T15:25:21.739701+0000","last_peered":"2024-03-09T15:25:21.739701+0000","last_clean":"2024-03-09T15:25:21.739701+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:25:21.739701+0000","last_undegraded":"2024-03-09T15:25:21.739701+0000","last_fullsized":"2024-03-09T15:25:21.739701+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:21.739582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:21.739582+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.739582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:00.133894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'2","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.175527+0000","last_change":"2024-03-09T14:35:55.635024+0000","last_active":"2024-03-09T15:24:38.175527+0000","last_peered":"2024-03-09T15:24:38.175527+0000","last_clean":"2024-03-09T15:24:38.175527+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:24:38.175527+0000","last_undegraded":"2024-03-09T15:24:38.175527+0000","last_fullsized":"2024-03-09T15:24:38.175527+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'9","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.588330+0000","last_change":"2024-03-09T15:25:09.588354+0000","last_active":"2024-03-09T15:25:09.588330+0000","last_peered":"2024-03-09T15:25:09.588330+0000","last_clean":"2024-03-09T15:25:09.588330+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:25:09.588330+0000","last_undegraded":"2024-03-09T15:25:09.588330+0000","last_fullsized":"2024-03-09T15:25:09.588330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:25:09.588233+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:25:09.588233+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.588233+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:15.832508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.486516+0000","last_change":"2024-03-09T15:24:50.486571+0000","last_active":"2024-03-09T15:24:50.486516+0000","last_peered":"2024-03-09T15:24:50.486516+0000","last_clean":"2024-03-09T15:24:50.486516+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:24:50.486516+0000","last_undegraded":"2024-03-09T15:24:50.486516+0000","last_fullsized":"2024-03-09T15:24:50.486516+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-03-09T15:24:50.486408+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-03-09T15:24:50.486408+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.486408+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:55.168821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.035300+0000","last_change":"2024-03-09T14:50:03.664715+0000","last_active":"2024-03-09T15:24:07.035300+0000","last_peered":"2024-03-09T15:24:07.035300+0000","last_clean":"2024-03-09T15:24:07.035300+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:24:07.035300+0000","last_undegraded":"2024-03-09T15:24:07.035300+0000","last_fullsized":"2024-03-09T15:24:07.035300+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'4","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.402108+0000","last_change":"2024-03-09T15:25:13.402175+0000","last_active":"2024-03-09T15:25:13.402108+0000","last_peered":"2024-03-09T15:25:13.402108+0000","last_clean":"2024-03-09T15:25:13.402108+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:25:13.402108+0000","last_undegraded":"2024-03-09T15:25:13.402108+0000","last_fullsized":"2024-03-09T15:25:13.402108+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-03-09T15:25:13.401993+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-03-09T15:25:13.401993+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.401993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:48:46.625514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":4,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.097878+0000","last_change":"2024-03-09T15:24:56.097903+0000","last_active":"2024-03-09T15:24:56.097878+0000","last_peered":"2024-03-09T15:24:56.097878+0000","last_clean":"2024-03-09T15:24:56.097878+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:24:56.097878+0000","last_undegraded":"2024-03-09T15:24:56.097878+0000","last_fullsized":"2024-03-09T15:24:56.097878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.097789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.097789+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.097789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:38.020173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.524498+0000","last_change":"2024-03-09T15:24:46.524522+0000","last_active":"2024-03-09T15:24:46.524498+0000","last_peered":"2024-03-09T15:24:46.524498+0000","last_clean":"2024-03-09T15:24:46.524498+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:24:46.524498+0000","last_undegraded":"2024-03-09T15:24:46.524498+0000","last_fullsized":"2024-03-09T15:24:46.524498+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-03-09T15:24:46.524416+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-03-09T15:24:46.524416+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.524416+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:58.615066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.036509+0000","last_change":"2024-03-09T14:50:03.656253+0000","last_active":"2024-03-09T15:24:17.036509+0000","last_peered":"2024-03-09T15:24:17.036509+0000","last_clean":"2024-03-09T15:24:17.036509+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:24:17.036509+0000","last_undegraded":"2024-03-09T15:24:17.036509+0000","last_fullsized":"2024-03-09T15:24:17.036509+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.081093+0000","last_change":"2024-03-09T14:35:55.603890+0000","last_active":"2024-03-09T15:24:38.081093+0000","last_peered":"2024-03-09T15:24:38.081093+0000","last_clean":"2024-03-09T15:24:38.081093+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:24:38.081093+0000","last_undegraded":"2024-03-09T15:24:38.081093+0000","last_fullsized":"2024-03-09T15:24:38.081093+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.628724+0000","last_change":"2024-03-09T15:24:56.628747+0000","last_active":"2024-03-09T15:24:56.628724+0000","last_peered":"2024-03-09T15:24:56.628724+0000","last_clean":"2024-03-09T15:24:56.628724+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:24:56.628724+0000","last_undegraded":"2024-03-09T15:24:56.628724+0000","last_fullsized":"2024-03-09T15:24:56.628724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:56.628637+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:56.628637+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.628637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:17.119574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.565793+0000","last_change":"2024-03-09T15:24:48.565834+0000","last_active":"2024-03-09T15:24:48.565793+0000","last_peered":"2024-03-09T15:24:48.565793+0000","last_clean":"2024-03-09T15:24:48.565793+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:24:48.565793+0000","last_undegraded":"2024-03-09T15:24:48.565793+0000","last_fullsized":"2024-03-09T15:24:48.565793+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'46","last_scrub_stamp":"2024-03-09T15:24:48.565702+0000","last_deep_scrub":"257'46","last_deep_scrub_stamp":"2024-03-09T15:24:48.565702+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.565702+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:18:54.025559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.012636+0000","last_change":"2024-03-09T14:50:03.661504+0000","last_active":"2024-03-09T15:23:27.012636+0000","last_peered":"2024-03-09T15:23:27.012636+0000","last_clean":"2024-03-09T15:23:27.012636+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:23:27.012636+0000","last_undegraded":"2024-03-09T15:23:27.012636+0000","last_fullsized":"2024-03-09T15:23:27.012636+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.721702+0000","last_change":"2024-03-09T15:25:17.721738+0000","last_active":"2024-03-09T15:25:17.721702+0000","last_peered":"2024-03-09T15:25:17.721702+0000","last_clean":"2024-03-09T15:25:17.721702+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:25:17.721702+0000","last_undegraded":"2024-03-09T15:25:17.721702+0000","last_fullsized":"2024-03-09T15:25:17.721702+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:25:17.721599+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:25:17.721599+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.721599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:29.665369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'12","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.031565+0000","last_change":"2024-03-09T15:24:48.031610+0000","last_active":"2024-03-09T15:24:48.031565+0000","last_peered":"2024-03-09T15:24:48.031565+0000","last_clean":"2024-03-09T15:24:48.031565+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:24:48.031565+0000","last_undegraded":"2024-03-09T15:24:48.031565+0000","last_fullsized":"2024-03-09T15:24:48.031565+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:48.031477+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:48.031477+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.031477+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:27.977465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.827683+0000","last_change":"2024-03-09T15:24:48.827736+0000","last_active":"2024-03-09T15:24:48.827683+0000","last_peered":"2024-03-09T15:24:48.827683+0000","last_clean":"2024-03-09T15:24:48.827683+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:24:48.827683+0000","last_undegraded":"2024-03-09T15:24:48.827683+0000","last_fullsized":"2024-03-09T15:24:48.827683+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-03-09T15:24:48.827568+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-03-09T15:24:48.827568+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.827568+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:08.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.597337+0000","last_change":"2024-03-09T14:50:03.659706+0000","last_active":"2024-03-09T15:24:45.597337+0000","last_peered":"2024-03-09T15:24:45.597337+0000","last_clean":"2024-03-09T15:24:45.597337+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:24:45.597337+0000","last_undegraded":"2024-03-09T15:24:45.597337+0000","last_fullsized":"2024-03-09T15:24:45.597337+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'5","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.716361+0000","last_change":"2024-03-09T15:25:19.716438+0000","last_active":"2024-03-09T15:25:19.716361+0000","last_peered":"2024-03-09T15:25:19.716361+0000","last_clean":"2024-03-09T15:25:19.716361+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:25:19.716361+0000","last_undegraded":"2024-03-09T15:25:19.716361+0000","last_fullsized":"2024-03-09T15:25:19.716361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:19.716268+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:19.716268+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.716268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:31.176829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.083859+0000","last_change":"2024-03-09T15:24:52.083889+0000","last_active":"2024-03-09T15:24:52.083859+0000","last_peered":"2024-03-09T15:24:52.083859+0000","last_clean":"2024-03-09T15:24:52.083859+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:24:52.083859+0000","last_undegraded":"2024-03-09T15:24:52.083859+0000","last_fullsized":"2024-03-09T15:24:52.083859+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:24:52.083766+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:24:52.083766+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.083766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:41:18.001798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.479353+0000","last_change":"2024-03-09T15:24:47.479381+0000","last_active":"2024-03-09T15:24:47.479353+0000","last_peered":"2024-03-09T15:24:47.479353+0000","last_clean":"2024-03-09T15:24:47.479353+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:24:47.479353+0000","last_undegraded":"2024-03-09T15:24:47.479353+0000","last_fullsized":"2024-03-09T15:24:47.479353+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'51","last_scrub_stamp":"2024-03-09T15:24:47.479255+0000","last_deep_scrub":"260'51","last_deep_scrub_stamp":"2024-03-09T15:24:47.479255+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.479255+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:59.761444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.597360+0000","last_change":"2024-03-09T14:50:03.664828+0000","last_active":"2024-03-09T15:24:45.597360+0000","last_peered":"2024-03-09T15:24:45.597360+0000","last_clean":"2024-03-09T15:24:45.597360+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:24:45.597360+0000","last_undegraded":"2024-03-09T15:24:45.597360+0000","last_fullsized":"2024-03-09T15:24:45.597360+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.419331+0000","last_change":"2024-03-09T15:25:01.419369+0000","last_active":"2024-03-09T15:25:01.419331+0000","last_peered":"2024-03-09T15:25:01.419331+0000","last_clean":"2024-03-09T15:25:01.419331+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:25:01.419331+0000","last_undegraded":"2024-03-09T15:25:01.419331+0000","last_fullsized":"2024-03-09T15:25:01.419331+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:01.419231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:01.419231+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.419231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:30.487865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.590774+0000","last_change":"2024-03-09T15:25:04.590810+0000","last_active":"2024-03-09T15:25:04.590774+0000","last_peered":"2024-03-09T15:25:04.590774+0000","last_clean":"2024-03-09T15:25:04.590774+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:25:04.590774+0000","last_undegraded":"2024-03-09T15:25:04.590774+0000","last_fullsized":"2024-03-09T15:25:04.590774+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:25:04.590684+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:25:04.590684+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.590684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:56.402715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.406552+0000","last_change":"2024-03-09T15:24:47.406588+0000","last_active":"2024-03-09T15:24:47.406552+0000","last_peered":"2024-03-09T15:24:47.406552+0000","last_clean":"2024-03-09T15:24:47.406552+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:24:47.406552+0000","last_undegraded":"2024-03-09T15:24:47.406552+0000","last_fullsized":"2024-03-09T15:24:47.406552+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'58","last_scrub_stamp":"2024-03-09T15:24:47.406438+0000","last_deep_scrub":"260'58","last_deep_scrub_stamp":"2024-03-09T15:24:47.406438+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.406438+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:13.779948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.756585+0000","last_change":"2024-03-09T14:50:03.657383+0000","last_active":"2024-03-09T15:24:42.756585+0000","last_peered":"2024-03-09T15:24:42.756585+0000","last_clean":"2024-03-09T15:24:42.756585+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:24:42.756585+0000","last_undegraded":"2024-03-09T15:24:42.756585+0000","last_fullsized":"2024-03-09T15:24:42.756585+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"257'11","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.036494+0000","last_change":"2024-03-09T14:35:55.634050+0000","last_active":"2024-03-09T15:24:17.036494+0000","last_peered":"2024-03-09T15:24:17.036494+0000","last_clean":"2024-03-09T15:24:17.036494+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:24:17.036494+0000","last_undegraded":"2024-03-09T15:24:17.036494+0000","last_fullsized":"2024-03-09T15:24:17.036494+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'12","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.650470+0000","last_change":"2024-03-09T15:24:52.650470+0000","last_active":"2024-03-09T15:24:52.650470+0000","last_peered":"2024-03-09T15:24:52.650470+0000","last_clean":"2024-03-09T15:24:52.650470+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:24:52.650470+0000","last_undegraded":"2024-03-09T15:24:52.650470+0000","last_fullsized":"2024-03-09T15:24:52.650470+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:52.650294+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:52.650294+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.650294+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:30.081533+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.450895+0000","last_change":"2024-03-09T15:24:45.450923+0000","last_active":"2024-03-09T15:24:45.450895+0000","last_peered":"2024-03-09T15:24:45.450895+0000","last_clean":"2024-03-09T15:24:45.450895+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:24:45.450895+0000","last_undegraded":"2024-03-09T15:24:45.450895+0000","last_fullsized":"2024-03-09T15:24:45.450895+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'33","last_scrub_stamp":"2024-03-09T15:24:45.450792+0000","last_deep_scrub":"260'33","last_deep_scrub_stamp":"2024-03-09T15:24:45.450792+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.450792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:44.369163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.698741+0000","last_change":"2024-03-09T15:25:12.698772+0000","last_active":"2024-03-09T15:25:12.698741+0000","last_peered":"2024-03-09T15:25:12.698741+0000","last_clean":"2024-03-09T15:25:12.698741+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:25:12.698741+0000","last_undegraded":"2024-03-09T15:25:12.698741+0000","last_fullsized":"2024-03-09T15:25:12.698741+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:12.698651+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:12.698651+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.698651+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:11.319847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.398056+0000","last_change":"2024-03-09T15:25:09.398056+0000","last_active":"2024-03-09T15:25:09.398056+0000","last_peered":"2024-03-09T15:25:09.398056+0000","last_clean":"2024-03-09T15:25:09.398056+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:25:09.398056+0000","last_undegraded":"2024-03-09T15:25:09.398056+0000","last_fullsized":"2024-03-09T15:25:09.398056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:25:09.397841+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:25:09.397841+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.397841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:41.109102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.481646+0000","last_change":"2024-03-09T15:24:49.481688+0000","last_active":"2024-03-09T15:24:49.481646+0000","last_peered":"2024-03-09T15:24:49.481646+0000","last_clean":"2024-03-09T15:24:49.481646+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:24:49.481646+0000","last_undegraded":"2024-03-09T15:24:49.481646+0000","last_fullsized":"2024-03-09T15:24:49.481646+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:24:49.481517+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:24:49.481517+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.481517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:43.451279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":104,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.537408+0000","last_change":"2024-03-09T15:24:47.537434+0000","last_active":"2024-03-09T15:24:47.537408+0000","last_peered":"2024-03-09T15:24:47.537408+0000","last_clean":"2024-03-09T15:24:47.537408+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:24:47.537408+0000","last_undegraded":"2024-03-09T15:24:47.537408+0000","last_fullsized":"2024-03-09T15:24:47.537408+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'20","last_scrub_stamp":"2024-03-09T15:24:47.537299+0000","last_deep_scrub":"260'20","last_deep_scrub_stamp":"2024-03-09T15:24:47.537299+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.537299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:09.169841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.509799+0000","last_change":"2024-03-09T15:25:10.509846+0000","last_active":"2024-03-09T15:25:10.509799+0000","last_peered":"2024-03-09T15:25:10.509799+0000","last_clean":"2024-03-09T15:25:10.509799+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:25:10.509799+0000","last_undegraded":"2024-03-09T15:25:10.509799+0000","last_fullsized":"2024-03-09T15:25:10.509799+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.509700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.509700+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.509700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:25.573280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'6","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.108150+0000","last_change":"2024-03-09T14:35:55.636071+0000","last_active":"2024-03-09T15:24:38.108150+0000","last_peered":"2024-03-09T15:24:38.108150+0000","last_clean":"2024-03-09T15:24:38.108150+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:24:38.108150+0000","last_undegraded":"2024-03-09T15:24:38.108150+0000","last_fullsized":"2024-03-09T15:24:38.108150+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.631382+0000","last_change":"2024-03-09T15:25:10.631410+0000","last_active":"2024-03-09T15:25:10.631382+0000","last_peered":"2024-03-09T15:25:10.631382+0000","last_clean":"2024-03-09T15:25:10.631382+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:25:10.631382+0000","last_undegraded":"2024-03-09T15:25:10.631382+0000","last_fullsized":"2024-03-09T15:25:10.631382+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.631274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.631274+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.631274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:53.728586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.717930+0000","last_change":"2024-03-09T15:24:56.717957+0000","last_active":"2024-03-09T15:24:56.717930+0000","last_peered":"2024-03-09T15:24:56.717930+0000","last_clean":"2024-03-09T15:24:56.717930+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:24:56.717930+0000","last_undegraded":"2024-03-09T15:24:56.717930+0000","last_fullsized":"2024-03-09T15:24:56.717930+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:56.717838+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:56.717838+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.717838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:47.629611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651647+0000","last_change":"2024-03-09T14:50:03.654352+0000","last_active":"2024-03-09T15:24:44.651647+0000","last_peered":"2024-03-09T15:24:44.651647+0000","last_clean":"2024-03-09T15:24:44.651647+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:24:44.651647+0000","last_undegraded":"2024-03-09T15:24:44.651647+0000","last_fullsized":"2024-03-09T15:24:44.651647+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":43,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.182423+0000","last_change":"2024-03-09T14:35:55.604280+0000","last_active":"2024-03-09T15:24:17.182423+0000","last_peered":"2024-03-09T15:24:17.182423+0000","last_clean":"2024-03-09T15:24:17.182423+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:24:17.182423+0000","last_undegraded":"2024-03-09T15:24:17.182423+0000","last_fullsized":"2024-03-09T15:24:17.182423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.507131+0000","last_change":"2024-03-09T15:24:48.507155+0000","last_active":"2024-03-09T15:24:48.507131+0000","last_peered":"2024-03-09T15:24:48.507131+0000","last_clean":"2024-03-09T15:24:48.507131+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:24:48.507131+0000","last_undegraded":"2024-03-09T15:24:48.507131+0000","last_fullsized":"2024-03-09T15:24:48.507131+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:48.507040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:48.507040+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.507040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:49.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.632388+0000","last_change":"2024-03-09T15:24:56.632388+0000","last_active":"2024-03-09T15:24:56.632388+0000","last_peered":"2024-03-09T15:24:56.632388+0000","last_clean":"2024-03-09T15:24:56.632388+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:24:56.632388+0000","last_undegraded":"2024-03-09T15:24:56.632388+0000","last_fullsized":"2024-03-09T15:24:56.632388+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'68","last_scrub_stamp":"2024-03-09T15:24:56.632230+0000","last_deep_scrub":"260'68","last_deep_scrub_stamp":"2024-03-09T15:24:56.632230+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.632230+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:56:00.995890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.034269+0000","last_change":"2024-03-09T14:50:03.655960+0000","last_active":"2024-03-09T15:23:57.034269+0000","last_peered":"2024-03-09T15:23:57.034269+0000","last_clean":"2024-03-09T15:23:57.034269+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:23:57.034269+0000","last_undegraded":"2024-03-09T15:23:57.034269+0000","last_fullsized":"2024-03-09T15:23:57.034269+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.784072+0000","last_change":"2024-03-09T15:25:21.784098+0000","last_active":"2024-03-09T15:25:21.784072+0000","last_peered":"2024-03-09T15:25:21.784072+0000","last_clean":"2024-03-09T15:25:21.784072+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:25:21.784072+0000","last_undegraded":"2024-03-09T15:25:21.784072+0000","last_fullsized":"2024-03-09T15:25:21.784072+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:25:21.783980+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:25:21.783980+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.783980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:28.271672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.046238+0000","last_change":"2024-03-09T15:25:00.046263+0000","last_active":"2024-03-09T15:25:00.046238+0000","last_peered":"2024-03-09T15:25:00.046238+0000","last_clean":"2024-03-09T15:25:00.046238+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:25:00.046238+0000","last_undegraded":"2024-03-09T15:25:00.046238+0000","last_fullsized":"2024-03-09T15:25:00.046238+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.046150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.046150+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.046150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:06.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.658475+0000","last_change":"2024-03-09T15:24:57.658502+0000","last_active":"2024-03-09T15:24:57.658475+0000","last_peered":"2024-03-09T15:24:57.658475+0000","last_clean":"2024-03-09T15:24:57.658475+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:24:57.658475+0000","last_undegraded":"2024-03-09T15:24:57.658475+0000","last_fullsized":"2024-03-09T15:24:57.658475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:57.658385+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:57.658385+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.658385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:19.298012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:56.918361+0000","last_change":"2024-03-09T14:50:03.660277+0000","last_active":"2024-03-09T15:23:56.918361+0000","last_peered":"2024-03-09T15:23:56.918361+0000","last_clean":"2024-03-09T15:23:56.918361+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:23:56.918361+0000","last_undegraded":"2024-03-09T15:23:56.918361+0000","last_fullsized":"2024-03-09T15:23:56.918361+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.725084+0000","last_change":"2024-03-09T15:25:19.725114+0000","last_active":"2024-03-09T15:25:19.725084+0000","last_peered":"2024-03-09T15:25:19.725084+0000","last_clean":"2024-03-09T15:25:19.725084+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:25:19.725084+0000","last_undegraded":"2024-03-09T15:25:19.725084+0000","last_fullsized":"2024-03-09T15:25:19.725084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:19.724994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:19.724994+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.724994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:29.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.544199+0000","last_change":"2024-03-09T15:24:49.544199+0000","last_active":"2024-03-09T15:24:49.544199+0000","last_peered":"2024-03-09T15:24:49.544199+0000","last_clean":"2024-03-09T15:24:49.544199+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:24:49.544199+0000","last_undegraded":"2024-03-09T15:24:49.544199+0000","last_fullsized":"2024-03-09T15:24:49.544199+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:49.544081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:49.544081+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.544081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:56.633076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.514486+0000","last_change":"2024-03-09T15:24:49.514524+0000","last_active":"2024-03-09T15:24:49.514486+0000","last_peered":"2024-03-09T15:24:49.514486+0000","last_clean":"2024-03-09T15:24:49.514486+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:24:49.514486+0000","last_undegraded":"2024-03-09T15:24:49.514486+0000","last_fullsized":"2024-03-09T15:24:49.514486+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'26","last_scrub_stamp":"2024-03-09T15:24:49.514387+0000","last_deep_scrub":"260'26","last_deep_scrub_stamp":"2024-03-09T15:24:49.514387+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.514387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:53.197965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"259'1","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281846+0000","last_change":"2024-03-09T14:50:03.662986+0000","last_active":"2024-03-09T15:24:42.281846+0000","last_peered":"2024-03-09T15:24:42.281846+0000","last_clean":"2024-03-09T15:24:42.281846+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:24:42.281846+0000","last_undegraded":"2024-03-09T15:24:42.281846+0000","last_fullsized":"2024-03-09T15:24:42.281846+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.417420+0000","last_change":"2024-03-09T15:25:05.417446+0000","last_active":"2024-03-09T15:25:05.417420+0000","last_peered":"2024-03-09T15:25:05.417420+0000","last_clean":"2024-03-09T15:25:05.417420+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:25:05.417420+0000","last_undegraded":"2024-03-09T15:25:05.417420+0000","last_fullsized":"2024-03-09T15:25:05.417420+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:05.417318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:05.417318+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.417318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:30.602964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.676718+0000","last_change":"2024-03-09T15:25:16.676757+0000","last_active":"2024-03-09T15:25:16.676718+0000","last_peered":"2024-03-09T15:25:16.676718+0000","last_clean":"2024-03-09T15:25:16.676718+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:25:16.676718+0000","last_undegraded":"2024-03-09T15:25:16.676718+0000","last_fullsized":"2024-03-09T15:25:16.676718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:16.676567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:16.676567+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.676567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:53.325136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'84","reported_seq":308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.084821+0000","last_change":"2024-03-09T15:24:46.084885+0000","last_active":"2024-03-09T15:24:46.084821+0000","last_peered":"2024-03-09T15:24:46.084821+0000","last_clean":"2024-03-09T15:24:46.084821+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:24:46.084821+0000","last_undegraded":"2024-03-09T15:24:46.084821+0000","last_fullsized":"2024-03-09T15:24:46.084821+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-03-09T15:24:46.084709+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-03-09T15:24:46.084709+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.084709+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:24.008976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":991,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'1","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.034225+0000","last_change":"2024-03-09T14:50:03.654675+0000","last_active":"2024-03-09T15:23:57.034225+0000","last_peered":"2024-03-09T15:23:57.034225+0000","last_clean":"2024-03-09T15:23:57.034225+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:23:57.034225+0000","last_undegraded":"2024-03-09T15:23:57.034225+0000","last_fullsized":"2024-03-09T15:23:57.034225+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'5","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.729336+0000","last_change":"2024-03-09T15:25:20.729362+0000","last_active":"2024-03-09T15:25:20.729336+0000","last_peered":"2024-03-09T15:25:20.729336+0000","last_clean":"2024-03-09T15:25:20.729336+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:25:20.729336+0000","last_undegraded":"2024-03-09T15:25:20.729336+0000","last_fullsized":"2024-03-09T15:25:20.729336+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:20.729245+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:20.729245+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.729245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:31:00.742562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.653606+0000","last_change":"2024-03-09T15:25:00.653633+0000","last_active":"2024-03-09T15:25:00.653606+0000","last_peered":"2024-03-09T15:25:00.653606+0000","last_clean":"2024-03-09T15:25:00.653606+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:25:00.653606+0000","last_undegraded":"2024-03-09T15:25:00.653606+0000","last_fullsized":"2024-03-09T15:25:00.653606+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.653510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.653510+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.653510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:05.772843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.484001+0000","last_change":"2024-03-09T15:24:51.484043+0000","last_active":"2024-03-09T15:24:51.484001+0000","last_peered":"2024-03-09T15:24:51.484001+0000","last_clean":"2024-03-09T15:24:51.484001+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:24:51.484001+0000","last_undegraded":"2024-03-09T15:24:51.484001+0000","last_fullsized":"2024-03-09T15:24:51.484001+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:24:51.483908+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:24:51.483908+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.483908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:36:33.766400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.678325+0000","last_change":"2024-03-09T15:25:13.678353+0000","last_active":"2024-03-09T15:25:13.678325+0000","last_peered":"2024-03-09T15:25:13.678325+0000","last_clean":"2024-03-09T15:25:13.678325+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:25:13.678325+0000","last_undegraded":"2024-03-09T15:25:13.678325+0000","last_fullsized":"2024-03-09T15:25:13.678325+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:13.678233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:13.678233+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.678233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:11.226892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'8","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.435849+0000","last_change":"2024-03-09T15:24:57.435905+0000","last_active":"2024-03-09T15:24:57.435849+0000","last_peered":"2024-03-09T15:24:57.435849+0000","last_clean":"2024-03-09T15:24:57.435849+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:24:57.435849+0000","last_undegraded":"2024-03-09T15:24:57.435849+0000","last_fullsized":"2024-03-09T15:24:57.435849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:57.435719+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:57.435719+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.435719+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:31.333096+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'8","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.515906+0000","last_change":"2024-03-09T15:24:48.515906+0000","last_active":"2024-03-09T15:24:48.515906+0000","last_peered":"2024-03-09T15:24:48.515906+0000","last_clean":"2024-03-09T15:24:48.515906+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:24:48.515906+0000","last_undegraded":"2024-03-09T15:24:48.515906+0000","last_fullsized":"2024-03-09T15:24:48.515906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:48.515771+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:48.515771+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.515771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:02.694004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6842,"num_write":13,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.498449+0000","last_change":"2024-03-09T15:24:44.498449+0000","last_active":"2024-03-09T15:24:44.498449+0000","last_peered":"2024-03-09T15:24:44.498449+0000","last_clean":"2024-03-09T15:24:44.498449+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:24:44.498449+0000","last_undegraded":"2024-03-09T15:24:44.498449+0000","last_fullsized":"2024-03-09T15:24:44.498449+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-03-09T15:24:44.498349+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-03-09T15:24:44.498349+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.498349+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:01.790715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.063082+0000","last_change":"2024-03-09T14:50:03.664102+0000","last_active":"2024-03-09T15:23:52.063082+0000","last_peered":"2024-03-09T15:23:52.063082+0000","last_clean":"2024-03-09T15:23:52.063082+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:23:52.063082+0000","last_undegraded":"2024-03-09T15:23:52.063082+0000","last_fullsized":"2024-03-09T15:23:52.063082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":49,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.054124+0000","last_change":"2024-03-09T14:36:32.678035+0000","last_active":"2024-03-09T15:23:52.054124+0000","last_peered":"2024-03-09T15:23:52.054124+0000","last_clean":"2024-03-09T15:23:52.054124+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:23:52.054124+0000","last_undegraded":"2024-03-09T15:23:52.054124+0000","last_fullsized":"2024-03-09T15:23:52.054124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.666785+0000","last_change":"2024-03-09T15:25:11.666785+0000","last_active":"2024-03-09T15:25:11.666785+0000","last_peered":"2024-03-09T15:25:11.666785+0000","last_clean":"2024-03-09T15:25:11.666785+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:25:11.666785+0000","last_undegraded":"2024-03-09T15:25:11.666785+0000","last_fullsized":"2024-03-09T15:25:11.666785+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:11.666666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:11.666666+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.666666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:36.105150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.502021+0000","last_change":"2024-03-09T15:24:48.502021+0000","last_active":"2024-03-09T15:24:48.502021+0000","last_peered":"2024-03-09T15:24:48.502021+0000","last_clean":"2024-03-09T15:24:48.502021+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:24:48.502021+0000","last_undegraded":"2024-03-09T15:24:48.502021+0000","last_fullsized":"2024-03-09T15:24:48.502021+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:48.501862+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:48.501862+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.501862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:24:45.310952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.123501+0000","last_change":"2024-03-09T14:50:03.658657+0000","last_active":"2024-03-09T15:24:45.123501+0000","last_peered":"2024-03-09T15:24:45.123501+0000","last_clean":"2024-03-09T15:24:45.123501+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:24:45.123501+0000","last_undegraded":"2024-03-09T15:24:45.123501+0000","last_fullsized":"2024-03-09T15:24:45.123501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":44,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:22.012143+0000","last_change":"2024-03-09T14:35:55.635179+0000","last_active":"2024-03-09T15:23:22.012143+0000","last_peered":"2024-03-09T15:23:22.012143+0000","last_clean":"2024-03-09T15:23:22.012143+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:23:22.012143+0000","last_undegraded":"2024-03-09T15:23:22.012143+0000","last_fullsized":"2024-03-09T15:23:22.012143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.700402+0000","last_change":"2024-03-09T15:25:00.700402+0000","last_active":"2024-03-09T15:25:00.700402+0000","last_peered":"2024-03-09T15:25:00.700402+0000","last_clean":"2024-03-09T15:25:00.700402+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:25:00.700402+0000","last_undegraded":"2024-03-09T15:25:00.700402+0000","last_fullsized":"2024-03-09T15:25:00.700402+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.700284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.700284+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.700284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:43.428686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":100,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.820656+0000","last_change":"2024-03-09T15:24:47.820656+0000","last_active":"2024-03-09T15:24:47.820656+0000","last_peered":"2024-03-09T15:24:47.820656+0000","last_clean":"2024-03-09T15:24:47.820656+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:24:47.820656+0000","last_undegraded":"2024-03-09T15:24:47.820656+0000","last_fullsized":"2024-03-09T15:24:47.820656+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:47.820481+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:47.820481+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.820481+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:00:39.801312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.551578+0000","last_change":"2024-03-09T15:25:06.551615+0000","last_active":"2024-03-09T15:25:06.551578+0000","last_peered":"2024-03-09T15:25:06.551578+0000","last_clean":"2024-03-09T15:25:06.551578+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:25:06.551578+0000","last_undegraded":"2024-03-09T15:25:06.551578+0000","last_fullsized":"2024-03-09T15:25:06.551578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.551487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.551487+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.551487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:45.045398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.511512+0000","last_change":"2024-03-09T15:24:53.511539+0000","last_active":"2024-03-09T15:24:53.511512+0000","last_peered":"2024-03-09T15:24:53.511512+0000","last_clean":"2024-03-09T15:24:53.511512+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:24:53.511512+0000","last_undegraded":"2024-03-09T15:24:53.511512+0000","last_fullsized":"2024-03-09T15:24:53.511512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:53.511424+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:53.511424+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.511424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:52:53.208885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'2","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.400000+0000","last_change":"2024-03-09T15:24:44.400023+0000","last_active":"2024-03-09T15:24:44.400000+0000","last_peered":"2024-03-09T15:24:44.400000+0000","last_clean":"2024-03-09T15:24:44.400000+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:24:44.400000+0000","last_undegraded":"2024-03-09T15:24:44.400000+0000","last_fullsized":"2024-03-09T15:24:44.400000+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:24:44.399922+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:24:44.399922+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.399922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:48.540054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":200,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.538981+0000","last_change":"2024-03-09T15:25:08.539006+0000","last_active":"2024-03-09T15:25:08.538981+0000","last_peered":"2024-03-09T15:25:08.538981+0000","last_clean":"2024-03-09T15:25:08.538981+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:25:08.538981+0000","last_undegraded":"2024-03-09T15:25:08.538981+0000","last_fullsized":"2024-03-09T15:25:08.538981+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-03-09T15:25:08.538889+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-03-09T15:25:08.538889+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.538889+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:36:23.027386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.033585+0000","last_change":"2024-03-09T14:50:03.656718+0000","last_active":"2024-03-09T15:23:52.033585+0000","last_peered":"2024-03-09T15:23:52.033585+0000","last_clean":"2024-03-09T15:23:52.033585+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:23:52.033585+0000","last_undegraded":"2024-03-09T15:23:52.033585+0000","last_fullsized":"2024-03-09T15:23:52.033585+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'8","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.989095+0000","last_change":"2024-03-09T14:35:55.603262+0000","last_active":"2024-03-09T15:24:37.989095+0000","last_peered":"2024-03-09T15:24:37.989095+0000","last_clean":"2024-03-09T15:24:37.989095+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:24:37.989095+0000","last_undegraded":"2024-03-09T15:24:37.989095+0000","last_fullsized":"2024-03-09T15:24:37.989095+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.544155+0000","last_change":"2024-03-09T15:24:52.544179+0000","last_active":"2024-03-09T15:24:52.544155+0000","last_peered":"2024-03-09T15:24:52.544155+0000","last_clean":"2024-03-09T15:24:52.544155+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:24:52.544155+0000","last_undegraded":"2024-03-09T15:24:52.544155+0000","last_fullsized":"2024-03-09T15:24:52.544155+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:52.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:52.544062+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:41.480469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.475071+0000","last_change":"2024-03-09T15:24:46.475071+0000","last_active":"2024-03-09T15:24:46.475071+0000","last_peered":"2024-03-09T15:24:46.475071+0000","last_clean":"2024-03-09T15:24:46.475071+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:24:46.475071+0000","last_undegraded":"2024-03-09T15:24:46.475071+0000","last_fullsized":"2024-03-09T15:24:46.475071+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'59","last_scrub_stamp":"2024-03-09T15:24:46.474945+0000","last_deep_scrub":"260'59","last_deep_scrub_stamp":"2024-03-09T15:24:46.474945+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.474945+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:55.520901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:02.064614+0000","last_change":"2024-03-09T14:50:03.659935+0000","last_active":"2024-03-09T15:24:02.064614+0000","last_peered":"2024-03-09T15:24:02.064614+0000","last_clean":"2024-03-09T15:24:02.064614+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:24:02.064614+0000","last_undegraded":"2024-03-09T15:24:02.064614+0000","last_fullsized":"2024-03-09T15:24:02.064614+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.681497+0000","last_change":"2024-03-09T15:24:58.681525+0000","last_active":"2024-03-09T15:24:58.681497+0000","last_peered":"2024-03-09T15:24:58.681497+0000","last_clean":"2024-03-09T15:24:58.681497+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:24:58.681497+0000","last_undegraded":"2024-03-09T15:24:58.681497+0000","last_fullsized":"2024-03-09T15:24:58.681497+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:58.681405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:58.681405+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.681405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:05.460441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.352678+0000","last_change":"2024-03-09T15:24:43.352717+0000","last_active":"2024-03-09T15:24:43.352678+0000","last_peered":"2024-03-09T15:24:43.352678+0000","last_clean":"2024-03-09T15:24:43.352678+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:24:43.352678+0000","last_undegraded":"2024-03-09T15:24:43.352678+0000","last_fullsized":"2024-03-09T15:24:43.352678+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:43.352488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:43.352488+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.352488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:16.403976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":95,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.621097+0000","last_change":"2024-03-09T15:24:55.621123+0000","last_active":"2024-03-09T15:24:55.621097+0000","last_peered":"2024-03-09T15:24:55.621097+0000","last_clean":"2024-03-09T15:24:55.621097+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:24:55.621097+0000","last_undegraded":"2024-03-09T15:24:55.621097+0000","last_fullsized":"2024-03-09T15:24:55.621097+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:55.621006+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:55.621006+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.621006+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:32.384038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'1","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.063106+0000","last_change":"2024-03-09T14:50:03.659514+0000","last_active":"2024-03-09T15:23:52.063106+0000","last_peered":"2024-03-09T15:23:52.063106+0000","last_clean":"2024-03-09T15:23:52.063106+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:23:52.063106+0000","last_undegraded":"2024-03-09T15:23:52.063106+0000","last_fullsized":"2024-03-09T15:23:52.063106+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.752191+0000","last_change":"2024-03-09T15:25:20.752214+0000","last_active":"2024-03-09T15:25:20.752191+0000","last_peered":"2024-03-09T15:25:20.752191+0000","last_clean":"2024-03-09T15:25:20.752191+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:25:20.752191+0000","last_undegraded":"2024-03-09T15:25:20.752191+0000","last_fullsized":"2024-03-09T15:25:20.752191+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:20.752099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:20.752099+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.752099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:59.892662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.421009+0000","last_change":"2024-03-09T15:24:44.421031+0000","last_active":"2024-03-09T15:24:44.421009+0000","last_peered":"2024-03-09T15:24:44.421009+0000","last_clean":"2024-03-09T15:24:44.421009+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:24:44.421009+0000","last_undegraded":"2024-03-09T15:24:44.421009+0000","last_fullsized":"2024-03-09T15:24:44.421009+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:24:44.420937+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:24:44.420937+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.420937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:44.572608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.495673+0000","last_change":"2024-03-09T15:24:50.495673+0000","last_active":"2024-03-09T15:24:50.495673+0000","last_peered":"2024-03-09T15:24:50.495673+0000","last_clean":"2024-03-09T15:24:50.495673+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:24:50.495673+0000","last_undegraded":"2024-03-09T15:24:50.495673+0000","last_fullsized":"2024-03-09T15:24:50.495673+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:50.495493+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:50.495493+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.495493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:52.491490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:51.917795+0000","last_change":"2024-03-09T14:50:03.659852+0000","last_active":"2024-03-09T15:23:51.917795+0000","last_peered":"2024-03-09T15:23:51.917795+0000","last_clean":"2024-03-09T15:23:51.917795+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:23:51.917795+0000","last_undegraded":"2024-03-09T15:23:51.917795+0000","last_fullsized":"2024-03-09T15:23:51.917795+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'3","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.571013+0000","last_change":"2024-03-09T15:24:54.571044+0000","last_active":"2024-03-09T15:24:54.571013+0000","last_peered":"2024-03-09T15:24:54.571013+0000","last_clean":"2024-03-09T15:24:54.571013+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:24:54.571013+0000","last_undegraded":"2024-03-09T15:24:54.571013+0000","last_fullsized":"2024-03-09T15:24:54.571013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:54.570920+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:54.570920+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.570920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:33:44.442956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'5","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.179355+0000","last_change":"2024-03-09T14:35:50.593430+0000","last_active":"2024-03-09T15:24:44.179355+0000","last_peered":"2024-03-09T15:24:44.179355+0000","last_clean":"2024-03-09T15:24:44.179355+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:24:44.179355+0000","last_undegraded":"2024-03-09T15:24:44.179355+0000","last_fullsized":"2024-03-09T15:24:44.179355+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:49.560393+0000","last_clean_scrub_stamp":"2024-03-09T14:35:49.560393+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10280,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":88,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.810112+0000","last_change":"2024-03-09T15:24:46.810112+0000","last_active":"2024-03-09T15:24:46.810112+0000","last_peered":"2024-03-09T15:24:46.810112+0000","last_clean":"2024-03-09T15:24:46.810112+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:24:46.810112+0000","last_undegraded":"2024-03-09T15:24:46.810112+0000","last_fullsized":"2024-03-09T15:24:46.810112+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:46.809971+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:46.809971+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.809971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:01.279230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.059621+0000","last_change":"2024-03-09T14:50:03.660084+0000","last_active":"2024-03-09T15:23:27.059621+0000","last_peered":"2024-03-09T15:23:27.059621+0000","last_clean":"2024-03-09T15:23:27.059621+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:23:27.059621+0000","last_undegraded":"2024-03-09T15:23:27.059621+0000","last_fullsized":"2024-03-09T15:23:27.059621+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.573837+0000","last_change":"2024-03-09T15:25:08.573891+0000","last_active":"2024-03-09T15:25:08.573837+0000","last_peered":"2024-03-09T15:25:08.573837+0000","last_clean":"2024-03-09T15:25:08.573837+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:25:08.573837+0000","last_undegraded":"2024-03-09T15:25:08.573837+0000","last_fullsized":"2024-03-09T15:25:08.573837+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:25:08.573724+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:25:08.573724+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.573724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:39.414597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.526291+0000","last_change":"2024-03-09T15:24:51.526317+0000","last_active":"2024-03-09T15:24:51.526291+0000","last_peered":"2024-03-09T15:24:51.526291+0000","last_clean":"2024-03-09T15:24:51.526291+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:24:51.526291+0000","last_undegraded":"2024-03-09T15:24:51.526291+0000","last_fullsized":"2024-03-09T15:24:51.526291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'6","last_scrub_stamp":"2024-03-09T15:24:51.526195+0000","last_deep_scrub":"257'6","last_deep_scrub_stamp":"2024-03-09T15:24:51.526195+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.526195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:49.267726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.416813+0000","last_change":"2024-03-09T15:24:43.416813+0000","last_active":"2024-03-09T15:24:43.416813+0000","last_peered":"2024-03-09T15:24:43.416813+0000","last_clean":"2024-03-09T15:24:43.416813+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:24:43.416813+0000","last_undegraded":"2024-03-09T15:24:43.416813+0000","last_fullsized":"2024-03-09T15:24:43.416813+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'55","last_scrub_stamp":"2024-03-09T15:24:43.416706+0000","last_deep_scrub":"260'55","last_deep_scrub_stamp":"2024-03-09T15:24:43.416706+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.416706+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:28.604905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.050574+0000","last_change":"2024-03-09T14:50:03.664606+0000","last_active":"2024-03-09T15:23:27.050574+0000","last_peered":"2024-03-09T15:23:27.050574+0000","last_clean":"2024-03-09T15:23:27.050574+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:23:27.050574+0000","last_undegraded":"2024-03-09T15:23:27.050574+0000","last_fullsized":"2024-03-09T15:23:27.050574+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:51.917769+0000","last_change":"2024-03-09T14:35:55.633776+0000","last_active":"2024-03-09T15:23:51.917769+0000","last_peered":"2024-03-09T15:23:51.917769+0000","last_clean":"2024-03-09T15:23:51.917769+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:23:51.917769+0000","last_undegraded":"2024-03-09T15:23:51.917769+0000","last_fullsized":"2024-03-09T15:23:51.917769+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.921504+0000","last_change":"2024-03-09T15:24:43.921531+0000","last_active":"2024-03-09T15:24:43.921504+0000","last_peered":"2024-03-09T15:24:43.921504+0000","last_clean":"2024-03-09T15:24:43.921504+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:24:43.921504+0000","last_undegraded":"2024-03-09T15:24:43.921504+0000","last_fullsized":"2024-03-09T15:24:43.921504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:43.921413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:43.921413+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.921413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:09:22.833429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.865684+0000","last_change":"2024-03-09T15:24:50.865684+0000","last_active":"2024-03-09T15:24:50.865684+0000","last_peered":"2024-03-09T15:24:50.865684+0000","last_clean":"2024-03-09T15:24:50.865684+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:24:50.865684+0000","last_undegraded":"2024-03-09T15:24:50.865684+0000","last_fullsized":"2024-03-09T15:24:50.865684+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'52","last_scrub_stamp":"2024-03-09T15:24:50.865508+0000","last_deep_scrub":"260'52","last_deep_scrub_stamp":"2024-03-09T15:24:50.865508+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.865508+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:21.737646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.017884+0000","last_change":"2024-03-09T14:50:03.658082+0000","last_active":"2024-03-09T15:24:17.017884+0000","last_peered":"2024-03-09T15:24:17.017884+0000","last_clean":"2024-03-09T15:24:17.017884+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:24:17.017884+0000","last_undegraded":"2024-03-09T15:24:17.017884+0000","last_fullsized":"2024-03-09T15:24:17.017884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.600679+0000","last_change":"2024-03-09T15:25:02.600707+0000","last_active":"2024-03-09T15:25:02.600679+0000","last_peered":"2024-03-09T15:25:02.600679+0000","last_clean":"2024-03-09T15:25:02.600679+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:25:02.600679+0000","last_undegraded":"2024-03-09T15:25:02.600679+0000","last_fullsized":"2024-03-09T15:25:02.600679+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:25:02.600568+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:25:02.600568+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.600568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:18.923316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.673149+0000","last_change":"2024-03-09T15:24:56.673177+0000","last_active":"2024-03-09T15:24:56.673149+0000","last_peered":"2024-03-09T15:24:56.673149+0000","last_clean":"2024-03-09T15:24:56.673149+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:24:56.673149+0000","last_undegraded":"2024-03-09T15:24:56.673149+0000","last_fullsized":"2024-03-09T15:24:56.673149+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:56.673047+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:56.673047+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.673047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:22:51.958302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":130,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.573047+0000","last_change":"2024-03-09T15:24:52.573077+0000","last_active":"2024-03-09T15:24:52.573047+0000","last_peered":"2024-03-09T15:24:52.573047+0000","last_clean":"2024-03-09T15:24:52.573047+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:24:52.573047+0000","last_undegraded":"2024-03-09T15:24:52.573047+0000","last_fullsized":"2024-03-09T15:24:52.573047+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'22","last_scrub_stamp":"2024-03-09T15:24:52.572962+0000","last_deep_scrub":"257'22","last_deep_scrub_stamp":"2024-03-09T15:24:52.572962+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.572962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:31.114327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:27.175431+0000","last_change":"2024-03-09T14:50:03.664652+0000","last_active":"2024-03-09T15:23:27.175431+0000","last_peered":"2024-03-09T15:23:27.175431+0000","last_clean":"2024-03-09T15:23:27.175431+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:23:27.175431+0000","last_undegraded":"2024-03-09T15:23:27.175431+0000","last_fullsized":"2024-03-09T15:23:27.175431+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.969209+0000","last_change":"2024-03-09T14:35:55.606581+0000","last_active":"2024-03-09T15:24:37.969209+0000","last_peered":"2024-03-09T15:24:37.969209+0000","last_clean":"2024-03-09T15:24:37.969209+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:24:37.969209+0000","last_undegraded":"2024-03-09T15:24:37.969209+0000","last_fullsized":"2024-03-09T15:24:37.969209+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'7","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.513630+0000","last_change":"2024-03-09T15:24:47.513654+0000","last_active":"2024-03-09T15:24:47.513630+0000","last_peered":"2024-03-09T15:24:47.513630+0000","last_clean":"2024-03-09T15:24:47.513630+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:24:47.513630+0000","last_undegraded":"2024-03-09T15:24:47.513630+0000","last_fullsized":"2024-03-09T15:24:47.513630+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-03-09T15:24:47.513517+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-03-09T15:24:47.513517+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.513517+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:21:32.580098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":242,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.380077+0000","last_change":"2024-03-09T15:24:46.380077+0000","last_active":"2024-03-09T15:24:46.380077+0000","last_peered":"2024-03-09T15:24:46.380077+0000","last_clean":"2024-03-09T15:24:46.380077+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:24:46.380077+0000","last_undegraded":"2024-03-09T15:24:46.380077+0000","last_fullsized":"2024-03-09T15:24:46.380077+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'71","last_scrub_stamp":"2024-03-09T15:24:46.379972+0000","last_deep_scrub":"260'71","last_deep_scrub_stamp":"2024-03-09T15:24:46.379972+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.379972+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:38.762567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.724962+0000","last_change":"2024-03-09T15:25:14.724990+0000","last_active":"2024-03-09T15:25:14.724962+0000","last_peered":"2024-03-09T15:25:14.724962+0000","last_clean":"2024-03-09T15:25:14.724962+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:25:14.724962+0000","last_undegraded":"2024-03-09T15:25:14.724962+0000","last_fullsized":"2024-03-09T15:25:14.724962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:14.724873+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:14.724873+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.724873+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:16.539018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'6","reported_seq":66,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.437501+0000","last_change":"2024-03-09T15:24:52.437571+0000","last_active":"2024-03-09T15:24:52.437501+0000","last_peered":"2024-03-09T15:24:52.437501+0000","last_clean":"2024-03-09T15:24:52.437501+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:24:52.437501+0000","last_undegraded":"2024-03-09T15:24:52.437501+0000","last_fullsized":"2024-03-09T15:24:52.437501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:24:52.437394+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:24:52.437394+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.437394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:42:22.375542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.495488+0000","last_change":"2024-03-09T15:24:50.495520+0000","last_active":"2024-03-09T15:24:50.495488+0000","last_peered":"2024-03-09T15:24:50.495488+0000","last_clean":"2024-03-09T15:24:50.495488+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:24:50.495488+0000","last_undegraded":"2024-03-09T15:24:50.495488+0000","last_fullsized":"2024-03-09T15:24:50.495488+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:50.495402+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:50.495402+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.495402+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:41.138717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":11,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'96","reported_seq":344,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.514877+0000","last_change":"2024-03-09T15:24:45.514877+0000","last_active":"2024-03-09T15:24:45.514877+0000","last_peered":"2024-03-09T15:24:45.514877+0000","last_clean":"2024-03-09T15:24:45.514877+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:24:45.514877+0000","last_undegraded":"2024-03-09T15:24:45.514877+0000","last_fullsized":"2024-03-09T15:24:45.514877+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'96","last_scrub_stamp":"2024-03-09T15:24:45.514758+0000","last_deep_scrub":"260'96","last_deep_scrub_stamp":"2024-03-09T15:24:45.514758+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.514758+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:31:22.175081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4649,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281875+0000","last_change":"2024-03-09T14:50:03.655635+0000","last_active":"2024-03-09T15:24:42.281875+0000","last_peered":"2024-03-09T15:24:42.281875+0000","last_clean":"2024-03-09T15:24:42.281875+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:24:42.281875+0000","last_undegraded":"2024-03-09T15:24:42.281875+0000","last_fullsized":"2024-03-09T15:24:42.281875+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":47,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.056215+0000","last_change":"2024-03-09T14:35:55.599321+0000","last_active":"2024-03-09T15:24:07.056215+0000","last_peered":"2024-03-09T15:24:07.056215+0000","last_clean":"2024-03-09T15:24:07.056215+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:24:07.056215+0000","last_undegraded":"2024-03-09T15:24:07.056215+0000","last_fullsized":"2024-03-09T15:24:07.056215+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'7","reported_seq":72,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.529280+0000","last_change":"2024-03-09T15:24:46.529305+0000","last_active":"2024-03-09T15:24:46.529280+0000","last_peered":"2024-03-09T15:24:46.529280+0000","last_clean":"2024-03-09T15:24:46.529280+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:24:46.529280+0000","last_undegraded":"2024-03-09T15:24:46.529280+0000","last_fullsized":"2024-03-09T15:24:46.529280+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-03-09T15:24:46.529187+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-03-09T15:24:46.529187+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.529187+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:48:47.943384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10288,"num_write":7,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":184,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.065367+0000","last_change":"2024-03-09T15:24:45.065367+0000","last_active":"2024-03-09T15:24:45.065367+0000","last_peered":"2024-03-09T15:24:45.065367+0000","last_clean":"2024-03-09T15:24:45.065367+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:24:45.065367+0000","last_undegraded":"2024-03-09T15:24:45.065367+0000","last_fullsized":"2024-03-09T15:24:45.065367+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:45.065248+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:45.065248+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.065248+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:23.682691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:26.914935+0000","last_change":"2024-03-09T14:50:03.658063+0000","last_active":"2024-03-09T15:23:26.914935+0000","last_peered":"2024-03-09T15:23:26.914935+0000","last_clean":"2024-03-09T15:23:26.914935+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:23:26.914935+0000","last_undegraded":"2024-03-09T15:23:26.914935+0000","last_fullsized":"2024-03-09T15:23:26.914935+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.681948+0000","last_change":"2024-03-09T15:25:18.681970+0000","last_active":"2024-03-09T15:25:18.681948+0000","last_peered":"2024-03-09T15:25:18.681948+0000","last_clean":"2024-03-09T15:25:18.681948+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:25:18.681948+0000","last_undegraded":"2024-03-09T15:25:18.681948+0000","last_fullsized":"2024-03-09T15:25:18.681948+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.681823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.681823+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.681823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:14.203153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'3","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.382037+0000","last_change":"2024-03-09T15:24:45.382059+0000","last_active":"2024-03-09T15:24:45.382037+0000","last_peered":"2024-03-09T15:24:45.382037+0000","last_clean":"2024-03-09T15:24:45.382037+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:24:45.382037+0000","last_undegraded":"2024-03-09T15:24:45.382037+0000","last_fullsized":"2024-03-09T15:24:45.382037+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:45.381961+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:45.381961+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.381961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:23.774369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.778408+0000","last_change":"2024-03-09T15:24:45.778408+0000","last_active":"2024-03-09T15:24:45.778408+0000","last_peered":"2024-03-09T15:24:45.778408+0000","last_clean":"2024-03-09T15:24:45.778408+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:24:45.778408+0000","last_undegraded":"2024-03-09T15:24:45.778408+0000","last_fullsized":"2024-03-09T15:24:45.778408+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:45.778285+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:45.778285+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.778285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:42.822410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:37.061038+0000","last_change":"2024-03-09T14:50:03.662160+0000","last_active":"2024-03-09T15:23:37.061038+0000","last_peered":"2024-03-09T15:23:37.061038+0000","last_clean":"2024-03-09T15:23:37.061038+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:23:37.061038+0000","last_undegraded":"2024-03-09T15:23:37.061038+0000","last_fullsized":"2024-03-09T15:23:37.061038+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:50:02.632028+0000","last_clean_scrub_stamp":"2024-03-09T14:50:02.632028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":46,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:52.178849+0000","last_change":"2024-03-09T14:35:55.603267+0000","last_active":"2024-03-09T15:23:52.178849+0000","last_peered":"2024-03-09T15:23:52.178849+0000","last_clean":"2024-03-09T15:23:52.178849+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:23:52.178849+0000","last_undegraded":"2024-03-09T15:23:52.178849+0000","last_fullsized":"2024-03-09T15:23:52.178849+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:35:54.581229+0000","last_clean_scrub_stamp":"2024-03-09T14:35:54.581229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.825903+0000","last_change":"2024-03-09T15:24:49.825928+0000","last_active":"2024-03-09T15:24:49.825903+0000","last_peered":"2024-03-09T15:24:49.825903+0000","last_clean":"2024-03-09T15:24:49.825903+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:24:49.825903+0000","last_undegraded":"2024-03-09T15:24:49.825903+0000","last_fullsized":"2024-03-09T15:24:49.825903+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:49.825815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:49.825815+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.825815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:32.539779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.584614+0000","last_change":"2024-03-09T15:24:53.584614+0000","last_active":"2024-03-09T15:24:53.584614+0000","last_peered":"2024-03-09T15:24:53.584614+0000","last_clean":"2024-03-09T15:24:53.584614+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:24:53.584614+0000","last_undegraded":"2024-03-09T15:24:53.584614+0000","last_fullsized":"2024-03-09T15:24:53.584614+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'42","last_scrub_stamp":"2024-03-09T15:24:53.584460+0000","last_deep_scrub":"257'42","last_deep_scrub_stamp":"2024-03-09T15:24:53.584460+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.584460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:12.250584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'217","reported_seq":864,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.152524+0000","last_change":"2024-03-09T14:21:54.364507+0000","last_active":"2024-03-09T15:24:38.152524+0000","last_peered":"2024-03-09T15:24:38.152524+0000","last_clean":"2024-03-09T15:24:38.152524+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:24:38.152524+0000","last_undegraded":"2024-03-09T15:24:38.152524+0000","last_fullsized":"2024-03-09T15:24:38.152524+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097261,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":32250,"num_write":1232,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'371","reported_seq":1087,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.691701+0000","last_change":"2024-03-09T15:25:09.691729+0000","last_active":"2024-03-09T15:25:09.691701+0000","last_peered":"2024-03-09T15:25:09.691701+0000","last_clean":"2024-03-09T15:25:09.691701+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:25:09.691701+0000","last_undegraded":"2024-03-09T15:25:09.691701+0000","last_fullsized":"2024-03-09T15:25:09.691701+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'371","last_scrub_stamp":"2024-03-09T15:25:09.691616+0000","last_deep_scrub":"260'371","last_deep_scrub_stamp":"2024-03-09T15:25:09.691616+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.691616+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:22.587397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'184","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.729214+0000","last_change":"2024-03-09T15:25:11.729307+0000","last_active":"2024-03-09T15:25:11.729214+0000","last_peered":"2024-03-09T15:25:11.729214+0000","last_clean":"2024-03-09T15:25:11.729214+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:25:11.729214+0000","last_undegraded":"2024-03-09T15:25:11.729214+0000","last_fullsized":"2024-03-09T15:25:11.729214+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-03-09T15:25:11.729098+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-03-09T15:25:11.729098+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.729098+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:55.848101+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10770133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":33432,"num_write":993,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.490228+0000","last_change":"2024-03-09T15:25:12.490255+0000","last_active":"2024-03-09T15:25:12.490228+0000","last_peered":"2024-03-09T15:25:12.490228+0000","last_clean":"2024-03-09T15:25:12.490228+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:25:12.490228+0000","last_undegraded":"2024-03-09T15:25:12.490228+0000","last_fullsized":"2024-03-09T15:25:12.490228+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-03-09T15:25:12.490143+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-03-09T15:25:12.490143+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.490143+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:34:38.295194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:26.921583+0000","last_change":"2024-03-09T14:21:54.357346+0000","last_active":"2024-03-09T15:24:26.921583+0000","last_peered":"2024-03-09T15:24:26.921583+0000","last_clean":"2024-03-09T15:24:26.921583+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:24:26.921583+0000","last_undegraded":"2024-03-09T15:24:26.921583+0000","last_fullsized":"2024-03-09T15:24:26.921583+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.136271+0000","last_change":"2024-03-09T15:25:06.136300+0000","last_active":"2024-03-09T15:25:06.136271+0000","last_peered":"2024-03-09T15:25:06.136271+0000","last_clean":"2024-03-09T15:25:06.136271+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:25:06.136271+0000","last_undegraded":"2024-03-09T15:25:06.136271+0000","last_fullsized":"2024-03-09T15:25:06.136271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'107","last_scrub_stamp":"2024-03-09T15:25:06.136177+0000","last_deep_scrub":"260'107","last_deep_scrub_stamp":"2024-03-09T15:25:06.136177+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.136177+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:14.459481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'193","reported_seq":903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.780415+0000","last_change":"2024-03-09T15:25:15.780516+0000","last_active":"2024-03-09T15:25:15.780415+0000","last_peered":"2024-03-09T15:25:15.780415+0000","last_clean":"2024-03-09T15:25:15.780415+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:25:15.780415+0000","last_undegraded":"2024-03-09T15:25:15.780415+0000","last_fullsized":"2024-03-09T15:25:15.780415+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-03-09T15:25:15.780299+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-03-09T15:25:15.780299+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.780299+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:04.896817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":557,"num_read_kb":57961,"num_write":1122,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":731,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.501497+0000","last_change":"2024-03-09T15:25:17.501559+0000","last_active":"2024-03-09T15:25:17.501497+0000","last_peered":"2024-03-09T15:25:17.501497+0000","last_clean":"2024-03-09T15:25:17.501497+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:25:17.501497+0000","last_undegraded":"2024-03-09T15:25:17.501497+0000","last_fullsized":"2024-03-09T15:25:17.501497+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'136","last_scrub_stamp":"2024-03-09T15:25:17.501384+0000","last_deep_scrub":"260'136","last_deep_scrub_stamp":"2024-03-09T15:25:17.501384+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.501384+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:07.292093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'194","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.121848+0000","last_change":"2024-03-09T14:21:54.361340+0000","last_active":"2024-03-09T15:24:38.121848+0000","last_peered":"2024-03-09T15:24:38.121848+0000","last_clean":"2024-03-09T15:24:38.121848+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:24:38.121848+0000","last_undegraded":"2024-03-09T15:24:38.121848+0000","last_fullsized":"2024-03-09T15:24:38.121848+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":140946,"num_write":1106,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.785712+0000","last_change":"2024-03-09T15:24:58.785759+0000","last_active":"2024-03-09T15:24:58.785712+0000","last_peered":"2024-03-09T15:24:58.785712+0000","last_clean":"2024-03-09T15:24:58.785712+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:24:58.785712+0000","last_undegraded":"2024-03-09T15:24:58.785712+0000","last_fullsized":"2024-03-09T15:24:58.785712+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-03-09T15:24:58.785614+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-03-09T15:24:58.785614+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.785614+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:45.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'194","reported_seq":836,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.101442+0000","last_change":"2024-03-09T14:21:54.369817+0000","last_active":"2024-03-09T15:24:38.101442+0000","last_peered":"2024-03-09T15:24:38.101442+0000","last_clean":"2024-03-09T15:24:38.101442+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:24:38.101442+0000","last_undegraded":"2024-03-09T15:24:38.101442+0000","last_fullsized":"2024-03-09T15:24:38.101442+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":400,"num_read_kb":13387,"num_write":1038,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.110497+0000","last_change":"2024-03-09T15:25:09.110523+0000","last_active":"2024-03-09T15:25:09.110497+0000","last_peered":"2024-03-09T15:25:09.110497+0000","last_clean":"2024-03-09T15:25:09.110497+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:25:09.110497+0000","last_undegraded":"2024-03-09T15:25:09.110497+0000","last_fullsized":"2024-03-09T15:25:09.110497+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'144","last_scrub_stamp":"2024-03-09T15:25:09.110405+0000","last_deep_scrub":"260'144","last_deep_scrub_stamp":"2024-03-09T15:25:09.110405+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.110405+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:56.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":863,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.068137+0000","last_change":"2024-03-09T14:21:54.360895+0000","last_active":"2024-03-09T15:24:27.068137+0000","last_peered":"2024-03-09T15:24:27.068137+0000","last_clean":"2024-03-09T15:24:27.068137+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:24:27.068137+0000","last_undegraded":"2024-03-09T15:24:27.068137+0000","last_fullsized":"2024-03-09T15:24:27.068137+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.477878+0000","last_change":"2024-03-09T15:24:46.477905+0000","last_active":"2024-03-09T15:24:46.477878+0000","last_peered":"2024-03-09T15:24:46.477878+0000","last_clean":"2024-03-09T15:24:46.477878+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:24:46.477878+0000","last_undegraded":"2024-03-09T15:24:46.477878+0000","last_fullsized":"2024-03-09T15:24:46.477878+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-03-09T15:24:46.477782+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-03-09T15:24:46.477782+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.477782+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:21.730641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'199","reported_seq":854,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.906647+0000","last_change":"2024-03-09T14:21:54.367692+0000","last_active":"2024-03-09T15:24:37.906647+0000","last_peered":"2024-03-09T15:24:37.906647+0000","last_clean":"2024-03-09T15:24:37.906647+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:24:37.906647+0000","last_undegraded":"2024-03-09T15:24:37.906647+0000","last_fullsized":"2024-03-09T15:24:37.906647+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":42906,"num_write":1255,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.564729+0000","last_change":"2024-03-09T15:25:04.564755+0000","last_active":"2024-03-09T15:25:04.564729+0000","last_peered":"2024-03-09T15:25:04.564729+0000","last_clean":"2024-03-09T15:25:04.564729+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:25:04.564729+0000","last_undegraded":"2024-03-09T15:25:04.564729+0000","last_fullsized":"2024-03-09T15:25:04.564729+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-03-09T15:25:04.564635+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-03-09T15:25:04.564635+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.564635+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:35:34.531429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'153","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.111121+0000","last_change":"2024-03-09T15:25:08.111149+0000","last_active":"2024-03-09T15:25:08.111121+0000","last_peered":"2024-03-09T15:25:08.111121+0000","last_clean":"2024-03-09T15:25:08.111121+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:25:08.111121+0000","last_undegraded":"2024-03-09T15:25:08.111121+0000","last_fullsized":"2024-03-09T15:25:08.111121+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-03-09T15:25:08.111036+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-03-09T15:25:08.111036+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.111036+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:40:01.586550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3063,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'172","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596476+0000","last_change":"2024-03-09T14:21:54.358160+0000","last_active":"2024-03-09T15:24:45.596476+0000","last_peered":"2024-03-09T15:24:45.596476+0000","last_clean":"2024-03-09T15:24:45.596476+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:24:45.596476+0000","last_undegraded":"2024-03-09T15:24:45.596476+0000","last_fullsized":"2024-03-09T15:24:45.596476+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":28832,"num_write":1019,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.470574+0000","last_change":"2024-03-09T15:25:14.470609+0000","last_active":"2024-03-09T15:25:14.470574+0000","last_peered":"2024-03-09T15:25:14.470574+0000","last_clean":"2024-03-09T15:25:14.470574+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:25:14.470574+0000","last_undegraded":"2024-03-09T15:25:14.470574+0000","last_fullsized":"2024-03-09T15:25:14.470574+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'147","last_scrub_stamp":"2024-03-09T15:25:14.470492+0000","last_deep_scrub":"260'147","last_deep_scrub_stamp":"2024-03-09T15:25:14.470492+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.470492+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:44:51.302254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'203","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.672704+0000","last_change":"2024-03-09T15:25:11.672763+0000","last_active":"2024-03-09T15:25:11.672704+0000","last_peered":"2024-03-09T15:25:11.672704+0000","last_clean":"2024-03-09T15:25:11.672704+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:25:11.672704+0000","last_undegraded":"2024-03-09T15:25:11.672704+0000","last_fullsized":"2024-03-09T15:25:11.672704+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-03-09T15:25:11.672606+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-03-09T15:25:11.672606+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.672606+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:55.552176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322934,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":20924,"num_write":1102,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.691620+0000","last_change":"2024-03-09T15:25:02.691620+0000","last_active":"2024-03-09T15:25:02.691620+0000","last_peered":"2024-03-09T15:25:02.691620+0000","last_clean":"2024-03-09T15:25:02.691620+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:25:02.691620+0000","last_undegraded":"2024-03-09T15:25:02.691620+0000","last_fullsized":"2024-03-09T15:25:02.691620+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'126","last_scrub_stamp":"2024-03-09T15:25:02.691466+0000","last_deep_scrub":"260'126","last_deep_scrub_stamp":"2024-03-09T15:25:02.691466+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.691466+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:45.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'191","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.675120+0000","last_change":"2024-03-09T15:25:14.675230+0000","last_active":"2024-03-09T15:25:14.675120+0000","last_peered":"2024-03-09T15:25:14.675120+0000","last_clean":"2024-03-09T15:25:14.675120+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:25:14.675120+0000","last_undegraded":"2024-03-09T15:25:14.675120+0000","last_fullsized":"2024-03-09T15:25:14.675120+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-03-09T15:25:14.675019+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-03-09T15:25:14.675019+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.675019+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:39.973729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661148,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":129688,"num_write":1091,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'328","reported_seq":1004,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.519487+0000","last_change":"2024-03-09T15:25:05.519517+0000","last_active":"2024-03-09T15:25:05.519487+0000","last_peered":"2024-03-09T15:25:05.519487+0000","last_clean":"2024-03-09T15:25:05.519487+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:25:05.519487+0000","last_undegraded":"2024-03-09T15:25:05.519487+0000","last_fullsized":"2024-03-09T15:25:05.519487+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'328","last_scrub_stamp":"2024-03-09T15:25:05.519385+0000","last_deep_scrub":"260'328","last_deep_scrub_stamp":"2024-03-09T15:25:05.519385+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.519385+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:58:41.778187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25680,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'188","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.744942+0000","last_change":"2024-03-09T15:24:54.744942+0000","last_active":"2024-03-09T15:24:54.744942+0000","last_peered":"2024-03-09T15:24:54.744942+0000","last_clean":"2024-03-09T15:24:54.744942+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:24:54.744942+0000","last_undegraded":"2024-03-09T15:24:54.744942+0000","last_fullsized":"2024-03-09T15:24:54.744942+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-03-09T15:24:54.744799+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-03-09T15:24:54.744799+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.744799+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:01.622856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":533,"num_read_kb":17983,"num_write":1110,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.653879+0000","last_change":"2024-03-09T15:25:02.653909+0000","last_active":"2024-03-09T15:25:02.653879+0000","last_peered":"2024-03-09T15:25:02.653879+0000","last_clean":"2024-03-09T15:25:02.653879+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:25:02.653879+0000","last_undegraded":"2024-03-09T15:25:02.653879+0000","last_fullsized":"2024-03-09T15:25:02.653879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-03-09T15:25:02.653777+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-03-09T15:25:02.653777+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.653777+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:02.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'193","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703856+0000","last_change":"2024-03-09T14:21:54.371479+0000","last_active":"2024-03-09T15:24:43.703856+0000","last_peered":"2024-03-09T15:24:43.703856+0000","last_clean":"2024-03-09T15:24:43.703856+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:24:43.703856+0000","last_undegraded":"2024-03-09T15:24:43.703856+0000","last_fullsized":"2024-03-09T15:24:43.703856+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":27148,"num_write":1016,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":743,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.095912+0000","last_change":"2024-03-09T15:25:05.095938+0000","last_active":"2024-03-09T15:25:05.095912+0000","last_peered":"2024-03-09T15:25:05.095912+0000","last_clean":"2024-03-09T15:25:05.095912+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:25:05.095912+0000","last_undegraded":"2024-03-09T15:25:05.095912+0000","last_fullsized":"2024-03-09T15:25:05.095912+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'126","last_scrub_stamp":"2024-03-09T15:25:05.095824+0000","last_deep_scrub":"260'126","last_deep_scrub_stamp":"2024-03-09T15:25:05.095824+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.095824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:34.424822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":988,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281038+0000","last_change":"2024-03-09T14:21:54.371089+0000","last_active":"2024-03-09T15:24:42.281038+0000","last_peered":"2024-03-09T15:24:42.281038+0000","last_clean":"2024-03-09T15:24:42.281038+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:24:42.281038+0000","last_undegraded":"2024-03-09T15:24:42.281038+0000","last_fullsized":"2024-03-09T15:24:42.281038+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262145,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1066,"num_read_kb":11712,"num_write":1257,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.040044+0000","last_change":"2024-03-09T15:24:47.040044+0000","last_active":"2024-03-09T15:24:47.040044+0000","last_peered":"2024-03-09T15:24:47.040044+0000","last_clean":"2024-03-09T15:24:47.040044+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:24:47.040044+0000","last_undegraded":"2024-03-09T15:24:47.040044+0000","last_fullsized":"2024-03-09T15:24:47.040044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'102","last_scrub_stamp":"2024-03-09T15:24:47.039894+0000","last_deep_scrub":"260'102","last_deep_scrub_stamp":"2024-03-09T15:24:47.039894+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.039894+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:55.824228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'115","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703936+0000","last_change":"2024-03-09T14:21:56.354345+0000","last_active":"2024-03-09T15:24:43.703936+0000","last_peered":"2024-03-09T15:24:43.703936+0000","last_clean":"2024-03-09T15:24:43.703936+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:24:43.703936+0000","last_undegraded":"2024-03-09T15:24:43.703936+0000","last_fullsized":"2024-03-09T15:24:43.703936+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'208","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596402+0000","last_change":"2024-03-09T14:21:54.364329+0000","last_active":"2024-03-09T15:24:45.596402+0000","last_peered":"2024-03-09T15:24:45.596402+0000","last_clean":"2024-03-09T15:24:45.596402+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:24:45.596402+0000","last_undegraded":"2024-03-09T15:24:45.596402+0000","last_fullsized":"2024-03-09T15:24:45.596402+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537676,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":3008,"num_write":992,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.722025+0000","last_change":"2024-03-09T15:25:06.722047+0000","last_active":"2024-03-09T15:25:06.722025+0000","last_peered":"2024-03-09T15:25:06.722025+0000","last_clean":"2024-03-09T15:25:06.722025+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:25:06.722025+0000","last_undegraded":"2024-03-09T15:25:06.722025+0000","last_fullsized":"2024-03-09T15:25:06.722025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.721943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.721943+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.721943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:32.418249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'216","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.456533+0000","last_change":"2024-03-09T15:25:20.456569+0000","last_active":"2024-03-09T15:25:20.456533+0000","last_peered":"2024-03-09T15:25:20.456533+0000","last_clean":"2024-03-09T15:25:20.456533+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:25:20.456533+0000","last_undegraded":"2024-03-09T15:25:20.456533+0000","last_fullsized":"2024-03-09T15:25:20.456533+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-03-09T15:25:20.456450+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-03-09T15:25:20.456450+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.456450+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:25.454690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":392,"num_write":172,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.529323+0000","last_change":"2024-03-09T15:25:07.529363+0000","last_active":"2024-03-09T15:25:07.529323+0000","last_peered":"2024-03-09T15:25:07.529323+0000","last_clean":"2024-03-09T15:25:07.529323+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:25:07.529323+0000","last_undegraded":"2024-03-09T15:25:07.529323+0000","last_fullsized":"2024-03-09T15:25:07.529323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:07.529229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:07.529229+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.529229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:54.074479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2480","reported_seq":4915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.559182+0000","last_change":"2024-03-09T15:24:51.559182+0000","last_active":"2024-03-09T15:24:51.559182+0000","last_peered":"2024-03-09T15:24:51.559182+0000","last_clean":"2024-03-09T15:24:51.559182+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:51.559182+0000","last_undegraded":"2024-03-09T15:24:51.559182+0000","last_fullsized":"2024-03-09T15:24:51.559182+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2480","last_scrub_stamp":"2024-03-09T15:24:51.559016+0000","last_deep_scrub":"260'2480","last_deep_scrub_stamp":"2024-03-09T15:24:51.559016+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.559016+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":2400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:08.961543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.760990+0000","last_change":"2024-03-09T15:25:05.761017+0000","last_active":"2024-03-09T15:25:05.760990+0000","last_peered":"2024-03-09T15:25:05.760990+0000","last_clean":"2024-03-09T15:25:05.760990+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:25:05.760990+0000","last_undegraded":"2024-03-09T15:25:05.760990+0000","last_fullsized":"2024-03-09T15:25:05.760990+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-03-09T15:25:05.760898+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-03-09T15:25:05.760898+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.760898+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:33:19.770970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'187","reported_seq":817,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.280919+0000","last_change":"2024-03-09T14:21:54.370606+0000","last_active":"2024-03-09T15:24:42.280919+0000","last_peered":"2024-03-09T15:24:42.280919+0000","last_clean":"2024-03-09T15:24:42.280919+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:24:42.280919+0000","last_undegraded":"2024-03-09T15:24:42.280919+0000","last_fullsized":"2024-03-09T15:24:42.280919+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":36262,"num_write":1057,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704122+0000","last_change":"2024-03-09T14:21:58.370142+0000","last_active":"2024-03-09T15:24:43.704122+0000","last_peered":"2024-03-09T15:24:43.704122+0000","last_clean":"2024-03-09T15:24:43.704122+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:24:43.704122+0000","last_undegraded":"2024-03-09T15:24:43.704122+0000","last_fullsized":"2024-03-09T15:24:43.704122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'111","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.041174+0000","last_change":"2024-03-09T15:25:01.041208+0000","last_active":"2024-03-09T15:25:01.041174+0000","last_peered":"2024-03-09T15:25:01.041174+0000","last_clean":"2024-03-09T15:25:01.041174+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:25:01.041174+0000","last_undegraded":"2024-03-09T15:25:01.041174+0000","last_fullsized":"2024-03-09T15:25:01.041174+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'111","last_scrub_stamp":"2024-03-09T15:25:01.041080+0000","last_deep_scrub":"260'111","last_deep_scrub_stamp":"2024-03-09T15:25:01.041080+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.041080+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:34.578856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.067706+0000","last_change":"2024-03-09T15:24:53.067728+0000","last_active":"2024-03-09T15:24:53.067706+0000","last_peered":"2024-03-09T15:24:53.067706+0000","last_clean":"2024-03-09T15:24:53.067706+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:24:53.067706+0000","last_undegraded":"2024-03-09T15:24:53.067706+0000","last_fullsized":"2024-03-09T15:24:53.067706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.067618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.067618+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.067618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:19.960545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'118","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.668933+0000","last_change":"2024-03-09T15:24:59.668977+0000","last_active":"2024-03-09T15:24:59.668933+0000","last_peered":"2024-03-09T15:24:59.668933+0000","last_clean":"2024-03-09T15:24:59.668933+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:24:59.668933+0000","last_undegraded":"2024-03-09T15:24:59.668933+0000","last_fullsized":"2024-03-09T15:24:59.668933+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-03-09T15:24:59.668844+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-03-09T15:24:59.668844+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.668844+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:39.551493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.486695+0000","last_change":"2024-03-09T15:25:15.486736+0000","last_active":"2024-03-09T15:25:15.486695+0000","last_peered":"2024-03-09T15:25:15.486695+0000","last_clean":"2024-03-09T15:25:15.486695+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:25:15.486695+0000","last_undegraded":"2024-03-09T15:25:15.486695+0000","last_fullsized":"2024-03-09T15:25:15.486695+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'384","last_scrub_stamp":"2024-03-09T15:25:15.486527+0000","last_deep_scrub":"260'384","last_deep_scrub_stamp":"2024-03-09T15:25:15.486527+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.486527+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:35:25.095101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'173","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.562760+0000","last_change":"2024-03-09T15:25:21.562799+0000","last_active":"2024-03-09T15:25:21.562760+0000","last_peered":"2024-03-09T15:25:21.562760+0000","last_clean":"2024-03-09T15:25:21.562760+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:25:21.562760+0000","last_undegraded":"2024-03-09T15:25:21.562760+0000","last_fullsized":"2024-03-09T15:25:21.562760+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-03-09T15:25:21.562672+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-03-09T15:25:21.562672+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.562672+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:52.305905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269857,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":24289,"num_write":907,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704025+0000","last_change":"2024-03-09T14:21:58.372340+0000","last_active":"2024-03-09T15:24:43.704025+0000","last_peered":"2024-03-09T15:24:43.704025+0000","last_clean":"2024-03-09T15:24:43.704025+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:24:43.704025+0000","last_undegraded":"2024-03-09T15:24:43.704025+0000","last_fullsized":"2024-03-09T15:24:43.704025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'138","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.864375+0000","last_change":"2024-03-09T15:24:51.864375+0000","last_active":"2024-03-09T15:24:51.864375+0000","last_peered":"2024-03-09T15:24:51.864375+0000","last_clean":"2024-03-09T15:24:51.864375+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:24:51.864375+0000","last_undegraded":"2024-03-09T15:24:51.864375+0000","last_fullsized":"2024-03-09T15:24:51.864375+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'138","last_scrub_stamp":"2024-03-09T15:24:51.864126+0000","last_deep_scrub":"260'138","last_deep_scrub_stamp":"2024-03-09T15:24:51.864126+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.864126+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:26.206830+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'505","reported_seq":2190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.563065+0000","last_change":"2024-03-09T15:25:04.563112+0000","last_active":"2024-03-09T15:25:04.563065+0000","last_peered":"2024-03-09T15:25:04.563065+0000","last_clean":"2024-03-09T15:25:04.563065+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:25:04.563065+0000","last_undegraded":"2024-03-09T15:25:04.563065+0000","last_fullsized":"2024-03-09T15:25:04.563065+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'505","last_scrub_stamp":"2024-03-09T15:25:04.562939+0000","last_deep_scrub":"260'505","last_deep_scrub_stamp":"2024-03-09T15:25:04.562939+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.562939+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:17.199198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'202","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.070390+0000","last_change":"2024-03-09T15:24:51.070423+0000","last_active":"2024-03-09T15:24:51.070390+0000","last_peered":"2024-03-09T15:24:51.070390+0000","last_clean":"2024-03-09T15:24:51.070390+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:24:51.070390+0000","last_undegraded":"2024-03-09T15:24:51.070390+0000","last_fullsized":"2024-03-09T15:24:51.070390+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-03-09T15:24:51.070293+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-03-09T15:24:51.070293+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.070293+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:13.198924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.325535+0000","last_change":"2024-03-09T15:25:17.325579+0000","last_active":"2024-03-09T15:25:17.325535+0000","last_peered":"2024-03-09T15:25:17.325535+0000","last_clean":"2024-03-09T15:25:17.325535+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:25:17.325535+0000","last_undegraded":"2024-03-09T15:25:17.325535+0000","last_fullsized":"2024-03-09T15:25:17.325535+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-03-09T15:25:17.325410+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-03-09T15:25:17.325410+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.325410+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:54.798262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'332","reported_seq":1065,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.625221+0000","last_change":"2024-03-09T15:25:12.625268+0000","last_active":"2024-03-09T15:25:12.625221+0000","last_peered":"2024-03-09T15:25:12.625221+0000","last_clean":"2024-03-09T15:25:12.625221+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:25:12.625221+0000","last_undegraded":"2024-03-09T15:25:12.625221+0000","last_fullsized":"2024-03-09T15:25:12.625221+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'332","last_scrub_stamp":"2024-03-09T15:25:12.625124+0000","last_deep_scrub":"260'332","last_deep_scrub_stamp":"2024-03-09T15:25:12.625124+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.625124+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:07.883712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264989,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":889,"num_read_kb":69587,"num_write":1468,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.752492+0000","last_change":"2024-03-09T15:25:12.752516+0000","last_active":"2024-03-09T15:25:12.752492+0000","last_peered":"2024-03-09T15:25:12.752492+0000","last_clean":"2024-03-09T15:25:12.752492+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:25:12.752492+0000","last_undegraded":"2024-03-09T15:25:12.752492+0000","last_fullsized":"2024-03-09T15:25:12.752492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:12.752399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:12.752399+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.752399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:15.364468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'143","reported_seq":726,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.498067+0000","last_change":"2024-03-09T15:25:09.498111+0000","last_active":"2024-03-09T15:25:09.498067+0000","last_peered":"2024-03-09T15:25:09.498067+0000","last_clean":"2024-03-09T15:25:09.498067+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:25:09.498067+0000","last_undegraded":"2024-03-09T15:25:09.498067+0000","last_fullsized":"2024-03-09T15:25:09.498067+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'143","last_scrub_stamp":"2024-03-09T15:25:09.497977+0000","last_deep_scrub":"260'143","last_deep_scrub_stamp":"2024-03-09T15:25:09.497977+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.497977+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:03.584046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4492,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":259,"num_write":96,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'547","reported_seq":2352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.384416+0000","last_change":"2024-03-09T15:25:02.384416+0000","last_active":"2024-03-09T15:25:02.384416+0000","last_peered":"2024-03-09T15:25:02.384416+0000","last_clean":"2024-03-09T15:25:02.384416+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:25:02.384416+0000","last_undegraded":"2024-03-09T15:25:02.384416+0000","last_fullsized":"2024-03-09T15:25:02.384416+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'547","last_scrub_stamp":"2024-03-09T15:25:02.384256+0000","last_deep_scrub":"260'547","last_deep_scrub_stamp":"2024-03-09T15:25:02.384256+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.384256+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:56.527935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'168","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.725848+0000","last_change":"2024-03-09T15:25:03.725877+0000","last_active":"2024-03-09T15:25:03.725848+0000","last_peered":"2024-03-09T15:25:03.725848+0000","last_clean":"2024-03-09T15:25:03.725848+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:25:03.725848+0000","last_undegraded":"2024-03-09T15:25:03.725848+0000","last_fullsized":"2024-03-09T15:25:03.725848+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-03-09T15:25:03.725761+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-03-09T15:25:03.725761+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.725761+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:34:04.800249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'214","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596371+0000","last_change":"2024-03-09T14:21:54.363733+0000","last_active":"2024-03-09T15:24:45.596371+0000","last_peered":"2024-03-09T15:24:45.596371+0000","last_clean":"2024-03-09T15:24:45.596371+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:24:45.596371+0000","last_undegraded":"2024-03-09T15:24:45.596371+0000","last_fullsized":"2024-03-09T15:24:45.596371+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102541,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":2831,"num_write":1215,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.517568+0000","last_change":"2024-03-09T15:25:18.517605+0000","last_active":"2024-03-09T15:25:18.517568+0000","last_peered":"2024-03-09T15:25:18.517568+0000","last_clean":"2024-03-09T15:25:18.517568+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:25:18.517568+0000","last_undegraded":"2024-03-09T15:25:18.517568+0000","last_fullsized":"2024-03-09T15:25:18.517568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.517468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.517468+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.517468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:11.159850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'240","reported_seq":876,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.697323+0000","last_change":"2024-03-09T15:24:59.697323+0000","last_active":"2024-03-09T15:24:59.697323+0000","last_peered":"2024-03-09T15:24:59.697323+0000","last_clean":"2024-03-09T15:24:59.697323+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:24:59.697323+0000","last_undegraded":"2024-03-09T15:24:59.697323+0000","last_fullsized":"2024-03-09T15:24:59.697323+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'240","last_scrub_stamp":"2024-03-09T15:24:59.697180+0000","last_deep_scrub":"260'240","last_deep_scrub_stamp":"2024-03-09T15:24:59.697180+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.697180+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:56.073618+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":331,"num_read_kb":401,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.687465+0000","last_change":"2024-03-09T15:25:06.687485+0000","last_active":"2024-03-09T15:25:06.687465+0000","last_peered":"2024-03-09T15:25:06.687465+0000","last_clean":"2024-03-09T15:25:06.687465+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:25:06.687465+0000","last_undegraded":"2024-03-09T15:25:06.687465+0000","last_fullsized":"2024-03-09T15:25:06.687465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.687390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.687390+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.687390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:06.678671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'550","reported_seq":1367,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.584620+0000","last_change":"2024-03-09T15:24:50.584659+0000","last_active":"2024-03-09T15:24:50.584620+0000","last_peered":"2024-03-09T15:24:50.584620+0000","last_clean":"2024-03-09T15:24:50.584620+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:50.584620+0000","last_undegraded":"2024-03-09T15:24:50.584620+0000","last_fullsized":"2024-03-09T15:24:50.584620+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'550","last_scrub_stamp":"2024-03-09T15:24:50.584505+0000","last_deep_scrub":"260'550","last_deep_scrub_stamp":"2024-03-09T15:24:50.584505+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.584505+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:19:35.935216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'161","reported_seq":783,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.114928+0000","last_change":"2024-03-09T15:25:07.114957+0000","last_active":"2024-03-09T15:25:07.114928+0000","last_peered":"2024-03-09T15:25:07.114928+0000","last_clean":"2024-03-09T15:25:07.114928+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:25:07.114928+0000","last_undegraded":"2024-03-09T15:25:07.114928+0000","last_fullsized":"2024-03-09T15:25:07.114928+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'161","last_scrub_stamp":"2024-03-09T15:25:07.114846+0000","last_deep_scrub":"260'161","last_deep_scrub_stamp":"2024-03-09T15:25:07.114846+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.114846+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:34:13.158789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596348+0000","last_change":"2024-03-09T14:21:54.361313+0000","last_active":"2024-03-09T15:24:45.596348+0000","last_peered":"2024-03-09T15:24:45.596348+0000","last_clean":"2024-03-09T15:24:45.596348+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:24:45.596348+0000","last_undegraded":"2024-03-09T15:24:45.596348+0000","last_fullsized":"2024-03-09T15:24:45.596348+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.787962+0000","last_change":"2024-03-09T15:24:53.787986+0000","last_active":"2024-03-09T15:24:53.787962+0000","last_peered":"2024-03-09T15:24:53.787962+0000","last_clean":"2024-03-09T15:24:53.787962+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:24:53.787962+0000","last_undegraded":"2024-03-09T15:24:53.787962+0000","last_fullsized":"2024-03-09T15:24:53.787962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.787868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.787868+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.787868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'141","reported_seq":730,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.425400+0000","last_change":"2024-03-09T15:25:14.425437+0000","last_active":"2024-03-09T15:25:14.425400+0000","last_peered":"2024-03-09T15:25:14.425400+0000","last_clean":"2024-03-09T15:25:14.425400+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:25:14.425400+0000","last_undegraded":"2024-03-09T15:25:14.425400+0000","last_fullsized":"2024-03-09T15:25:14.425400+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-03-09T15:25:14.425314+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-03-09T15:25:14.425314+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.425314+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:21.749920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":254,"num_write":98,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.372105+0000","last_change":"2024-03-09T15:25:03.372105+0000","last_active":"2024-03-09T15:25:03.372105+0000","last_peered":"2024-03-09T15:25:03.372105+0000","last_clean":"2024-03-09T15:25:03.372105+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:25:03.372105+0000","last_undegraded":"2024-03-09T15:25:03.372105+0000","last_fullsized":"2024-03-09T15:25:03.372105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:03.371988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:03.371988+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.371988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:17:23.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'155","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.693300+0000","last_change":"2024-03-09T15:25:15.693331+0000","last_active":"2024-03-09T15:25:15.693300+0000","last_peered":"2024-03-09T15:25:15.693300+0000","last_clean":"2024-03-09T15:25:15.693300+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:25:15.693300+0000","last_undegraded":"2024-03-09T15:25:15.693300+0000","last_fullsized":"2024-03-09T15:25:15.693300+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'155","last_scrub_stamp":"2024-03-09T15:25:15.693213+0000","last_deep_scrub":"260'155","last_deep_scrub_stamp":"2024-03-09T15:25:15.693213+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.693213+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:06.822439+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1078,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.704075+0000","last_change":"2024-03-09T15:25:00.704124+0000","last_active":"2024-03-09T15:25:00.704075+0000","last_peered":"2024-03-09T15:25:00.704075+0000","last_clean":"2024-03-09T15:25:00.704075+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:25:00.704075+0000","last_undegraded":"2024-03-09T15:25:00.704075+0000","last_fullsized":"2024-03-09T15:25:00.704075+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'433","last_scrub_stamp":"2024-03-09T15:25:00.703976+0000","last_deep_scrub":"260'433","last_deep_scrub_stamp":"2024-03-09T15:25:00.703976+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.703976+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:03:12.179793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'207","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.540205+0000","last_change":"2024-03-09T15:25:17.540293+0000","last_active":"2024-03-09T15:25:17.540205+0000","last_peered":"2024-03-09T15:25:17.540205+0000","last_clean":"2024-03-09T15:25:17.540205+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:25:17.540205+0000","last_undegraded":"2024-03-09T15:25:17.540205+0000","last_fullsized":"2024-03-09T15:25:17.540205+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'207","last_scrub_stamp":"2024-03-09T15:25:17.540099+0000","last_deep_scrub":"260'207","last_deep_scrub_stamp":"2024-03-09T15:25:17.540099+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.540099+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:12:49.189158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102580,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":99411,"num_write":1014,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.729301+0000","last_change":"2024-03-09T15:24:55.729301+0000","last_active":"2024-03-09T15:24:55.729301+0000","last_peered":"2024-03-09T15:24:55.729301+0000","last_clean":"2024-03-09T15:24:55.729301+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:24:55.729301+0000","last_undegraded":"2024-03-09T15:24:55.729301+0000","last_fullsized":"2024-03-09T15:24:55.729301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.729162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.729162+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.729162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:18.756282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'185","reported_seq":784,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596761+0000","last_change":"2024-03-09T14:22:00.384337+0000","last_active":"2024-03-09T15:24:45.596761+0000","last_peered":"2024-03-09T15:24:45.596761+0000","last_clean":"2024-03-09T15:24:45.596761+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:24:45.596761+0000","last_undegraded":"2024-03-09T15:24:45.596761+0000","last_fullsized":"2024-03-09T15:24:45.596761+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":304,"num_write":138,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'511","reported_seq":2136,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281337+0000","last_change":"2024-03-09T14:22:02.399057+0000","last_active":"2024-03-09T15:24:42.281337+0000","last_peered":"2024-03-09T15:24:42.281337+0000","last_clean":"2024-03-09T15:24:42.281337+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:24:42.281337+0000","last_undegraded":"2024-03-09T15:24:42.281337+0000","last_fullsized":"2024-03-09T15:24:42.281337+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'145","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.674375+0000","last_change":"2024-03-09T15:24:58.674451+0000","last_active":"2024-03-09T15:24:58.674375+0000","last_peered":"2024-03-09T15:24:58.674375+0000","last_clean":"2024-03-09T15:24:58.674375+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:24:58.674375+0000","last_undegraded":"2024-03-09T15:24:58.674375+0000","last_fullsized":"2024-03-09T15:24:58.674375+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-03-09T15:24:58.674272+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-03-09T15:24:58.674272+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.674272+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:54.303141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":712,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281099+0000","last_change":"2024-03-09T14:21:56.371534+0000","last_active":"2024-03-09T15:24:42.281099+0000","last_peered":"2024-03-09T15:24:42.281099+0000","last_clean":"2024-03-09T15:24:42.281099+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:24:42.281099+0000","last_undegraded":"2024-03-09T15:24:42.281099+0000","last_fullsized":"2024-03-09T15:24:42.281099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'165","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650791+0000","last_change":"2024-03-09T14:21:54.369550+0000","last_active":"2024-03-09T15:24:44.650791+0000","last_peered":"2024-03-09T15:24:44.650791+0000","last_clean":"2024-03-09T15:24:44.650791+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:24:44.650791+0000","last_undegraded":"2024-03-09T15:24:44.650791+0000","last_fullsized":"2024-03-09T15:24:44.650791+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":41462,"num_write":961,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.699157+0000","last_change":"2024-03-09T15:24:59.699157+0000","last_active":"2024-03-09T15:24:59.699157+0000","last_peered":"2024-03-09T15:24:59.699157+0000","last_clean":"2024-03-09T15:24:59.699157+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:24:59.699157+0000","last_undegraded":"2024-03-09T15:24:59.699157+0000","last_fullsized":"2024-03-09T15:24:59.699157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:59.699022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:59.699022+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.699022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:49.773254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'223","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.523098+0000","last_change":"2024-03-09T15:25:14.523171+0000","last_active":"2024-03-09T15:25:14.523098+0000","last_peered":"2024-03-09T15:25:14.523098+0000","last_clean":"2024-03-09T15:25:14.523098+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:25:14.523098+0000","last_undegraded":"2024-03-09T15:25:14.523098+0000","last_fullsized":"2024-03-09T15:25:14.523098+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'223","last_scrub_stamp":"2024-03-09T15:25:14.523001+0000","last_deep_scrub":"260'223","last_deep_scrub_stamp":"2024-03-09T15:25:14.523001+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.523001+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:46:56.028597+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11412,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":306,"num_read_kb":453,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.904270+0000","last_change":"2024-03-09T15:24:47.904270+0000","last_active":"2024-03-09T15:24:47.904270+0000","last_peered":"2024-03-09T15:24:47.904270+0000","last_clean":"2024-03-09T15:24:47.904270+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:24:47.904270+0000","last_undegraded":"2024-03-09T15:24:47.904270+0000","last_fullsized":"2024-03-09T15:24:47.904270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:47.904093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:47.904093+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.904093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:28.926895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'97","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.421523+0000","last_change":"2024-03-09T15:24:49.421523+0000","last_active":"2024-03-09T15:24:49.421523+0000","last_peered":"2024-03-09T15:24:49.421523+0000","last_clean":"2024-03-09T15:24:49.421523+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:24:49.421523+0000","last_undegraded":"2024-03-09T15:24:49.421523+0000","last_fullsized":"2024-03-09T15:24:49.421523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'97","last_scrub_stamp":"2024-03-09T15:24:49.421394+0000","last_deep_scrub":"260'97","last_deep_scrub_stamp":"2024-03-09T15:24:49.421394+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.421394+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:26.790404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":600,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178717+0000","last_change":"2024-03-09T14:21:56.352377+0000","last_active":"2024-03-09T15:24:44.178717+0000","last_peered":"2024-03-09T15:24:44.178717+0000","last_clean":"2024-03-09T15:24:44.178717+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:24:44.178717+0000","last_undegraded":"2024-03-09T15:24:44.178717+0000","last_fullsized":"2024-03-09T15:24:44.178717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'163","reported_seq":789,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.886711+0000","last_change":"2024-03-09T15:24:44.886740+0000","last_active":"2024-03-09T15:24:44.886711+0000","last_peered":"2024-03-09T15:24:44.886711+0000","last_clean":"2024-03-09T15:24:44.886711+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:24:44.886711+0000","last_undegraded":"2024-03-09T15:24:44.886711+0000","last_fullsized":"2024-03-09T15:24:44.886711+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-03-09T15:24:44.886619+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-03-09T15:24:44.886619+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.886619+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:51.439361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":87296,"num_write":884,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.733968+0000","last_change":"2024-03-09T15:24:57.733968+0000","last_active":"2024-03-09T15:24:57.733968+0000","last_peered":"2024-03-09T15:24:57.733968+0000","last_clean":"2024-03-09T15:24:57.733968+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:24:57.733968+0000","last_undegraded":"2024-03-09T15:24:57.733968+0000","last_fullsized":"2024-03-09T15:24:57.733968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.733853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.733853+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.733853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:49.813483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'174","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.034667+0000","last_change":"2024-03-09T15:24:59.034667+0000","last_active":"2024-03-09T15:24:59.034667+0000","last_peered":"2024-03-09T15:24:59.034667+0000","last_clean":"2024-03-09T15:24:59.034667+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:24:59.034667+0000","last_undegraded":"2024-03-09T15:24:59.034667+0000","last_fullsized":"2024-03-09T15:24:59.034667+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'174","last_scrub_stamp":"2024-03-09T15:24:59.034541+0000","last_deep_scrub":"260'174","last_deep_scrub_stamp":"2024-03-09T15:24:59.034541+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.034541+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:16.852793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":307,"num_write":178,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.618108+0000","last_change":"2024-03-09T15:25:03.618108+0000","last_active":"2024-03-09T15:25:03.618108+0000","last_peered":"2024-03-09T15:25:03.618108+0000","last_clean":"2024-03-09T15:25:03.618108+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:25:03.618108+0000","last_undegraded":"2024-03-09T15:25:03.618108+0000","last_fullsized":"2024-03-09T15:25:03.618108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:03.617964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:03.617964+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.617964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:08.320244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'105","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.492045+0000","last_change":"2024-03-09T15:24:52.492077+0000","last_active":"2024-03-09T15:24:52.492045+0000","last_peered":"2024-03-09T15:24:52.492045+0000","last_clean":"2024-03-09T15:24:52.492045+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:24:52.492045+0000","last_undegraded":"2024-03-09T15:24:52.492045+0000","last_fullsized":"2024-03-09T15:24:52.492045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'105","last_scrub_stamp":"2024-03-09T15:24:52.491966+0000","last_deep_scrub":"260'105","last_deep_scrub_stamp":"2024-03-09T15:24:52.491966+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.491966+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:27.870108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":873,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.076275+0000","last_change":"2024-03-09T15:25:04.076301+0000","last_active":"2024-03-09T15:25:04.076275+0000","last_peered":"2024-03-09T15:25:04.076275+0000","last_clean":"2024-03-09T15:25:04.076275+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:25:04.076275+0000","last_undegraded":"2024-03-09T15:25:04.076275+0000","last_fullsized":"2024-03-09T15:25:04.076275+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'253","last_scrub_stamp":"2024-03-09T15:25:04.076142+0000","last_deep_scrub":"260'253","last_deep_scrub_stamp":"2024-03-09T15:25:04.076142+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.076142+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:55.042919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'175","reported_seq":806,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.647743+0000","last_change":"2024-03-09T15:25:09.647828+0000","last_active":"2024-03-09T15:25:09.647743+0000","last_peered":"2024-03-09T15:25:09.647743+0000","last_clean":"2024-03-09T15:25:09.647743+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:25:09.647743+0000","last_undegraded":"2024-03-09T15:25:09.647743+0000","last_fullsized":"2024-03-09T15:25:09.647743+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-03-09T15:25:09.647618+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-03-09T15:25:09.647618+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.647618+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:48.900051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":31184,"num_write":930,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.604965+0000","last_change":"2024-03-09T15:24:58.604965+0000","last_active":"2024-03-09T15:24:58.604965+0000","last_peered":"2024-03-09T15:24:58.604965+0000","last_clean":"2024-03-09T15:24:58.604965+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:24:58.604965+0000","last_undegraded":"2024-03-09T15:24:58.604965+0000","last_fullsized":"2024-03-09T15:24:58.604965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:58.604810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:58.604810+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.604810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:23.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'203","reported_seq":809,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.904105+0000","last_change":"2024-03-09T15:24:49.904105+0000","last_active":"2024-03-09T15:24:49.904105+0000","last_peered":"2024-03-09T15:24:49.904105+0000","last_clean":"2024-03-09T15:24:49.904105+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:24:49.904105+0000","last_undegraded":"2024-03-09T15:24:49.904105+0000","last_fullsized":"2024-03-09T15:24:49.904105+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-03-09T15:24:49.903932+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-03-09T15:24:49.903932+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.903932+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:42.211020+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9198,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":342,"num_write":152,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'490","reported_seq":4313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.886883+0000","last_change":"2024-03-09T15:24:45.886883+0000","last_active":"2024-03-09T15:24:45.886883+0000","last_peered":"2024-03-09T15:24:45.886883+0000","last_clean":"2024-03-09T15:24:45.886883+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:45.886883+0000","last_undegraded":"2024-03-09T15:24:45.886883+0000","last_fullsized":"2024-03-09T15:24:45.886883+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'490","last_scrub_stamp":"2024-03-09T15:24:45.886735+0000","last_deep_scrub":"260'490","last_deep_scrub_stamp":"2024-03-09T15:24:45.886735+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.886735+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:22.443324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'206","reported_seq":739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.404175+0000","last_change":"2024-03-09T15:24:50.404230+0000","last_active":"2024-03-09T15:24:50.404175+0000","last_peered":"2024-03-09T15:24:50.404175+0000","last_clean":"2024-03-09T15:24:50.404175+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:24:50.404175+0000","last_undegraded":"2024-03-09T15:24:50.404175+0000","last_fullsized":"2024-03-09T15:24:50.404175+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-03-09T15:24:50.404077+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-03-09T15:24:50.404077+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.404077+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:52.580530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":880,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.177194+0000","last_change":"2024-03-09T15:25:13.177228+0000","last_active":"2024-03-09T15:25:13.177194+0000","last_peered":"2024-03-09T15:25:13.177194+0000","last_clean":"2024-03-09T15:25:13.177194+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:25:13.177194+0000","last_undegraded":"2024-03-09T15:25:13.177194+0000","last_fullsized":"2024-03-09T15:25:13.177194+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'264","last_scrub_stamp":"2024-03-09T15:25:13.177091+0000","last_deep_scrub":"260'264","last_deep_scrub_stamp":"2024-03-09T15:25:13.177091+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.177091+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:43:54.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'173","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.244248+0000","last_change":"2024-03-09T15:25:21.244296+0000","last_active":"2024-03-09T15:25:21.244248+0000","last_peered":"2024-03-09T15:25:21.244248+0000","last_clean":"2024-03-09T15:25:21.244248+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:25:21.244248+0000","last_undegraded":"2024-03-09T15:25:21.244248+0000","last_fullsized":"2024-03-09T15:25:21.244248+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-03-09T15:25:21.244139+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-03-09T15:25:21.244139+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.244139+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:09.844295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":987,"num_read_kb":38802,"num_write":973,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"260'4","reported_seq":1137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.695535+0000","last_change":"2024-03-09T15:25:10.695535+0000","last_active":"2024-03-09T15:25:10.695535+0000","last_peered":"2024-03-09T15:25:10.695535+0000","last_clean":"2024-03-09T15:25:10.695535+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:25:10.695535+0000","last_undegraded":"2024-03-09T15:25:10.695535+0000","last_fullsized":"2024-03-09T15:25:10.695535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-03-09T15:25:10.695408+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-03-09T15:25:10.695408+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.695408+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:51.943097+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'95","reported_seq":637,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.399573+0000","last_change":"2024-03-09T15:25:08.399607+0000","last_active":"2024-03-09T15:25:08.399573+0000","last_peered":"2024-03-09T15:25:08.399573+0000","last_clean":"2024-03-09T15:25:08.399573+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:25:08.399573+0000","last_undegraded":"2024-03-09T15:25:08.399573+0000","last_fullsized":"2024-03-09T15:25:08.399573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'95","last_scrub_stamp":"2024-03-09T15:25:08.399482+0000","last_deep_scrub":"260'95","last_deep_scrub_stamp":"2024-03-09T15:25:08.399482+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.399482+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:15.019711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'507","reported_seq":2223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.896169+0000","last_change":"2024-03-09T15:24:55.896169+0000","last_active":"2024-03-09T15:24:55.896169+0000","last_peered":"2024-03-09T15:24:55.896169+0000","last_clean":"2024-03-09T15:24:55.896169+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:55.896169+0000","last_undegraded":"2024-03-09T15:24:55.896169+0000","last_fullsized":"2024-03-09T15:24:55.896169+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'507","last_scrub_stamp":"2024-03-09T15:24:55.896044+0000","last_deep_scrub":"260'507","last_deep_scrub_stamp":"2024-03-09T15:24:55.896044+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.896044+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:53.777778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.985028+0000","last_change":"2024-03-09T15:24:48.985058+0000","last_active":"2024-03-09T15:24:48.985028+0000","last_peered":"2024-03-09T15:24:48.985028+0000","last_clean":"2024-03-09T15:24:48.985028+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:24:48.985028+0000","last_undegraded":"2024-03-09T15:24:48.985028+0000","last_fullsized":"2024-03-09T15:24:48.985028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-03-09T15:24:48.984934+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-03-09T15:24:48.984934+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.984934+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:04.370133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.572515+0000","last_change":"2024-03-09T15:24:59.572515+0000","last_active":"2024-03-09T15:24:59.572515+0000","last_peered":"2024-03-09T15:24:59.572515+0000","last_clean":"2024-03-09T15:24:59.572515+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:24:59.572515+0000","last_undegraded":"2024-03-09T15:24:59.572515+0000","last_fullsized":"2024-03-09T15:24:59.572515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'50","last_scrub_stamp":"2024-03-09T15:24:59.572399+0000","last_deep_scrub":"260'50","last_deep_scrub_stamp":"2024-03-09T15:24:59.572399+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.572399+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:43.118034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'191","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703707+0000","last_change":"2024-03-09T14:21:54.368543+0000","last_active":"2024-03-09T15:24:43.703707+0000","last_peered":"2024-03-09T15:24:43.703707+0000","last_clean":"2024-03-09T15:24:43.703707+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:24:43.703707+0000","last_undegraded":"2024-03-09T15:24:43.703707+0000","last_fullsized":"2024-03-09T15:24:43.703707+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":26998,"num_write":1069,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"260'5","reported_seq":832,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.158784+0000","last_change":"2024-03-09T15:25:12.158836+0000","last_active":"2024-03-09T15:25:12.158784+0000","last_peered":"2024-03-09T15:25:12.158784+0000","last_clean":"2024-03-09T15:25:12.158784+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:25:12.158784+0000","last_undegraded":"2024-03-09T15:25:12.158784+0000","last_fullsized":"2024-03-09T15:25:12.158784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:12.158688+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:12.158688+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.158688+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:15.796742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'297","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.823567+0000","last_change":"2024-03-09T15:25:16.823613+0000","last_active":"2024-03-09T15:25:16.823567+0000","last_peered":"2024-03-09T15:25:16.823567+0000","last_clean":"2024-03-09T15:25:16.823567+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:25:16.823567+0000","last_undegraded":"2024-03-09T15:25:16.823567+0000","last_fullsized":"2024-03-09T15:25:16.823567+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'297","last_scrub_stamp":"2024-03-09T15:25:16.823473+0000","last_deep_scrub":"260'297","last_deep_scrub_stamp":"2024-03-09T15:25:16.823473+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.823473+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:13.193080+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6907,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1015,"num_read_kb":1081,"num_write":1596,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508974,"num_omap_keys":1176,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.703264+0000","last_change":"2024-03-09T15:25:01.703264+0000","last_active":"2024-03-09T15:25:01.703264+0000","last_peered":"2024-03-09T15:25:01.703264+0000","last_clean":"2024-03-09T15:25:01.703264+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:25:01.703264+0000","last_undegraded":"2024-03-09T15:25:01.703264+0000","last_fullsized":"2024-03-09T15:25:01.703264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:01.703150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:01.703150+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.703150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:08.511551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'158","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.402684+0000","last_change":"2024-03-09T15:24:51.402738+0000","last_active":"2024-03-09T15:24:51.402684+0000","last_peered":"2024-03-09T15:24:51.402684+0000","last_clean":"2024-03-09T15:24:51.402684+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:24:51.402684+0000","last_undegraded":"2024-03-09T15:24:51.402684+0000","last_fullsized":"2024-03-09T15:24:51.402684+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'158","last_scrub_stamp":"2024-03-09T15:24:51.402553+0000","last_deep_scrub":"260'158","last_deep_scrub_stamp":"2024-03-09T15:24:51.402553+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.402553+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:26.705481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":672,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.741570+0000","last_change":"2024-03-09T15:25:04.741609+0000","last_active":"2024-03-09T15:25:04.741570+0000","last_peered":"2024-03-09T15:25:04.741570+0000","last_clean":"2024-03-09T15:25:04.741570+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:25:04.741570+0000","last_undegraded":"2024-03-09T15:25:04.741570+0000","last_fullsized":"2024-03-09T15:25:04.741570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-03-09T15:25:04.741478+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-03-09T15:25:04.741478+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.741478+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:14.392332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":522,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.063707+0000","last_change":"2024-03-09T14:21:39.159822+0000","last_active":"2024-03-09T15:23:57.063707+0000","last_peered":"2024-03-09T15:23:57.063707+0000","last_clean":"2024-03-09T15:23:57.063707+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:23:57.063707+0000","last_undegraded":"2024-03-09T15:23:57.063707+0000","last_fullsized":"2024-03-09T15:23:57.063707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'155","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.074851+0000","last_change":"2024-03-09T14:21:54.358849+0000","last_active":"2024-03-09T15:24:38.074851+0000","last_peered":"2024-03-09T15:24:38.074851+0000","last_clean":"2024-03-09T15:24:38.074851+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:24:38.074851+0000","last_undegraded":"2024-03-09T15:24:38.074851+0000","last_fullsized":"2024-03-09T15:24:38.074851+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244523,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":7813,"num_write":928,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:32.068988+0000","last_change":"2024-03-09T14:21:58.372665+0000","last_active":"2024-03-09T15:24:32.068988+0000","last_peered":"2024-03-09T15:24:32.068988+0000","last_clean":"2024-03-09T15:24:32.068988+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:24:32.068988+0000","last_undegraded":"2024-03-09T15:24:32.068988+0000","last_fullsized":"2024-03-09T15:24:32.068988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'304","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.693795+0000","last_change":"2024-03-09T15:25:01.693832+0000","last_active":"2024-03-09T15:25:01.693795+0000","last_peered":"2024-03-09T15:25:01.693795+0000","last_clean":"2024-03-09T15:25:01.693795+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:25:01.693795+0000","last_undegraded":"2024-03-09T15:25:01.693795+0000","last_fullsized":"2024-03-09T15:25:01.693795+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'304","last_scrub_stamp":"2024-03-09T15:25:01.693710+0000","last_deep_scrub":"260'304","last_deep_scrub_stamp":"2024-03-09T15:25:01.693710+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.693710+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:21.881360+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":594,"num_write":476,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89360,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.614033+0000","last_change":"2024-03-09T15:25:05.614058+0000","last_active":"2024-03-09T15:25:05.614033+0000","last_peered":"2024-03-09T15:25:05.614033+0000","last_clean":"2024-03-09T15:25:05.614033+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:25:05.614033+0000","last_undegraded":"2024-03-09T15:25:05.614033+0000","last_fullsized":"2024-03-09T15:25:05.614033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:05.613943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:05.613943+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.613943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:51.795750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'218","reported_seq":910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.700252+0000","last_change":"2024-03-09T15:25:05.700308+0000","last_active":"2024-03-09T15:25:05.700252+0000","last_peered":"2024-03-09T15:25:05.700252+0000","last_clean":"2024-03-09T15:25:05.700252+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:25:05.700252+0000","last_undegraded":"2024-03-09T15:25:05.700252+0000","last_fullsized":"2024-03-09T15:25:05.700252+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-03-09T15:25:05.700156+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-03-09T15:25:05.700156+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.700156+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:26.306332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'339","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.642929+0000","last_change":"2024-03-09T15:25:05.642956+0000","last_active":"2024-03-09T15:25:05.642929+0000","last_peered":"2024-03-09T15:25:05.642929+0000","last_clean":"2024-03-09T15:25:05.642929+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:25:05.642929+0000","last_undegraded":"2024-03-09T15:25:05.642929+0000","last_fullsized":"2024-03-09T15:25:05.642929+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'339","last_scrub_stamp":"2024-03-09T15:25:05.642847+0000","last_deep_scrub":"260'339","last_deep_scrub_stamp":"2024-03-09T15:25:05.642847+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.642847+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:04:47.163093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.901035+0000","last_change":"2024-03-09T15:25:18.901076+0000","last_active":"2024-03-09T15:25:18.901035+0000","last_peered":"2024-03-09T15:25:18.901035+0000","last_clean":"2024-03-09T15:25:18.901035+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:25:18.901035+0000","last_undegraded":"2024-03-09T15:25:18.901035+0000","last_fullsized":"2024-03-09T15:25:18.901035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.900942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.900942+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.900942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:06.181007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'156","reported_seq":758,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.183183+0000","last_change":"2024-03-09T15:25:19.183225+0000","last_active":"2024-03-09T15:25:19.183183+0000","last_peered":"2024-03-09T15:25:19.183183+0000","last_clean":"2024-03-09T15:25:19.183183+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:25:19.183183+0000","last_undegraded":"2024-03-09T15:25:19.183183+0000","last_fullsized":"2024-03-09T15:25:19.183183+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'156","last_scrub_stamp":"2024-03-09T15:25:19.183077+0000","last_deep_scrub":"260'156","last_deep_scrub_stamp":"2024-03-09T15:25:19.183077+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.183077+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:18.345920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081389,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":315,"num_read_kb":1406,"num_write":852,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.534368+0000","last_change":"2024-03-09T15:25:12.534392+0000","last_active":"2024-03-09T15:25:12.534368+0000","last_peered":"2024-03-09T15:25:12.534368+0000","last_clean":"2024-03-09T15:25:12.534368+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:25:12.534368+0000","last_undegraded":"2024-03-09T15:25:12.534368+0000","last_fullsized":"2024-03-09T15:25:12.534368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:12.534280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:12.534280+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.534280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:03.877837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'151","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.410371+0000","last_change":"2024-03-09T15:25:11.410457+0000","last_active":"2024-03-09T15:25:11.410371+0000","last_peered":"2024-03-09T15:25:11.410371+0000","last_clean":"2024-03-09T15:25:11.410371+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:25:11.410371+0000","last_undegraded":"2024-03-09T15:25:11.410371+0000","last_fullsized":"2024-03-09T15:25:11.410371+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'151","last_scrub_stamp":"2024-03-09T15:25:11.410269+0000","last_deep_scrub":"260'151","last_deep_scrub_stamp":"2024-03-09T15:25:11.410269+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.410269+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:56.413429+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1630,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.817739+0000","last_change":"2024-03-09T15:24:57.817762+0000","last_active":"2024-03-09T15:24:57.817739+0000","last_peered":"2024-03-09T15:24:57.817739+0000","last_clean":"2024-03-09T15:24:57.817739+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:24:57.817739+0000","last_undegraded":"2024-03-09T15:24:57.817739+0000","last_fullsized":"2024-03-09T15:24:57.817739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.817646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.817646+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.817646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:44.573136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'104","reported_seq":621,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.552490+0000","last_change":"2024-03-09T15:24:49.552490+0000","last_active":"2024-03-09T15:24:49.552490+0000","last_peered":"2024-03-09T15:24:49.552490+0000","last_clean":"2024-03-09T15:24:49.552490+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:24:49.552490+0000","last_undegraded":"2024-03-09T15:24:49.552490+0000","last_fullsized":"2024-03-09T15:24:49.552490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'104","last_scrub_stamp":"2024-03-09T15:24:49.552331+0000","last_deep_scrub":"260'104","last_deep_scrub_stamp":"2024-03-09T15:24:49.552331+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.552331+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.826402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":633,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.698615+0000","last_change":"2024-03-09T15:25:07.698646+0000","last_active":"2024-03-09T15:25:07.698615+0000","last_peered":"2024-03-09T15:25:07.698615+0000","last_clean":"2024-03-09T15:25:07.698615+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:25:07.698615+0000","last_undegraded":"2024-03-09T15:25:07.698615+0000","last_fullsized":"2024-03-09T15:25:07.698615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'62","last_scrub_stamp":"2024-03-09T15:25:07.698514+0000","last_deep_scrub":"260'62","last_deep_scrub_stamp":"2024-03-09T15:25:07.698514+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.698514+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:36.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":521,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:07.065367+0000","last_change":"2024-03-09T14:21:39.159664+0000","last_active":"2024-03-09T15:24:07.065367+0000","last_peered":"2024-03-09T15:24:07.065367+0000","last_clean":"2024-03-09T15:24:07.065367+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:24:07.065367+0000","last_undegraded":"2024-03-09T15:24:07.065367+0000","last_fullsized":"2024-03-09T15:24:07.065367+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'209","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.765007+0000","last_change":"2024-03-09T15:25:15.765071+0000","last_active":"2024-03-09T15:25:15.765007+0000","last_peered":"2024-03-09T15:25:15.765007+0000","last_clean":"2024-03-09T15:25:15.765007+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:25:15.765007+0000","last_undegraded":"2024-03-09T15:25:15.765007+0000","last_fullsized":"2024-03-09T15:25:15.765007+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'209","last_scrub_stamp":"2024-03-09T15:25:15.764908+0000","last_deep_scrub":"260'209","last_deep_scrub_stamp":"2024-03-09T15:25:15.764908+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.764908+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:29:58.109409+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343543,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":33193,"num_write":1185,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.503768+0000","last_change":"2024-03-09T15:25:07.503828+0000","last_active":"2024-03-09T15:25:07.503768+0000","last_peered":"2024-03-09T15:25:07.503768+0000","last_clean":"2024-03-09T15:25:07.503768+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:25:07.503768+0000","last_undegraded":"2024-03-09T15:25:07.503768+0000","last_fullsized":"2024-03-09T15:25:07.503768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:07.503662+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:07.503662+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.503662+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:43:37.814904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'291","reported_seq":1600,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.501226+0000","last_change":"2024-03-09T15:25:08.501284+0000","last_active":"2024-03-09T15:25:08.501226+0000","last_peered":"2024-03-09T15:25:08.501226+0000","last_clean":"2024-03-09T15:25:08.501226+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:25:08.501226+0000","last_undegraded":"2024-03-09T15:25:08.501226+0000","last_fullsized":"2024-03-09T15:25:08.501226+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'291","last_scrub_stamp":"2024-03-09T15:25:08.501127+0000","last_deep_scrub":"260'291","last_deep_scrub_stamp":"2024-03-09T15:25:08.501127+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.501127+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:40.704832+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.546936+0000","last_change":"2024-03-09T15:25:09.546994+0000","last_active":"2024-03-09T15:25:09.546936+0000","last_peered":"2024-03-09T15:25:09.546936+0000","last_clean":"2024-03-09T15:25:09.546936+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:25:09.546936+0000","last_undegraded":"2024-03-09T15:25:09.546936+0000","last_fullsized":"2024-03-09T15:25:09.546936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:09.546818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:09.546818+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.546818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:11.952986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'258","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.453607+0000","last_change":"2024-03-09T15:24:55.453607+0000","last_active":"2024-03-09T15:24:55.453607+0000","last_peered":"2024-03-09T15:24:55.453607+0000","last_clean":"2024-03-09T15:24:55.453607+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:24:55.453607+0000","last_undegraded":"2024-03-09T15:24:55.453607+0000","last_fullsized":"2024-03-09T15:24:55.453607+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'258","last_scrub_stamp":"2024-03-09T15:24:55.453479+0000","last_deep_scrub":"260'258","last_deep_scrub_stamp":"2024-03-09T15:24:55.453479+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.453479+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:17:21.907096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.484921+0000","last_change":"2024-03-09T15:25:21.484948+0000","last_active":"2024-03-09T15:25:21.484921+0000","last_peered":"2024-03-09T15:25:21.484921+0000","last_clean":"2024-03-09T15:25:21.484921+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:25:21.484921+0000","last_undegraded":"2024-03-09T15:25:21.484921+0000","last_fullsized":"2024-03-09T15:25:21.484921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-03-09T15:25:21.484817+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-03-09T15:25:21.484817+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.484817+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:28:10.386548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":531,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.706812+0000","last_change":"2024-03-09T15:25:10.706853+0000","last_active":"2024-03-09T15:25:10.706812+0000","last_peered":"2024-03-09T15:25:10.706812+0000","last_clean":"2024-03-09T15:25:10.706812+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:25:10.706812+0000","last_undegraded":"2024-03-09T15:25:10.706812+0000","last_fullsized":"2024-03-09T15:25:10.706812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.706721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.706721+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.706721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:22.457901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":670,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:23:57.063728+0000","last_change":"2024-03-09T14:21:39.590470+0000","last_active":"2024-03-09T15:23:57.063728+0000","last_peered":"2024-03-09T15:23:57.063728+0000","last_clean":"2024-03-09T15:23:57.063728+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:23:57.063728+0000","last_undegraded":"2024-03-09T15:23:57.063728+0000","last_fullsized":"2024-03-09T15:23:57.063728+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:38.278811+0000","last_clean_scrub_stamp":"2024-03-09T14:21:38.278811+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'146","reported_seq":738,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.979799+0000","last_change":"2024-03-09T14:21:54.370907+0000","last_active":"2024-03-09T15:24:37.979799+0000","last_peered":"2024-03-09T15:24:37.979799+0000","last_clean":"2024-03-09T15:24:37.979799+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:24:37.979799+0000","last_undegraded":"2024-03-09T15:24:37.979799+0000","last_fullsized":"2024-03-09T15:24:37.979799+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":13701,"num_write":831,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.716565+0000","last_change":"2024-03-09T15:25:08.716609+0000","last_active":"2024-03-09T15:25:08.716565+0000","last_peered":"2024-03-09T15:25:08.716565+0000","last_clean":"2024-03-09T15:25:08.716565+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:25:08.716565+0000","last_undegraded":"2024-03-09T15:25:08.716565+0000","last_fullsized":"2024-03-09T15:25:08.716565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:08.716469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:08.716469+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.716469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:58:38.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'741","reported_seq":2365,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.657812+0000","last_change":"2024-03-09T15:25:02.657866+0000","last_active":"2024-03-09T15:25:02.657812+0000","last_peered":"2024-03-09T15:25:02.657812+0000","last_clean":"2024-03-09T15:25:02.657812+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:25:02.657812+0000","last_undegraded":"2024-03-09T15:25:02.657812+0000","last_fullsized":"2024-03-09T15:25:02.657812+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'741","last_scrub_stamp":"2024-03-09T15:25:02.657722+0000","last_deep_scrub":"260'741","last_deep_scrub_stamp":"2024-03-09T15:25:02.657722+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.657722+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:37.822889+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17200,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":996,"num_read_kb":1152,"num_write":364,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.567318+0000","last_change":"2024-03-09T15:25:05.567356+0000","last_active":"2024-03-09T15:25:05.567318+0000","last_peered":"2024-03-09T15:25:05.567318+0000","last_clean":"2024-03-09T15:25:05.567318+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:25:05.567318+0000","last_undegraded":"2024-03-09T15:25:05.567318+0000","last_fullsized":"2024-03-09T15:25:05.567318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:05.567209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:05.567209+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.567209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:38.466715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'162","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.466183+0000","last_change":"2024-03-09T15:24:53.466183+0000","last_active":"2024-03-09T15:24:53.466183+0000","last_peered":"2024-03-09T15:24:53.466183+0000","last_clean":"2024-03-09T15:24:53.466183+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:24:53.466183+0000","last_undegraded":"2024-03-09T15:24:53.466183+0000","last_fullsized":"2024-03-09T15:24:53.466183+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'162","last_scrub_stamp":"2024-03-09T15:24:53.466019+0000","last_deep_scrub":"260'162","last_deep_scrub_stamp":"2024-03-09T15:24:53.466019+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.466019+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:47.577441+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.205478+0000","last_change":"2024-03-09T15:25:17.205502+0000","last_active":"2024-03-09T15:25:17.205478+0000","last_peered":"2024-03-09T15:25:17.205478+0000","last_clean":"2024-03-09T15:25:17.205478+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:25:17.205478+0000","last_undegraded":"2024-03-09T15:25:17.205478+0000","last_fullsized":"2024-03-09T15:25:17.205478+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'178","last_scrub_stamp":"2024-03-09T15:25:17.205381+0000","last_deep_scrub":"260'178","last_deep_scrub_stamp":"2024-03-09T15:25:17.205381+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.205381+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:49.670666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'133","reported_seq":703,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.873015+0000","last_change":"2024-03-09T15:24:50.873015+0000","last_active":"2024-03-09T15:24:50.873015+0000","last_peered":"2024-03-09T15:24:50.873015+0000","last_clean":"2024-03-09T15:24:50.873015+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:24:50.873015+0000","last_undegraded":"2024-03-09T15:24:50.873015+0000","last_fullsized":"2024-03-09T15:24:50.873015+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-03-09T15:24:50.872869+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-03-09T15:24:50.872869+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.872869+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:54.055792+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506641,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":4172,"num_write":719,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":524,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:12.035866+0000","last_change":"2024-03-09T14:21:38.294444+0000","last_active":"2024-03-09T15:24:12.035866+0000","last_peered":"2024-03-09T15:24:12.035866+0000","last_clean":"2024-03-09T15:24:12.035866+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:24:12.035866+0000","last_undegraded":"2024-03-09T15:24:12.035866+0000","last_fullsized":"2024-03-09T15:24:12.035866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:37.277184+0000","last_clean_scrub_stamp":"2024-03-09T14:21:37.277184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:17.036412+0000","last_change":"2024-03-09T14:21:58.372306+0000","last_active":"2024-03-09T15:24:17.036412+0000","last_peered":"2024-03-09T15:24:17.036412+0000","last_clean":"2024-03-09T15:24:17.036412+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:24:17.036412+0000","last_undegraded":"2024-03-09T15:24:17.036412+0000","last_fullsized":"2024-03-09T15:24:17.036412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'354","reported_seq":1092,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.504947+0000","last_change":"2024-03-09T15:25:11.504996+0000","last_active":"2024-03-09T15:25:11.504947+0000","last_peered":"2024-03-09T15:25:11.504947+0000","last_clean":"2024-03-09T15:25:11.504947+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:25:11.504947+0000","last_undegraded":"2024-03-09T15:25:11.504947+0000","last_fullsized":"2024-03-09T15:25:11.504947+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'354","last_scrub_stamp":"2024-03-09T15:25:11.504860+0000","last_deep_scrub":"260'354","last_deep_scrub_stamp":"2024-03-09T15:25:11.504860+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.504860+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:40.112965+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24501,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":711,"num_write":258,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.418462+0000","last_change":"2024-03-09T15:25:00.418498+0000","last_active":"2024-03-09T15:25:00.418462+0000","last_peered":"2024-03-09T15:25:00.418462+0000","last_clean":"2024-03-09T15:25:00.418462+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:25:00.418462+0000","last_undegraded":"2024-03-09T15:25:00.418462+0000","last_fullsized":"2024-03-09T15:25:00.418462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.418360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.418360+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.418360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:58.612049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'146","reported_seq":646,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.642995+0000","last_change":"2024-03-09T15:24:53.642995+0000","last_active":"2024-03-09T15:24:53.642995+0000","last_peered":"2024-03-09T15:24:53.642995+0000","last_clean":"2024-03-09T15:24:53.642995+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:24:53.642995+0000","last_undegraded":"2024-03-09T15:24:53.642995+0000","last_fullsized":"2024-03-09T15:24:53.642995+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:24:53.642875+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:24:53.642875+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.642875+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:43:16.650237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":767,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.319988+0000","last_change":"2024-03-09T15:25:19.320018+0000","last_active":"2024-03-09T15:25:19.319988+0000","last_peered":"2024-03-09T15:25:19.319988+0000","last_clean":"2024-03-09T15:25:19.319988+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:25:19.319988+0000","last_undegraded":"2024-03-09T15:25:19.319988+0000","last_fullsized":"2024-03-09T15:25:19.319988+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-03-09T15:25:19.319889+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-03-09T15:25:19.319889+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.319889+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:31.174513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'187","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703707+0000","last_change":"2024-03-09T14:21:54.358356+0000","last_active":"2024-03-09T15:24:43.703707+0000","last_peered":"2024-03-09T15:24:43.703707+0000","last_clean":"2024-03-09T15:24:43.703707+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:24:43.703707+0000","last_undegraded":"2024-03-09T15:24:43.703707+0000","last_fullsized":"2024-03-09T15:24:43.703707+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":496,"num_read_kb":43067,"num_write":1018,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":537,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.160181+0000","last_change":"2024-03-09T15:25:18.160205+0000","last_active":"2024-03-09T15:25:18.160181+0000","last_peered":"2024-03-09T15:25:18.160181+0000","last_clean":"2024-03-09T15:25:18.160181+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:25:18.160181+0000","last_undegraded":"2024-03-09T15:25:18.160181+0000","last_fullsized":"2024-03-09T15:25:18.160181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.160083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.160083+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.160083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:33.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.160598+0000","last_change":"2024-03-09T15:25:16.160623+0000","last_active":"2024-03-09T15:25:16.160598+0000","last_peered":"2024-03-09T15:25:16.160598+0000","last_clean":"2024-03-09T15:25:16.160598+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:25:16.160598+0000","last_undegraded":"2024-03-09T15:25:16.160598+0000","last_fullsized":"2024-03-09T15:25:16.160598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:16.160499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:16.160499+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.160499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:29.796635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'128","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.082977+0000","last_change":"2024-03-09T15:24:58.083018+0000","last_active":"2024-03-09T15:24:58.082977+0000","last_peered":"2024-03-09T15:24:58.082977+0000","last_clean":"2024-03-09T15:24:58.082977+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:24:58.082977+0000","last_undegraded":"2024-03-09T15:24:58.082977+0000","last_fullsized":"2024-03-09T15:24:58.082977+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'128","last_scrub_stamp":"2024-03-09T15:24:58.082889+0000","last_deep_scrub":"260'128","last_deep_scrub_stamp":"2024-03-09T15:24:58.082889+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.082889+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:51.050199+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'548","reported_seq":4170,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.384356+0000","last_change":"2024-03-09T15:25:06.384380+0000","last_active":"2024-03-09T15:25:06.384356+0000","last_peered":"2024-03-09T15:25:06.384356+0000","last_clean":"2024-03-09T15:25:06.384356+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:25:06.384356+0000","last_undegraded":"2024-03-09T15:25:06.384356+0000","last_fullsized":"2024-03-09T15:25:06.384356+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'548","last_scrub_stamp":"2024-03-09T15:25:06.384283+0000","last_deep_scrub":"260'548","last_deep_scrub_stamp":"2024-03-09T15:25:06.384283+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.384283+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:00:52.327053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'184","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.604719+0000","last_change":"2024-03-09T15:24:55.604719+0000","last_active":"2024-03-09T15:24:55.604719+0000","last_peered":"2024-03-09T15:24:55.604719+0000","last_clean":"2024-03-09T15:24:55.604719+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:24:55.604719+0000","last_undegraded":"2024-03-09T15:24:55.604719+0000","last_fullsized":"2024-03-09T15:24:55.604719+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-03-09T15:24:55.604578+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-03-09T15:24:55.604578+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.604578+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:15.803844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1015,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:26.921550+0000","last_change":"2024-03-09T14:21:56.370846+0000","last_active":"2024-03-09T15:24:26.921550+0000","last_peered":"2024-03-09T15:24:26.921550+0000","last_clean":"2024-03-09T15:24:26.921550+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:24:26.921550+0000","last_undegraded":"2024-03-09T15:24:26.921550+0000","last_fullsized":"2024-03-09T15:24:26.921550+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'211","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.730734+0000","last_change":"2024-03-09T15:25:14.730781+0000","last_active":"2024-03-09T15:25:14.730734+0000","last_peered":"2024-03-09T15:25:14.730734+0000","last_clean":"2024-03-09T15:25:14.730734+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:25:14.730734+0000","last_undegraded":"2024-03-09T15:25:14.730734+0000","last_fullsized":"2024-03-09T15:25:14.730734+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'211","last_scrub_stamp":"2024-03-09T15:25:14.730645+0000","last_deep_scrub":"260'211","last_deep_scrub_stamp":"2024-03-09T15:25:14.730645+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.730645+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:22.608834+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117883,"num_write":1122,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.638840+0000","last_change":"2024-03-09T15:25:08.638864+0000","last_active":"2024-03-09T15:25:08.638840+0000","last_peered":"2024-03-09T15:25:08.638840+0000","last_clean":"2024-03-09T15:25:08.638840+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:25:08.638840+0000","last_undegraded":"2024-03-09T15:25:08.638840+0000","last_fullsized":"2024-03-09T15:25:08.638840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:08.638753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:08.638753+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.638753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:34.351820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.865681+0000","last_change":"2024-03-09T15:24:56.865719+0000","last_active":"2024-03-09T15:24:56.865681+0000","last_peered":"2024-03-09T15:24:56.865681+0000","last_clean":"2024-03-09T15:24:56.865681+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:24:56.865681+0000","last_undegraded":"2024-03-09T15:24:56.865681+0000","last_fullsized":"2024-03-09T15:24:56.865681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.865592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.865592+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.865592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:13.969932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'245","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.683480+0000","last_change":"2024-03-09T15:25:04.683527+0000","last_active":"2024-03-09T15:25:04.683480+0000","last_peered":"2024-03-09T15:25:04.683480+0000","last_clean":"2024-03-09T15:25:04.683480+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:25:04.683480+0000","last_undegraded":"2024-03-09T15:25:04.683480+0000","last_fullsized":"2024-03-09T15:25:04.683480+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'245","last_scrub_stamp":"2024-03-09T15:25:04.683390+0000","last_deep_scrub":"260'245","last_deep_scrub_stamp":"2024-03-09T15:25:04.683390+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.683390+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:43.615136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'541","reported_seq":2701,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.661233+0000","last_change":"2024-03-09T15:24:58.661257+0000","last_active":"2024-03-09T15:24:58.661233+0000","last_peered":"2024-03-09T15:24:58.661233+0000","last_clean":"2024-03-09T15:24:58.661233+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:58.661233+0000","last_undegraded":"2024-03-09T15:24:58.661233+0000","last_fullsized":"2024-03-09T15:24:58.661233+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'541","last_scrub_stamp":"2024-03-09T15:24:58.661130+0000","last_deep_scrub":"260'541","last_deep_scrub_stamp":"2024-03-09T15:24:58.661130+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.661130+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:40.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'118","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.502386+0000","last_change":"2024-03-09T15:24:54.502386+0000","last_active":"2024-03-09T15:24:54.502386+0000","last_peered":"2024-03-09T15:24:54.502386+0000","last_clean":"2024-03-09T15:24:54.502386+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:24:54.502386+0000","last_undegraded":"2024-03-09T15:24:54.502386+0000","last_fullsized":"2024-03-09T15:24:54.502386+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-03-09T15:24:54.502257+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-03-09T15:24:54.502257+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.502257+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:35.717063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.739165+0000","last_change":"2024-03-09T15:25:09.739188+0000","last_active":"2024-03-09T15:25:09.739165+0000","last_peered":"2024-03-09T15:25:09.739165+0000","last_clean":"2024-03-09T15:25:09.739165+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:25:09.739165+0000","last_undegraded":"2024-03-09T15:25:09.739165+0000","last_fullsized":"2024-03-09T15:25:09.739165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'90","last_scrub_stamp":"2024-03-09T15:25:09.739074+0000","last_deep_scrub":"260'90","last_deep_scrub_stamp":"2024-03-09T15:25:09.739074+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.739074+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:14.880002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'197","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.786576+0000","last_change":"2024-03-09T15:25:13.786637+0000","last_active":"2024-03-09T15:25:13.786576+0000","last_peered":"2024-03-09T15:25:13.786576+0000","last_clean":"2024-03-09T15:25:13.786576+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:25:13.786576+0000","last_undegraded":"2024-03-09T15:25:13.786576+0000","last_fullsized":"2024-03-09T15:25:13.786576+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:25:13.786465+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:25:13.786465+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.786465+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:01:02.974753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":52342,"num_write":1104,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.685725+0000","last_change":"2024-03-09T15:25:07.685762+0000","last_active":"2024-03-09T15:25:07.685725+0000","last_peered":"2024-03-09T15:25:07.685725+0000","last_clean":"2024-03-09T15:25:07.685725+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:25:07.685725+0000","last_undegraded":"2024-03-09T15:25:07.685725+0000","last_fullsized":"2024-03-09T15:25:07.685725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:07.685604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:07.685604+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.685604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:04.564583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.557619+0000","last_change":"2024-03-09T15:25:11.557641+0000","last_active":"2024-03-09T15:25:11.557619+0000","last_peered":"2024-03-09T15:25:11.557619+0000","last_clean":"2024-03-09T15:25:11.557619+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:25:11.557619+0000","last_undegraded":"2024-03-09T15:25:11.557619+0000","last_fullsized":"2024-03-09T15:25:11.557619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:11.557532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:11.557532+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.557532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:50:37.941802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'287","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.499889+0000","last_change":"2024-03-09T15:25:18.499933+0000","last_active":"2024-03-09T15:25:18.499889+0000","last_peered":"2024-03-09T15:25:18.499889+0000","last_clean":"2024-03-09T15:25:18.499889+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:25:18.499889+0000","last_undegraded":"2024-03-09T15:25:18.499889+0000","last_fullsized":"2024-03-09T15:25:18.499889+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'287","last_scrub_stamp":"2024-03-09T15:25:18.499784+0000","last_deep_scrub":"260'287","last_deep_scrub_stamp":"2024-03-09T15:25:18.499784+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.499784+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:39.485013+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15555,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":412,"num_read_kb":552,"num_write":228,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.080772+0000","last_change":"2024-03-09T15:24:54.080795+0000","last_active":"2024-03-09T15:24:54.080772+0000","last_peered":"2024-03-09T15:24:54.080772+0000","last_clean":"2024-03-09T15:24:54.080772+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:24:54.080772+0000","last_undegraded":"2024-03-09T15:24:54.080772+0000","last_fullsized":"2024-03-09T15:24:54.080772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:54.080680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:54.080680+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.080680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:08:50.163746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'189","reported_seq":693,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.667141+0000","last_change":"2024-03-09T15:24:57.667141+0000","last_active":"2024-03-09T15:24:57.667141+0000","last_peered":"2024-03-09T15:24:57.667141+0000","last_clean":"2024-03-09T15:24:57.667141+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:24:57.667141+0000","last_undegraded":"2024-03-09T15:24:57.667141+0000","last_fullsized":"2024-03-09T15:24:57.667141+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'189","last_scrub_stamp":"2024-03-09T15:24:57.667023+0000","last_deep_scrub":"260'189","last_deep_scrub_stamp":"2024-03-09T15:24:57.667023+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.667023+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:01.539204+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'135","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.677121+0000","last_change":"2024-03-09T15:25:01.677151+0000","last_active":"2024-03-09T15:25:01.677121+0000","last_peered":"2024-03-09T15:25:01.677121+0000","last_clean":"2024-03-09T15:25:01.677121+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:25:01.677121+0000","last_undegraded":"2024-03-09T15:25:01.677121+0000","last_fullsized":"2024-03-09T15:25:01.677121+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'135","last_scrub_stamp":"2024-03-09T15:25:01.677031+0000","last_deep_scrub":"260'135","last_deep_scrub_stamp":"2024-03-09T15:25:01.677031+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.677031+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:22.411149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4674,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.178783+0000","last_change":"2024-03-09T14:21:56.355418+0000","last_active":"2024-03-09T15:24:44.178783+0000","last_peered":"2024-03-09T15:24:44.178783+0000","last_clean":"2024-03-09T15:24:44.178783+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:24:44.178783+0000","last_undegraded":"2024-03-09T15:24:44.178783+0000","last_fullsized":"2024-03-09T15:24:44.178783+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'149","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.213101+0000","last_change":"2024-03-09T15:25:20.213166+0000","last_active":"2024-03-09T15:25:20.213101+0000","last_peered":"2024-03-09T15:25:20.213101+0000","last_clean":"2024-03-09T15:25:20.213101+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:25:20.213101+0000","last_undegraded":"2024-03-09T15:25:20.213101+0000","last_fullsized":"2024-03-09T15:25:20.213101+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-03-09T15:25:20.212978+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-03-09T15:25:20.212978+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.212978+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:34.335711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":29246,"num_write":815,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.533737+0000","last_change":"2024-03-09T15:24:56.533737+0000","last_active":"2024-03-09T15:24:56.533737+0000","last_peered":"2024-03-09T15:24:56.533737+0000","last_clean":"2024-03-09T15:24:56.533737+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:24:56.533737+0000","last_undegraded":"2024-03-09T15:24:56.533737+0000","last_fullsized":"2024-03-09T15:24:56.533737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.533621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.533621+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.533621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:17.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'146","reported_seq":733,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704237+0000","last_change":"2024-03-09T14:22:00.386530+0000","last_active":"2024-03-09T15:24:43.704237+0000","last_peered":"2024-03-09T15:24:43.704237+0000","last_clean":"2024-03-09T15:24:43.704237+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:24:43.704237+0000","last_undegraded":"2024-03-09T15:24:43.704237+0000","last_fullsized":"2024-03-09T15:24:43.704237+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":294,"num_write":114,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.412083+0000","last_change":"2024-03-09T15:25:04.412130+0000","last_active":"2024-03-09T15:25:04.412083+0000","last_peered":"2024-03-09T15:25:04.412083+0000","last_clean":"2024-03-09T15:25:04.412083+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:25:04.412083+0000","last_undegraded":"2024-03-09T15:25:04.412083+0000","last_fullsized":"2024-03-09T15:25:04.412083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:04.411983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:04.411983+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.411983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:08:57.801480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.410479+0000","last_change":"2024-03-09T15:24:58.410504+0000","last_active":"2024-03-09T15:24:58.410479+0000","last_peered":"2024-03-09T15:24:58.410479+0000","last_clean":"2024-03-09T15:24:58.410479+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:24:58.410479+0000","last_undegraded":"2024-03-09T15:24:58.410479+0000","last_fullsized":"2024-03-09T15:24:58.410479+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'134","last_scrub_stamp":"2024-03-09T15:24:58.410391+0000","last_deep_scrub":"260'134","last_deep_scrub_stamp":"2024-03-09T15:24:58.410391+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.410391+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:52.946147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4079","reported_seq":4660,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.645255+0000","last_change":"2024-03-09T15:25:01.645309+0000","last_active":"2024-03-09T15:25:01.645255+0000","last_peered":"2024-03-09T15:25:01.645255+0000","last_clean":"2024-03-09T15:25:01.645255+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:25:01.645255+0000","last_undegraded":"2024-03-09T15:25:01.645255+0000","last_fullsized":"2024-03-09T15:25:01.645255+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4079","last_scrub_stamp":"2024-03-09T15:25:01.645158+0000","last_deep_scrub":"260'4079","last_deep_scrub_stamp":"2024-03-09T15:25:01.645158+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.645158+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":3000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:47.461607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'214","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.558956+0000","last_change":"2024-03-09T15:25:19.559011+0000","last_active":"2024-03-09T15:25:19.558956+0000","last_peered":"2024-03-09T15:25:19.558956+0000","last_clean":"2024-03-09T15:25:19.558956+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:25:19.558956+0000","last_undegraded":"2024-03-09T15:25:19.558956+0000","last_fullsized":"2024-03-09T15:25:19.558956+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-03-09T15:25:19.558867+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-03-09T15:25:19.558867+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.558867+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:34:30.154058+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34568,"num_write":1093,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.704047+0000","last_change":"2024-03-09T14:21:58.373073+0000","last_active":"2024-03-09T15:24:43.704047+0000","last_peered":"2024-03-09T15:24:43.704047+0000","last_clean":"2024-03-09T15:24:43.704047+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:24:43.704047+0000","last_undegraded":"2024-03-09T15:24:43.704047+0000","last_fullsized":"2024-03-09T15:24:43.704047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:57.352305+0000","last_clean_scrub_stamp":"2024-03-09T14:21:57.352305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'44","reported_seq":547,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281347+0000","last_change":"2024-03-09T14:22:00.389956+0000","last_active":"2024-03-09T15:24:42.281347+0000","last_peered":"2024-03-09T15:24:42.281347+0000","last_clean":"2024-03-09T15:24:42.281347+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:24:42.281347+0000","last_undegraded":"2024-03-09T15:24:42.281347+0000","last_fullsized":"2024-03-09T15:24:42.281347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.572330+0000","last_change":"2024-03-09T15:25:03.572355+0000","last_active":"2024-03-09T15:25:03.572330+0000","last_peered":"2024-03-09T15:25:03.572330+0000","last_clean":"2024-03-09T15:25:03.572330+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:25:03.572330+0000","last_undegraded":"2024-03-09T15:25:03.572330+0000","last_fullsized":"2024-03-09T15:25:03.572330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:03.572232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:03.572232+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.572232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:11.517223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'191","reported_seq":719,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.632264+0000","last_change":"2024-03-09T15:25:02.632296+0000","last_active":"2024-03-09T15:25:02.632264+0000","last_peered":"2024-03-09T15:25:02.632264+0000","last_clean":"2024-03-09T15:25:02.632264+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:25:02.632264+0000","last_undegraded":"2024-03-09T15:25:02.632264+0000","last_fullsized":"2024-03-09T15:25:02.632264+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-03-09T15:25:02.632158+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-03-09T15:25:02.632158+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.632158+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:41.257547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.370131+0000","last_change":"2024-03-09T15:25:16.370155+0000","last_active":"2024-03-09T15:25:16.370131+0000","last_peered":"2024-03-09T15:25:16.370131+0000","last_clean":"2024-03-09T15:25:16.370131+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:25:16.370131+0000","last_undegraded":"2024-03-09T15:25:16.370131+0000","last_fullsized":"2024-03-09T15:25:16.370131+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4088","last_scrub_stamp":"2024-03-09T15:25:16.370033+0000","last_deep_scrub":"260'4088","last_deep_scrub_stamp":"2024-03-09T15:25:16.370033+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.370033+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:38.757088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'142","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.935873+0000","last_change":"2024-03-09T15:25:20.935985+0000","last_active":"2024-03-09T15:25:20.935873+0000","last_peered":"2024-03-09T15:25:20.935873+0000","last_clean":"2024-03-09T15:25:20.935873+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:25:20.935873+0000","last_undegraded":"2024-03-09T15:25:20.935873+0000","last_fullsized":"2024-03-09T15:25:20.935873+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-03-09T15:25:20.935779+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-03-09T15:25:20.935779+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.935779+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:57.842297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7716,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":77468,"num_write":821,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.553668+0000","last_change":"2024-03-09T15:25:20.553691+0000","last_active":"2024-03-09T15:25:20.553668+0000","last_peered":"2024-03-09T15:25:20.553668+0000","last_clean":"2024-03-09T15:25:20.553668+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:25:20.553668+0000","last_undegraded":"2024-03-09T15:25:20.553668+0000","last_fullsized":"2024-03-09T15:25:20.553668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:20.553566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:20.553566+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.553566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:26.478272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'177","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.372227+0000","last_change":"2024-03-09T15:25:12.372270+0000","last_active":"2024-03-09T15:25:12.372227+0000","last_peered":"2024-03-09T15:25:12.372227+0000","last_clean":"2024-03-09T15:25:12.372227+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:25:12.372227+0000","last_undegraded":"2024-03-09T15:25:12.372227+0000","last_fullsized":"2024-03-09T15:25:12.372227+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-03-09T15:25:12.372138+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-03-09T15:25:12.372138+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.372138+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:35.580718+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":299,"num_write":138,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.738952+0000","last_change":"2024-03-09T15:24:59.738952+0000","last_active":"2024-03-09T15:24:59.738952+0000","last_peered":"2024-03-09T15:24:59.738952+0000","last_clean":"2024-03-09T15:24:59.738952+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:24:59.738952+0000","last_undegraded":"2024-03-09T15:24:59.738952+0000","last_fullsized":"2024-03-09T15:24:59.738952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:59.738850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:59.738850+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.738850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:08:10.311280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'125","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.649935+0000","last_change":"2024-03-09T15:24:54.649967+0000","last_active":"2024-03-09T15:24:54.649935+0000","last_peered":"2024-03-09T15:24:54.649935+0000","last_clean":"2024-03-09T15:24:54.649935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:24:54.649935+0000","last_undegraded":"2024-03-09T15:24:54.649935+0000","last_fullsized":"2024-03-09T15:24:54.649935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'125","last_scrub_stamp":"2024-03-09T15:24:54.649852+0000","last_deep_scrub":"260'125","last_deep_scrub_stamp":"2024-03-09T15:24:54.649852+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.649852+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:06.812371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1187,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703855+0000","last_change":"2024-03-09T14:21:56.353346+0000","last_active":"2024-03-09T15:24:43.703855+0000","last_peered":"2024-03-09T15:24:43.703855+0000","last_clean":"2024-03-09T15:24:43.703855+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:24:43.703855+0000","last_undegraded":"2024-03-09T15:24:43.703855+0000","last_fullsized":"2024-03-09T15:24:43.703855+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'178","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.280928+0000","last_change":"2024-03-09T14:21:54.368774+0000","last_active":"2024-03-09T15:24:42.280928+0000","last_peered":"2024-03-09T15:24:42.280928+0000","last_clean":"2024-03-09T15:24:42.280928+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:24:42.280928+0000","last_undegraded":"2024-03-09T15:24:42.280928+0000","last_fullsized":"2024-03-09T15:24:42.280928+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507990,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":372,"num_read_kb":57120,"num_write":931,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.896790+0000","last_change":"2024-03-09T15:24:54.896790+0000","last_active":"2024-03-09T15:24:54.896790+0000","last_peered":"2024-03-09T15:24:54.896790+0000","last_clean":"2024-03-09T15:24:54.896790+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:24:54.896790+0000","last_undegraded":"2024-03-09T15:24:54.896790+0000","last_fullsized":"2024-03-09T15:24:54.896790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:54.896671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:54.896671+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.896671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:02.977300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'147","reported_seq":723,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596772+0000","last_change":"2024-03-09T14:22:00.383681+0000","last_active":"2024-03-09T15:24:45.596772+0000","last_peered":"2024-03-09T15:24:45.596772+0000","last_clean":"2024-03-09T15:24:45.596772+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:24:45.596772+0000","last_undegraded":"2024-03-09T15:24:45.596772+0000","last_fullsized":"2024-03-09T15:24:45.596772+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8269,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":267,"num_write":100,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.573167+0000","last_change":"2024-03-09T15:25:06.573187+0000","last_active":"2024-03-09T15:25:06.573167+0000","last_peered":"2024-03-09T15:25:06.573167+0000","last_clean":"2024-03-09T15:25:06.573167+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:25:06.573167+0000","last_undegraded":"2024-03-09T15:25:06.573167+0000","last_fullsized":"2024-03-09T15:25:06.573167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.573100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.573100+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.573100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:45.788949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.711307+0000","last_change":"2024-03-09T15:25:06.711352+0000","last_active":"2024-03-09T15:25:06.711307+0000","last_peered":"2024-03-09T15:25:06.711307+0000","last_clean":"2024-03-09T15:25:06.711307+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:25:06.711307+0000","last_undegraded":"2024-03-09T15:25:06.711307+0000","last_fullsized":"2024-03-09T15:25:06.711307+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:25:06.711183+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:25:06.711183+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.711183+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:09:34.251726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'190","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703768+0000","last_change":"2024-03-09T14:21:54.361543+0000","last_active":"2024-03-09T15:24:43.703768+0000","last_peered":"2024-03-09T15:24:43.703768+0000","last_clean":"2024-03-09T15:24:43.703768+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:24:43.703768+0000","last_undegraded":"2024-03-09T15:24:43.703768+0000","last_fullsized":"2024-03-09T15:24:43.703768+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":29766,"num_write":1073,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.567097+0000","last_change":"2024-03-09T15:25:10.567166+0000","last_active":"2024-03-09T15:25:10.567097+0000","last_peered":"2024-03-09T15:25:10.567097+0000","last_clean":"2024-03-09T15:25:10.567097+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:25:10.567097+0000","last_undegraded":"2024-03-09T15:25:10.567097+0000","last_fullsized":"2024-03-09T15:25:10.567097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.566993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.566993+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.566993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:06.632677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'226","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.617210+0000","last_change":"2024-03-09T15:25:00.617246+0000","last_active":"2024-03-09T15:25:00.617210+0000","last_peered":"2024-03-09T15:25:00.617210+0000","last_clean":"2024-03-09T15:25:00.617210+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:25:00.617210+0000","last_undegraded":"2024-03-09T15:25:00.617210+0000","last_fullsized":"2024-03-09T15:25:00.617210+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-03-09T15:25:00.617126+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-03-09T15:25:00.617126+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.617126+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:40.866463+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15733,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":333,"num_read_kb":495,"num_write":212,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.696961+0000","last_change":"2024-03-09T15:24:57.696994+0000","last_active":"2024-03-09T15:24:57.696961+0000","last_peered":"2024-03-09T15:24:57.696961+0000","last_clean":"2024-03-09T15:24:57.696961+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:24:57.696961+0000","last_undegraded":"2024-03-09T15:24:57.696961+0000","last_fullsized":"2024-03-09T15:24:57.696961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.696839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.696839+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.696839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:10.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'177","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.412926+0000","last_change":"2024-03-09T15:24:56.412926+0000","last_active":"2024-03-09T15:24:56.412926+0000","last_peered":"2024-03-09T15:24:56.412926+0000","last_clean":"2024-03-09T15:24:56.412926+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:24:56.412926+0000","last_undegraded":"2024-03-09T15:24:56.412926+0000","last_fullsized":"2024-03-09T15:24:56.412926+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-03-09T15:24:56.412779+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-03-09T15:24:56.412779+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.412779+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.170082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:16.920475+0000","last_change":"2024-03-09T14:21:56.366627+0000","last_active":"2024-03-09T15:24:16.920475+0000","last_peered":"2024-03-09T15:24:16.920475+0000","last_clean":"2024-03-09T15:24:16.920475+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:24:16.920475+0000","last_undegraded":"2024-03-09T15:24:16.920475+0000","last_fullsized":"2024-03-09T15:24:16.920475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'317","reported_seq":1057,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.726890+0000","last_change":"2024-03-09T15:25:13.726934+0000","last_active":"2024-03-09T15:25:13.726890+0000","last_peered":"2024-03-09T15:25:13.726890+0000","last_clean":"2024-03-09T15:25:13.726890+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:25:13.726890+0000","last_undegraded":"2024-03-09T15:25:13.726890+0000","last_fullsized":"2024-03-09T15:25:13.726890+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'317","last_scrub_stamp":"2024-03-09T15:25:13.726778+0000","last_deep_scrub":"260'317","last_deep_scrub_stamp":"2024-03-09T15:25:13.726778+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.726778+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:21.653177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243080,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":990,"num_read_kb":20523,"num_write":1606,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.874942+0000","last_change":"2024-03-09T15:24:52.874964+0000","last_active":"2024-03-09T15:24:52.874942+0000","last_peered":"2024-03-09T15:24:52.874942+0000","last_clean":"2024-03-09T15:24:52.874942+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:24:52.874942+0000","last_undegraded":"2024-03-09T15:24:52.874942+0000","last_fullsized":"2024-03-09T15:24:52.874942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:52.874873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:52.874873+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.874873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:49.190884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'181","reported_seq":776,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:37.971456+0000","last_change":"2024-03-09T14:22:00.384248+0000","last_active":"2024-03-09T15:24:37.971456+0000","last_peered":"2024-03-09T15:24:37.971456+0000","last_clean":"2024-03-09T15:24:37.971456+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:24:37.971456+0000","last_undegraded":"2024-03-09T15:24:37.971456+0000","last_fullsized":"2024-03-09T15:24:37.971456+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9600,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":340,"num_write":176,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.724571+0000","last_change":"2024-03-09T15:25:08.724603+0000","last_active":"2024-03-09T15:25:08.724571+0000","last_peered":"2024-03-09T15:25:08.724571+0000","last_clean":"2024-03-09T15:25:08.724571+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:25:08.724571+0000","last_undegraded":"2024-03-09T15:25:08.724571+0000","last_fullsized":"2024-03-09T15:25:08.724571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:08.724486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:08.724486+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.724486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:51:46.809660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'174","reported_seq":1374,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.717279+0000","last_change":"2024-03-09T15:25:03.717279+0000","last_active":"2024-03-09T15:25:03.717279+0000","last_peered":"2024-03-09T15:25:03.717279+0000","last_clean":"2024-03-09T15:25:03.717279+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:25:03.717279+0000","last_undegraded":"2024-03-09T15:25:03.717279+0000","last_fullsized":"2024-03-09T15:25:03.717279+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'174","last_scrub_stamp":"2024-03-09T15:25:03.717114+0000","last_deep_scrub":"260'174","last_deep_scrub_stamp":"2024-03-09T15:25:03.717114+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.717114+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:10.125063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":658,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.037745+0000","last_change":"2024-03-09T14:21:56.352420+0000","last_active":"2024-03-09T15:24:27.037745+0000","last_peered":"2024-03-09T15:24:27.037745+0000","last_clean":"2024-03-09T15:24:27.037745+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:24:27.037745+0000","last_undegraded":"2024-03-09T15:24:27.037745+0000","last_fullsized":"2024-03-09T15:24:27.037745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'180","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.874089+0000","last_change":"2024-03-09T15:24:46.874089+0000","last_active":"2024-03-09T15:24:46.874089+0000","last_peered":"2024-03-09T15:24:46.874089+0000","last_clean":"2024-03-09T15:24:46.874089+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:24:46.874089+0000","last_undegraded":"2024-03-09T15:24:46.874089+0000","last_fullsized":"2024-03-09T15:24:46.874089+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'180","last_scrub_stamp":"2024-03-09T15:24:46.873902+0000","last_deep_scrub":"260'180","last_deep_scrub_stamp":"2024-03-09T15:24:46.873902+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.873902+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:58.769545+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079970,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":42859,"num_write":1107,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.145721+0000","last_change":"2024-03-09T15:25:14.145747+0000","last_active":"2024-03-09T15:25:14.145721+0000","last_peered":"2024-03-09T15:25:14.145721+0000","last_clean":"2024-03-09T15:25:14.145721+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:25:14.145721+0000","last_undegraded":"2024-03-09T15:25:14.145721+0000","last_fullsized":"2024-03-09T15:25:14.145721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:14.145625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:14.145625+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.145625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:12:23.023977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'149","reported_seq":748,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.430482+0000","last_change":"2024-03-09T15:25:07.430516+0000","last_active":"2024-03-09T15:25:07.430482+0000","last_peered":"2024-03-09T15:25:07.430482+0000","last_clean":"2024-03-09T15:25:07.430482+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:25:07.430482+0000","last_undegraded":"2024-03-09T15:25:07.430482+0000","last_fullsized":"2024-03-09T15:25:07.430482+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-03-09T15:25:07.430387+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-03-09T15:25:07.430387+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.430387+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:34:51.892125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":204,"num_read_kb":270,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.733282+0000","last_change":"2024-03-09T15:25:18.733311+0000","last_active":"2024-03-09T15:25:18.733282+0000","last_peered":"2024-03-09T15:25:18.733282+0000","last_clean":"2024-03-09T15:25:18.733282+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:25:18.733282+0000","last_undegraded":"2024-03-09T15:25:18.733282+0000","last_fullsized":"2024-03-09T15:25:18.733282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.733176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.733176+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.733176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:32.965896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'111","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.678427+0000","last_change":"2024-03-09T15:24:55.678427+0000","last_active":"2024-03-09T15:24:55.678427+0000","last_peered":"2024-03-09T15:24:55.678427+0000","last_clean":"2024-03-09T15:24:55.678427+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:55.678427+0000","last_undegraded":"2024-03-09T15:24:55.678427+0000","last_fullsized":"2024-03-09T15:24:55.678427+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'111","last_scrub_stamp":"2024-03-09T15:24:55.678295+0000","last_deep_scrub":"260'111","last_deep_scrub_stamp":"2024-03-09T15:24:55.678295+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.678295+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:19.579572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.528533+0000","last_change":"2024-03-09T15:25:06.528556+0000","last_active":"2024-03-09T15:25:06.528533+0000","last_peered":"2024-03-09T15:25:06.528533+0000","last_clean":"2024-03-09T15:25:06.528533+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:25:06.528533+0000","last_undegraded":"2024-03-09T15:25:06.528533+0000","last_fullsized":"2024-03-09T15:25:06.528533+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'144","last_scrub_stamp":"2024-03-09T15:25:06.528450+0000","last_deep_scrub":"260'144","last_deep_scrub_stamp":"2024-03-09T15:25:06.528450+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.528450+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:58.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'197","reported_seq":839,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.589642+0000","last_change":"2024-03-09T15:24:53.589692+0000","last_active":"2024-03-09T15:24:53.589642+0000","last_peered":"2024-03-09T15:24:53.589642+0000","last_clean":"2024-03-09T15:24:53.589642+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:24:53.589642+0000","last_undegraded":"2024-03-09T15:24:53.589642+0000","last_fullsized":"2024-03-09T15:24:53.589642+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:24:53.589537+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:24:53.589537+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.589537+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:24.871040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322946,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":96221,"num_write":1020,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.501649+0000","last_change":"2024-03-09T15:24:55.501674+0000","last_active":"2024-03-09T15:24:55.501649+0000","last_peered":"2024-03-09T15:24:55.501649+0000","last_clean":"2024-03-09T15:24:55.501649+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:24:55.501649+0000","last_undegraded":"2024-03-09T15:24:55.501649+0000","last_fullsized":"2024-03-09T15:24:55.501649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.501552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.501552+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.501552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:49.656602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'110","reported_seq":659,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.069174+0000","last_change":"2024-03-09T15:24:57.069220+0000","last_active":"2024-03-09T15:24:57.069174+0000","last_peered":"2024-03-09T15:24:57.069174+0000","last_clean":"2024-03-09T15:24:57.069174+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:24:57.069174+0000","last_undegraded":"2024-03-09T15:24:57.069174+0000","last_fullsized":"2024-03-09T15:24:57.069174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'110","last_scrub_stamp":"2024-03-09T15:24:57.069084+0000","last_deep_scrub":"260'110","last_deep_scrub_stamp":"2024-03-09T15:24:57.069084+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.069084+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:48.543598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'507","reported_seq":2255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.884269+0000","last_change":"2024-03-09T15:24:51.884295+0000","last_active":"2024-03-09T15:24:51.884269+0000","last_peered":"2024-03-09T15:24:51.884269+0000","last_clean":"2024-03-09T15:24:51.884269+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:51.884269+0000","last_undegraded":"2024-03-09T15:24:51.884269+0000","last_fullsized":"2024-03-09T15:24:51.884269+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'507","last_scrub_stamp":"2024-03-09T15:24:51.884180+0000","last_deep_scrub":"260'507","last_deep_scrub_stamp":"2024-03-09T15:24:51.884180+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.884180+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:19.318327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'119","reported_seq":646,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.655743+0000","last_change":"2024-03-09T15:25:00.655743+0000","last_active":"2024-03-09T15:25:00.655743+0000","last_peered":"2024-03-09T15:25:00.655743+0000","last_clean":"2024-03-09T15:25:00.655743+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:25:00.655743+0000","last_undegraded":"2024-03-09T15:25:00.655743+0000","last_fullsized":"2024-03-09T15:25:00.655743+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-03-09T15:25:00.655625+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-03-09T15:25:00.655625+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.655625+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:34.048316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":814,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183884+0000","last_change":"2024-03-09T14:21:56.352673+0000","last_active":"2024-03-09T15:24:27.183884+0000","last_peered":"2024-03-09T15:24:27.183884+0000","last_clean":"2024-03-09T15:24:27.183884+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:24:27.183884+0000","last_undegraded":"2024-03-09T15:24:27.183884+0000","last_fullsized":"2024-03-09T15:24:27.183884+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'150","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.949370+0000","last_change":"2024-03-09T15:25:21.949441+0000","last_active":"2024-03-09T15:25:21.949370+0000","last_peered":"2024-03-09T15:25:21.949370+0000","last_clean":"2024-03-09T15:25:21.949370+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:25:21.949370+0000","last_undegraded":"2024-03-09T15:25:21.949370+0000","last_fullsized":"2024-03-09T15:25:21.949370+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'150","last_scrub_stamp":"2024-03-09T15:25:21.949279+0000","last_deep_scrub":"260'150","last_deep_scrub_stamp":"2024-03-09T15:25:21.949279+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.949279+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:04.038278+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":327,"num_read_kb":36416,"num_write":870,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.497811+0000","last_change":"2024-03-09T15:25:16.497849+0000","last_active":"2024-03-09T15:25:16.497811+0000","last_peered":"2024-03-09T15:25:16.497811+0000","last_clean":"2024-03-09T15:25:16.497811+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:25:16.497811+0000","last_undegraded":"2024-03-09T15:25:16.497811+0000","last_fullsized":"2024-03-09T15:25:16.497811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:16.497691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:16.497691+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.497691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:00:06.867807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'175","reported_seq":771,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.651235+0000","last_change":"2024-03-09T14:22:00.386165+0000","last_active":"2024-03-09T15:24:44.651235+0000","last_peered":"2024-03-09T15:24:44.651235+0000","last_clean":"2024-03-09T15:24:44.651235+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:24:44.651235+0000","last_undegraded":"2024-03-09T15:24:44.651235+0000","last_fullsized":"2024-03-09T15:24:44.651235+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":241,"num_read_kb":303,"num_write":134,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":484,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281407+0000","last_change":"2024-03-09T14:22:02.398377+0000","last_active":"2024-03-09T15:24:42.281407+0000","last_peered":"2024-03-09T15:24:42.281407+0000","last_clean":"2024-03-09T15:24:42.281407+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:24:42.281407+0000","last_undegraded":"2024-03-09T15:24:42.281407+0000","last_fullsized":"2024-03-09T15:24:42.281407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:22:01.371333+0000","last_clean_scrub_stamp":"2024-03-09T14:22:01.371333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'112","reported_seq":618,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.702326+0000","last_change":"2024-03-09T15:24:59.702360+0000","last_active":"2024-03-09T15:24:59.702326+0000","last_peered":"2024-03-09T15:24:59.702326+0000","last_clean":"2024-03-09T15:24:59.702326+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:24:59.702326+0000","last_undegraded":"2024-03-09T15:24:59.702326+0000","last_fullsized":"2024-03-09T15:24:59.702326+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'112","last_scrub_stamp":"2024-03-09T15:24:59.702244+0000","last_deep_scrub":"260'112","last_deep_scrub_stamp":"2024-03-09T15:24:59.702244+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.702244+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:16.961678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":606,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:27.183807+0000","last_change":"2024-03-09T14:21:56.352123+0000","last_active":"2024-03-09T15:24:27.183807+0000","last_peered":"2024-03-09T15:24:27.183807+0000","last_clean":"2024-03-09T15:24:27.183807+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:24:27.183807+0000","last_undegraded":"2024-03-09T15:24:27.183807+0000","last_fullsized":"2024-03-09T15:24:27.183807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:55.338285+0000","last_clean_scrub_stamp":"2024-03-09T14:21:55.338285+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'167","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.735693+0000","last_change":"2024-03-09T15:25:11.735763+0000","last_active":"2024-03-09T15:25:11.735693+0000","last_peered":"2024-03-09T15:25:11.735693+0000","last_clean":"2024-03-09T15:25:11.735693+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:25:11.735693+0000","last_undegraded":"2024-03-09T15:25:11.735693+0000","last_fullsized":"2024-03-09T15:25:11.735693+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'167","last_scrub_stamp":"2024-03-09T15:25:11.735592+0000","last_deep_scrub":"260'167","last_deep_scrub_stamp":"2024-03-09T15:25:11.735592+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.735592+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:52.243408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":54818,"num_write":999,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.809372+0000","last_change":"2024-03-09T15:25:14.809397+0000","last_active":"2024-03-09T15:25:14.809372+0000","last_peered":"2024-03-09T15:25:14.809372+0000","last_clean":"2024-03-09T15:25:14.809372+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:25:14.809372+0000","last_undegraded":"2024-03-09T15:25:14.809372+0000","last_fullsized":"2024-03-09T15:25:14.809372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:14.809288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:14.809288+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.809288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:28.122958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'140","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.514834+0000","last_change":"2024-03-09T15:25:16.514872+0000","last_active":"2024-03-09T15:25:16.514834+0000","last_peered":"2024-03-09T15:25:16.514834+0000","last_clean":"2024-03-09T15:25:16.514834+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:25:16.514834+0000","last_undegraded":"2024-03-09T15:25:16.514834+0000","last_fullsized":"2024-03-09T15:25:16.514834+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'140","last_scrub_stamp":"2024-03-09T15:25:16.514738+0000","last_deep_scrub":"260'140","last_deep_scrub_stamp":"2024-03-09T15:25:16.514738+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.514738+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:46.004423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":230,"num_write":94,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.879148+0000","last_change":"2024-03-09T15:24:53.879148+0000","last_active":"2024-03-09T15:24:53.879148+0000","last_peered":"2024-03-09T15:24:53.879148+0000","last_clean":"2024-03-09T15:24:53.879148+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:24:53.879148+0000","last_undegraded":"2024-03-09T15:24:53.879148+0000","last_fullsized":"2024-03-09T15:24:53.879148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.878965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.878965+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.878965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:10.584696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'99","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.415079+0000","last_change":"2024-03-09T15:24:59.415115+0000","last_active":"2024-03-09T15:24:59.415079+0000","last_peered":"2024-03-09T15:24:59.415079+0000","last_clean":"2024-03-09T15:24:59.415079+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:24:59.415079+0000","last_undegraded":"2024-03-09T15:24:59.415079+0000","last_fullsized":"2024-03-09T15:24:59.415079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'99","last_scrub_stamp":"2024-03-09T15:24:59.414984+0000","last_deep_scrub":"260'99","last_deep_scrub_stamp":"2024-03-09T15:24:59.414984+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.414984+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:31:06.423310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":778,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.390866+0000","last_change":"2024-03-09T15:25:15.390911+0000","last_active":"2024-03-09T15:25:15.390866+0000","last_peered":"2024-03-09T15:25:15.390866+0000","last_clean":"2024-03-09T15:25:15.390866+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:25:15.390866+0000","last_undegraded":"2024-03-09T15:25:15.390866+0000","last_fullsized":"2024-03-09T15:25:15.390866+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-03-09T15:25:15.390721+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-03-09T15:25:15.390721+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.390721+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:14.405862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'229","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.044122+0000","last_change":"2024-03-09T14:21:54.358944+0000","last_active":"2024-03-09T15:24:38.044122+0000","last_peered":"2024-03-09T15:24:38.044122+0000","last_clean":"2024-03-09T15:24:38.044122+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:24:38.044122+0000","last_undegraded":"2024-03-09T15:24:38.044122+0000","last_fullsized":"2024-03-09T15:24:38.044122+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":44740,"num_write":1211,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.104612+0000","last_change":"2024-03-09T15:25:10.104638+0000","last_active":"2024-03-09T15:25:10.104612+0000","last_peered":"2024-03-09T15:25:10.104612+0000","last_clean":"2024-03-09T15:25:10.104612+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:25:10.104612+0000","last_undegraded":"2024-03-09T15:25:10.104612+0000","last_fullsized":"2024-03-09T15:25:10.104612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.104505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.104505+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.104505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:05.633704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'117","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.407630+0000","last_change":"2024-03-09T15:25:10.407663+0000","last_active":"2024-03-09T15:25:10.407630+0000","last_peered":"2024-03-09T15:25:10.407630+0000","last_clean":"2024-03-09T15:25:10.407630+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:25:10.407630+0000","last_undegraded":"2024-03-09T15:25:10.407630+0000","last_fullsized":"2024-03-09T15:25:10.407630+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-03-09T15:25:10.407543+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-03-09T15:25:10.407543+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.407543+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:16.704015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":194,"num_write":70,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.053602+0000","last_change":"2024-03-09T15:24:55.053626+0000","last_active":"2024-03-09T15:24:55.053602+0000","last_peered":"2024-03-09T15:24:55.053602+0000","last_clean":"2024-03-09T15:24:55.053602+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:24:55.053602+0000","last_undegraded":"2024-03-09T15:24:55.053602+0000","last_fullsized":"2024-03-09T15:24:55.053602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.053498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.053498+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.053498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:38.275368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'150","reported_seq":1819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.611849+0000","last_change":"2024-03-09T15:25:01.611893+0000","last_active":"2024-03-09T15:25:01.611849+0000","last_peered":"2024-03-09T15:25:01.611849+0000","last_clean":"2024-03-09T15:25:01.611849+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:25:01.611849+0000","last_undegraded":"2024-03-09T15:25:01.611849+0000","last_fullsized":"2024-03-09T15:25:01.611849+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'150","last_scrub_stamp":"2024-03-09T15:25:01.611770+0000","last_deep_scrub":"260'150","last_deep_scrub_stamp":"2024-03-09T15:25:01.611770+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.611770+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:25.632376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.121729+0000","last_change":"2024-03-09T15:25:15.121756+0000","last_active":"2024-03-09T15:25:15.121729+0000","last_peered":"2024-03-09T15:25:15.121729+0000","last_clean":"2024-03-09T15:25:15.121729+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:25:15.121729+0000","last_undegraded":"2024-03-09T15:25:15.121729+0000","last_fullsized":"2024-03-09T15:25:15.121729+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-03-09T15:25:15.121631+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-03-09T15:25:15.121631+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.121631+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:50.426797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'214","reported_seq":979,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.167481+0000","last_change":"2024-03-09T14:21:54.358595+0000","last_active":"2024-03-09T15:24:38.167481+0000","last_peered":"2024-03-09T15:24:38.167481+0000","last_clean":"2024-03-09T15:24:38.167481+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:24:38.167481+0000","last_undegraded":"2024-03-09T15:24:38.167481+0000","last_fullsized":"2024-03-09T15:24:38.167481+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284795,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":699,"num_read_kb":64460,"num_write":1159,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'6","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.466144+0000","last_change":"2024-03-09T15:24:54.466144+0000","last_active":"2024-03-09T15:24:54.466144+0000","last_peered":"2024-03-09T15:24:54.466144+0000","last_clean":"2024-03-09T15:24:54.466144+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:54.466144+0000","last_undegraded":"2024-03-09T15:24:54.466144+0000","last_fullsized":"2024-03-09T15:24:54.466144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:24:54.466003+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:24:54.466003+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.466003+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:49:13.636187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'166","reported_seq":763,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:38.116848+0000","last_change":"2024-03-09T14:22:00.381012+0000","last_active":"2024-03-09T15:24:38.116848+0000","last_peered":"2024-03-09T15:24:38.116848+0000","last_clean":"2024-03-09T15:24:38.116848+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:24:38.116848+0000","last_undegraded":"2024-03-09T15:24:38.116848+0000","last_fullsized":"2024-03-09T15:24:38.116848+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:59.364155+0000","last_clean_scrub_stamp":"2024-03-09T14:21:59.364155+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20360,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":325,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.563195+0000","last_change":"2024-03-09T15:25:07.563219+0000","last_active":"2024-03-09T15:25:07.563195+0000","last_peered":"2024-03-09T15:25:07.563195+0000","last_clean":"2024-03-09T15:25:07.563195+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:25:07.563195+0000","last_undegraded":"2024-03-09T15:25:07.563195+0000","last_fullsized":"2024-03-09T15:25:07.563195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:07.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:07.563107+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.563107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:45.978911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'109","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.022419+0000","last_change":"2024-03-09T15:24:50.022419+0000","last_active":"2024-03-09T15:24:50.022419+0000","last_peered":"2024-03-09T15:24:50.022419+0000","last_clean":"2024-03-09T15:24:50.022419+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:24:50.022419+0000","last_undegraded":"2024-03-09T15:24:50.022419+0000","last_fullsized":"2024-03-09T15:24:50.022419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-03-09T15:24:50.022263+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-03-09T15:24:50.022263+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.022263+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:01:53.310008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.710380+0000","last_change":"2024-03-09T15:25:17.710444+0000","last_active":"2024-03-09T15:25:17.710380+0000","last_peered":"2024-03-09T15:25:17.710380+0000","last_clean":"2024-03-09T15:25:17.710380+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:25:17.710380+0000","last_undegraded":"2024-03-09T15:25:17.710380+0000","last_fullsized":"2024-03-09T15:25:17.710380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:25:17.710269+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:25:17.710269+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.710269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:40.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'182","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.630869+0000","last_change":"2024-03-09T15:25:13.630920+0000","last_active":"2024-03-09T15:25:13.630869+0000","last_peered":"2024-03-09T15:25:13.630869+0000","last_clean":"2024-03-09T15:25:13.630869+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:25:13.630869+0000","last_undegraded":"2024-03-09T15:25:13.630869+0000","last_fullsized":"2024-03-09T15:25:13.630869+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'182","last_scrub_stamp":"2024-03-09T15:25:13.630775+0000","last_deep_scrub":"260'182","last_deep_scrub_stamp":"2024-03-09T15:25:13.630775+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.630775+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:38.097608+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342104,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":789,"num_read_kb":18311,"num_write":1113,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.575183+0000","last_change":"2024-03-09T15:24:57.575211+0000","last_active":"2024-03-09T15:24:57.575183+0000","last_peered":"2024-03-09T15:24:57.575183+0000","last_clean":"2024-03-09T15:24:57.575183+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:24:57.575183+0000","last_undegraded":"2024-03-09T15:24:57.575183+0000","last_fullsized":"2024-03-09T15:24:57.575183+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'231","last_scrub_stamp":"2024-03-09T15:24:57.575095+0000","last_deep_scrub":"260'231","last_deep_scrub_stamp":"2024-03-09T15:24:57.575095+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.575095+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:22:23.882512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'271","reported_seq":1092,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.676663+0000","last_change":"2024-03-09T15:25:01.676707+0000","last_active":"2024-03-09T15:25:01.676663+0000","last_peered":"2024-03-09T15:25:01.676663+0000","last_clean":"2024-03-09T15:25:01.676663+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:25:01.676663+0000","last_undegraded":"2024-03-09T15:25:01.676663+0000","last_fullsized":"2024-03-09T15:25:01.676663+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'271","last_scrub_stamp":"2024-03-09T15:25:01.676568+0000","last_deep_scrub":"260'271","last_deep_scrub_stamp":"2024-03-09T15:25:01.676568+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.676568+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:03.427239+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1220,"num_read_kb":137737,"num_write":1250,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.715153+0000","last_change":"2024-03-09T15:25:07.715178+0000","last_active":"2024-03-09T15:25:07.715153+0000","last_peered":"2024-03-09T15:25:07.715153+0000","last_clean":"2024-03-09T15:25:07.715153+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:25:07.715153+0000","last_undegraded":"2024-03-09T15:25:07.715153+0000","last_fullsized":"2024-03-09T15:25:07.715153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'60","last_scrub_stamp":"2024-03-09T15:25:07.715064+0000","last_deep_scrub":"260'60","last_deep_scrub_stamp":"2024-03-09T15:25:07.715064+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.715064+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:18.286015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'163","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.853916+0000","last_change":"2024-03-09T15:25:17.853947+0000","last_active":"2024-03-09T15:25:17.853916+0000","last_peered":"2024-03-09T15:25:17.853916+0000","last_clean":"2024-03-09T15:25:17.853916+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:25:17.853916+0000","last_undegraded":"2024-03-09T15:25:17.853916+0000","last_fullsized":"2024-03-09T15:25:17.853916+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-03-09T15:25:17.853829+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-03-09T15:25:17.853829+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.853829+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:21.627601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":5631,"num_write":926,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.656551+0000","last_change":"2024-03-09T15:25:03.656611+0000","last_active":"2024-03-09T15:25:03.656551+0000","last_peered":"2024-03-09T15:25:03.656551+0000","last_clean":"2024-03-09T15:25:03.656551+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:25:03.656551+0000","last_undegraded":"2024-03-09T15:25:03.656551+0000","last_fullsized":"2024-03-09T15:25:03.656551+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'170","last_scrub_stamp":"2024-03-09T15:25:03.656448+0000","last_deep_scrub":"260'170","last_deep_scrub_stamp":"2024-03-09T15:25:03.656448+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.656448+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:49:08.952959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'146","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.598133+0000","last_change":"2024-03-09T15:24:54.598212+0000","last_active":"2024-03-09T15:24:54.598133+0000","last_peered":"2024-03-09T15:24:54.598133+0000","last_clean":"2024-03-09T15:24:54.598133+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:24:54.598133+0000","last_undegraded":"2024-03-09T15:24:54.598133+0000","last_fullsized":"2024-03-09T15:24:54.598133+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:24:54.598022+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:24:54.598022+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.598022+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:02.821961+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4226579,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":2407,"num_write":836,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'204","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.348527+0000","last_change":"2024-03-09T15:25:20.348559+0000","last_active":"2024-03-09T15:25:20.348527+0000","last_peered":"2024-03-09T15:25:20.348527+0000","last_clean":"2024-03-09T15:25:20.348527+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:25:20.348527+0000","last_undegraded":"2024-03-09T15:25:20.348527+0000","last_fullsized":"2024-03-09T15:25:20.348527+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'204","last_scrub_stamp":"2024-03-09T15:25:20.348434+0000","last_deep_scrub":"260'204","last_deep_scrub_stamp":"2024-03-09T15:25:20.348434+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.348434+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:25:39.962187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'227","reported_seq":966,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703764+0000","last_change":"2024-03-09T14:21:54.360027+0000","last_active":"2024-03-09T15:24:43.703764+0000","last_peered":"2024-03-09T15:24:43.703764+0000","last_clean":"2024-03-09T15:24:43.703764+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:24:43.703764+0000","last_undegraded":"2024-03-09T15:24:43.703764+0000","last_fullsized":"2024-03-09T15:24:43.703764+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079971,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":807,"num_read_kb":22283,"num_write":1154,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.082767+0000","last_change":"2024-03-09T15:25:02.082809+0000","last_active":"2024-03-09T15:25:02.082767+0000","last_peered":"2024-03-09T15:25:02.082767+0000","last_clean":"2024-03-09T15:25:02.082767+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:25:02.082767+0000","last_undegraded":"2024-03-09T15:25:02.082767+0000","last_fullsized":"2024-03-09T15:25:02.082767+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'143","last_scrub_stamp":"2024-03-09T15:25:02.082645+0000","last_deep_scrub":"260'143","last_deep_scrub_stamp":"2024-03-09T15:25:02.082645+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.082645+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:08.396801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'197","reported_seq":868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.737183+0000","last_change":"2024-03-09T15:25:16.737242+0000","last_active":"2024-03-09T15:25:16.737183+0000","last_peered":"2024-03-09T15:25:16.737183+0000","last_clean":"2024-03-09T15:25:16.737183+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:25:16.737183+0000","last_undegraded":"2024-03-09T15:25:16.737183+0000","last_fullsized":"2024-03-09T15:25:16.737183+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:25:16.737069+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:25:16.737069+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.737069+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:38.072969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":38599,"num_write":1107,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.335355+0000","last_change":"2024-03-09T15:25:18.335390+0000","last_active":"2024-03-09T15:25:18.335355+0000","last_peered":"2024-03-09T15:25:18.335355+0000","last_clean":"2024-03-09T15:25:18.335355+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:25:18.335355+0000","last_undegraded":"2024-03-09T15:25:18.335355+0000","last_fullsized":"2024-03-09T15:25:18.335355+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'371","last_scrub_stamp":"2024-03-09T15:25:18.335257+0000","last_deep_scrub":"260'371","last_deep_scrub_stamp":"2024-03-09T15:25:18.335257+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.335257+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:51.442744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'214","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.703303+0000","last_change":"2024-03-09T15:25:10.703353+0000","last_active":"2024-03-09T15:25:10.703303+0000","last_peered":"2024-03-09T15:25:10.703303+0000","last_clean":"2024-03-09T15:25:10.703303+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:25:10.703303+0000","last_undegraded":"2024-03-09T15:25:10.703303+0000","last_fullsized":"2024-03-09T15:25:10.703303+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-03-09T15:25:10.703213+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-03-09T15:25:10.703213+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.703213+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:32.839461+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":1161,"num_write":1167,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.703687+0000","last_change":"2024-03-09T15:25:02.703712+0000","last_active":"2024-03-09T15:25:02.703687+0000","last_peered":"2024-03-09T15:25:02.703687+0000","last_clean":"2024-03-09T15:25:02.703687+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:25:02.703687+0000","last_undegraded":"2024-03-09T15:25:02.703687+0000","last_fullsized":"2024-03-09T15:25:02.703687+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'319","last_scrub_stamp":"2024-03-09T15:25:02.703601+0000","last_deep_scrub":"260'319","last_deep_scrub_stamp":"2024-03-09T15:25:02.703601+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.703601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:11.101908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'187","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.703740+0000","last_change":"2024-03-09T14:21:54.365980+0000","last_active":"2024-03-09T15:24:43.703740+0000","last_peered":"2024-03-09T15:24:43.703740+0000","last_clean":"2024-03-09T15:24:43.703740+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:24:43.703740+0000","last_undegraded":"2024-03-09T15:24:43.703740+0000","last_fullsized":"2024-03-09T15:24:43.703740+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":434,"num_read_kb":15052,"num_write":1039,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":728,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.526029+0000","last_change":"2024-03-09T15:24:51.526029+0000","last_active":"2024-03-09T15:24:51.526029+0000","last_peered":"2024-03-09T15:24:51.526029+0000","last_clean":"2024-03-09T15:24:51.526029+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:24:51.526029+0000","last_undegraded":"2024-03-09T15:24:51.526029+0000","last_fullsized":"2024-03-09T15:24:51.526029+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'131","last_scrub_stamp":"2024-03-09T15:24:51.525912+0000","last_deep_scrub":"260'131","last_deep_scrub_stamp":"2024-03-09T15:24:51.525912+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.525912+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:26.494362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'174","reported_seq":808,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650867+0000","last_change":"2024-03-09T14:21:54.370760+0000","last_active":"2024-03-09T15:24:44.650867+0000","last_peered":"2024-03-09T15:24:44.650867+0000","last_clean":"2024-03-09T15:24:44.650867+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:24:44.650867+0000","last_undegraded":"2024-03-09T15:24:44.650867+0000","last_fullsized":"2024-03-09T15:24:44.650867+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":2617,"num_write":1101,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'90","reported_seq":673,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.116636+0000","last_change":"2024-03-09T15:25:03.116665+0000","last_active":"2024-03-09T15:25:03.116636+0000","last_peered":"2024-03-09T15:25:03.116636+0000","last_clean":"2024-03-09T15:25:03.116636+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:25:03.116636+0000","last_undegraded":"2024-03-09T15:25:03.116636+0000","last_fullsized":"2024-03-09T15:25:03.116636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'90","last_scrub_stamp":"2024-03-09T15:25:03.116532+0000","last_deep_scrub":"260'90","last_deep_scrub_stamp":"2024-03-09T15:25:03.116532+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.116532+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:52.853288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":810,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.869479+0000","last_change":"2024-03-09T15:24:48.869520+0000","last_active":"2024-03-09T15:24:48.869479+0000","last_peered":"2024-03-09T15:24:48.869479+0000","last_clean":"2024-03-09T15:24:48.869479+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:24:48.869479+0000","last_undegraded":"2024-03-09T15:24:48.869479+0000","last_fullsized":"2024-03-09T15:24:48.869479+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'212","last_scrub_stamp":"2024-03-09T15:24:48.869376+0000","last_deep_scrub":"260'212","last_deep_scrub_stamp":"2024-03-09T15:24:48.869376+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.869376+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:06.455688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.610226+0000","last_change":"2024-03-09T15:25:03.610226+0000","last_active":"2024-03-09T15:25:03.610226+0000","last_peered":"2024-03-09T15:25:03.610226+0000","last_clean":"2024-03-09T15:25:03.610226+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:25:03.610226+0000","last_undegraded":"2024-03-09T15:25:03.610226+0000","last_fullsized":"2024-03-09T15:25:03.610226+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-03-09T15:25:03.610105+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-03-09T15:25:03.610105+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.610105+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:40.358842+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'157","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.898701+0000","last_change":"2024-03-09T15:25:19.898769+0000","last_active":"2024-03-09T15:25:19.898701+0000","last_peered":"2024-03-09T15:25:19.898701+0000","last_clean":"2024-03-09T15:25:19.898701+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:25:19.898701+0000","last_undegraded":"2024-03-09T15:25:19.898701+0000","last_fullsized":"2024-03-09T15:25:19.898701+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'157","last_scrub_stamp":"2024-03-09T15:25:19.898609+0000","last_deep_scrub":"260'157","last_deep_scrub_stamp":"2024-03-09T15:25:19.898609+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.898609+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:31:13.487231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262239,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":372,"num_read_kb":3591,"num_write":919,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.138914+0000","last_change":"2024-03-09T15:25:11.138966+0000","last_active":"2024-03-09T15:25:11.138914+0000","last_peered":"2024-03-09T15:25:11.138914+0000","last_clean":"2024-03-09T15:25:11.138914+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:25:11.138914+0000","last_undegraded":"2024-03-09T15:25:11.138914+0000","last_fullsized":"2024-03-09T15:25:11.138914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-03-09T15:25:11.138807+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-03-09T15:25:11.138807+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.138807+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:33.587801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'229","reported_seq":870,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.281028+0000","last_change":"2024-03-09T14:21:54.361294+0000","last_active":"2024-03-09T15:24:42.281028+0000","last_peered":"2024-03-09T15:24:42.281028+0000","last_clean":"2024-03-09T15:24:42.281028+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:24:42.281028+0000","last_undegraded":"2024-03-09T15:24:42.281028+0000","last_fullsized":"2024-03-09T15:24:42.281028+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":6366,"num_write":1241,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'193","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.496497+0000","last_change":"2024-03-09T15:25:15.496525+0000","last_active":"2024-03-09T15:25:15.496497+0000","last_peered":"2024-03-09T15:25:15.496497+0000","last_clean":"2024-03-09T15:25:15.496497+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:25:15.496497+0000","last_undegraded":"2024-03-09T15:25:15.496497+0000","last_fullsized":"2024-03-09T15:25:15.496497+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-03-09T15:25:15.496413+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-03-09T15:25:15.496413+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.496413+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:43.755698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'213","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.835888+0000","last_change":"2024-03-09T15:24:52.836015+0000","last_active":"2024-03-09T15:24:52.835888+0000","last_peered":"2024-03-09T15:24:52.835888+0000","last_clean":"2024-03-09T15:24:52.835888+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:24:52.835888+0000","last_undegraded":"2024-03-09T15:24:52.835888+0000","last_fullsized":"2024-03-09T15:24:52.835888+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-03-09T15:24:52.835746+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-03-09T15:24:52.835746+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.835746+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:24.034553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343410,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":30999,"num_write":1210,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.478368+0000","last_change":"2024-03-09T15:25:19.478418+0000","last_active":"2024-03-09T15:25:19.478368+0000","last_peered":"2024-03-09T15:25:19.478368+0000","last_clean":"2024-03-09T15:25:19.478368+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:25:19.478368+0000","last_undegraded":"2024-03-09T15:25:19.478368+0000","last_fullsized":"2024-03-09T15:25:19.478368+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-03-09T15:25:19.478271+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-03-09T15:25:19.478271+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.478271+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:34.467178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'188","reported_seq":791,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.596462+0000","last_change":"2024-03-09T14:21:54.364838+0000","last_active":"2024-03-09T15:24:45.596462+0000","last_peered":"2024-03-09T15:24:45.596462+0000","last_clean":"2024-03-09T15:24:45.596462+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:24:45.596462+0000","last_undegraded":"2024-03-09T15:24:45.596462+0000","last_fullsized":"2024-03-09T15:24:45.596462+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":358,"num_read_kb":8057,"num_write":1058,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.368946+0000","last_change":"2024-03-09T15:25:21.368976+0000","last_active":"2024-03-09T15:25:21.368946+0000","last_peered":"2024-03-09T15:25:21.368946+0000","last_clean":"2024-03-09T15:25:21.368946+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:25:21.368946+0000","last_undegraded":"2024-03-09T15:25:21.368946+0000","last_fullsized":"2024-03-09T15:25:21.368946+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'125","last_scrub_stamp":"2024-03-09T15:25:21.368852+0000","last_deep_scrub":"260'125","last_deep_scrub_stamp":"2024-03-09T15:25:21.368852+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.368852+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:53.127396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'194","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.701458+0000","last_change":"2024-03-09T15:25:00.701513+0000","last_active":"2024-03-09T15:25:00.701458+0000","last_peered":"2024-03-09T15:25:00.701458+0000","last_clean":"2024-03-09T15:25:00.701458+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:25:00.701458+0000","last_undegraded":"2024-03-09T15:25:00.701458+0000","last_fullsized":"2024-03-09T15:25:00.701458+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-03-09T15:25:00.701355+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-03-09T15:25:00.701355+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.701355+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:44.493825+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867857,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":1771,"num_write":1080,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.472386+0000","last_change":"2024-03-09T15:25:13.472413+0000","last_active":"2024-03-09T15:25:13.472386+0000","last_peered":"2024-03-09T15:25:13.472386+0000","last_clean":"2024-03-09T15:25:13.472386+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:25:13.472386+0000","last_undegraded":"2024-03-09T15:25:13.472386+0000","last_fullsized":"2024-03-09T15:25:13.472386+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-03-09T15:25:13.472286+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-03-09T15:25:13.472286+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.472286+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:26.133764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'195","reported_seq":813,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.650921+0000","last_change":"2024-03-09T14:21:54.362334+0000","last_active":"2024-03-09T15:24:44.650921+0000","last_peered":"2024-03-09T15:24:44.650921+0000","last_clean":"2024-03-09T15:24:44.650921+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:24:44.650921+0000","last_undegraded":"2024-03-09T15:24:44.650921+0000","last_fullsized":"2024-03-09T15:24:44.650921+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:21:53.328909+0000","last_clean_scrub_stamp":"2024-03-09T14:21:53.328909+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":6618,"num_write":1000,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'208","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.458832+0000","last_change":"2024-03-09T15:24:47.458832+0000","last_active":"2024-03-09T15:24:47.458832+0000","last_peered":"2024-03-09T15:24:47.458832+0000","last_clean":"2024-03-09T15:24:47.458832+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:24:47.458832+0000","last_undegraded":"2024-03-09T15:24:47.458832+0000","last_fullsized":"2024-03-09T15:24:47.458832+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'208","last_scrub_stamp":"2024-03-09T15:24:47.458581+0000","last_deep_scrub":"260'208","last_deep_scrub_stamp":"2024-03-09T15:24:47.458581+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.458581+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:31:30.767151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":70161,"num_write":1223,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":929,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.532525+0000","last_change":"2024-03-09T15:25:13.532575+0000","last_active":"2024-03-09T15:25:13.532525+0000","last_peered":"2024-03-09T15:25:13.532525+0000","last_clean":"2024-03-09T15:25:13.532525+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:25:13.532525+0000","last_undegraded":"2024-03-09T15:25:13.532525+0000","last_fullsized":"2024-03-09T15:25:13.532525+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'276","last_scrub_stamp":"2024-03-09T15:25:13.532414+0000","last_deep_scrub":"260'276","last_deep_scrub_stamp":"2024-03-09T15:25:13.532414+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.532414+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:49:11.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'195","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.769635+0000","last_change":"2024-03-09T15:25:12.769701+0000","last_active":"2024-03-09T15:25:12.769635+0000","last_peered":"2024-03-09T15:25:12.769635+0000","last_clean":"2024-03-09T15:25:12.769635+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:25:12.769635+0000","last_undegraded":"2024-03-09T15:25:12.769635+0000","last_fullsized":"2024-03-09T15:25:12.769635+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-03-09T15:25:12.769519+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-03-09T15:25:12.769519+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.769519+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:45.905992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":29809,"num_write":1056,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.754758+0000","last_change":"2024-03-09T15:25:04.754782+0000","last_active":"2024-03-09T15:25:04.754758+0000","last_peered":"2024-03-09T15:25:04.754758+0000","last_clean":"2024-03-09T15:25:04.754758+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:25:04.754758+0000","last_undegraded":"2024-03-09T15:25:04.754758+0000","last_fullsized":"2024-03-09T15:25:04.754758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'82","last_scrub_stamp":"2024-03-09T15:25:04.754671+0000","last_deep_scrub":"260'82","last_deep_scrub_stamp":"2024-03-09T15:25:04.754671+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.754671+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:48:22.436199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5640,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1228,"ondisk_log_size":1228,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2106,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2039,"ondisk_log_size":2039,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":556,"ondisk_log_size":556,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":248436,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":9145,"num_read_kb":11177,"num_write":6541,"num_write_kb":2993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":667596,"num_omap_keys":1550,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1845,"ondisk_log_size":1845,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32356,"num_omap_keys":134,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3757,"ondisk_log_size":3757,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":112174806,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":32019,"num_read_kb":2295864,"num_write":68252,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170090496,"data_stored":170090496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4240,"ondisk_log_size":4240,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":170575,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":174957,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575617,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":23364,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":23924736,"data_stored":21980799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":286390730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575617,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275968,"kb_used_data":37944,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94095872,"statfs":{"total":96636764160,"available":96354172928,"internally_reserved":0,"allocated":38854656,"data_stored":36958563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575618,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126900,"kb_used_data":37484,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94244940,"statfs":{"total":96636764160,"available":96506818560,"internally_reserved":0,"allocated":38383616,"data_stored":36419893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575619,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118904,"kb_used_data":43312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94252936,"statfs":{"total":96636764160,"available":96515006464,"internally_reserved":0,"allocated":44351488,"data_stored":42475464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575620,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241172,"kb_used_data":29516,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94130668,"statfs":{"total":96636764160,"available":96389804032,"internally_reserved":0,"allocated":30224384,"data_stored":28300435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575619,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110248,"kb_used_data":24992,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94261592,"statfs":{"total":96636764160,"available":96523870208,"internally_reserved":0,"allocated":25591808,"data_stored":23689459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575618,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141856,"kb_used_data":34392,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94229984,"statfs":{"total":96636764160,"available":96491503616,"internally_reserved":0,"allocated":35217408,"data_stored":33306448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575616,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254404,"kb_used_data":34428,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94117436,"statfs":{"total":96636764160,"available":96376254464,"internally_reserved":0,"allocated":35254272,"data_stored":33315187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30007296,"data_stored":30007296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16187392,"data_stored":16187392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23441408,"data_stored":23441408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18432000,"data_stored":18432000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24215552,"data_stored":24215552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18083840,"data_stored":18083840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:25:26.867 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.867 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.867 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.867 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.868 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.868 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.868 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.868 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.868 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.869 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.869 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.869 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.869 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.869 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.870 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.870 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.870 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.870 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.870 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.871 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.871 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.871 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.871 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.871 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.872 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.872 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.872 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.872 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.872 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-09T14:35:49.560393+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=49, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.873 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.873 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.873 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.873 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.873 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.873 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.874 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.874 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.874 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.874 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:50:02.632028+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=50, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.874 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:35:54.581229+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=35, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.875 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.875 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.875 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.875 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.875 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.876 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.876 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.876 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.876 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.876 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.876 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.877 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.877 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.877 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.877 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.878 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.878 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.878 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.878 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.878 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.879 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.879 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.879 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.879 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.879 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.880 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.880 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:21:38.278811+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=38, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.880 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.880 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-03-09T14:21:37.277184+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=37, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.880 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.881 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.881 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.881 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.881 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.882 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:21:57.352305+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=57, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.882 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.882 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.882 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.883 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.883 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.883 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.883 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.883 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.884 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.884 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.884 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-09T14:22:01.371333+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=22, tm_sec=1, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.884 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:21:55.338285+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=55, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.884 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.885 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.885 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-09T14:21:59.364155+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=59, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.885 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.885 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.886 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.886 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.886 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.886 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-09T14:21:53.328909+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=21, tm_sec=53, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=24, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:25:26.886 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:25:46.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:25:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-03-09T15:25:47.251 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-03-09T15:25:47.254 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":2178,"stamp":"2024-03-09T15:25:47.178286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":146582508,"num_objects":538,"num_object_clones":0,"num_object_copies":1298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":151082,"num_read_kb":2744375,"num_write":128593,"num_write_kb":2398318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":56,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":721338,"num_omap_keys":1751,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13950,"ondisk_log_size":13950,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1572504,"kb_used_data":265432,"kb_used_omap":12,"kb_used_meta":1306995,"kb_avail":753402216,"statfs":{"total":773094113280,"available":771483869184,"internally_reserved":0,"allocated":271802368,"data_stored":256446248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1338363440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004783"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:32.857990+0000","last_change":"2024-03-09T15:25:32.858013+0000","last_active":"2024-03-09T15:25:32.857990+0000","last_peered":"2024-03-09T15:25:32.857990+0000","last_clean":"2024-03-09T15:25:32.857990+0000","last_became_active":"2024-03-09T14:50:03.656540+0000","last_became_peered":"2024-03-09T14:50:03.656540+0000","last_unstale":"2024-03-09T15:25:32.857990+0000","last_undegraded":"2024-03-09T15:25:32.857990+0000","last_fullsized":"2024-03-09T15:25:32.857990+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:32.857904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:32.857904+0000","last_clean_scrub_stamp":"2024-03-09T15:25:32.857904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:33.171590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"260'9","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:28.897558+0000","last_change":"2024-03-09T15:25:28.897630+0000","last_active":"2024-03-09T15:25:28.897558+0000","last_peered":"2024-03-09T15:25:28.897558+0000","last_clean":"2024-03-09T15:25:28.897558+0000","last_became_active":"2024-03-09T14:35:55.601703+0000","last_became_peered":"2024-03-09T14:35:55.601703+0000","last_unstale":"2024-03-09T15:25:28.897558+0000","last_undegraded":"2024-03-09T15:25:28.897558+0000","last_fullsized":"2024-03-09T15:25:28.897558+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:25:28.897439+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:25:28.897439+0000","last_clean_scrub_stamp":"2024-03-09T15:25:28.897439+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:43.121383+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.522125+0000","last_change":"2024-03-09T15:24:45.522159+0000","last_active":"2024-03-09T15:24:45.522125+0000","last_peered":"2024-03-09T15:24:45.522125+0000","last_clean":"2024-03-09T15:24:45.522125+0000","last_became_active":"2024-03-09T14:35:50.588559+0000","last_became_peered":"2024-03-09T14:35:50.588559+0000","last_unstale":"2024-03-09T15:24:45.522125+0000","last_undegraded":"2024-03-09T15:24:45.522125+0000","last_fullsized":"2024-03-09T15:24:45.522125+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:45.522026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:45.522026+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.522026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:01.025473+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"260'14","reported_seq":97,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:42.400651+0000","last_change":"2024-03-09T15:24:42.400651+0000","last_active":"2024-03-09T15:24:42.400651+0000","last_peered":"2024-03-09T15:24:42.400651+0000","last_clean":"2024-03-09T15:24:42.400651+0000","last_became_active":"2024-03-09T14:31:01.148693+0000","last_became_peered":"2024-03-09T14:31:01.148693+0000","last_unstale":"2024-03-09T15:24:42.400651+0000","last_undegraded":"2024-03-09T15:24:42.400651+0000","last_fullsized":"2024-03-09T15:24:42.400651+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:42.400547+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:42.400547+0000","last_clean_scrub_stamp":"2024-03-09T15:24:42.400547+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:59.057207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.684578+0000","last_change":"2024-03-09T15:25:15.684621+0000","last_active":"2024-03-09T15:25:15.684578+0000","last_peered":"2024-03-09T15:25:15.684578+0000","last_clean":"2024-03-09T15:25:15.684578+0000","last_became_active":"2024-03-09T14:50:03.659266+0000","last_became_peered":"2024-03-09T14:50:03.659266+0000","last_unstale":"2024-03-09T15:25:15.684578+0000","last_undegraded":"2024-03-09T15:25:15.684578+0000","last_fullsized":"2024-03-09T15:25:15.684578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:15.684464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:15.684464+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.684464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:26.930217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:28.255469+0000","last_change":"2024-03-09T15:25:28.255506+0000","last_active":"2024-03-09T15:25:28.255469+0000","last_peered":"2024-03-09T15:25:28.255469+0000","last_clean":"2024-03-09T15:25:28.255469+0000","last_became_active":"2024-03-09T14:35:55.597552+0000","last_became_peered":"2024-03-09T14:35:55.597552+0000","last_unstale":"2024-03-09T15:25:28.255469+0000","last_undegraded":"2024-03-09T15:25:28.255469+0000","last_fullsized":"2024-03-09T15:25:28.255469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:28.255347+0000","last_clean_scrub_stamp":"2024-03-09T15:25:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:04.942121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"260'3","reported_seq":61,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.419467+0000","last_change":"2024-03-09T15:24:48.419511+0000","last_active":"2024-03-09T15:24:48.419467+0000","last_peered":"2024-03-09T15:24:48.419467+0000","last_clean":"2024-03-09T15:24:48.419467+0000","last_became_active":"2024-03-09T14:35:50.585298+0000","last_became_peered":"2024-03-09T14:35:50.585298+0000","last_unstale":"2024-03-09T15:24:48.419467+0000","last_undegraded":"2024-03-09T15:24:48.419467+0000","last_fullsized":"2024-03-09T15:24:48.419467+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:48.419366+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:48.419366+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.419366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:11.692358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"260'41","reported_seq":166,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.717456+0000","last_change":"2024-03-09T15:24:58.717456+0000","last_active":"2024-03-09T15:24:58.717456+0000","last_peered":"2024-03-09T15:24:58.717456+0000","last_clean":"2024-03-09T15:24:58.717456+0000","last_became_active":"2024-03-09T14:31:01.138654+0000","last_became_peered":"2024-03-09T14:31:01.138654+0000","last_unstale":"2024-03-09T15:24:58.717456+0000","last_undegraded":"2024-03-09T15:24:58.717456+0000","last_fullsized":"2024-03-09T15:24:58.717456+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'41","last_scrub_stamp":"2024-03-09T15:24:58.717334+0000","last_deep_scrub":"260'41","last_deep_scrub_stamp":"2024-03-09T15:24:58.717334+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.717334+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:04.291118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.739701+0000","last_change":"2024-03-09T15:25:21.739728+0000","last_active":"2024-03-09T15:25:21.739701+0000","last_peered":"2024-03-09T15:25:21.739701+0000","last_clean":"2024-03-09T15:25:21.739701+0000","last_became_active":"2024-03-09T14:50:03.653452+0000","last_became_peered":"2024-03-09T14:50:03.653452+0000","last_unstale":"2024-03-09T15:25:21.739701+0000","last_undegraded":"2024-03-09T15:25:21.739701+0000","last_fullsized":"2024-03-09T15:25:21.739701+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:21.739582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:21.739582+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.739582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:00.133894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"260'2","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:36.498015+0000","last_change":"2024-03-09T15:25:36.498041+0000","last_active":"2024-03-09T15:25:36.498015+0000","last_peered":"2024-03-09T15:25:36.498015+0000","last_clean":"2024-03-09T15:25:36.498015+0000","last_became_active":"2024-03-09T14:35:55.634755+0000","last_became_peered":"2024-03-09T14:35:55.634755+0000","last_unstale":"2024-03-09T15:25:36.498015+0000","last_undegraded":"2024-03-09T15:25:36.498015+0000","last_fullsized":"2024-03-09T15:25:36.498015+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:36.497926+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:36.497926+0000","last_clean_scrub_stamp":"2024-03-09T15:25:36.497926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:49.427827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'9","reported_seq":73,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.588330+0000","last_change":"2024-03-09T15:25:09.588354+0000","last_active":"2024-03-09T15:25:09.588330+0000","last_peered":"2024-03-09T15:25:09.588330+0000","last_clean":"2024-03-09T15:25:09.588330+0000","last_became_active":"2024-03-09T14:35:50.591943+0000","last_became_peered":"2024-03-09T14:35:50.591943+0000","last_unstale":"2024-03-09T15:25:09.588330+0000","last_undegraded":"2024-03-09T15:25:09.588330+0000","last_fullsized":"2024-03-09T15:25:09.588330+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:25:09.588233+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:25:09.588233+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.588233+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:15.832508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":24,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'25","reported_seq":118,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.486516+0000","last_change":"2024-03-09T15:24:50.486571+0000","last_active":"2024-03-09T15:24:50.486516+0000","last_peered":"2024-03-09T15:24:50.486516+0000","last_clean":"2024-03-09T15:24:50.486516+0000","last_became_active":"2024-03-09T14:31:01.143756+0000","last_became_peered":"2024-03-09T14:31:01.143756+0000","last_unstale":"2024-03-09T15:24:50.486516+0000","last_undegraded":"2024-03-09T15:24:50.486516+0000","last_fullsized":"2024-03-09T15:24:50.486516+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-03-09T15:24:50.486408+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-03-09T15:24:50.486408+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.486408+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:55.168821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":65,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:46.430518+0000","last_change":"2024-03-09T15:25:46.430542+0000","last_active":"2024-03-09T15:25:46.430518+0000","last_peered":"2024-03-09T15:25:46.430518+0000","last_clean":"2024-03-09T15:25:46.430518+0000","last_became_active":"2024-03-09T14:50:03.663930+0000","last_became_peered":"2024-03-09T14:50:03.663930+0000","last_unstale":"2024-03-09T15:25:46.430518+0000","last_undegraded":"2024-03-09T15:25:46.430518+0000","last_fullsized":"2024-03-09T15:25:46.430518+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:46.430419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:46.430419+0000","last_clean_scrub_stamp":"2024-03-09T15:25:46.430419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:11.045889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'4","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.402108+0000","last_change":"2024-03-09T15:25:13.402175+0000","last_active":"2024-03-09T15:25:13.402108+0000","last_peered":"2024-03-09T15:25:13.402108+0000","last_clean":"2024-03-09T15:25:13.402108+0000","last_became_active":"2024-03-09T14:35:55.632799+0000","last_became_peered":"2024-03-09T14:35:55.632799+0000","last_unstale":"2024-03-09T15:25:13.402108+0000","last_undegraded":"2024-03-09T15:25:13.402108+0000","last_fullsized":"2024-03-09T15:25:13.402108+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-03-09T15:25:13.401993+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-03-09T15:25:13.401993+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.401993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:48:46.625514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6192,"num_write":4,"num_write_kb":3120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.097878+0000","last_change":"2024-03-09T15:24:56.097903+0000","last_active":"2024-03-09T15:24:56.097878+0000","last_peered":"2024-03-09T15:24:56.097878+0000","last_clean":"2024-03-09T15:24:56.097878+0000","last_became_active":"2024-03-09T14:35:50.588126+0000","last_became_peered":"2024-03-09T14:35:50.588126+0000","last_unstale":"2024-03-09T15:24:56.097878+0000","last_undegraded":"2024-03-09T15:24:56.097878+0000","last_fullsized":"2024-03-09T15:24:56.097878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.097789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.097789+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.097789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:31:38.020173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"260'42","reported_seq":163,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.524498+0000","last_change":"2024-03-09T15:24:46.524522+0000","last_active":"2024-03-09T15:24:46.524498+0000","last_peered":"2024-03-09T15:24:46.524498+0000","last_clean":"2024-03-09T15:24:46.524498+0000","last_became_active":"2024-03-09T14:31:01.143278+0000","last_became_peered":"2024-03-09T14:31:01.143278+0000","last_unstale":"2024-03-09T15:24:46.524498+0000","last_undegraded":"2024-03-09T15:24:46.524498+0000","last_fullsized":"2024-03-09T15:24:46.524498+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-03-09T15:24:46.524416+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-03-09T15:24:46.524416+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.524416+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:58.615066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":124,"num_write":74,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:44.444237+0000","last_change":"2024-03-09T15:25:44.444264+0000","last_active":"2024-03-09T15:25:44.444237+0000","last_peered":"2024-03-09T15:25:44.444237+0000","last_clean":"2024-03-09T15:25:44.444237+0000","last_became_active":"2024-03-09T14:50:03.654873+0000","last_became_peered":"2024-03-09T14:50:03.654873+0000","last_unstale":"2024-03-09T15:25:44.444237+0000","last_undegraded":"2024-03-09T15:25:44.444237+0000","last_fullsized":"2024-03-09T15:25:44.444237+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:44.444146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:44.444146+0000","last_clean_scrub_stamp":"2024-03-09T15:25:44.444146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:13.606378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:29.888666+0000","last_change":"2024-03-09T15:25:29.888709+0000","last_active":"2024-03-09T15:25:29.888666+0000","last_peered":"2024-03-09T15:25:29.888666+0000","last_clean":"2024-03-09T15:25:29.888666+0000","last_became_active":"2024-03-09T14:35:55.603620+0000","last_became_peered":"2024-03-09T14:35:55.603620+0000","last_unstale":"2024-03-09T15:25:29.888666+0000","last_undegraded":"2024-03-09T15:25:29.888666+0000","last_fullsized":"2024-03-09T15:25:29.888666+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:29.888540+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:29.888540+0000","last_clean_scrub_stamp":"2024-03-09T15:25:29.888540+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:47.241853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":64,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.628724+0000","last_change":"2024-03-09T15:24:56.628747+0000","last_active":"2024-03-09T15:24:56.628724+0000","last_peered":"2024-03-09T15:24:56.628724+0000","last_clean":"2024-03-09T15:24:56.628724+0000","last_became_active":"2024-03-09T14:35:50.585879+0000","last_became_peered":"2024-03-09T14:35:50.585879+0000","last_unstale":"2024-03-09T15:24:56.628724+0000","last_undegraded":"2024-03-09T15:24:56.628724+0000","last_fullsized":"2024-03-09T15:24:56.628724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:56.628637+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:56.628637+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.628637+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:17.119574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"257'46","reported_seq":173,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.565793+0000","last_change":"2024-03-09T15:24:48.565834+0000","last_active":"2024-03-09T15:24:48.565793+0000","last_peered":"2024-03-09T15:24:48.565793+0000","last_clean":"2024-03-09T15:24:48.565793+0000","last_became_active":"2024-03-09T14:31:01.141551+0000","last_became_peered":"2024-03-09T14:31:01.141551+0000","last_unstale":"2024-03-09T15:24:48.565793+0000","last_undegraded":"2024-03-09T15:24:48.565793+0000","last_fullsized":"2024-03-09T15:24:48.565793+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'46","last_scrub_stamp":"2024-03-09T15:24:48.565702+0000","last_deep_scrub":"257'46","last_deep_scrub_stamp":"2024-03-09T15:24:48.565702+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.565702+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:18:54.025559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":136,"num_write":78,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:25.721438+0000","last_change":"2024-03-09T15:25:25.721438+0000","last_active":"2024-03-09T15:25:25.721438+0000","last_peered":"2024-03-09T15:25:25.721438+0000","last_clean":"2024-03-09T15:25:25.721438+0000","last_became_active":"2024-03-09T14:50:03.661206+0000","last_became_peered":"2024-03-09T14:50:03.661206+0000","last_unstale":"2024-03-09T15:25:25.721438+0000","last_undegraded":"2024-03-09T15:25:25.721438+0000","last_fullsized":"2024-03-09T15:25:25.721438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:25.721309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:25.721309+0000","last_clean_scrub_stamp":"2024-03-09T15:25:25.721309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:31.914666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"260'3","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.721702+0000","last_change":"2024-03-09T15:25:17.721738+0000","last_active":"2024-03-09T15:25:17.721702+0000","last_peered":"2024-03-09T15:25:17.721702+0000","last_clean":"2024-03-09T15:25:17.721702+0000","last_became_active":"2024-03-09T14:35:55.603623+0000","last_became_peered":"2024-03-09T14:35:55.603623+0000","last_unstale":"2024-03-09T15:25:17.721702+0000","last_undegraded":"2024-03-09T15:25:17.721702+0000","last_fullsized":"2024-03-09T15:25:17.721702+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:25:17.721599+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:25:17.721599+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.721599+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:29.665369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"260'12","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.031565+0000","last_change":"2024-03-09T15:24:48.031610+0000","last_active":"2024-03-09T15:24:48.031565+0000","last_peered":"2024-03-09T15:24:48.031565+0000","last_clean":"2024-03-09T15:24:48.031565+0000","last_became_active":"2024-03-09T14:35:50.584103+0000","last_became_peered":"2024-03-09T14:35:50.584103+0000","last_unstale":"2024-03-09T15:24:48.031565+0000","last_undegraded":"2024-03-09T15:24:48.031565+0000","last_fullsized":"2024-03-09T15:24:48.031565+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:48.031477+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:48.031477+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.031477+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:27.977465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"260'25","reported_seq":116,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.827683+0000","last_change":"2024-03-09T15:24:48.827736+0000","last_active":"2024-03-09T15:24:48.827683+0000","last_peered":"2024-03-09T15:24:48.827683+0000","last_clean":"2024-03-09T15:24:48.827683+0000","last_became_active":"2024-03-09T14:31:01.137521+0000","last_became_peered":"2024-03-09T14:31:01.137521+0000","last_unstale":"2024-03-09T15:24:48.827683+0000","last_undegraded":"2024-03-09T15:24:48.827683+0000","last_fullsized":"2024-03-09T15:24:48.827683+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'25","last_scrub_stamp":"2024-03-09T15:24:48.827568+0000","last_deep_scrub":"260'25","last_deep_scrub_stamp":"2024-03-09T15:24:48.827568+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.827568+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:08.305798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":59,"num_write":50,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"260'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:38.631432+0000","last_change":"2024-03-09T15:25:38.631462+0000","last_active":"2024-03-09T15:25:38.631432+0000","last_peered":"2024-03-09T15:25:38.631432+0000","last_clean":"2024-03-09T15:25:38.631432+0000","last_became_active":"2024-03-09T14:50:03.659363+0000","last_became_peered":"2024-03-09T14:50:03.659363+0000","last_unstale":"2024-03-09T15:25:38.631432+0000","last_undegraded":"2024-03-09T15:25:38.631432+0000","last_fullsized":"2024-03-09T15:25:38.631432+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:38.631335+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:38.631335+0000","last_clean_scrub_stamp":"2024-03-09T15:25:38.631335+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:28.858609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"260'5","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.716361+0000","last_change":"2024-03-09T15:25:19.716438+0000","last_active":"2024-03-09T15:25:19.716361+0000","last_peered":"2024-03-09T15:25:19.716361+0000","last_clean":"2024-03-09T15:25:19.716361+0000","last_became_active":"2024-03-09T14:35:55.605146+0000","last_became_peered":"2024-03-09T14:35:55.605146+0000","last_unstale":"2024-03-09T15:25:19.716361+0000","last_undegraded":"2024-03-09T15:25:19.716361+0000","last_fullsized":"2024-03-09T15:25:19.716361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:19.716268+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:19.716268+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.716268+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:31.176829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"257'2","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.083859+0000","last_change":"2024-03-09T15:24:52.083889+0000","last_active":"2024-03-09T15:24:52.083859+0000","last_peered":"2024-03-09T15:24:52.083859+0000","last_clean":"2024-03-09T15:24:52.083859+0000","last_became_active":"2024-03-09T14:35:50.584378+0000","last_became_peered":"2024-03-09T14:35:50.584378+0000","last_unstale":"2024-03-09T15:24:52.083859+0000","last_undegraded":"2024-03-09T15:24:52.083859+0000","last_fullsized":"2024-03-09T15:24:52.083859+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:24:52.083766+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:24:52.083766+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.083766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:41:18.001798+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"260'51","reported_seq":189,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.479353+0000","last_change":"2024-03-09T15:24:47.479381+0000","last_active":"2024-03-09T15:24:47.479353+0000","last_peered":"2024-03-09T15:24:47.479353+0000","last_clean":"2024-03-09T15:24:47.479353+0000","last_became_active":"2024-03-09T14:31:01.144510+0000","last_became_peered":"2024-03-09T14:31:01.144510+0000","last_unstale":"2024-03-09T15:24:47.479353+0000","last_undegraded":"2024-03-09T15:24:47.479353+0000","last_fullsized":"2024-03-09T15:24:47.479353+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'51","last_scrub_stamp":"2024-03-09T15:24:47.479255+0000","last_deep_scrub":"260'51","last_deep_scrub_stamp":"2024-03-09T15:24:47.479255+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.479255+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:59.761444+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":221,"num_read_kb":156,"num_write":87,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:43.643825+0000","last_change":"2024-03-09T15:25:43.643852+0000","last_active":"2024-03-09T15:25:43.643825+0000","last_peered":"2024-03-09T15:25:43.643825+0000","last_clean":"2024-03-09T15:25:43.643825+0000","last_became_active":"2024-03-09T14:50:03.664306+0000","last_became_peered":"2024-03-09T14:50:03.664306+0000","last_unstale":"2024-03-09T15:25:43.643825+0000","last_undegraded":"2024-03-09T15:25:43.643825+0000","last_fullsized":"2024-03-09T15:25:43.643825+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:43.643731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:43.643731+0000","last_clean_scrub_stamp":"2024-03-09T15:25:43.643731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:53:43.072586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":50,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.419331+0000","last_change":"2024-03-09T15:25:01.419369+0000","last_active":"2024-03-09T15:25:01.419331+0000","last_peered":"2024-03-09T15:25:01.419331+0000","last_clean":"2024-03-09T15:25:01.419331+0000","last_became_active":"2024-03-09T14:35:55.606358+0000","last_became_peered":"2024-03-09T14:35:55.606358+0000","last_unstale":"2024-03-09T15:25:01.419331+0000","last_undegraded":"2024-03-09T15:25:01.419331+0000","last_fullsized":"2024-03-09T15:25:01.419331+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:01.419231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:01.419231+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.419231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:30.487865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"257'3","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.590774+0000","last_change":"2024-03-09T15:25:04.590810+0000","last_active":"2024-03-09T15:25:04.590774+0000","last_peered":"2024-03-09T15:25:04.590774+0000","last_clean":"2024-03-09T15:25:04.590774+0000","last_became_active":"2024-03-09T14:35:50.593566+0000","last_became_peered":"2024-03-09T14:35:50.593566+0000","last_unstale":"2024-03-09T15:25:04.590774+0000","last_undegraded":"2024-03-09T15:25:04.590774+0000","last_fullsized":"2024-03-09T15:25:04.590774+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:25:04.590684+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:25:04.590684+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.590684+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:56.402715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"260'58","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.406552+0000","last_change":"2024-03-09T15:24:47.406588+0000","last_active":"2024-03-09T15:24:47.406552+0000","last_peered":"2024-03-09T15:24:47.406552+0000","last_clean":"2024-03-09T15:24:47.406552+0000","last_became_active":"2024-03-09T14:31:01.134780+0000","last_became_peered":"2024-03-09T14:31:01.134780+0000","last_unstale":"2024-03-09T15:24:47.406552+0000","last_undegraded":"2024-03-09T15:24:47.406552+0000","last_fullsized":"2024-03-09T15:24:47.406552+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'58","last_scrub_stamp":"2024-03-09T15:24:47.406438+0000","last_deep_scrub":"260'58","last_deep_scrub_stamp":"2024-03-09T15:24:47.406438+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.406438+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:13.779948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":167,"num_write":119,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:23.759797+0000","last_change":"2024-03-09T15:25:23.759820+0000","last_active":"2024-03-09T15:25:23.759797+0000","last_peered":"2024-03-09T15:25:23.759797+0000","last_clean":"2024-03-09T15:25:23.759797+0000","last_became_active":"2024-03-09T14:50:03.657047+0000","last_became_peered":"2024-03-09T14:50:03.657047+0000","last_unstale":"2024-03-09T15:25:23.759797+0000","last_undegraded":"2024-03-09T15:25:23.759797+0000","last_fullsized":"2024-03-09T15:25:23.759797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:23.759708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:23.759708+0000","last_clean_scrub_stamp":"2024-03-09T15:25:23.759708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:46:04.215436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"260'12","reported_seq":78,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:40.368374+0000","last_change":"2024-03-09T15:25:40.368418+0000","last_active":"2024-03-09T15:25:40.368374+0000","last_peered":"2024-03-09T15:25:40.368374+0000","last_clean":"2024-03-09T15:25:40.368374+0000","last_became_active":"2024-03-09T14:35:55.633750+0000","last_became_peered":"2024-03-09T14:35:55.633750+0000","last_unstale":"2024-03-09T15:25:40.368374+0000","last_undegraded":"2024-03-09T15:25:40.368374+0000","last_fullsized":"2024-03-09T15:25:40.368374+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:25:40.368280+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:25:40.368280+0000","last_clean_scrub_stamp":"2024-03-09T15:25:40.368280+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:19:54.368262+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":26626,"num_write":20,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"260'12","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.650470+0000","last_change":"2024-03-09T15:24:52.650470+0000","last_active":"2024-03-09T15:24:52.650470+0000","last_peered":"2024-03-09T15:24:52.650470+0000","last_clean":"2024-03-09T15:24:52.650470+0000","last_became_active":"2024-03-09T14:35:50.582334+0000","last_became_peered":"2024-03-09T14:35:50.582334+0000","last_unstale":"2024-03-09T15:24:52.650470+0000","last_undegraded":"2024-03-09T15:24:52.650470+0000","last_fullsized":"2024-03-09T15:24:52.650470+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:52.650294+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:52.650294+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.650294+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:30.081533+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":40964,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"260'33","reported_seq":146,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.450895+0000","last_change":"2024-03-09T15:24:45.450923+0000","last_active":"2024-03-09T15:24:45.450895+0000","last_peered":"2024-03-09T15:24:45.450895+0000","last_clean":"2024-03-09T15:24:45.450895+0000","last_became_active":"2024-03-09T14:31:01.148298+0000","last_became_peered":"2024-03-09T14:31:01.148298+0000","last_unstale":"2024-03-09T15:24:45.450895+0000","last_undegraded":"2024-03-09T15:24:45.450895+0000","last_fullsized":"2024-03-09T15:24:45.450895+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'33","last_scrub_stamp":"2024-03-09T15:24:45.450792+0000","last_deep_scrub":"260'33","last_deep_scrub_stamp":"2024-03-09T15:24:45.450792+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.450792+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:44.369163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":107,"num_write":61,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.698741+0000","last_change":"2024-03-09T15:25:12.698772+0000","last_active":"2024-03-09T15:25:12.698741+0000","last_peered":"2024-03-09T15:25:12.698741+0000","last_clean":"2024-03-09T15:25:12.698741+0000","last_became_active":"2024-03-09T14:50:03.654860+0000","last_became_peered":"2024-03-09T14:50:03.654860+0000","last_unstale":"2024-03-09T15:25:12.698741+0000","last_undegraded":"2024-03-09T15:25:12.698741+0000","last_fullsized":"2024-03-09T15:25:12.698741+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:12.698651+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:12.698651+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.698651+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:11.319847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"257'3","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.398056+0000","last_change":"2024-03-09T15:25:09.398056+0000","last_active":"2024-03-09T15:25:09.398056+0000","last_peered":"2024-03-09T15:25:09.398056+0000","last_clean":"2024-03-09T15:25:09.398056+0000","last_became_active":"2024-03-09T14:35:55.633308+0000","last_became_peered":"2024-03-09T14:35:55.633308+0000","last_unstale":"2024-03-09T15:25:09.398056+0000","last_undegraded":"2024-03-09T15:25:09.398056+0000","last_fullsized":"2024-03-09T15:25:09.398056+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:25:09.397841+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:25:09.397841+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.397841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:41.109102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"257'3","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.481646+0000","last_change":"2024-03-09T15:24:49.481688+0000","last_active":"2024-03-09T15:24:49.481646+0000","last_peered":"2024-03-09T15:24:49.481646+0000","last_clean":"2024-03-09T15:24:49.481646+0000","last_became_active":"2024-03-09T14:35:50.584791+0000","last_became_peered":"2024-03-09T14:35:50.584791+0000","last_unstale":"2024-03-09T15:24:49.481646+0000","last_undegraded":"2024-03-09T15:24:49.481646+0000","last_fullsized":"2024-03-09T15:24:49.481646+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:24:49.481517+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:24:49.481517+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.481517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:06:43.451279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"260'20","reported_seq":104,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.537408+0000","last_change":"2024-03-09T15:24:47.537434+0000","last_active":"2024-03-09T15:24:47.537408+0000","last_peered":"2024-03-09T15:24:47.537408+0000","last_clean":"2024-03-09T15:24:47.537408+0000","last_became_active":"2024-03-09T14:31:01.142718+0000","last_became_peered":"2024-03-09T14:31:01.142718+0000","last_unstale":"2024-03-09T15:24:47.537408+0000","last_undegraded":"2024-03-09T15:24:47.537408+0000","last_fullsized":"2024-03-09T15:24:47.537408+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'20","last_scrub_stamp":"2024-03-09T15:24:47.537299+0000","last_deep_scrub":"260'20","last_deep_scrub_stamp":"2024-03-09T15:24:47.537299+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.537299+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:09.169841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":42,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.509799+0000","last_change":"2024-03-09T15:25:10.509846+0000","last_active":"2024-03-09T15:25:10.509799+0000","last_peered":"2024-03-09T15:25:10.509799+0000","last_clean":"2024-03-09T15:25:10.509799+0000","last_became_active":"2024-03-09T14:50:03.657489+0000","last_became_peered":"2024-03-09T14:50:03.657489+0000","last_unstale":"2024-03-09T15:25:10.509799+0000","last_undegraded":"2024-03-09T15:25:10.509799+0000","last_fullsized":"2024-03-09T15:25:10.509799+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.509700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.509700+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.509700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:25.573280+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"260'6","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:41.386891+0000","last_change":"2024-03-09T15:25:41.386945+0000","last_active":"2024-03-09T15:25:41.386891+0000","last_peered":"2024-03-09T15:25:41.386891+0000","last_clean":"2024-03-09T15:25:41.386891+0000","last_became_active":"2024-03-09T14:35:55.635721+0000","last_became_peered":"2024-03-09T14:35:55.635721+0000","last_unstale":"2024-03-09T15:25:41.386891+0000","last_undegraded":"2024-03-09T15:25:41.386891+0000","last_fullsized":"2024-03-09T15:25:41.386891+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:25:41.386750+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:25:41.386750+0000","last_clean_scrub_stamp":"2024-03-09T15:25:41.386750+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:22:19.750513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.631382+0000","last_change":"2024-03-09T15:25:10.631410+0000","last_active":"2024-03-09T15:25:10.631382+0000","last_peered":"2024-03-09T15:25:10.631382+0000","last_clean":"2024-03-09T15:25:10.631382+0000","last_became_active":"2024-03-09T14:35:50.592668+0000","last_became_peered":"2024-03-09T14:35:50.592668+0000","last_unstale":"2024-03-09T15:25:10.631382+0000","last_undegraded":"2024-03-09T15:25:10.631382+0000","last_fullsized":"2024-03-09T15:25:10.631382+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.631274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.631274+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.631274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:53.728586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'48","reported_seq":177,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.717930+0000","last_change":"2024-03-09T15:24:56.717957+0000","last_active":"2024-03-09T15:24:56.717930+0000","last_peered":"2024-03-09T15:24:56.717930+0000","last_clean":"2024-03-09T15:24:56.717930+0000","last_became_active":"2024-03-09T14:31:01.133724+0000","last_became_peered":"2024-03-09T14:31:01.133724+0000","last_unstale":"2024-03-09T15:24:56.717930+0000","last_undegraded":"2024-03-09T15:24:56.717930+0000","last_fullsized":"2024-03-09T15:24:56.717930+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:56.717838+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:56.717838+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.717838+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:47.629611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":140,"num_write":80,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:31.838543+0000","last_change":"2024-03-09T15:25:31.838572+0000","last_active":"2024-03-09T15:25:31.838543+0000","last_peered":"2024-03-09T15:25:31.838543+0000","last_clean":"2024-03-09T15:25:31.838543+0000","last_became_active":"2024-03-09T14:50:03.654095+0000","last_became_peered":"2024-03-09T14:50:03.654095+0000","last_unstale":"2024-03-09T15:25:31.838543+0000","last_undegraded":"2024-03-09T15:25:31.838543+0000","last_fullsized":"2024-03-09T15:25:31.838543+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:31.838449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:31.838449+0000","last_clean_scrub_stamp":"2024-03-09T15:25:31.838449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:43.719116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":51,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:31.166202+0000","last_change":"2024-03-09T15:25:31.166225+0000","last_active":"2024-03-09T15:25:31.166202+0000","last_peered":"2024-03-09T15:25:31.166202+0000","last_clean":"2024-03-09T15:25:31.166202+0000","last_became_active":"2024-03-09T14:35:55.603910+0000","last_became_peered":"2024-03-09T14:35:55.603910+0000","last_unstale":"2024-03-09T15:25:31.166202+0000","last_undegraded":"2024-03-09T15:25:31.166202+0000","last_fullsized":"2024-03-09T15:25:31.166202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:31.166105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:31.166105+0000","last_clean_scrub_stamp":"2024-03-09T15:25:31.166105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:44:23.222818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.507131+0000","last_change":"2024-03-09T15:24:48.507155+0000","last_active":"2024-03-09T15:24:48.507131+0000","last_peered":"2024-03-09T15:24:48.507131+0000","last_clean":"2024-03-09T15:24:48.507131+0000","last_became_active":"2024-03-09T14:35:50.584951+0000","last_became_peered":"2024-03-09T14:35:50.584951+0000","last_unstale":"2024-03-09T15:24:48.507131+0000","last_undegraded":"2024-03-09T15:24:48.507131+0000","last_fullsized":"2024-03-09T15:24:48.507131+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:48.507040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:48.507040+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.507040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:49.958161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"260'68","reported_seq":227,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.632388+0000","last_change":"2024-03-09T15:24:56.632388+0000","last_active":"2024-03-09T15:24:56.632388+0000","last_peered":"2024-03-09T15:24:56.632388+0000","last_clean":"2024-03-09T15:24:56.632388+0000","last_became_active":"2024-03-09T14:31:01.137345+0000","last_became_peered":"2024-03-09T14:31:01.137345+0000","last_unstale":"2024-03-09T15:24:56.632388+0000","last_undegraded":"2024-03-09T15:24:56.632388+0000","last_fullsized":"2024-03-09T15:24:56.632388+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'68","last_scrub_stamp":"2024-03-09T15:24:56.632230+0000","last_deep_scrub":"260'68","last_deep_scrub_stamp":"2024-03-09T15:24:56.632230+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.632230+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:56:00.995890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":287,"num_read_kb":203,"num_write":113,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:43.411093+0000","last_change":"2024-03-09T15:25:43.411134+0000","last_active":"2024-03-09T15:25:43.411093+0000","last_peered":"2024-03-09T15:25:43.411093+0000","last_clean":"2024-03-09T15:25:43.411093+0000","last_became_active":"2024-03-09T14:50:03.655251+0000","last_became_peered":"2024-03-09T14:50:03.655251+0000","last_unstale":"2024-03-09T15:25:43.411093+0000","last_undegraded":"2024-03-09T15:25:43.411093+0000","last_fullsized":"2024-03-09T15:25:43.411093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:43.410982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:43.410982+0000","last_clean_scrub_stamp":"2024-03-09T15:25:43.410982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:52:39.567988+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"257'2","reported_seq":56,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.784072+0000","last_change":"2024-03-09T15:25:21.784098+0000","last_active":"2024-03-09T15:25:21.784072+0000","last_peered":"2024-03-09T15:25:21.784072+0000","last_clean":"2024-03-09T15:25:21.784072+0000","last_became_active":"2024-03-09T14:35:55.606548+0000","last_became_peered":"2024-03-09T14:35:55.606548+0000","last_unstale":"2024-03-09T15:25:21.784072+0000","last_undegraded":"2024-03-09T15:25:21.784072+0000","last_fullsized":"2024-03-09T15:25:21.784072+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:25:21.783980+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:25:21.783980+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.783980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:28.271672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.046238+0000","last_change":"2024-03-09T15:25:00.046263+0000","last_active":"2024-03-09T15:25:00.046238+0000","last_peered":"2024-03-09T15:25:00.046238+0000","last_clean":"2024-03-09T15:25:00.046238+0000","last_became_active":"2024-03-09T14:35:50.590365+0000","last_became_peered":"2024-03-09T14:35:50.590365+0000","last_unstale":"2024-03-09T15:25:00.046238+0000","last_undegraded":"2024-03-09T15:25:00.046238+0000","last_fullsized":"2024-03-09T15:25:00.046238+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.046150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.046150+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.046150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:46:06.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"260'12","reported_seq":93,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.658475+0000","last_change":"2024-03-09T15:24:57.658502+0000","last_active":"2024-03-09T15:24:57.658475+0000","last_peered":"2024-03-09T15:24:57.658475+0000","last_clean":"2024-03-09T15:24:57.658475+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:24:57.658475+0000","last_undegraded":"2024-03-09T15:24:57.658475+0000","last_fullsized":"2024-03-09T15:24:57.658475+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'12","last_scrub_stamp":"2024-03-09T15:24:57.658385+0000","last_deep_scrub":"260'12","last_deep_scrub_stamp":"2024-03-09T15:24:57.658385+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.658385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:19.298012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":35,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:40.564217+0000","last_change":"2024-03-09T15:25:40.564239+0000","last_active":"2024-03-09T15:25:40.564217+0000","last_peered":"2024-03-09T15:25:40.564217+0000","last_clean":"2024-03-09T15:25:40.564217+0000","last_became_active":"2024-03-09T14:50:03.659976+0000","last_became_peered":"2024-03-09T14:50:03.659976+0000","last_unstale":"2024-03-09T15:25:40.564217+0000","last_undegraded":"2024-03-09T15:25:40.564217+0000","last_fullsized":"2024-03-09T15:25:40.564217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:40.564121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:40.564121+0000","last_clean_scrub_stamp":"2024-03-09T15:25:40.564121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:01.263454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.725084+0000","last_change":"2024-03-09T15:25:19.725114+0000","last_active":"2024-03-09T15:25:19.725084+0000","last_peered":"2024-03-09T15:25:19.725084+0000","last_clean":"2024-03-09T15:25:19.725084+0000","last_became_active":"2024-03-09T14:35:55.600439+0000","last_became_peered":"2024-03-09T14:35:55.600439+0000","last_unstale":"2024-03-09T15:25:19.725084+0000","last_undegraded":"2024-03-09T15:25:19.725084+0000","last_fullsized":"2024-03-09T15:25:19.725084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:19.724994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:19.724994+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.724994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:29.875061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.544199+0000","last_change":"2024-03-09T15:24:49.544199+0000","last_active":"2024-03-09T15:24:49.544199+0000","last_peered":"2024-03-09T15:24:49.544199+0000","last_clean":"2024-03-09T15:24:49.544199+0000","last_became_active":"2024-03-09T14:35:50.590558+0000","last_became_peered":"2024-03-09T14:35:50.590558+0000","last_unstale":"2024-03-09T15:24:49.544199+0000","last_undegraded":"2024-03-09T15:24:49.544199+0000","last_fullsized":"2024-03-09T15:24:49.544199+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:49.544081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:49.544081+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.544081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:56.633076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"260'26","reported_seq":117,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.514486+0000","last_change":"2024-03-09T15:24:49.514524+0000","last_active":"2024-03-09T15:24:49.514486+0000","last_peered":"2024-03-09T15:24:49.514486+0000","last_clean":"2024-03-09T15:24:49.514486+0000","last_became_active":"2024-03-09T14:31:01.144074+0000","last_became_peered":"2024-03-09T14:31:01.144074+0000","last_unstale":"2024-03-09T15:24:49.514486+0000","last_undegraded":"2024-03-09T15:24:49.514486+0000","last_fullsized":"2024-03-09T15:24:49.514486+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'26","last_scrub_stamp":"2024-03-09T15:24:49.514387+0000","last_deep_scrub":"260'26","last_deep_scrub_stamp":"2024-03-09T15:24:49.514387+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.514387+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:53.197965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":56,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:41.560547+0000","last_change":"2024-03-09T15:25:41.560577+0000","last_active":"2024-03-09T15:25:41.560547+0000","last_peered":"2024-03-09T15:25:41.560547+0000","last_clean":"2024-03-09T15:25:41.560547+0000","last_became_active":"2024-03-09T14:50:03.660751+0000","last_became_peered":"2024-03-09T14:50:03.660751+0000","last_unstale":"2024-03-09T15:25:41.560547+0000","last_undegraded":"2024-03-09T15:25:41.560547+0000","last_fullsized":"2024-03-09T15:25:41.560547+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:41.560459+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:41.560459+0000","last_clean_scrub_stamp":"2024-03-09T15:25:41.560459+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:39.013723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":52,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.417420+0000","last_change":"2024-03-09T15:25:05.417446+0000","last_active":"2024-03-09T15:25:05.417420+0000","last_peered":"2024-03-09T15:25:05.417420+0000","last_clean":"2024-03-09T15:25:05.417420+0000","last_became_active":"2024-03-09T14:35:55.605987+0000","last_became_peered":"2024-03-09T14:35:55.605987+0000","last_unstale":"2024-03-09T15:25:05.417420+0000","last_undegraded":"2024-03-09T15:25:05.417420+0000","last_fullsized":"2024-03-09T15:25:05.417420+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:05.417318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:05.417318+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.417318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:30.602964+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.676718+0000","last_change":"2024-03-09T15:25:16.676757+0000","last_active":"2024-03-09T15:25:16.676718+0000","last_peered":"2024-03-09T15:25:16.676718+0000","last_clean":"2024-03-09T15:25:16.676718+0000","last_became_active":"2024-03-09T14:35:50.581047+0000","last_became_peered":"2024-03-09T14:35:50.581047+0000","last_unstale":"2024-03-09T15:25:16.676718+0000","last_undegraded":"2024-03-09T15:25:16.676718+0000","last_fullsized":"2024-03-09T15:25:16.676718+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:16.676567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:16.676567+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.676567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:28:53.325136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"260'84","reported_seq":308,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.084821+0000","last_change":"2024-03-09T15:24:46.084885+0000","last_active":"2024-03-09T15:24:46.084821+0000","last_peered":"2024-03-09T15:24:46.084821+0000","last_clean":"2024-03-09T15:24:46.084821+0000","last_became_active":"2024-03-09T14:31:01.140068+0000","last_became_peered":"2024-03-09T14:31:01.140068+0000","last_unstale":"2024-03-09T15:24:46.084821+0000","last_undegraded":"2024-03-09T15:24:46.084821+0000","last_fullsized":"2024-03-09T15:24:46.084821+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-03-09T15:24:46.084709+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-03-09T15:24:46.084709+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.084709+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:24.008976+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":455,"num_read_kb":335,"num_write":123,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":991,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"260'2","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:42.423611+0000","last_change":"2024-03-09T15:25:42.423674+0000","last_active":"2024-03-09T15:25:42.423611+0000","last_peered":"2024-03-09T15:25:42.423611+0000","last_clean":"2024-03-09T15:25:42.423611+0000","last_became_active":"2024-03-09T14:50:03.654371+0000","last_became_peered":"2024-03-09T14:50:03.654371+0000","last_unstale":"2024-03-09T15:25:42.423611+0000","last_undegraded":"2024-03-09T15:25:42.423611+0000","last_fullsized":"2024-03-09T15:25:42.423611+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:42.423505+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:42.423505+0000","last_clean_scrub_stamp":"2024-03-09T15:25:42.423505+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:30:05.264586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'5","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.729336+0000","last_change":"2024-03-09T15:25:20.729362+0000","last_active":"2024-03-09T15:25:20.729336+0000","last_peered":"2024-03-09T15:25:20.729336+0000","last_clean":"2024-03-09T15:25:20.729336+0000","last_became_active":"2024-03-09T14:35:55.607123+0000","last_became_peered":"2024-03-09T14:35:55.607123+0000","last_unstale":"2024-03-09T15:25:20.729336+0000","last_undegraded":"2024-03-09T15:25:20.729336+0000","last_fullsized":"2024-03-09T15:25:20.729336+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:20.729245+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:20.729245+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.729245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:31:00.742562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.653606+0000","last_change":"2024-03-09T15:25:00.653633+0000","last_active":"2024-03-09T15:25:00.653606+0000","last_peered":"2024-03-09T15:25:00.653606+0000","last_clean":"2024-03-09T15:25:00.653606+0000","last_became_active":"2024-03-09T14:35:50.591873+0000","last_became_peered":"2024-03-09T14:35:50.591873+0000","last_unstale":"2024-03-09T15:25:00.653606+0000","last_undegraded":"2024-03-09T15:25:00.653606+0000","last_fullsized":"2024-03-09T15:25:00.653606+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.653510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.653510+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.653510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:05.772843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'9","reported_seq":86,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.484001+0000","last_change":"2024-03-09T15:24:51.484043+0000","last_active":"2024-03-09T15:24:51.484001+0000","last_peered":"2024-03-09T15:24:51.484001+0000","last_clean":"2024-03-09T15:24:51.484001+0000","last_became_active":"2024-03-09T14:31:01.141219+0000","last_became_peered":"2024-03-09T14:31:01.141219+0000","last_unstale":"2024-03-09T15:24:51.484001+0000","last_undegraded":"2024-03-09T15:24:51.484001+0000","last_fullsized":"2024-03-09T15:24:51.484001+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:24:51.483908+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:24:51.483908+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.483908+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:36:33.766400+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.678325+0000","last_change":"2024-03-09T15:25:13.678353+0000","last_active":"2024-03-09T15:25:13.678325+0000","last_peered":"2024-03-09T15:25:13.678325+0000","last_clean":"2024-03-09T15:25:13.678325+0000","last_became_active":"2024-03-09T14:50:03.655194+0000","last_became_peered":"2024-03-09T14:50:03.655194+0000","last_unstale":"2024-03-09T15:25:13.678325+0000","last_undegraded":"2024-03-09T15:25:13.678325+0000","last_fullsized":"2024-03-09T15:25:13.678325+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:13.678233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:13.678233+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.678233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:11.226892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"260'8","reported_seq":72,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.435905+0000","last_change":"2024-03-09T15:24:57.435905+0000","last_active":"2024-03-09T15:24:57.435905+0000","last_peered":"2024-03-09T15:24:57.435905+0000","last_clean":"2024-03-09T15:24:57.435905+0000","last_became_active":"2024-03-09T14:35:55.605793+0000","last_became_peered":"2024-03-09T14:35:55.605793+0000","last_unstale":"2024-03-09T15:24:57.435905+0000","last_undegraded":"2024-03-09T15:24:57.435905+0000","last_fullsized":"2024-03-09T15:24:57.435905+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:57.435719+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:57.435719+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.435719+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:39:31.333096+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"260'8","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.515906+0000","last_change":"2024-03-09T15:24:48.515906+0000","last_active":"2024-03-09T15:24:48.515906+0000","last_peered":"2024-03-09T15:24:48.515906+0000","last_clean":"2024-03-09T15:24:48.515906+0000","last_became_active":"2024-03-09T14:35:50.587837+0000","last_became_peered":"2024-03-09T14:35:50.587837+0000","last_unstale":"2024-03-09T15:24:48.515906+0000","last_undegraded":"2024-03-09T15:24:48.515906+0000","last_fullsized":"2024-03-09T15:24:48.515906+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:48.515771+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:48.515771+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.515771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:02.694004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6842,"num_write":13,"num_write_kb":11962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"260'27","reported_seq":127,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.498449+0000","last_change":"2024-03-09T15:24:44.498449+0000","last_active":"2024-03-09T15:24:44.498449+0000","last_peered":"2024-03-09T15:24:44.498449+0000","last_clean":"2024-03-09T15:24:44.498449+0000","last_became_active":"2024-03-09T14:31:01.145560+0000","last_became_peered":"2024-03-09T14:31:01.145560+0000","last_unstale":"2024-03-09T15:24:44.498449+0000","last_undegraded":"2024-03-09T15:24:44.498449+0000","last_fullsized":"2024-03-09T15:24:44.498449+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'27","last_scrub_stamp":"2024-03-09T15:24:44.498349+0000","last_deep_scrub":"260'27","last_deep_scrub_stamp":"2024-03-09T15:24:44.498349+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.498349+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:01.790715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":48,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:42.611968+0000","last_change":"2024-03-09T15:25:42.611993+0000","last_active":"2024-03-09T15:25:42.611968+0000","last_peered":"2024-03-09T15:25:42.611968+0000","last_clean":"2024-03-09T15:25:42.611968+0000","last_became_active":"2024-03-09T14:50:03.663858+0000","last_became_peered":"2024-03-09T14:50:03.663858+0000","last_unstale":"2024-03-09T15:25:42.611968+0000","last_undegraded":"2024-03-09T15:25:42.611968+0000","last_fullsized":"2024-03-09T15:25:42.611968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:42.611876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:42.611876+0000","last_clean_scrub_stamp":"2024-03-09T15:25:42.611876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:18.003175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"257'6","reported_seq":57,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:30.887890+0000","last_change":"2024-03-09T15:25:30.887915+0000","last_active":"2024-03-09T15:25:30.887890+0000","last_peered":"2024-03-09T15:25:30.887890+0000","last_clean":"2024-03-09T15:25:30.887890+0000","last_became_active":"2024-03-09T14:36:32.656411+0000","last_became_peered":"2024-03-09T14:36:32.656411+0000","last_unstale":"2024-03-09T15:25:30.887890+0000","last_undegraded":"2024-03-09T15:25:30.887890+0000","last_fullsized":"2024-03-09T15:25:30.887890+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'6","last_scrub_stamp":"2024-03-09T15:25:30.887778+0000","last_deep_scrub":"257'6","last_deep_scrub_stamp":"2024-03-09T15:25:30.887778+0000","last_clean_scrub_stamp":"2024-03-09T15:25:30.887778+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:48.657443+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.666785+0000","last_change":"2024-03-09T15:25:11.666785+0000","last_active":"2024-03-09T15:25:11.666785+0000","last_peered":"2024-03-09T15:25:11.666785+0000","last_clean":"2024-03-09T15:25:11.666785+0000","last_became_active":"2024-03-09T14:35:50.593412+0000","last_became_peered":"2024-03-09T14:35:50.593412+0000","last_unstale":"2024-03-09T15:25:11.666785+0000","last_undegraded":"2024-03-09T15:25:11.666785+0000","last_fullsized":"2024-03-09T15:25:11.666785+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:11.666666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:11.666666+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.666666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:36.105150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"260'8","reported_seq":87,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.502021+0000","last_change":"2024-03-09T15:24:48.502021+0000","last_active":"2024-03-09T15:24:48.502021+0000","last_peered":"2024-03-09T15:24:48.502021+0000","last_clean":"2024-03-09T15:24:48.502021+0000","last_became_active":"2024-03-09T14:31:01.138104+0000","last_became_peered":"2024-03-09T14:31:01.138104+0000","last_unstale":"2024-03-09T15:24:48.502021+0000","last_undegraded":"2024-03-09T15:24:48.502021+0000","last_fullsized":"2024-03-09T15:24:48.502021+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:48.501862+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:48.501862+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.501862+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:24:45.310952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.781144+0000","last_change":"2024-03-09T15:25:22.781176+0000","last_active":"2024-03-09T15:25:22.781144+0000","last_peered":"2024-03-09T15:25:22.781144+0000","last_clean":"2024-03-09T15:25:22.781144+0000","last_became_active":"2024-03-09T14:50:03.658294+0000","last_became_peered":"2024-03-09T14:50:03.658294+0000","last_unstale":"2024-03-09T15:25:22.781144+0000","last_undegraded":"2024-03-09T15:25:22.781144+0000","last_fullsized":"2024-03-09T15:25:22.781144+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:22.781055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:22.781055+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.781055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:35:29.404865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.757531+0000","last_change":"2024-03-09T15:25:22.757531+0000","last_active":"2024-03-09T15:25:22.757531+0000","last_peered":"2024-03-09T15:25:22.757531+0000","last_clean":"2024-03-09T15:25:22.757531+0000","last_became_active":"2024-03-09T14:35:55.634864+0000","last_became_peered":"2024-03-09T14:35:55.634864+0000","last_unstale":"2024-03-09T15:25:22.757531+0000","last_undegraded":"2024-03-09T15:25:22.757531+0000","last_fullsized":"2024-03-09T15:25:22.757531+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:22.757409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:22.757409+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.757409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:51:02.529677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":59,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.700402+0000","last_change":"2024-03-09T15:25:00.700402+0000","last_active":"2024-03-09T15:25:00.700402+0000","last_peered":"2024-03-09T15:25:00.700402+0000","last_clean":"2024-03-09T15:25:00.700402+0000","last_became_active":"2024-03-09T14:35:50.586774+0000","last_became_peered":"2024-03-09T14:35:50.586774+0000","last_unstale":"2024-03-09T15:25:00.700402+0000","last_undegraded":"2024-03-09T15:25:00.700402+0000","last_fullsized":"2024-03-09T15:25:00.700402+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.700284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.700284+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.700284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:43.428686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'14","reported_seq":100,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.820656+0000","last_change":"2024-03-09T15:24:47.820656+0000","last_active":"2024-03-09T15:24:47.820656+0000","last_peered":"2024-03-09T15:24:47.820656+0000","last_clean":"2024-03-09T15:24:47.820656+0000","last_became_active":"2024-03-09T14:31:01.139186+0000","last_became_peered":"2024-03-09T14:31:01.139186+0000","last_unstale":"2024-03-09T15:24:47.820656+0000","last_undegraded":"2024-03-09T15:24:47.820656+0000","last_fullsized":"2024-03-09T15:24:47.820656+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:47.820481+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:47.820481+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.820481+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:00:39.801312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":42,"num_write":29,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.551578+0000","last_change":"2024-03-09T15:25:06.551615+0000","last_active":"2024-03-09T15:25:06.551578+0000","last_peered":"2024-03-09T15:25:06.551578+0000","last_clean":"2024-03-09T15:25:06.551578+0000","last_became_active":"2024-03-09T14:50:03.657091+0000","last_became_peered":"2024-03-09T14:50:03.657091+0000","last_unstale":"2024-03-09T15:25:06.551578+0000","last_undegraded":"2024-03-09T15:25:06.551578+0000","last_fullsized":"2024-03-09T15:25:06.551578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.551487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.551487+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.551487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:45.045398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'3","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.511539+0000","last_change":"2024-03-09T15:24:53.511539+0000","last_active":"2024-03-09T15:24:53.511539+0000","last_peered":"2024-03-09T15:24:53.511539+0000","last_clean":"2024-03-09T15:24:53.511539+0000","last_became_active":"2024-03-09T14:35:55.603228+0000","last_became_peered":"2024-03-09T14:35:55.603228+0000","last_unstale":"2024-03-09T15:24:53.511539+0000","last_undegraded":"2024-03-09T15:24:53.511539+0000","last_fullsized":"2024-03-09T15:24:53.511539+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:53.511424+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:53.511424+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.511424+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:52:53.208885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"260'2","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.400023+0000","last_change":"2024-03-09T15:24:44.400023+0000","last_active":"2024-03-09T15:24:44.400023+0000","last_peered":"2024-03-09T15:24:44.400023+0000","last_clean":"2024-03-09T15:24:44.400023+0000","last_became_active":"2024-03-09T14:35:50.586849+0000","last_became_peered":"2024-03-09T14:35:50.586849+0000","last_unstale":"2024-03-09T15:24:44.400023+0000","last_undegraded":"2024-03-09T15:24:44.400023+0000","last_fullsized":"2024-03-09T15:24:44.400023+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:24:44.399922+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:24:44.399922+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.399922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:48.540054+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"260'54","reported_seq":200,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.538981+0000","last_change":"2024-03-09T15:25:08.539006+0000","last_active":"2024-03-09T15:25:08.538981+0000","last_peered":"2024-03-09T15:25:08.538981+0000","last_clean":"2024-03-09T15:25:08.538981+0000","last_became_active":"2024-03-09T14:31:01.142031+0000","last_became_peered":"2024-03-09T14:31:01.142031+0000","last_unstale":"2024-03-09T15:25:08.538981+0000","last_undegraded":"2024-03-09T15:25:08.538981+0000","last_fullsized":"2024-03-09T15:25:08.538981+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-03-09T15:25:08.538889+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-03-09T15:25:08.538889+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.538889+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:36:23.027386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":241,"num_read_kb":173,"num_write":88,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:45.428941+0000","last_change":"2024-03-09T15:25:45.429003+0000","last_active":"2024-03-09T15:25:45.428941+0000","last_peered":"2024-03-09T15:25:45.428941+0000","last_clean":"2024-03-09T15:25:45.428941+0000","last_became_active":"2024-03-09T14:50:03.656417+0000","last_became_peered":"2024-03-09T14:50:03.656417+0000","last_unstale":"2024-03-09T15:25:45.428941+0000","last_undegraded":"2024-03-09T15:25:45.428941+0000","last_fullsized":"2024-03-09T15:25:45.428941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:45.428818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:45.428818+0000","last_clean_scrub_stamp":"2024-03-09T15:25:45.428818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:32.976029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"260'9","reported_seq":72,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:30.206432+0000","last_change":"2024-03-09T15:25:30.206464+0000","last_active":"2024-03-09T15:25:30.206432+0000","last_peered":"2024-03-09T15:25:30.206432+0000","last_clean":"2024-03-09T15:25:30.206432+0000","last_became_active":"2024-03-09T14:35:55.602942+0000","last_became_peered":"2024-03-09T14:35:55.602942+0000","last_unstale":"2024-03-09T15:25:30.206432+0000","last_undegraded":"2024-03-09T15:25:30.206432+0000","last_fullsized":"2024-03-09T15:25:30.206432+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-03-09T15:25:30.206343+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-03-09T15:25:30.206343+0000","last_clean_scrub_stamp":"2024-03-09T15:25:30.206343+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:34.377558+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.544179+0000","last_change":"2024-03-09T15:24:52.544179+0000","last_active":"2024-03-09T15:24:52.544179+0000","last_peered":"2024-03-09T15:24:52.544179+0000","last_clean":"2024-03-09T15:24:52.544179+0000","last_became_active":"2024-03-09T14:35:50.585514+0000","last_became_peered":"2024-03-09T14:35:50.585514+0000","last_unstale":"2024-03-09T15:24:52.544179+0000","last_undegraded":"2024-03-09T15:24:52.544179+0000","last_fullsized":"2024-03-09T15:24:52.544179+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:52.544062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:52.544062+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.544062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:37:41.480469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"260'59","reported_seq":225,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.475071+0000","last_change":"2024-03-09T15:24:46.475071+0000","last_active":"2024-03-09T15:24:46.475071+0000","last_peered":"2024-03-09T15:24:46.475071+0000","last_clean":"2024-03-09T15:24:46.475071+0000","last_became_active":"2024-03-09T14:31:01.147996+0000","last_became_peered":"2024-03-09T14:31:01.147996+0000","last_unstale":"2024-03-09T15:24:46.475071+0000","last_undegraded":"2024-03-09T15:24:46.475071+0000","last_fullsized":"2024-03-09T15:24:46.475071+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'59","last_scrub_stamp":"2024-03-09T15:24:46.474945+0000","last_deep_scrub":"260'59","last_deep_scrub_stamp":"2024-03-09T15:24:46.474945+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.474945+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:55.520901+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":215,"num_write":85,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:39.590067+0000","last_change":"2024-03-09T15:25:39.590121+0000","last_active":"2024-03-09T15:25:39.590067+0000","last_peered":"2024-03-09T15:25:39.590067+0000","last_clean":"2024-03-09T15:25:39.590067+0000","last_became_active":"2024-03-09T14:50:03.659655+0000","last_became_peered":"2024-03-09T14:50:03.659655+0000","last_unstale":"2024-03-09T15:25:39.590067+0000","last_undegraded":"2024-03-09T15:25:39.590067+0000","last_fullsized":"2024-03-09T15:25:39.590067+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:39.589963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:39.589963+0000","last_clean_scrub_stamp":"2024-03-09T15:25:39.589963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:05.827409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.681525+0000","last_change":"2024-03-09T15:24:58.681525+0000","last_active":"2024-03-09T15:24:58.681525+0000","last_peered":"2024-03-09T15:24:58.681525+0000","last_clean":"2024-03-09T15:24:58.681525+0000","last_became_active":"2024-03-09T14:35:55.632839+0000","last_became_peered":"2024-03-09T14:35:55.632839+0000","last_unstale":"2024-03-09T15:24:58.681525+0000","last_undegraded":"2024-03-09T15:24:58.681525+0000","last_fullsized":"2024-03-09T15:24:58.681525+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:58.681405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:58.681405+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.681405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:05.460441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.352717+0000","last_change":"2024-03-09T15:24:43.352717+0000","last_active":"2024-03-09T15:24:43.352717+0000","last_peered":"2024-03-09T15:24:43.352717+0000","last_clean":"2024-03-09T15:24:43.352717+0000","last_became_active":"2024-03-09T14:35:50.582881+0000","last_became_peered":"2024-03-09T14:35:50.582881+0000","last_unstale":"2024-03-09T15:24:43.352717+0000","last_undegraded":"2024-03-09T15:24:43.352717+0000","last_fullsized":"2024-03-09T15:24:43.352717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:43.352488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:43.352488+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.352488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:16.403976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"260'14","reported_seq":96,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.621123+0000","last_change":"2024-03-09T15:24:55.621123+0000","last_active":"2024-03-09T15:24:55.621123+0000","last_peered":"2024-03-09T15:24:55.621123+0000","last_clean":"2024-03-09T15:24:55.621123+0000","last_became_active":"2024-03-09T14:31:01.138321+0000","last_became_peered":"2024-03-09T14:31:01.138321+0000","last_unstale":"2024-03-09T15:24:55.621123+0000","last_undegraded":"2024-03-09T15:24:55.621123+0000","last_fullsized":"2024-03-09T15:24:55.621123+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'14","last_scrub_stamp":"2024-03-09T15:24:55.621006+0000","last_deep_scrub":"260'14","last_deep_scrub_stamp":"2024-03-09T15:24:55.621006+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.621006+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:32.384038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"260'2","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:37.652719+0000","last_change":"2024-03-09T15:25:37.652745+0000","last_active":"2024-03-09T15:25:37.652719+0000","last_peered":"2024-03-09T15:25:37.652719+0000","last_clean":"2024-03-09T15:25:37.652719+0000","last_became_active":"2024-03-09T14:50:03.659028+0000","last_became_peered":"2024-03-09T14:50:03.659028+0000","last_unstale":"2024-03-09T15:25:37.652719+0000","last_undegraded":"2024-03-09T15:25:37.652719+0000","last_fullsized":"2024-03-09T15:25:37.652719+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:37.652634+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:37.652634+0000","last_clean_scrub_stamp":"2024-03-09T15:25:37.652634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:08.876632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":53,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.752214+0000","last_change":"2024-03-09T15:25:20.752214+0000","last_active":"2024-03-09T15:25:20.752214+0000","last_peered":"2024-03-09T15:25:20.752214+0000","last_clean":"2024-03-09T15:25:20.752214+0000","last_became_active":"2024-03-09T14:35:55.605524+0000","last_became_peered":"2024-03-09T14:35:55.605524+0000","last_unstale":"2024-03-09T15:25:20.752214+0000","last_undegraded":"2024-03-09T15:25:20.752214+0000","last_fullsized":"2024-03-09T15:25:20.752214+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:20.752099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:20.752099+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.752099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:59.892662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"260'2","reported_seq":63,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.421009+0000","last_change":"2024-03-09T15:24:44.421031+0000","last_active":"2024-03-09T15:24:44.421009+0000","last_peered":"2024-03-09T15:24:44.421009+0000","last_clean":"2024-03-09T15:24:44.421009+0000","last_became_active":"2024-03-09T14:35:50.584333+0000","last_became_peered":"2024-03-09T14:35:50.584333+0000","last_unstale":"2024-03-09T15:24:44.421009+0000","last_undegraded":"2024-03-09T15:24:44.421009+0000","last_fullsized":"2024-03-09T15:24:44.421009+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:24:44.420937+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:24:44.420937+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.420937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:44.572608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"260'8","reported_seq":90,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.495673+0000","last_change":"2024-03-09T15:24:50.495673+0000","last_active":"2024-03-09T15:24:50.495673+0000","last_peered":"2024-03-09T15:24:50.495673+0000","last_clean":"2024-03-09T15:24:50.495673+0000","last_became_active":"2024-03-09T14:31:01.141468+0000","last_became_peered":"2024-03-09T14:31:01.141468+0000","last_unstale":"2024-03-09T15:24:50.495673+0000","last_undegraded":"2024-03-09T15:24:50.495673+0000","last_fullsized":"2024-03-09T15:24:50.495673+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:50.495493+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:50.495493+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.495493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:52.491490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":30,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":36,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:39.534675+0000","last_change":"2024-03-09T15:25:39.534697+0000","last_active":"2024-03-09T15:25:39.534675+0000","last_peered":"2024-03-09T15:25:39.534675+0000","last_clean":"2024-03-09T15:25:39.534675+0000","last_became_active":"2024-03-09T14:50:03.659544+0000","last_became_peered":"2024-03-09T14:50:03.659544+0000","last_unstale":"2024-03-09T15:25:39.534675+0000","last_undegraded":"2024-03-09T15:25:39.534675+0000","last_fullsized":"2024-03-09T15:25:39.534675+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:39.534580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:39.534580+0000","last_clean_scrub_stamp":"2024-03-09T15:25:39.534580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:03.721809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"260'3","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.571013+0000","last_change":"2024-03-09T15:24:54.571044+0000","last_active":"2024-03-09T15:24:54.571013+0000","last_peered":"2024-03-09T15:24:54.571013+0000","last_clean":"2024-03-09T15:24:54.571013+0000","last_became_active":"2024-03-09T14:35:55.600972+0000","last_became_peered":"2024-03-09T14:35:55.600972+0000","last_unstale":"2024-03-09T15:24:54.571013+0000","last_undegraded":"2024-03-09T15:24:54.571013+0000","last_fullsized":"2024-03-09T15:24:54.571013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:54.570920+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:54.570920+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.570920+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:33:44.442956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'5","reported_seq":69,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:27.221537+0000","last_change":"2024-03-09T15:25:27.221563+0000","last_active":"2024-03-09T15:25:27.221537+0000","last_peered":"2024-03-09T15:25:27.221537+0000","last_clean":"2024-03-09T15:25:27.221537+0000","last_became_active":"2024-03-09T14:35:50.593173+0000","last_became_peered":"2024-03-09T14:35:50.593173+0000","last_unstale":"2024-03-09T15:25:27.221537+0000","last_undegraded":"2024-03-09T15:25:27.221537+0000","last_fullsized":"2024-03-09T15:25:27.221537+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:27.221428+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:27.221428+0000","last_clean_scrub_stamp":"2024-03-09T15:25:27.221428+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:51:38.316344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10280,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"260'8","reported_seq":88,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.810112+0000","last_change":"2024-03-09T15:24:46.810112+0000","last_active":"2024-03-09T15:24:46.810112+0000","last_peered":"2024-03-09T15:24:46.810112+0000","last_clean":"2024-03-09T15:24:46.810112+0000","last_became_active":"2024-03-09T14:31:01.139885+0000","last_became_peered":"2024-03-09T14:31:01.139885+0000","last_unstale":"2024-03-09T15:24:46.810112+0000","last_undegraded":"2024-03-09T15:24:46.810112+0000","last_fullsized":"2024-03-09T15:24:46.810112+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:46.809971+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:46.809971+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.809971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:01.279230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:40.584112+0000","last_change":"2024-03-09T15:25:40.584133+0000","last_active":"2024-03-09T15:25:40.584112+0000","last_peered":"2024-03-09T15:25:40.584112+0000","last_clean":"2024-03-09T15:25:40.584112+0000","last_became_active":"2024-03-09T14:50:03.659530+0000","last_became_peered":"2024-03-09T14:50:03.659530+0000","last_unstale":"2024-03-09T15:25:40.584112+0000","last_undegraded":"2024-03-09T15:25:40.584112+0000","last_fullsized":"2024-03-09T15:25:40.584112+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:40.584027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:40.584027+0000","last_clean_scrub_stamp":"2024-03-09T15:25:40.584027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:30.257088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"257'3","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.573837+0000","last_change":"2024-03-09T15:25:08.573891+0000","last_active":"2024-03-09T15:25:08.573837+0000","last_peered":"2024-03-09T15:25:08.573837+0000","last_clean":"2024-03-09T15:25:08.573837+0000","last_became_active":"2024-03-09T14:35:55.603158+0000","last_became_peered":"2024-03-09T14:35:55.603158+0000","last_unstale":"2024-03-09T15:25:08.573837+0000","last_undegraded":"2024-03-09T15:25:08.573837+0000","last_fullsized":"2024-03-09T15:25:08.573837+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'3","last_scrub_stamp":"2024-03-09T15:25:08.573724+0000","last_deep_scrub":"257'3","last_deep_scrub_stamp":"2024-03-09T15:25:08.573724+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.573724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:40:39.414597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"257'6","reported_seq":71,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.526291+0000","last_change":"2024-03-09T15:24:51.526317+0000","last_active":"2024-03-09T15:24:51.526291+0000","last_peered":"2024-03-09T15:24:51.526291+0000","last_clean":"2024-03-09T15:24:51.526291+0000","last_became_active":"2024-03-09T14:35:50.583874+0000","last_became_peered":"2024-03-09T14:35:50.583874+0000","last_unstale":"2024-03-09T15:24:51.526291+0000","last_undegraded":"2024-03-09T15:24:51.526291+0000","last_fullsized":"2024-03-09T15:24:51.526291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'6","last_scrub_stamp":"2024-03-09T15:24:51.526195+0000","last_deep_scrub":"257'6","last_deep_scrub_stamp":"2024-03-09T15:24:51.526195+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.526195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:49.267726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"260'55","reported_seq":192,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.416813+0000","last_change":"2024-03-09T15:24:43.416813+0000","last_active":"2024-03-09T15:24:43.416813+0000","last_peered":"2024-03-09T15:24:43.416813+0000","last_clean":"2024-03-09T15:24:43.416813+0000","last_became_active":"2024-03-09T14:31:01.148588+0000","last_became_peered":"2024-03-09T14:31:01.148588+0000","last_unstale":"2024-03-09T15:24:43.416813+0000","last_undegraded":"2024-03-09T15:24:43.416813+0000","last_fullsized":"2024-03-09T15:24:43.416813+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'55","last_scrub_stamp":"2024-03-09T15:24:43.416706+0000","last_deep_scrub":"260'55","last_deep_scrub_stamp":"2024-03-09T15:24:43.416706+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.416706+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:28.604905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":151,"num_write":97,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:33.850471+0000","last_change":"2024-03-09T15:25:33.850493+0000","last_active":"2024-03-09T15:25:33.850471+0000","last_peered":"2024-03-09T15:25:33.850471+0000","last_clean":"2024-03-09T15:25:33.850471+0000","last_became_active":"2024-03-09T14:50:03.664279+0000","last_became_peered":"2024-03-09T14:50:03.664279+0000","last_unstale":"2024-03-09T15:25:33.850471+0000","last_undegraded":"2024-03-09T15:25:33.850471+0000","last_fullsized":"2024-03-09T15:25:33.850471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:33.850365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:33.850365+0000","last_clean_scrub_stamp":"2024-03-09T15:25:33.850365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:57.963127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:35.502333+0000","last_change":"2024-03-09T15:25:35.502389+0000","last_active":"2024-03-09T15:25:35.502333+0000","last_peered":"2024-03-09T15:25:35.502333+0000","last_clean":"2024-03-09T15:25:35.502333+0000","last_became_active":"2024-03-09T14:35:55.633470+0000","last_became_peered":"2024-03-09T14:35:55.633470+0000","last_unstale":"2024-03-09T15:25:35.502333+0000","last_undegraded":"2024-03-09T15:25:35.502333+0000","last_fullsized":"2024-03-09T15:25:35.502333+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:35.502224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:35.502224+0000","last_clean_scrub_stamp":"2024-03-09T15:25:35.502224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:47.573831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:43.921504+0000","last_change":"2024-03-09T15:24:43.921531+0000","last_active":"2024-03-09T15:24:43.921504+0000","last_peered":"2024-03-09T15:24:43.921504+0000","last_clean":"2024-03-09T15:24:43.921504+0000","last_became_active":"2024-03-09T14:35:50.591323+0000","last_became_peered":"2024-03-09T14:35:50.591323+0000","last_unstale":"2024-03-09T15:24:43.921504+0000","last_undegraded":"2024-03-09T15:24:43.921504+0000","last_fullsized":"2024-03-09T15:24:43.921504+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:43.921413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:43.921413+0000","last_clean_scrub_stamp":"2024-03-09T15:24:43.921413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:09:22.833429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"260'52","reported_seq":199,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.865684+0000","last_change":"2024-03-09T15:24:50.865684+0000","last_active":"2024-03-09T15:24:50.865684+0000","last_peered":"2024-03-09T15:24:50.865684+0000","last_clean":"2024-03-09T15:24:50.865684+0000","last_became_active":"2024-03-09T14:31:01.137294+0000","last_became_peered":"2024-03-09T14:31:01.137294+0000","last_unstale":"2024-03-09T15:24:50.865684+0000","last_undegraded":"2024-03-09T15:24:50.865684+0000","last_fullsized":"2024-03-09T15:24:50.865684+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'52","last_scrub_stamp":"2024-03-09T15:24:50.865508+0000","last_deep_scrub":"260'52","last_deep_scrub_stamp":"2024-03-09T15:24:50.865508+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.865508+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:21.737646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":176,"num_write":74,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:24.733627+0000","last_change":"2024-03-09T15:25:24.733651+0000","last_active":"2024-03-09T15:25:24.733627+0000","last_peered":"2024-03-09T15:25:24.733627+0000","last_clean":"2024-03-09T15:25:24.733627+0000","last_became_active":"2024-03-09T14:50:03.657756+0000","last_became_peered":"2024-03-09T14:50:03.657756+0000","last_unstale":"2024-03-09T15:25:24.733627+0000","last_undegraded":"2024-03-09T15:25:24.733627+0000","last_fullsized":"2024-03-09T15:25:24.733627+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:24.733533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:24.733533+0000","last_clean_scrub_stamp":"2024-03-09T15:25:24.733533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:42:05.238100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"257'2","reported_seq":58,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.600707+0000","last_change":"2024-03-09T15:25:02.600707+0000","last_active":"2024-03-09T15:25:02.600707+0000","last_peered":"2024-03-09T15:25:02.600707+0000","last_clean":"2024-03-09T15:25:02.600707+0000","last_became_active":"2024-03-09T14:35:55.634603+0000","last_became_peered":"2024-03-09T14:35:55.634603+0000","last_unstale":"2024-03-09T15:25:02.600707+0000","last_undegraded":"2024-03-09T15:25:02.600707+0000","last_fullsized":"2024-03-09T15:25:02.600707+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'2","last_scrub_stamp":"2024-03-09T15:25:02.600568+0000","last_deep_scrub":"257'2","last_deep_scrub_stamp":"2024-03-09T15:25:02.600568+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.600568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:18.923316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'3","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.673177+0000","last_change":"2024-03-09T15:24:56.673177+0000","last_active":"2024-03-09T15:24:56.673177+0000","last_peered":"2024-03-09T15:24:56.673177+0000","last_clean":"2024-03-09T15:24:56.673177+0000","last_became_active":"2024-03-09T14:35:50.589815+0000","last_became_peered":"2024-03-09T14:35:50.589815+0000","last_unstale":"2024-03-09T15:24:56.673177+0000","last_undegraded":"2024-03-09T15:24:56.673177+0000","last_fullsized":"2024-03-09T15:24:56.673177+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:56.673047+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:56.673047+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.673047+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:22:51.958302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"257'22","reported_seq":131,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.573077+0000","last_change":"2024-03-09T15:24:52.573077+0000","last_active":"2024-03-09T15:24:52.573077+0000","last_peered":"2024-03-09T15:24:52.573077+0000","last_clean":"2024-03-09T15:24:52.573077+0000","last_became_active":"2024-03-09T14:31:01.144988+0000","last_became_peered":"2024-03-09T14:31:01.144988+0000","last_unstale":"2024-03-09T15:24:52.573077+0000","last_undegraded":"2024-03-09T15:24:52.573077+0000","last_fullsized":"2024-03-09T15:24:52.573077+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'22","last_scrub_stamp":"2024-03-09T15:24:52.572962+0000","last_deep_scrub":"257'22","last_deep_scrub_stamp":"2024-03-09T15:24:52.572962+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.572962+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:31.114327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":83,"num_write":35,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:33.161017+0000","last_change":"2024-03-09T15:25:33.161048+0000","last_active":"2024-03-09T15:25:33.161017+0000","last_peered":"2024-03-09T15:25:33.161017+0000","last_clean":"2024-03-09T15:25:33.161017+0000","last_became_active":"2024-03-09T14:50:03.664320+0000","last_became_peered":"2024-03-09T14:50:03.664320+0000","last_unstale":"2024-03-09T15:25:33.161017+0000","last_undegraded":"2024-03-09T15:25:33.161017+0000","last_fullsized":"2024-03-09T15:25:33.161017+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:33.160935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:33.160935+0000","last_clean_scrub_stamp":"2024-03-09T15:25:33.160935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:46:33.904652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":62,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:32.152886+0000","last_change":"2024-03-09T15:25:32.152926+0000","last_active":"2024-03-09T15:25:32.152886+0000","last_peered":"2024-03-09T15:25:32.152886+0000","last_clean":"2024-03-09T15:25:32.152886+0000","last_became_active":"2024-03-09T14:35:55.606259+0000","last_became_peered":"2024-03-09T14:35:55.606259+0000","last_unstale":"2024-03-09T15:25:32.152886+0000","last_undegraded":"2024-03-09T15:25:32.152886+0000","last_fullsized":"2024-03-09T15:25:32.152886+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:32.152792+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:32.152792+0000","last_clean_scrub_stamp":"2024-03-09T15:25:32.152792+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:59.951694+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"260'7","reported_seq":72,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.513654+0000","last_change":"2024-03-09T15:24:47.513654+0000","last_active":"2024-03-09T15:24:47.513654+0000","last_peered":"2024-03-09T15:24:47.513654+0000","last_clean":"2024-03-09T15:24:47.513654+0000","last_became_active":"2024-03-09T14:35:50.587913+0000","last_became_peered":"2024-03-09T14:35:50.587913+0000","last_unstale":"2024-03-09T15:24:47.513654+0000","last_undegraded":"2024-03-09T15:24:47.513654+0000","last_fullsized":"2024-03-09T15:24:47.513654+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-03-09T15:24:47.513517+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-03-09T15:24:47.513517+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.513517+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:21:32.580098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9232,"num_write":7,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"260'71","reported_seq":242,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.380077+0000","last_change":"2024-03-09T15:24:46.380077+0000","last_active":"2024-03-09T15:24:46.380077+0000","last_peered":"2024-03-09T15:24:46.380077+0000","last_clean":"2024-03-09T15:24:46.380077+0000","last_became_active":"2024-03-09T14:31:01.140550+0000","last_became_peered":"2024-03-09T14:31:01.140550+0000","last_unstale":"2024-03-09T15:24:46.380077+0000","last_undegraded":"2024-03-09T15:24:46.380077+0000","last_fullsized":"2024-03-09T15:24:46.380077+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'71","last_scrub_stamp":"2024-03-09T15:24:46.379972+0000","last_deep_scrub":"260'71","last_deep_scrub_stamp":"2024-03-09T15:24:46.379972+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.379972+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:38.762567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":220,"num_write":118,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"260'2","reported_seq":39,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.724962+0000","last_change":"2024-03-09T15:25:14.724990+0000","last_active":"2024-03-09T15:25:14.724962+0000","last_peered":"2024-03-09T15:25:14.724962+0000","last_clean":"2024-03-09T15:25:14.724962+0000","last_became_active":"2024-03-09T14:50:03.658706+0000","last_became_peered":"2024-03-09T14:50:03.658706+0000","last_unstale":"2024-03-09T15:25:14.724962+0000","last_undegraded":"2024-03-09T15:25:14.724962+0000","last_fullsized":"2024-03-09T15:25:14.724962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:14.724873+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:14.724873+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.724873+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:16.539018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"260'6","reported_seq":66,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.437501+0000","last_change":"2024-03-09T15:24:52.437571+0000","last_active":"2024-03-09T15:24:52.437501+0000","last_peered":"2024-03-09T15:24:52.437501+0000","last_clean":"2024-03-09T15:24:52.437501+0000","last_became_active":"2024-03-09T14:35:55.596397+0000","last_became_peered":"2024-03-09T14:35:55.596397+0000","last_unstale":"2024-03-09T15:24:52.437501+0000","last_undegraded":"2024-03-09T15:24:52.437501+0000","last_fullsized":"2024-03-09T15:24:52.437501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:24:52.437394+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:24:52.437394+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.437394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:42:22.375542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12288,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"260'8","reported_seq":76,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.495488+0000","last_change":"2024-03-09T15:24:50.495520+0000","last_active":"2024-03-09T15:24:50.495488+0000","last_peered":"2024-03-09T15:24:50.495488+0000","last_clean":"2024-03-09T15:24:50.495488+0000","last_became_active":"2024-03-09T14:35:50.591320+0000","last_became_peered":"2024-03-09T14:35:50.591320+0000","last_unstale":"2024-03-09T15:24:50.495488+0000","last_undegraded":"2024-03-09T15:24:50.495488+0000","last_fullsized":"2024-03-09T15:24:50.495488+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'8","last_scrub_stamp":"2024-03-09T15:24:50.495402+0000","last_deep_scrub":"260'8","last_deep_scrub_stamp":"2024-03-09T15:24:50.495402+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.495402+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:41.138717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":4138,"num_write":11,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"260'96","reported_seq":344,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.514877+0000","last_change":"2024-03-09T15:24:45.514877+0000","last_active":"2024-03-09T15:24:45.514877+0000","last_peered":"2024-03-09T15:24:45.514877+0000","last_clean":"2024-03-09T15:24:45.514877+0000","last_became_active":"2024-03-09T14:31:01.135434+0000","last_became_peered":"2024-03-09T14:31:01.135434+0000","last_unstale":"2024-03-09T15:24:45.514877+0000","last_undegraded":"2024-03-09T15:24:45.514877+0000","last_fullsized":"2024-03-09T15:24:45.514877+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'96","last_scrub_stamp":"2024-03-09T15:24:45.514758+0000","last_deep_scrub":"260'96","last_deep_scrub_stamp":"2024-03-09T15:24:45.514758+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.514758+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:31:22.175081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":367,"num_write":146,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4649,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:37.508554+0000","last_change":"2024-03-09T15:25:37.508600+0000","last_active":"2024-03-09T15:25:37.508554+0000","last_peered":"2024-03-09T15:25:37.508554+0000","last_clean":"2024-03-09T15:25:37.508554+0000","last_became_active":"2024-03-09T14:50:03.655332+0000","last_became_peered":"2024-03-09T14:50:03.655332+0000","last_unstale":"2024-03-09T15:25:37.508554+0000","last_undegraded":"2024-03-09T15:25:37.508554+0000","last_fullsized":"2024-03-09T15:25:37.508554+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:37.508446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:37.508446+0000","last_clean_scrub_stamp":"2024-03-09T15:25:37.508446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:17.514140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":55,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:27.854281+0000","last_change":"2024-03-09T15:25:27.854309+0000","last_active":"2024-03-09T15:25:27.854281+0000","last_peered":"2024-03-09T15:25:27.854281+0000","last_clean":"2024-03-09T15:25:27.854281+0000","last_became_active":"2024-03-09T14:35:55.597678+0000","last_became_peered":"2024-03-09T14:35:55.597678+0000","last_unstale":"2024-03-09T15:25:27.854281+0000","last_undegraded":"2024-03-09T15:25:27.854281+0000","last_fullsized":"2024-03-09T15:25:27.854281+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:27.854182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:27.854182+0000","last_clean_scrub_stamp":"2024-03-09T15:25:27.854182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:23:57.242734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"260'7","reported_seq":72,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.529280+0000","last_change":"2024-03-09T15:24:46.529305+0000","last_active":"2024-03-09T15:24:46.529280+0000","last_peered":"2024-03-09T15:24:46.529280+0000","last_clean":"2024-03-09T15:24:46.529280+0000","last_became_active":"2024-03-09T14:35:50.590453+0000","last_became_peered":"2024-03-09T14:35:50.590453+0000","last_unstale":"2024-03-09T15:24:46.529280+0000","last_undegraded":"2024-03-09T15:24:46.529280+0000","last_fullsized":"2024-03-09T15:24:46.529280+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-03-09T15:24:46.529187+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-03-09T15:24:46.529187+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.529187+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:48:47.943384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10288,"num_write":7,"num_write_kb":10288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"260'48","reported_seq":184,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.065367+0000","last_change":"2024-03-09T15:24:45.065367+0000","last_active":"2024-03-09T15:24:45.065367+0000","last_peered":"2024-03-09T15:24:45.065367+0000","last_clean":"2024-03-09T15:24:45.065367+0000","last_became_active":"2024-03-09T14:31:01.141398+0000","last_became_peered":"2024-03-09T14:31:01.141398+0000","last_unstale":"2024-03-09T15:24:45.065367+0000","last_undegraded":"2024-03-09T15:24:45.065367+0000","last_fullsized":"2024-03-09T15:24:45.065367+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:45.065248+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:45.065248+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.065248+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:53:23.682691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":147,"num_write":80,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:38.506316+0000","last_change":"2024-03-09T15:25:38.506339+0000","last_active":"2024-03-09T15:25:38.506316+0000","last_peered":"2024-03-09T15:25:38.506316+0000","last_clean":"2024-03-09T15:25:38.506316+0000","last_became_active":"2024-03-09T14:50:03.657765+0000","last_became_peered":"2024-03-09T14:50:03.657765+0000","last_unstale":"2024-03-09T15:25:38.506316+0000","last_undegraded":"2024-03-09T15:25:38.506316+0000","last_fullsized":"2024-03-09T15:25:38.506316+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:38.506179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:38.506179+0000","last_clean_scrub_stamp":"2024-03-09T15:25:38.506179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:53:17.743431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.681948+0000","last_change":"2024-03-09T15:25:18.681970+0000","last_active":"2024-03-09T15:25:18.681948+0000","last_peered":"2024-03-09T15:25:18.681948+0000","last_clean":"2024-03-09T15:25:18.681948+0000","last_became_active":"2024-03-09T14:35:55.604107+0000","last_became_peered":"2024-03-09T14:35:55.604107+0000","last_unstale":"2024-03-09T15:25:18.681948+0000","last_undegraded":"2024-03-09T15:25:18.681948+0000","last_fullsized":"2024-03-09T15:25:18.681948+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.681823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.681823+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.681823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:14.203153+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'3","reported_seq":65,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.382037+0000","last_change":"2024-03-09T15:24:45.382059+0000","last_active":"2024-03-09T15:24:45.382037+0000","last_peered":"2024-03-09T15:24:45.382037+0000","last_clean":"2024-03-09T15:24:45.382037+0000","last_became_active":"2024-03-09T14:35:50.579934+0000","last_became_peered":"2024-03-09T14:35:50.579934+0000","last_unstale":"2024-03-09T15:24:45.382037+0000","last_undegraded":"2024-03-09T15:24:45.382037+0000","last_fullsized":"2024-03-09T15:24:45.382037+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-03-09T15:24:45.381961+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-03-09T15:24:45.381961+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.381961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:23.774369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"260'48","reported_seq":175,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.778408+0000","last_change":"2024-03-09T15:24:45.778408+0000","last_active":"2024-03-09T15:24:45.778408+0000","last_peered":"2024-03-09T15:24:45.778408+0000","last_clean":"2024-03-09T15:24:45.778408+0000","last_became_active":"2024-03-09T14:31:01.140832+0000","last_became_peered":"2024-03-09T14:31:01.140832+0000","last_unstale":"2024-03-09T15:24:45.778408+0000","last_undegraded":"2024-03-09T15:24:45.778408+0000","last_fullsized":"2024-03-09T15:24:45.778408+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:24:45.778285+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:24:45.778285+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.778285+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:42.822410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":125,"num_write":99,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:41.625884+0000","last_change":"2024-03-09T15:25:41.625884+0000","last_active":"2024-03-09T15:25:41.625884+0000","last_peered":"2024-03-09T15:25:41.625884+0000","last_clean":"2024-03-09T15:25:41.625884+0000","last_became_active":"2024-03-09T14:50:03.661924+0000","last_became_peered":"2024-03-09T14:50:03.661924+0000","last_unstale":"2024-03-09T15:25:41.625884+0000","last_undegraded":"2024-03-09T15:25:41.625884+0000","last_fullsized":"2024-03-09T15:25:41.625884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:41.625759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:41.625759+0000","last_clean_scrub_stamp":"2024-03-09T15:25:41.625759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:24.631281+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":54,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:29.251865+0000","last_change":"2024-03-09T15:25:29.251889+0000","last_active":"2024-03-09T15:25:29.251865+0000","last_peered":"2024-03-09T15:25:29.251865+0000","last_clean":"2024-03-09T15:25:29.251865+0000","last_became_active":"2024-03-09T14:35:55.602360+0000","last_became_peered":"2024-03-09T14:35:55.602360+0000","last_unstale":"2024-03-09T15:25:29.251865+0000","last_undegraded":"2024-03-09T15:25:29.251865+0000","last_fullsized":"2024-03-09T15:25:29.251865+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:29.251770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:29.251770+0000","last_clean_scrub_stamp":"2024-03-09T15:25:29.251770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:36.241668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":60,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.825903+0000","last_change":"2024-03-09T15:24:49.825928+0000","last_active":"2024-03-09T15:24:49.825903+0000","last_peered":"2024-03-09T15:24:49.825903+0000","last_clean":"2024-03-09T15:24:49.825903+0000","last_became_active":"2024-03-09T14:35:50.579278+0000","last_became_peered":"2024-03-09T14:35:50.579278+0000","last_unstale":"2024-03-09T15:24:49.825903+0000","last_undegraded":"2024-03-09T15:24:49.825903+0000","last_fullsized":"2024-03-09T15:24:49.825903+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:49.825815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:49.825815+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.825815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:32.539779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"257'42","reported_seq":167,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.584614+0000","last_change":"2024-03-09T15:24:53.584614+0000","last_active":"2024-03-09T15:24:53.584614+0000","last_peered":"2024-03-09T15:24:53.584614+0000","last_clean":"2024-03-09T15:24:53.584614+0000","last_became_active":"2024-03-09T14:31:01.139908+0000","last_became_peered":"2024-03-09T14:31:01.139908+0000","last_unstale":"2024-03-09T15:24:53.584614+0000","last_undegraded":"2024-03-09T15:24:53.584614+0000","last_fullsized":"2024-03-09T15:24:53.584614+0000","mapping_epoch":247,"log_start":"0'0","ondisk_log_start":"0'0","created":247,"last_epoch_clean":248,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'42","last_scrub_stamp":"2024-03-09T15:24:53.584460+0000","last_deep_scrub":"257'42","last_deep_scrub_stamp":"2024-03-09T15:24:53.584460+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.584460+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:12.250584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":118,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"260'217","reported_seq":872,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:25.585858+0000","last_change":"2024-03-09T15:25:25.585994+0000","last_active":"2024-03-09T15:25:25.585858+0000","last_peered":"2024-03-09T15:25:25.585858+0000","last_clean":"2024-03-09T15:25:25.585858+0000","last_became_active":"2024-03-09T14:21:54.364177+0000","last_became_peered":"2024-03-09T14:21:54.364177+0000","last_unstale":"2024-03-09T15:25:25.585858+0000","last_undegraded":"2024-03-09T15:25:25.585858+0000","last_fullsized":"2024-03-09T15:25:25.585858+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'217","last_scrub_stamp":"2024-03-09T15:25:25.585764+0000","last_deep_scrub":"260'217","last_deep_scrub_stamp":"2024-03-09T15:25:25.585764+0000","last_clean_scrub_stamp":"2024-03-09T15:25:25.585764+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:00.751759+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097261,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":508,"num_read_kb":32250,"num_write":1232,"num_write_kb":30781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"260'371","reported_seq":1087,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.691701+0000","last_change":"2024-03-09T15:25:09.691729+0000","last_active":"2024-03-09T15:25:09.691701+0000","last_peered":"2024-03-09T15:25:09.691701+0000","last_clean":"2024-03-09T15:25:09.691701+0000","last_became_active":"2024-03-09T14:21:56.357401+0000","last_became_peered":"2024-03-09T14:21:56.357401+0000","last_unstale":"2024-03-09T15:25:09.691701+0000","last_undegraded":"2024-03-09T15:25:09.691701+0000","last_fullsized":"2024-03-09T15:25:09.691701+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'371","last_scrub_stamp":"2024-03-09T15:25:09.691616+0000","last_deep_scrub":"260'371","last_deep_scrub_stamp":"2024-03-09T15:25:09.691616+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.691616+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:22.587397+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1658,"num_read_kb":1396,"num_write":595,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"260'184","reported_seq":805,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.729214+0000","last_change":"2024-03-09T15:25:11.729307+0000","last_active":"2024-03-09T15:25:11.729214+0000","last_peered":"2024-03-09T15:25:11.729214+0000","last_clean":"2024-03-09T15:25:11.729214+0000","last_became_active":"2024-03-09T14:21:54.365525+0000","last_became_peered":"2024-03-09T14:21:54.365525+0000","last_unstale":"2024-03-09T15:25:11.729214+0000","last_undegraded":"2024-03-09T15:25:11.729214+0000","last_fullsized":"2024-03-09T15:25:11.729214+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-03-09T15:25:11.729098+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-03-09T15:25:11.729098+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.729098+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:55.848101+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10770133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":33432,"num_write":993,"num_write_kb":46223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"260'216","reported_seq":840,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.490228+0000","last_change":"2024-03-09T15:25:12.490255+0000","last_active":"2024-03-09T15:25:12.490228+0000","last_peered":"2024-03-09T15:25:12.490228+0000","last_clean":"2024-03-09T15:25:12.490228+0000","last_became_active":"2024-03-09T14:21:56.370855+0000","last_became_peered":"2024-03-09T14:21:56.370855+0000","last_unstale":"2024-03-09T15:25:12.490228+0000","last_undegraded":"2024-03-09T15:25:12.490228+0000","last_fullsized":"2024-03-09T15:25:12.490228+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-03-09T15:25:12.490143+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-03-09T15:25:12.490143+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.490143+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:34:38.295194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":839,"num_read_kb":683,"num_write":319,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"260'172","reported_seq":797,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:26.528036+0000","last_change":"2024-03-09T15:25:26.528077+0000","last_active":"2024-03-09T15:25:26.528036+0000","last_peered":"2024-03-09T15:25:26.528036+0000","last_clean":"2024-03-09T15:25:26.528036+0000","last_became_active":"2024-03-09T14:21:54.357015+0000","last_became_peered":"2024-03-09T14:21:54.357015+0000","last_unstale":"2024-03-09T15:25:26.528036+0000","last_undegraded":"2024-03-09T15:25:26.528036+0000","last_fullsized":"2024-03-09T15:25:26.528036+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'172","last_scrub_stamp":"2024-03-09T15:25:26.527936+0000","last_deep_scrub":"260'172","last_deep_scrub_stamp":"2024-03-09T15:25:26.527936+0000","last_clean_scrub_stamp":"2024-03-09T15:25:26.527936+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:54.443454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262195,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":2073,"num_write":1029,"num_write_kb":29427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"260'107","reported_seq":709,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.136271+0000","last_change":"2024-03-09T15:25:06.136300+0000","last_active":"2024-03-09T15:25:06.136271+0000","last_peered":"2024-03-09T15:25:06.136271+0000","last_clean":"2024-03-09T15:25:06.136271+0000","last_became_active":"2024-03-09T14:21:56.366438+0000","last_became_peered":"2024-03-09T14:21:56.366438+0000","last_unstale":"2024-03-09T15:25:06.136271+0000","last_undegraded":"2024-03-09T15:25:06.136271+0000","last_fullsized":"2024-03-09T15:25:06.136271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'107","last_scrub_stamp":"2024-03-09T15:25:06.136177+0000","last_deep_scrub":"260'107","last_deep_scrub_stamp":"2024-03-09T15:25:06.136177+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.136177+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:14.459481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":338,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"260'193","reported_seq":903,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.780415+0000","last_change":"2024-03-09T15:25:15.780516+0000","last_active":"2024-03-09T15:25:15.780415+0000","last_peered":"2024-03-09T15:25:15.780415+0000","last_clean":"2024-03-09T15:25:15.780415+0000","last_became_active":"2024-03-09T14:21:54.370671+0000","last_became_peered":"2024-03-09T14:21:54.370671+0000","last_unstale":"2024-03-09T15:25:15.780415+0000","last_undegraded":"2024-03-09T15:25:15.780415+0000","last_fullsized":"2024-03-09T15:25:15.780415+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-03-09T15:25:15.780299+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-03-09T15:25:15.780299+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.780299+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:04.896817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1506,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":557,"num_read_kb":57961,"num_write":1122,"num_write_kb":39707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"260'136","reported_seq":731,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.501497+0000","last_change":"2024-03-09T15:25:17.501559+0000","last_active":"2024-03-09T15:25:17.501497+0000","last_peered":"2024-03-09T15:25:17.501497+0000","last_clean":"2024-03-09T15:25:17.501497+0000","last_became_active":"2024-03-09T14:21:56.372346+0000","last_became_peered":"2024-03-09T14:21:56.372346+0000","last_unstale":"2024-03-09T15:25:17.501497+0000","last_undegraded":"2024-03-09T15:25:17.501497+0000","last_fullsized":"2024-03-09T15:25:17.501497+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'136","last_scrub_stamp":"2024-03-09T15:25:17.501384+0000","last_deep_scrub":"260'136","last_deep_scrub_stamp":"2024-03-09T15:25:17.501384+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.501384+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:07.292093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":546,"num_read_kb":444,"num_write":192,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"260'194","reported_seq":933,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:34.619963+0000","last_change":"2024-03-09T15:25:34.620034+0000","last_active":"2024-03-09T15:25:34.619963+0000","last_peered":"2024-03-09T15:25:34.619963+0000","last_clean":"2024-03-09T15:25:34.619963+0000","last_became_active":"2024-03-09T14:21:54.360968+0000","last_became_peered":"2024-03-09T14:21:54.360968+0000","last_unstale":"2024-03-09T15:25:34.619963+0000","last_undegraded":"2024-03-09T15:25:34.619963+0000","last_fullsized":"2024-03-09T15:25:34.619963+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-03-09T15:25:34.619867+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-03-09T15:25:34.619867+0000","last_clean_scrub_stamp":"2024-03-09T15:25:34.619867+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:59.500909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3158107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":544,"num_read_kb":140946,"num_write":1106,"num_write_kb":54269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"260'205","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.785712+0000","last_change":"2024-03-09T15:24:58.785759+0000","last_active":"2024-03-09T15:24:58.785712+0000","last_peered":"2024-03-09T15:24:58.785712+0000","last_clean":"2024-03-09T15:24:58.785712+0000","last_became_active":"2024-03-09T14:21:56.366611+0000","last_became_peered":"2024-03-09T14:21:56.366611+0000","last_unstale":"2024-03-09T15:24:58.785712+0000","last_undegraded":"2024-03-09T15:24:58.785712+0000","last_fullsized":"2024-03-09T15:24:58.785712+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'205","last_scrub_stamp":"2024-03-09T15:24:58.785614+0000","last_deep_scrub":"260'205","last_deep_scrub_stamp":"2024-03-09T15:24:58.785614+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.785614+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:57:45.925649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":831,"num_read_kb":691,"num_write":334,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"260'194","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:24.864182+0000","last_change":"2024-03-09T15:25:24.864218+0000","last_active":"2024-03-09T15:25:24.864182+0000","last_peered":"2024-03-09T15:25:24.864182+0000","last_clean":"2024-03-09T15:25:24.864182+0000","last_became_active":"2024-03-09T14:21:54.369498+0000","last_became_peered":"2024-03-09T14:21:54.369498+0000","last_unstale":"2024-03-09T15:25:24.864182+0000","last_undegraded":"2024-03-09T15:25:24.864182+0000","last_fullsized":"2024-03-09T15:25:24.864182+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-03-09T15:25:24.864067+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-03-09T15:25:24.864067+0000","last_clean_scrub_stamp":"2024-03-09T15:25:24.864067+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:04.511618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1035,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":400,"num_read_kb":13387,"num_write":1038,"num_write_kb":30766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"260'144","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.110497+0000","last_change":"2024-03-09T15:25:09.110523+0000","last_active":"2024-03-09T15:25:09.110497+0000","last_peered":"2024-03-09T15:25:09.110497+0000","last_clean":"2024-03-09T15:25:09.110497+0000","last_became_active":"2024-03-09T14:21:56.357733+0000","last_became_peered":"2024-03-09T14:21:56.357733+0000","last_unstale":"2024-03-09T15:25:09.110497+0000","last_undegraded":"2024-03-09T15:25:09.110497+0000","last_fullsized":"2024-03-09T15:25:09.110497+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'144","last_scrub_stamp":"2024-03-09T15:25:09.110405+0000","last_deep_scrub":"260'144","last_deep_scrub_stamp":"2024-03-09T15:25:09.110405+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.110405+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:56.080014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":643,"num_read_kb":541,"num_write":202,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"260'227","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:32.589085+0000","last_change":"2024-03-09T15:25:32.589157+0000","last_active":"2024-03-09T15:25:32.589085+0000","last_peered":"2024-03-09T15:25:32.589085+0000","last_clean":"2024-03-09T15:25:32.589085+0000","last_became_active":"2024-03-09T14:21:54.360424+0000","last_became_peered":"2024-03-09T14:21:54.360424+0000","last_unstale":"2024-03-09T15:25:32.589085+0000","last_undegraded":"2024-03-09T15:25:32.589085+0000","last_fullsized":"2024-03-09T15:25:32.589085+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'227","last_scrub_stamp":"2024-03-09T15:25:32.588978+0000","last_deep_scrub":"260'227","last_deep_scrub_stamp":"2024-03-09T15:25:32.588978+0000","last_clean_scrub_stamp":"2024-03-09T15:25:32.588978+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:26.207266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244482,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":552,"num_read_kb":3303,"num_write":1207,"num_write_kb":21826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"260'220","reported_seq":916,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.477878+0000","last_change":"2024-03-09T15:24:46.477905+0000","last_active":"2024-03-09T15:24:46.477878+0000","last_peered":"2024-03-09T15:24:46.477878+0000","last_clean":"2024-03-09T15:24:46.477878+0000","last_became_active":"2024-03-09T14:23:32.139608+0000","last_became_peered":"2024-03-09T14:23:32.139608+0000","last_unstale":"2024-03-09T15:24:46.477878+0000","last_undegraded":"2024-03-09T15:24:46.477878+0000","last_fullsized":"2024-03-09T15:24:46.477878+0000","mapping_epoch":35,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'220","last_scrub_stamp":"2024-03-09T15:24:46.477782+0000","last_deep_scrub":"260'220","last_deep_scrub_stamp":"2024-03-09T15:24:46.477782+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.477782+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:21.730641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":958,"num_read_kb":787,"num_write":379,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"260'199","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:38.379724+0000","last_change":"2024-03-09T15:25:38.379784+0000","last_active":"2024-03-09T15:25:38.379724+0000","last_peered":"2024-03-09T15:25:38.379724+0000","last_clean":"2024-03-09T15:25:38.379724+0000","last_became_active":"2024-03-09T14:21:54.367258+0000","last_became_peered":"2024-03-09T14:21:54.367258+0000","last_unstale":"2024-03-09T15:25:38.379724+0000","last_undegraded":"2024-03-09T15:25:38.379724+0000","last_fullsized":"2024-03-09T15:25:38.379724+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'199","last_scrub_stamp":"2024-03-09T15:25:38.379626+0000","last_deep_scrub":"260'199","last_deep_scrub_stamp":"2024-03-09T15:25:38.379626+0000","last_clean_scrub_stamp":"2024-03-09T15:25:38.379626+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:18:50.733315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":42906,"num_write":1255,"num_write_kb":41243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"260'152","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.564729+0000","last_change":"2024-03-09T15:25:04.564755+0000","last_active":"2024-03-09T15:25:04.564729+0000","last_peered":"2024-03-09T15:25:04.564729+0000","last_clean":"2024-03-09T15:25:04.564729+0000","last_became_active":"2024-03-09T14:21:56.362430+0000","last_became_peered":"2024-03-09T14:21:56.362430+0000","last_unstale":"2024-03-09T15:25:04.564729+0000","last_undegraded":"2024-03-09T15:25:04.564729+0000","last_fullsized":"2024-03-09T15:25:04.564729+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-03-09T15:25:04.564635+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-03-09T15:25:04.564635+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.564635+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:35:34.531429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":527,"num_write":229,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"260'153","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.111121+0000","last_change":"2024-03-09T15:25:08.111149+0000","last_active":"2024-03-09T15:25:08.111121+0000","last_peered":"2024-03-09T15:25:08.111121+0000","last_clean":"2024-03-09T15:25:08.111121+0000","last_became_active":"2024-03-09T14:21:56.368099+0000","last_became_peered":"2024-03-09T14:21:56.368099+0000","last_unstale":"2024-03-09T15:25:08.111121+0000","last_undegraded":"2024-03-09T15:25:08.111121+0000","last_fullsized":"2024-03-09T15:25:08.111121+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-03-09T15:25:08.111036+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-03-09T15:25:08.111036+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.111036+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:40:01.586550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":599,"num_write":223,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3063,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"260'172","reported_seq":824,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:31.552447+0000","last_change":"2024-03-09T15:25:31.552482+0000","last_active":"2024-03-09T15:25:31.552447+0000","last_peered":"2024-03-09T15:25:31.552447+0000","last_clean":"2024-03-09T15:25:31.552447+0000","last_became_active":"2024-03-09T14:21:54.357845+0000","last_became_peered":"2024-03-09T14:21:54.357845+0000","last_unstale":"2024-03-09T15:25:31.552447+0000","last_undegraded":"2024-03-09T15:25:31.552447+0000","last_fullsized":"2024-03-09T15:25:31.552447+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'172","last_scrub_stamp":"2024-03-09T15:25:31.552357+0000","last_deep_scrub":"260'172","last_deep_scrub_stamp":"2024-03-09T15:25:31.552357+0000","last_clean_scrub_stamp":"2024-03-09T15:25:31.552357+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:28.145788+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":28832,"num_write":1019,"num_write_kb":15072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"260'147","reported_seq":801,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.470574+0000","last_change":"2024-03-09T15:25:14.470609+0000","last_active":"2024-03-09T15:25:14.470574+0000","last_peered":"2024-03-09T15:25:14.470574+0000","last_clean":"2024-03-09T15:25:14.470574+0000","last_became_active":"2024-03-09T14:21:56.370838+0000","last_became_peered":"2024-03-09T14:21:56.370838+0000","last_unstale":"2024-03-09T15:25:14.470574+0000","last_undegraded":"2024-03-09T15:25:14.470574+0000","last_fullsized":"2024-03-09T15:25:14.470574+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'147","last_scrub_stamp":"2024-03-09T15:25:14.470492+0000","last_deep_scrub":"260'147","last_deep_scrub_stamp":"2024-03-09T15:25:14.470492+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.470492+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:44:51.302254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":535,"num_write":218,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"260'203","reported_seq":830,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.672704+0000","last_change":"2024-03-09T15:25:11.672763+0000","last_active":"2024-03-09T15:25:11.672704+0000","last_peered":"2024-03-09T15:25:11.672704+0000","last_clean":"2024-03-09T15:25:11.672704+0000","last_became_active":"2024-03-09T14:21:54.366175+0000","last_became_peered":"2024-03-09T14:21:54.366175+0000","last_unstale":"2024-03-09T15:25:11.672704+0000","last_undegraded":"2024-03-09T15:25:11.672704+0000","last_fullsized":"2024-03-09T15:25:11.672704+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-03-09T15:25:11.672606+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-03-09T15:25:11.672606+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.672606+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:55.552176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322934,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":20924,"num_write":1102,"num_write_kb":42973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"260'126","reported_seq":722,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.691620+0000","last_change":"2024-03-09T15:25:02.691620+0000","last_active":"2024-03-09T15:25:02.691620+0000","last_peered":"2024-03-09T15:25:02.691620+0000","last_clean":"2024-03-09T15:25:02.691620+0000","last_became_active":"2024-03-09T14:21:56.361786+0000","last_became_peered":"2024-03-09T14:21:56.361786+0000","last_unstale":"2024-03-09T15:25:02.691620+0000","last_undegraded":"2024-03-09T15:25:02.691620+0000","last_fullsized":"2024-03-09T15:25:02.691620+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'126","last_scrub_stamp":"2024-03-09T15:25:02.691466+0000","last_deep_scrub":"260'126","last_deep_scrub_stamp":"2024-03-09T15:25:02.691466+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.691466+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:45.147160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":523,"num_read_kb":421,"num_write":195,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"260'191","reported_seq":892,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.675120+0000","last_change":"2024-03-09T15:25:14.675230+0000","last_active":"2024-03-09T15:25:14.675120+0000","last_peered":"2024-03-09T15:25:14.675120+0000","last_clean":"2024-03-09T15:25:14.675120+0000","last_became_active":"2024-03-09T14:21:54.368741+0000","last_became_peered":"2024-03-09T14:21:54.368741+0000","last_unstale":"2024-03-09T15:25:14.675120+0000","last_undegraded":"2024-03-09T15:25:14.675120+0000","last_fullsized":"2024-03-09T15:25:14.675120+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-03-09T15:25:14.675019+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-03-09T15:25:14.675019+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.675019+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:39.973729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661148,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":641,"num_read_kb":129688,"num_write":1091,"num_write_kb":33880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"260'328","reported_seq":1004,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.519487+0000","last_change":"2024-03-09T15:25:05.519517+0000","last_active":"2024-03-09T15:25:05.519487+0000","last_peered":"2024-03-09T15:25:05.519487+0000","last_clean":"2024-03-09T15:25:05.519487+0000","last_became_active":"2024-03-09T14:21:56.363065+0000","last_became_peered":"2024-03-09T14:21:56.363065+0000","last_unstale":"2024-03-09T15:25:05.519487+0000","last_undegraded":"2024-03-09T15:25:05.519487+0000","last_fullsized":"2024-03-09T15:25:05.519487+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'328","last_scrub_stamp":"2024-03-09T15:25:05.519385+0000","last_deep_scrub":"260'328","last_deep_scrub_stamp":"2024-03-09T15:25:05.519385+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.519385+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:58:41.778187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1401,"num_read_kb":1176,"num_write":482,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25680,"num_omap_keys":101,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"260'188","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.744942+0000","last_change":"2024-03-09T15:24:54.744942+0000","last_active":"2024-03-09T15:24:54.744942+0000","last_peered":"2024-03-09T15:24:54.744942+0000","last_clean":"2024-03-09T15:24:54.744942+0000","last_became_active":"2024-03-09T14:22:31.545331+0000","last_became_peered":"2024-03-09T14:22:31.545331+0000","last_unstale":"2024-03-09T15:24:54.744942+0000","last_undegraded":"2024-03-09T15:24:54.744942+0000","last_fullsized":"2024-03-09T15:24:54.744942+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-03-09T15:24:54.744799+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-03-09T15:24:54.744799+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.744799+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:01.622856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":533,"num_read_kb":17983,"num_write":1110,"num_write_kb":16646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"260'106","reported_seq":697,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.653879+0000","last_change":"2024-03-09T15:25:02.653909+0000","last_active":"2024-03-09T15:25:02.653879+0000","last_peered":"2024-03-09T15:25:02.653879+0000","last_clean":"2024-03-09T15:25:02.653879+0000","last_became_active":"2024-03-09T14:21:56.359492+0000","last_became_peered":"2024-03-09T14:21:56.359492+0000","last_unstale":"2024-03-09T15:25:02.653879+0000","last_undegraded":"2024-03-09T15:25:02.653879+0000","last_fullsized":"2024-03-09T15:25:02.653879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-03-09T15:25:02.653777+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-03-09T15:25:02.653777+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.653777+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:02.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":355,"num_write":148,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"260'193","reported_seq":841,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:28.399719+0000","last_change":"2024-03-09T15:25:28.399793+0000","last_active":"2024-03-09T15:25:28.399719+0000","last_peered":"2024-03-09T15:25:28.399719+0000","last_clean":"2024-03-09T15:25:28.399719+0000","last_became_active":"2024-03-09T14:21:54.370709+0000","last_became_peered":"2024-03-09T14:21:54.370709+0000","last_unstale":"2024-03-09T15:25:28.399719+0000","last_undegraded":"2024-03-09T15:25:28.399719+0000","last_fullsized":"2024-03-09T15:25:28.399719+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-03-09T15:25:28.399628+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-03-09T15:25:28.399628+0000","last_clean_scrub_stamp":"2024-03-09T15:25:28.399628+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:18.210551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":27148,"num_write":1016,"num_write_kb":27520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"260'126","reported_seq":743,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.095912+0000","last_change":"2024-03-09T15:25:05.095938+0000","last_active":"2024-03-09T15:25:05.095912+0000","last_peered":"2024-03-09T15:25:05.095912+0000","last_clean":"2024-03-09T15:25:05.095912+0000","last_became_active":"2024-03-09T14:21:56.360232+0000","last_became_peered":"2024-03-09T14:21:56.360232+0000","last_unstale":"2024-03-09T15:25:05.095912+0000","last_undegraded":"2024-03-09T15:25:05.095912+0000","last_fullsized":"2024-03-09T15:25:05.095912+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'126","last_scrub_stamp":"2024-03-09T15:25:05.095824+0000","last_deep_scrub":"260'126","last_deep_scrub_stamp":"2024-03-09T15:25:05.095824+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.095824+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:27:34.424822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":426,"num_write":179,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"260'248","reported_seq":996,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:32.523543+0000","last_change":"2024-03-09T15:25:32.523625+0000","last_active":"2024-03-09T15:25:32.523543+0000","last_peered":"2024-03-09T15:25:32.523543+0000","last_clean":"2024-03-09T15:25:32.523543+0000","last_became_active":"2024-03-09T14:21:54.370736+0000","last_became_peered":"2024-03-09T14:21:54.370736+0000","last_unstale":"2024-03-09T15:25:32.523543+0000","last_undegraded":"2024-03-09T15:25:32.523543+0000","last_fullsized":"2024-03-09T15:25:32.523543+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'248","last_scrub_stamp":"2024-03-09T15:25:32.523423+0000","last_deep_scrub":"260'248","last_deep_scrub_stamp":"2024-03-09T15:25:32.523423+0000","last_clean_scrub_stamp":"2024-03-09T15:25:32.523423+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:47.482845+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262145,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1066,"num_read_kb":11712,"num_write":1257,"num_write_kb":18090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"260'102","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.040044+0000","last_change":"2024-03-09T15:24:47.040044+0000","last_active":"2024-03-09T15:24:47.040044+0000","last_peered":"2024-03-09T15:24:47.040044+0000","last_clean":"2024-03-09T15:24:47.040044+0000","last_became_active":"2024-03-09T14:22:04.407214+0000","last_became_peered":"2024-03-09T14:22:04.407214+0000","last_unstale":"2024-03-09T15:24:47.040044+0000","last_undegraded":"2024-03-09T15:24:47.040044+0000","last_fullsized":"2024-03-09T15:24:47.040044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'102","last_scrub_stamp":"2024-03-09T15:24:47.039894+0000","last_deep_scrub":"260'102","last_deep_scrub_stamp":"2024-03-09T15:24:47.039894+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.039894+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:55.824228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":94,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"260'116","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.382310+0000","last_change":"2024-03-09T15:25:22.382375+0000","last_active":"2024-03-09T15:25:22.382310+0000","last_peered":"2024-03-09T15:25:22.382310+0000","last_clean":"2024-03-09T15:25:22.382310+0000","last_became_active":"2024-03-09T14:21:56.353992+0000","last_became_peered":"2024-03-09T14:21:56.353992+0000","last_unstale":"2024-03-09T15:25:22.382310+0000","last_undegraded":"2024-03-09T15:25:22.382310+0000","last_fullsized":"2024-03-09T15:25:22.382310+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'116","last_scrub_stamp":"2024-03-09T15:25:22.382208+0000","last_deep_scrub":"260'116","last_deep_scrub_stamp":"2024-03-09T15:25:22.382208+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.382208+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:54.858237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":493,"num_read_kb":403,"num_write":171,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":464,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"260'208","reported_seq":838,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:27.588336+0000","last_change":"2024-03-09T15:25:27.588380+0000","last_active":"2024-03-09T15:25:27.588336+0000","last_peered":"2024-03-09T15:25:27.588336+0000","last_clean":"2024-03-09T15:25:27.588336+0000","last_became_active":"2024-03-09T14:21:54.363972+0000","last_became_peered":"2024-03-09T14:21:54.363972+0000","last_unstale":"2024-03-09T15:25:27.588336+0000","last_undegraded":"2024-03-09T15:25:27.588336+0000","last_fullsized":"2024-03-09T15:25:27.588336+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'208","last_scrub_stamp":"2024-03-09T15:25:27.588244+0000","last_deep_scrub":"260'208","last_deep_scrub_stamp":"2024-03-09T15:25:27.588244+0000","last_clean_scrub_stamp":"2024-03-09T15:25:27.588244+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:26.837892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537676,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":3008,"num_write":992,"num_write_kb":21029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.722025+0000","last_change":"2024-03-09T15:25:06.722047+0000","last_active":"2024-03-09T15:25:06.722025+0000","last_peered":"2024-03-09T15:25:06.722025+0000","last_clean":"2024-03-09T15:25:06.722025+0000","last_became_active":"2024-03-09T14:21:58.369609+0000","last_became_peered":"2024-03-09T14:21:58.369609+0000","last_unstale":"2024-03-09T15:25:06.722025+0000","last_undegraded":"2024-03-09T15:25:06.722025+0000","last_fullsized":"2024-03-09T15:25:06.722025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.721943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.721943+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.721943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:32.418249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"260'216","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.456533+0000","last_change":"2024-03-09T15:25:20.456569+0000","last_active":"2024-03-09T15:25:20.456533+0000","last_peered":"2024-03-09T15:25:20.456533+0000","last_clean":"2024-03-09T15:25:20.456533+0000","last_became_active":"2024-03-09T14:22:00.387691+0000","last_became_peered":"2024-03-09T14:22:00.387691+0000","last_unstale":"2024-03-09T15:25:20.456533+0000","last_undegraded":"2024-03-09T15:25:20.456533+0000","last_fullsized":"2024-03-09T15:25:20.456533+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'216","last_scrub_stamp":"2024-03-09T15:25:20.456450+0000","last_deep_scrub":"260'216","last_deep_scrub_stamp":"2024-03-09T15:25:20.456450+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.456450+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:25.454690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":286,"num_read_kb":392,"num_write":172,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.529323+0000","last_change":"2024-03-09T15:25:07.529363+0000","last_active":"2024-03-09T15:25:07.529323+0000","last_peered":"2024-03-09T15:25:07.529323+0000","last_clean":"2024-03-09T15:25:07.529323+0000","last_became_active":"2024-03-09T14:22:02.390753+0000","last_became_peered":"2024-03-09T14:22:02.390753+0000","last_unstale":"2024-03-09T15:25:07.529323+0000","last_undegraded":"2024-03-09T15:25:07.529323+0000","last_fullsized":"2024-03-09T15:25:07.529323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:07.529229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:07.529229+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.529229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:54.074479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"260'2480","reported_seq":4915,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.559182+0000","last_change":"2024-03-09T15:24:51.559182+0000","last_active":"2024-03-09T15:24:51.559182+0000","last_peered":"2024-03-09T15:24:51.559182+0000","last_clean":"2024-03-09T15:24:51.559182+0000","last_became_active":"2024-03-09T14:22:04.400907+0000","last_became_peered":"2024-03-09T14:22:04.400907+0000","last_unstale":"2024-03-09T15:24:51.559182+0000","last_undegraded":"2024-03-09T15:24:51.559182+0000","last_fullsized":"2024-03-09T15:24:51.559182+0000","mapping_epoch":30,"log_start":"260'2400","ondisk_log_start":"260'2400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2480","last_scrub_stamp":"2024-03-09T15:24:51.559016+0000","last_deep_scrub":"260'2480","last_deep_scrub_stamp":"2024-03-09T15:24:51.559016+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.559016+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":2400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:08.961543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6738,"num_read_kb":6738,"num_write":5013,"num_write_kb":1836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"260'168","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.760990+0000","last_change":"2024-03-09T15:25:05.761017+0000","last_active":"2024-03-09T15:25:05.760990+0000","last_peered":"2024-03-09T15:25:05.760990+0000","last_clean":"2024-03-09T15:25:05.760990+0000","last_became_active":"2024-03-09T14:21:56.360383+0000","last_became_peered":"2024-03-09T14:21:56.360383+0000","last_unstale":"2024-03-09T15:25:05.760990+0000","last_undegraded":"2024-03-09T15:25:05.760990+0000","last_fullsized":"2024-03-09T15:25:05.760990+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-03-09T15:25:05.760898+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-03-09T15:25:05.760898+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.760898+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:33:19.770970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":683,"num_read_kb":549,"num_write":281,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"260'187","reported_seq":825,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:30.474347+0000","last_change":"2024-03-09T15:25:30.474391+0000","last_active":"2024-03-09T15:25:30.474347+0000","last_peered":"2024-03-09T15:25:30.474347+0000","last_clean":"2024-03-09T15:25:30.474347+0000","last_became_active":"2024-03-09T14:21:54.368944+0000","last_became_peered":"2024-03-09T14:21:54.368944+0000","last_unstale":"2024-03-09T15:25:30.474347+0000","last_undegraded":"2024-03-09T15:25:30.474347+0000","last_fullsized":"2024-03-09T15:25:30.474347+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'187","last_scrub_stamp":"2024-03-09T15:25:30.474251+0000","last_deep_scrub":"260'187","last_deep_scrub_stamp":"2024-03-09T15:25:30.474251+0000","last_clean_scrub_stamp":"2024-03-09T15:25:30.474251+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:49:41.234691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":429,"num_read_kb":36262,"num_write":1057,"num_write_kb":43036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:23.392525+0000","last_change":"2024-03-09T15:25:23.392551+0000","last_active":"2024-03-09T15:25:23.392525+0000","last_peered":"2024-03-09T15:25:23.392525+0000","last_clean":"2024-03-09T15:25:23.392525+0000","last_became_active":"2024-03-09T14:21:58.369207+0000","last_became_peered":"2024-03-09T14:21:58.369207+0000","last_unstale":"2024-03-09T15:25:23.392525+0000","last_undegraded":"2024-03-09T15:25:23.392525+0000","last_fullsized":"2024-03-09T15:25:23.392525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:23.392436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:23.392436+0000","last_clean_scrub_stamp":"2024-03-09T15:25:23.392436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:20.992778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"260'111","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.041174+0000","last_change":"2024-03-09T15:25:01.041208+0000","last_active":"2024-03-09T15:25:01.041174+0000","last_peered":"2024-03-09T15:25:01.041174+0000","last_clean":"2024-03-09T15:25:01.041174+0000","last_became_active":"2024-03-09T14:22:00.383479+0000","last_became_peered":"2024-03-09T14:22:00.383479+0000","last_unstale":"2024-03-09T15:25:01.041174+0000","last_undegraded":"2024-03-09T15:25:01.041174+0000","last_fullsized":"2024-03-09T15:25:01.041174+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'111","last_scrub_stamp":"2024-03-09T15:25:01.041080+0000","last_deep_scrub":"260'111","last_deep_scrub_stamp":"2024-03-09T15:25:01.041080+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.041080+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:34.578856+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":105,"num_write":76,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.067706+0000","last_change":"2024-03-09T15:24:53.067728+0000","last_active":"2024-03-09T15:24:53.067706+0000","last_peered":"2024-03-09T15:24:53.067706+0000","last_clean":"2024-03-09T15:24:53.067706+0000","last_became_active":"2024-03-09T14:22:02.401066+0000","last_became_peered":"2024-03-09T14:22:02.401066+0000","last_unstale":"2024-03-09T15:24:53.067706+0000","last_undegraded":"2024-03-09T15:24:53.067706+0000","last_fullsized":"2024-03-09T15:24:53.067706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.067618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.067618+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.067618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:19.960545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"260'118","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.668933+0000","last_change":"2024-03-09T15:24:59.668977+0000","last_active":"2024-03-09T15:24:59.668933+0000","last_peered":"2024-03-09T15:24:59.668933+0000","last_clean":"2024-03-09T15:24:59.668933+0000","last_became_active":"2024-03-09T14:22:04.401475+0000","last_became_peered":"2024-03-09T14:22:04.401475+0000","last_unstale":"2024-03-09T15:24:59.668933+0000","last_undegraded":"2024-03-09T15:24:59.668933+0000","last_fullsized":"2024-03-09T15:24:59.668933+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-03-09T15:24:59.668844+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-03-09T15:24:59.668844+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.668844+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:39.551493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":272,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"260'384","reported_seq":1105,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.486695+0000","last_change":"2024-03-09T15:25:15.486736+0000","last_active":"2024-03-09T15:25:15.486695+0000","last_peered":"2024-03-09T15:25:15.486695+0000","last_clean":"2024-03-09T15:25:15.486695+0000","last_became_active":"2024-03-09T14:21:56.372394+0000","last_became_peered":"2024-03-09T14:21:56.372394+0000","last_unstale":"2024-03-09T15:25:15.486695+0000","last_undegraded":"2024-03-09T15:25:15.486695+0000","last_fullsized":"2024-03-09T15:25:15.486695+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'384","last_scrub_stamp":"2024-03-09T15:25:15.486527+0000","last_deep_scrub":"260'384","last_deep_scrub_stamp":"2024-03-09T15:25:15.486527+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.486527+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:35:25.095101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1643,"num_read_kb":1379,"num_write":698,"num_write_kb":480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"260'173","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.562760+0000","last_change":"2024-03-09T15:25:21.562799+0000","last_active":"2024-03-09T15:25:21.562760+0000","last_peered":"2024-03-09T15:25:21.562760+0000","last_clean":"2024-03-09T15:25:21.562760+0000","last_became_active":"2024-03-09T14:21:54.364671+0000","last_became_peered":"2024-03-09T14:21:54.364671+0000","last_unstale":"2024-03-09T15:25:21.562760+0000","last_undegraded":"2024-03-09T15:25:21.562760+0000","last_fullsized":"2024-03-09T15:25:21.562760+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-03-09T15:25:21.562672+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-03-09T15:25:21.562672+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.562672+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:52.305905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269857,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":24289,"num_write":907,"num_write_kb":41433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:29.381078+0000","last_change":"2024-03-09T15:25:29.381104+0000","last_active":"2024-03-09T15:25:29.381078+0000","last_peered":"2024-03-09T15:25:29.381078+0000","last_clean":"2024-03-09T15:25:29.381078+0000","last_became_active":"2024-03-09T14:21:58.372049+0000","last_became_peered":"2024-03-09T14:21:58.372049+0000","last_unstale":"2024-03-09T15:25:29.381078+0000","last_undegraded":"2024-03-09T15:25:29.381078+0000","last_fullsized":"2024-03-09T15:25:29.381078+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:29.380970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:29.380970+0000","last_clean_scrub_stamp":"2024-03-09T15:25:29.380970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:15.979855+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"260'138","reported_seq":690,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.864375+0000","last_change":"2024-03-09T15:24:51.864375+0000","last_active":"2024-03-09T15:24:51.864375+0000","last_peered":"2024-03-09T15:24:51.864375+0000","last_clean":"2024-03-09T15:24:51.864375+0000","last_became_active":"2024-03-09T14:22:00.383851+0000","last_became_peered":"2024-03-09T14:22:00.383851+0000","last_unstale":"2024-03-09T15:24:51.864375+0000","last_undegraded":"2024-03-09T15:24:51.864375+0000","last_fullsized":"2024-03-09T15:24:51.864375+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'138","last_scrub_stamp":"2024-03-09T15:24:51.864126+0000","last_deep_scrub":"260'138","last_deep_scrub_stamp":"2024-03-09T15:24:51.864126+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.864126+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:26.206830+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":147,"num_write":108,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"260'505","reported_seq":2190,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.563065+0000","last_change":"2024-03-09T15:25:04.563112+0000","last_active":"2024-03-09T15:25:04.563065+0000","last_peered":"2024-03-09T15:25:04.563065+0000","last_clean":"2024-03-09T15:25:04.563065+0000","last_became_active":"2024-03-09T14:22:02.393876+0000","last_became_peered":"2024-03-09T14:22:02.393876+0000","last_unstale":"2024-03-09T15:25:04.563065+0000","last_undegraded":"2024-03-09T15:25:04.563065+0000","last_fullsized":"2024-03-09T15:25:04.563065+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'505","last_scrub_stamp":"2024-03-09T15:25:04.562939+0000","last_deep_scrub":"260'505","last_deep_scrub_stamp":"2024-03-09T15:25:04.562939+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.562939+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:17.199198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"260'202","reported_seq":1022,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.070390+0000","last_change":"2024-03-09T15:24:51.070423+0000","last_active":"2024-03-09T15:24:51.070390+0000","last_peered":"2024-03-09T15:24:51.070390+0000","last_clean":"2024-03-09T15:24:51.070390+0000","last_became_active":"2024-03-09T14:22:04.393383+0000","last_became_peered":"2024-03-09T14:22:04.393383+0000","last_unstale":"2024-03-09T15:24:51.070390+0000","last_undegraded":"2024-03-09T15:24:51.070390+0000","last_fullsized":"2024-03-09T15:24:51.070390+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'202","last_scrub_stamp":"2024-03-09T15:24:51.070293+0000","last_deep_scrub":"260'202","last_deep_scrub_stamp":"2024-03-09T15:24:51.070293+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.070293+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:13.198924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":562,"num_write":441,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"260'278","reported_seq":945,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.325535+0000","last_change":"2024-03-09T15:25:17.325579+0000","last_active":"2024-03-09T15:25:17.325535+0000","last_peered":"2024-03-09T15:25:17.325535+0000","last_clean":"2024-03-09T15:25:17.325535+0000","last_became_active":"2024-03-09T14:21:56.366500+0000","last_became_peered":"2024-03-09T14:21:56.366500+0000","last_unstale":"2024-03-09T15:25:17.325535+0000","last_undegraded":"2024-03-09T15:25:17.325535+0000","last_fullsized":"2024-03-09T15:25:17.325535+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'278","last_scrub_stamp":"2024-03-09T15:25:17.325410+0000","last_deep_scrub":"260'278","last_deep_scrub_stamp":"2024-03-09T15:25:17.325410+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.325410+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:54.798262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1129,"num_read_kb":893,"num_write":439,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"260'332","reported_seq":1065,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.625221+0000","last_change":"2024-03-09T15:25:12.625268+0000","last_active":"2024-03-09T15:25:12.625221+0000","last_peered":"2024-03-09T15:25:12.625221+0000","last_clean":"2024-03-09T15:25:12.625221+0000","last_became_active":"2024-03-09T14:21:54.366238+0000","last_became_peered":"2024-03-09T14:21:54.366238+0000","last_unstale":"2024-03-09T15:25:12.625221+0000","last_undegraded":"2024-03-09T15:25:12.625221+0000","last_fullsized":"2024-03-09T15:25:12.625221+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'332","last_scrub_stamp":"2024-03-09T15:25:12.625124+0000","last_deep_scrub":"260'332","last_deep_scrub_stamp":"2024-03-09T15:25:12.625124+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.625124+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:07.883712+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5264989,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":889,"num_read_kb":69587,"num_write":1468,"num_write_kb":37813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.752492+0000","last_change":"2024-03-09T15:25:12.752516+0000","last_active":"2024-03-09T15:25:12.752492+0000","last_peered":"2024-03-09T15:25:12.752492+0000","last_clean":"2024-03-09T15:25:12.752492+0000","last_became_active":"2024-03-09T14:21:58.369825+0000","last_became_peered":"2024-03-09T14:21:58.369825+0000","last_unstale":"2024-03-09T15:25:12.752492+0000","last_undegraded":"2024-03-09T15:25:12.752492+0000","last_fullsized":"2024-03-09T15:25:12.752492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:12.752399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:12.752399+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.752399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:15.364468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"260'143","reported_seq":726,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.498067+0000","last_change":"2024-03-09T15:25:09.498111+0000","last_active":"2024-03-09T15:25:09.498067+0000","last_peered":"2024-03-09T15:25:09.498067+0000","last_clean":"2024-03-09T15:25:09.498067+0000","last_became_active":"2024-03-09T14:22:00.493800+0000","last_became_peered":"2024-03-09T14:22:00.493800+0000","last_unstale":"2024-03-09T15:25:09.498067+0000","last_undegraded":"2024-03-09T15:25:09.498067+0000","last_fullsized":"2024-03-09T15:25:09.498067+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'143","last_scrub_stamp":"2024-03-09T15:25:09.497977+0000","last_deep_scrub":"260'143","last_deep_scrub_stamp":"2024-03-09T15:25:09.497977+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.497977+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:55:03.584046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4492,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":181,"num_read_kb":259,"num_write":96,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"260'547","reported_seq":2352,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.384416+0000","last_change":"2024-03-09T15:25:02.384416+0000","last_active":"2024-03-09T15:25:02.384416+0000","last_peered":"2024-03-09T15:25:02.384416+0000","last_clean":"2024-03-09T15:25:02.384416+0000","last_became_active":"2024-03-09T14:22:02.399343+0000","last_became_peered":"2024-03-09T14:22:02.399343+0000","last_unstale":"2024-03-09T15:25:02.384416+0000","last_undegraded":"2024-03-09T15:25:02.384416+0000","last_fullsized":"2024-03-09T15:25:02.384416+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'547","last_scrub_stamp":"2024-03-09T15:25:02.384256+0000","last_deep_scrub":"260'547","last_deep_scrub_stamp":"2024-03-09T15:25:02.384256+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.384256+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:27:56.527935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"260'168","reported_seq":781,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.725848+0000","last_change":"2024-03-09T15:25:03.725877+0000","last_active":"2024-03-09T15:25:03.725848+0000","last_peered":"2024-03-09T15:25:03.725848+0000","last_clean":"2024-03-09T15:25:03.725848+0000","last_became_active":"2024-03-09T14:21:56.361164+0000","last_became_peered":"2024-03-09T14:21:56.361164+0000","last_unstale":"2024-03-09T15:25:03.725848+0000","last_undegraded":"2024-03-09T15:25:03.725848+0000","last_fullsized":"2024-03-09T15:25:03.725848+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-03-09T15:25:03.725761+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-03-09T15:25:03.725761+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.725761+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:34:04.800249+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":663,"num_read_kb":529,"num_write":250,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"260'214","reported_seq":867,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:35.665572+0000","last_change":"2024-03-09T15:25:35.665633+0000","last_active":"2024-03-09T15:25:35.665572+0000","last_peered":"2024-03-09T15:25:35.665572+0000","last_clean":"2024-03-09T15:25:35.665572+0000","last_became_active":"2024-03-09T14:21:54.363390+0000","last_became_peered":"2024-03-09T14:21:54.363390+0000","last_unstale":"2024-03-09T15:25:35.665572+0000","last_undegraded":"2024-03-09T15:25:35.665572+0000","last_fullsized":"2024-03-09T15:25:35.665572+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-03-09T15:25:35.665469+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-03-09T15:25:35.665469+0000","last_clean_scrub_stamp":"2024-03-09T15:25:35.665469+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:04.236380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102541,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":2831,"num_write":1215,"num_write_kb":29415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.517568+0000","last_change":"2024-03-09T15:25:18.517605+0000","last_active":"2024-03-09T15:25:18.517568+0000","last_peered":"2024-03-09T15:25:18.517568+0000","last_clean":"2024-03-09T15:25:18.517568+0000","last_became_active":"2024-03-09T14:21:58.368367+0000","last_became_peered":"2024-03-09T14:21:58.368367+0000","last_unstale":"2024-03-09T15:25:18.517568+0000","last_undegraded":"2024-03-09T15:25:18.517568+0000","last_fullsized":"2024-03-09T15:25:18.517568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.517468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.517468+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.517468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:11.159850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"260'240","reported_seq":876,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.697323+0000","last_change":"2024-03-09T15:24:59.697323+0000","last_active":"2024-03-09T15:24:59.697323+0000","last_peered":"2024-03-09T15:24:59.697323+0000","last_clean":"2024-03-09T15:24:59.697323+0000","last_became_active":"2024-03-09T14:22:00.492132+0000","last_became_peered":"2024-03-09T14:22:00.492132+0000","last_unstale":"2024-03-09T15:24:59.697323+0000","last_undegraded":"2024-03-09T15:24:59.697323+0000","last_fullsized":"2024-03-09T15:24:59.697323+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'240","last_scrub_stamp":"2024-03-09T15:24:59.697180+0000","last_deep_scrub":"260'240","last_deep_scrub_stamp":"2024-03-09T15:24:59.697180+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.697180+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:49:56.073618+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8025,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":331,"num_read_kb":401,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.687465+0000","last_change":"2024-03-09T15:25:06.687485+0000","last_active":"2024-03-09T15:25:06.687465+0000","last_peered":"2024-03-09T15:25:06.687465+0000","last_clean":"2024-03-09T15:25:06.687465+0000","last_became_active":"2024-03-09T14:22:02.394141+0000","last_became_peered":"2024-03-09T14:22:02.394141+0000","last_unstale":"2024-03-09T15:25:06.687465+0000","last_undegraded":"2024-03-09T15:25:06.687465+0000","last_fullsized":"2024-03-09T15:25:06.687465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.687390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.687390+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.687390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:06.678671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"260'550","reported_seq":1367,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.584620+0000","last_change":"2024-03-09T15:24:50.584659+0000","last_active":"2024-03-09T15:24:50.584620+0000","last_peered":"2024-03-09T15:24:50.584620+0000","last_clean":"2024-03-09T15:24:50.584620+0000","last_became_active":"2024-03-09T14:22:04.401098+0000","last_became_peered":"2024-03-09T14:22:04.401098+0000","last_unstale":"2024-03-09T15:24:50.584620+0000","last_undegraded":"2024-03-09T15:24:50.584620+0000","last_fullsized":"2024-03-09T15:24:50.584620+0000","mapping_epoch":30,"log_start":"260'500","ondisk_log_start":"260'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'550","last_scrub_stamp":"2024-03-09T15:24:50.584505+0000","last_deep_scrub":"260'550","last_deep_scrub_stamp":"2024-03-09T15:24:50.584505+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.584505+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:19:35.935216+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1267,"num_read_kb":1264,"num_write":1139,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"260'161","reported_seq":783,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.114928+0000","last_change":"2024-03-09T15:25:07.114957+0000","last_active":"2024-03-09T15:25:07.114928+0000","last_peered":"2024-03-09T15:25:07.114928+0000","last_clean":"2024-03-09T15:25:07.114928+0000","last_became_active":"2024-03-09T14:21:56.359949+0000","last_became_peered":"2024-03-09T14:21:56.359949+0000","last_unstale":"2024-03-09T15:25:07.114928+0000","last_undegraded":"2024-03-09T15:25:07.114928+0000","last_fullsized":"2024-03-09T15:25:07.114928+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'161","last_scrub_stamp":"2024-03-09T15:25:07.114846+0000","last_deep_scrub":"260'161","last_deep_scrub_stamp":"2024-03-09T15:25:07.114846+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.114846+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:34:13.158789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":508,"num_write":278,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"260'204","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:33.591054+0000","last_change":"2024-03-09T15:25:33.591103+0000","last_active":"2024-03-09T15:25:33.591054+0000","last_peered":"2024-03-09T15:25:33.591054+0000","last_clean":"2024-03-09T15:25:33.591054+0000","last_became_active":"2024-03-09T14:21:54.360943+0000","last_became_peered":"2024-03-09T14:21:54.360943+0000","last_unstale":"2024-03-09T15:25:33.591054+0000","last_undegraded":"2024-03-09T15:25:33.591054+0000","last_fullsized":"2024-03-09T15:25:33.591054+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'204","last_scrub_stamp":"2024-03-09T15:25:33.590959+0000","last_deep_scrub":"260'204","last_deep_scrub_stamp":"2024-03-09T15:25:33.590959+0000","last_clean_scrub_stamp":"2024-03-09T15:25:33.590959+0000","objects_scrubbed":6,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:10:46.715411+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2652785,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":420,"num_read_kb":7699,"num_write":1172,"num_write_kb":26180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.787962+0000","last_change":"2024-03-09T15:24:53.787986+0000","last_active":"2024-03-09T15:24:53.787962+0000","last_peered":"2024-03-09T15:24:53.787962+0000","last_clean":"2024-03-09T15:24:53.787962+0000","last_became_active":"2024-03-09T14:21:58.371890+0000","last_became_peered":"2024-03-09T14:21:58.371890+0000","last_unstale":"2024-03-09T15:24:53.787962+0000","last_undegraded":"2024-03-09T15:24:53.787962+0000","last_fullsized":"2024-03-09T15:24:53.787962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.787868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.787868+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.787868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:57.602301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"260'141","reported_seq":730,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.425400+0000","last_change":"2024-03-09T15:25:14.425437+0000","last_active":"2024-03-09T15:25:14.425400+0000","last_peered":"2024-03-09T15:25:14.425400+0000","last_clean":"2024-03-09T15:25:14.425400+0000","last_became_active":"2024-03-09T14:22:00.386247+0000","last_became_peered":"2024-03-09T14:22:00.386247+0000","last_unstale":"2024-03-09T15:25:14.425400+0000","last_undegraded":"2024-03-09T15:25:14.425400+0000","last_fullsized":"2024-03-09T15:25:14.425400+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'141","last_scrub_stamp":"2024-03-09T15:25:14.425314+0000","last_deep_scrub":"260'141","last_deep_scrub_stamp":"2024-03-09T15:25:14.425314+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.425314+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:21.749920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5437,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":183,"num_read_kb":254,"num_write":98,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.372105+0000","last_change":"2024-03-09T15:25:03.372105+0000","last_active":"2024-03-09T15:25:03.372105+0000","last_peered":"2024-03-09T15:25:03.372105+0000","last_clean":"2024-03-09T15:25:03.372105+0000","last_became_active":"2024-03-09T14:22:02.398869+0000","last_became_peered":"2024-03-09T14:22:02.398869+0000","last_unstale":"2024-03-09T15:25:03.372105+0000","last_undegraded":"2024-03-09T15:25:03.372105+0000","last_fullsized":"2024-03-09T15:25:03.372105+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:03.371988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:03.371988+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.371988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:17:23.774394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"260'155","reported_seq":662,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.693300+0000","last_change":"2024-03-09T15:25:15.693331+0000","last_active":"2024-03-09T15:25:15.693300+0000","last_peered":"2024-03-09T15:25:15.693300+0000","last_clean":"2024-03-09T15:25:15.693300+0000","last_became_active":"2024-03-09T14:22:04.401412+0000","last_became_peered":"2024-03-09T14:22:04.401412+0000","last_unstale":"2024-03-09T15:25:15.693300+0000","last_undegraded":"2024-03-09T15:25:15.693300+0000","last_fullsized":"2024-03-09T15:25:15.693300+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'155","last_scrub_stamp":"2024-03-09T15:25:15.693213+0000","last_deep_scrub":"260'155","last_deep_scrub_stamp":"2024-03-09T15:25:15.693213+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.693213+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:06.822439+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":164,"num_read_kb":154,"num_write":399,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"260'433","reported_seq":1078,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.704075+0000","last_change":"2024-03-09T15:25:00.704124+0000","last_active":"2024-03-09T15:25:00.704075+0000","last_peered":"2024-03-09T15:25:00.704075+0000","last_clean":"2024-03-09T15:25:00.704075+0000","last_became_active":"2024-03-09T14:21:56.363669+0000","last_became_peered":"2024-03-09T14:21:56.363669+0000","last_unstale":"2024-03-09T15:25:00.704075+0000","last_undegraded":"2024-03-09T15:25:00.704075+0000","last_fullsized":"2024-03-09T15:25:00.704075+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'433","last_scrub_stamp":"2024-03-09T15:25:00.703976+0000","last_deep_scrub":"260'433","last_deep_scrub_stamp":"2024-03-09T15:25:00.703976+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.703976+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:03:12.179793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1656,"num_read_kb":1273,"num_write":709,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"260'207","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.540205+0000","last_change":"2024-03-09T15:25:17.540293+0000","last_active":"2024-03-09T15:25:17.540205+0000","last_peered":"2024-03-09T15:25:17.540205+0000","last_clean":"2024-03-09T15:25:17.540205+0000","last_became_active":"2024-03-09T14:21:54.370292+0000","last_became_peered":"2024-03-09T14:21:54.370292+0000","last_unstale":"2024-03-09T15:25:17.540205+0000","last_undegraded":"2024-03-09T15:25:17.540205+0000","last_fullsized":"2024-03-09T15:25:17.540205+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'207","last_scrub_stamp":"2024-03-09T15:25:17.540099+0000","last_deep_scrub":"260'207","last_deep_scrub_stamp":"2024-03-09T15:25:17.540099+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.540099+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:12:49.189158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102580,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":99411,"num_write":1014,"num_write_kb":38984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.729301+0000","last_change":"2024-03-09T15:24:55.729301+0000","last_active":"2024-03-09T15:24:55.729301+0000","last_peered":"2024-03-09T15:24:55.729301+0000","last_clean":"2024-03-09T15:24:55.729301+0000","last_became_active":"2024-03-09T14:21:58.373062+0000","last_became_peered":"2024-03-09T14:21:58.373062+0000","last_unstale":"2024-03-09T15:24:55.729301+0000","last_undegraded":"2024-03-09T15:24:55.729301+0000","last_fullsized":"2024-03-09T15:24:55.729301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.729162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.729162+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.729162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:18.756282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"260'193","reported_seq":800,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:36.673375+0000","last_change":"2024-03-09T15:25:36.673444+0000","last_active":"2024-03-09T15:25:36.673375+0000","last_peered":"2024-03-09T15:25:36.673375+0000","last_clean":"2024-03-09T15:25:36.673375+0000","last_became_active":"2024-03-09T14:22:00.383903+0000","last_became_peered":"2024-03-09T14:22:00.383903+0000","last_unstale":"2024-03-09T15:25:36.673375+0000","last_undegraded":"2024-03-09T15:25:36.673375+0000","last_fullsized":"2024-03-09T15:25:36.673375+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-03-09T15:25:36.673274+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-03-09T15:25:36.673274+0000","last_clean_scrub_stamp":"2024-03-09T15:25:36.673274+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:06.085568+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":243,"num_read_kb":304,"num_write":138,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"260'512","reported_seq":2145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:34.491139+0000","last_change":"2024-03-09T15:25:34.491170+0000","last_active":"2024-03-09T15:25:34.491139+0000","last_peered":"2024-03-09T15:25:34.491139+0000","last_clean":"2024-03-09T15:25:34.491139+0000","last_became_active":"2024-03-09T14:22:02.397875+0000","last_became_peered":"2024-03-09T14:22:02.397875+0000","last_unstale":"2024-03-09T15:25:34.491139+0000","last_undegraded":"2024-03-09T15:25:34.491139+0000","last_fullsized":"2024-03-09T15:25:34.491139+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'512","last_scrub_stamp":"2024-03-09T15:25:34.491052+0000","last_deep_scrub":"260'512","last_deep_scrub_stamp":"2024-03-09T15:25:34.491052+0000","last_clean_scrub_stamp":"2024-03-09T15:25:34.491052+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:19:22.304766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"260'145","reported_seq":636,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.674375+0000","last_change":"2024-03-09T15:24:58.674451+0000","last_active":"2024-03-09T15:24:58.674375+0000","last_peered":"2024-03-09T15:24:58.674375+0000","last_clean":"2024-03-09T15:24:58.674375+0000","last_became_active":"2024-03-09T14:22:04.401512+0000","last_became_peered":"2024-03-09T14:22:04.401512+0000","last_unstale":"2024-03-09T15:24:58.674375+0000","last_undegraded":"2024-03-09T15:24:58.674375+0000","last_fullsized":"2024-03-09T15:24:58.674375+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'145","last_scrub_stamp":"2024-03-09T15:24:58.674272+0000","last_deep_scrub":"260'145","last_deep_scrub_stamp":"2024-03-09T15:24:58.674272+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.674272+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:37:54.303141+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"260'102","reported_seq":720,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:23.496842+0000","last_change":"2024-03-09T15:25:23.496871+0000","last_active":"2024-03-09T15:25:23.496842+0000","last_peered":"2024-03-09T15:25:23.496842+0000","last_clean":"2024-03-09T15:25:23.496842+0000","last_became_active":"2024-03-09T14:21:56.371245+0000","last_became_peered":"2024-03-09T14:21:56.371245+0000","last_unstale":"2024-03-09T15:25:23.496842+0000","last_undegraded":"2024-03-09T15:25:23.496842+0000","last_fullsized":"2024-03-09T15:25:23.496842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'102","last_scrub_stamp":"2024-03-09T15:25:23.496725+0000","last_deep_scrub":"260'102","last_deep_scrub_stamp":"2024-03-09T15:25:23.496725+0000","last_clean_scrub_stamp":"2024-03-09T15:25:23.496725+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:09.365258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":440,"num_read_kb":370,"num_write":141,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"260'165","reported_seq":798,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:23.895284+0000","last_change":"2024-03-09T15:25:23.895345+0000","last_active":"2024-03-09T15:25:23.895284+0000","last_peered":"2024-03-09T15:25:23.895284+0000","last_clean":"2024-03-09T15:25:23.895284+0000","last_became_active":"2024-03-09T14:21:54.369004+0000","last_became_peered":"2024-03-09T14:21:54.369004+0000","last_unstale":"2024-03-09T15:25:23.895284+0000","last_undegraded":"2024-03-09T15:25:23.895284+0000","last_fullsized":"2024-03-09T15:25:23.895284+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'165","last_scrub_stamp":"2024-03-09T15:25:23.895192+0000","last_deep_scrub":"260'165","last_deep_scrub_stamp":"2024-03-09T15:25:23.895192+0000","last_clean_scrub_stamp":"2024-03-09T15:25:23.895192+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:33:54.677716+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263679,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":41462,"num_write":961,"num_write_kb":24346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.699157+0000","last_change":"2024-03-09T15:24:59.699157+0000","last_active":"2024-03-09T15:24:59.699157+0000","last_peered":"2024-03-09T15:24:59.699157+0000","last_clean":"2024-03-09T15:24:59.699157+0000","last_became_active":"2024-03-09T14:21:58.372570+0000","last_became_peered":"2024-03-09T14:21:58.372570+0000","last_unstale":"2024-03-09T15:24:59.699157+0000","last_undegraded":"2024-03-09T15:24:59.699157+0000","last_fullsized":"2024-03-09T15:24:59.699157+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:59.699022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:59.699022+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.699022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:49.773254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"260'223","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.523098+0000","last_change":"2024-03-09T15:25:14.523171+0000","last_active":"2024-03-09T15:25:14.523098+0000","last_peered":"2024-03-09T15:25:14.523098+0000","last_clean":"2024-03-09T15:25:14.523098+0000","last_became_active":"2024-03-09T14:22:00.383349+0000","last_became_peered":"2024-03-09T14:22:00.383349+0000","last_unstale":"2024-03-09T15:25:14.523098+0000","last_undegraded":"2024-03-09T15:25:14.523098+0000","last_fullsized":"2024-03-09T15:25:14.523098+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'223","last_scrub_stamp":"2024-03-09T15:25:14.523001+0000","last_deep_scrub":"260'223","last_deep_scrub_stamp":"2024-03-09T15:25:14.523001+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.523001+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:46:56.028597+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11412,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":306,"num_read_kb":453,"num_write":160,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.904270+0000","last_change":"2024-03-09T15:24:47.904270+0000","last_active":"2024-03-09T15:24:47.904270+0000","last_peered":"2024-03-09T15:24:47.904270+0000","last_clean":"2024-03-09T15:24:47.904270+0000","last_became_active":"2024-03-09T14:22:02.391385+0000","last_became_peered":"2024-03-09T14:22:02.391385+0000","last_unstale":"2024-03-09T15:24:47.904270+0000","last_undegraded":"2024-03-09T15:24:47.904270+0000","last_fullsized":"2024-03-09T15:24:47.904270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:47.904093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:47.904093+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.904093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:28.926895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"260'97","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.421523+0000","last_change":"2024-03-09T15:24:49.421523+0000","last_active":"2024-03-09T15:24:49.421523+0000","last_peered":"2024-03-09T15:24:49.421523+0000","last_clean":"2024-03-09T15:24:49.421523+0000","last_became_active":"2024-03-09T14:22:04.406118+0000","last_became_peered":"2024-03-09T14:22:04.406118+0000","last_unstale":"2024-03-09T15:24:49.421523+0000","last_undegraded":"2024-03-09T15:24:49.421523+0000","last_fullsized":"2024-03-09T15:24:49.421523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'97","last_scrub_stamp":"2024-03-09T15:24:49.421394+0000","last_deep_scrub":"260'97","last_deep_scrub_stamp":"2024-03-09T15:24:49.421394+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.421394+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:41:26.790404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":498,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":216,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"260'40","reported_seq":608,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:23.198947+0000","last_change":"2024-03-09T15:25:23.198983+0000","last_active":"2024-03-09T15:25:23.198947+0000","last_peered":"2024-03-09T15:25:23.198947+0000","last_clean":"2024-03-09T15:25:23.198947+0000","last_became_active":"2024-03-09T14:21:56.352009+0000","last_became_peered":"2024-03-09T14:21:56.352009+0000","last_unstale":"2024-03-09T15:25:23.198947+0000","last_undegraded":"2024-03-09T15:25:23.198947+0000","last_fullsized":"2024-03-09T15:25:23.198947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'40","last_scrub_stamp":"2024-03-09T15:25:23.198853+0000","last_deep_scrub":"260'40","last_deep_scrub_stamp":"2024-03-09T15:25:23.198853+0000","last_clean_scrub_stamp":"2024-03-09T15:25:23.198853+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:57.492091+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":159,"num_write":54,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"260'163","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:44.886740+0000","last_change":"2024-03-09T15:24:44.886740+0000","last_active":"2024-03-09T15:24:44.886740+0000","last_peered":"2024-03-09T15:24:44.886740+0000","last_clean":"2024-03-09T15:24:44.886740+0000","last_became_active":"2024-03-09T14:22:31.501837+0000","last_became_peered":"2024-03-09T14:22:31.501837+0000","last_unstale":"2024-03-09T15:24:44.886740+0000","last_undegraded":"2024-03-09T15:24:44.886740+0000","last_fullsized":"2024-03-09T15:24:44.886740+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-03-09T15:24:44.886619+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-03-09T15:24:44.886619+0000","last_clean_scrub_stamp":"2024-03-09T15:24:44.886619+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:51.439361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342034,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":373,"num_read_kb":87296,"num_write":884,"num_write_kb":42577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,4],"acting":[2,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":507,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.733968+0000","last_change":"2024-03-09T15:24:57.733968+0000","last_active":"2024-03-09T15:24:57.733968+0000","last_peered":"2024-03-09T15:24:57.733968+0000","last_clean":"2024-03-09T15:24:57.733968+0000","last_became_active":"2024-03-09T14:21:58.372909+0000","last_became_peered":"2024-03-09T14:21:58.372909+0000","last_unstale":"2024-03-09T15:24:57.733968+0000","last_undegraded":"2024-03-09T15:24:57.733968+0000","last_fullsized":"2024-03-09T15:24:57.733968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.733853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.733853+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.733853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:45:49.813483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"260'174","reported_seq":774,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.034667+0000","last_change":"2024-03-09T15:24:59.034667+0000","last_active":"2024-03-09T15:24:59.034667+0000","last_peered":"2024-03-09T15:24:59.034667+0000","last_clean":"2024-03-09T15:24:59.034667+0000","last_became_active":"2024-03-09T14:22:00.383550+0000","last_became_peered":"2024-03-09T14:22:00.383550+0000","last_unstale":"2024-03-09T15:24:59.034667+0000","last_undegraded":"2024-03-09T15:24:59.034667+0000","last_fullsized":"2024-03-09T15:24:59.034667+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'174","last_scrub_stamp":"2024-03-09T15:24:59.034541+0000","last_deep_scrub":"260'174","last_deep_scrub_stamp":"2024-03-09T15:24:59.034541+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.034541+0000","objects_scrubbed":6,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:16.852793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":238,"num_read_kb":307,"num_write":178,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":494,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.618108+0000","last_change":"2024-03-09T15:25:03.618108+0000","last_active":"2024-03-09T15:25:03.618108+0000","last_peered":"2024-03-09T15:25:03.618108+0000","last_clean":"2024-03-09T15:25:03.618108+0000","last_became_active":"2024-03-09T14:22:02.404138+0000","last_became_peered":"2024-03-09T14:22:02.404138+0000","last_unstale":"2024-03-09T15:25:03.618108+0000","last_undegraded":"2024-03-09T15:25:03.618108+0000","last_fullsized":"2024-03-09T15:25:03.618108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:03.617964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:03.617964+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.617964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:08.320244+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"260'105","reported_seq":607,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.492045+0000","last_change":"2024-03-09T15:24:52.492077+0000","last_active":"2024-03-09T15:24:52.492045+0000","last_peered":"2024-03-09T15:24:52.492045+0000","last_clean":"2024-03-09T15:24:52.492045+0000","last_became_active":"2024-03-09T14:22:04.407374+0000","last_became_peered":"2024-03-09T14:22:04.407374+0000","last_unstale":"2024-03-09T15:24:52.492045+0000","last_undegraded":"2024-03-09T15:24:52.492045+0000","last_fullsized":"2024-03-09T15:24:52.492045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'105","last_scrub_stamp":"2024-03-09T15:24:52.491966+0000","last_deep_scrub":"260'105","last_deep_scrub_stamp":"2024-03-09T15:24:52.491966+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.491966+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:27.870108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":241,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"260'253","reported_seq":873,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.076275+0000","last_change":"2024-03-09T15:25:04.076301+0000","last_active":"2024-03-09T15:25:04.076275+0000","last_peered":"2024-03-09T15:25:04.076275+0000","last_clean":"2024-03-09T15:25:04.076275+0000","last_became_active":"2024-03-09T14:21:56.363459+0000","last_became_peered":"2024-03-09T14:21:56.363459+0000","last_unstale":"2024-03-09T15:25:04.076275+0000","last_undegraded":"2024-03-09T15:25:04.076275+0000","last_fullsized":"2024-03-09T15:25:04.076275+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'253","last_scrub_stamp":"2024-03-09T15:25:04.076142+0000","last_deep_scrub":"260'253","last_deep_scrub_stamp":"2024-03-09T15:25:04.076142+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.076142+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:55.042919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":965,"num_read_kb":767,"num_write":365,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"260'175","reported_seq":806,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.647743+0000","last_change":"2024-03-09T15:25:09.647828+0000","last_active":"2024-03-09T15:25:09.647743+0000","last_peered":"2024-03-09T15:25:09.647743+0000","last_clean":"2024-03-09T15:25:09.647743+0000","last_became_active":"2024-03-09T14:21:54.360403+0000","last_became_peered":"2024-03-09T14:21:54.360403+0000","last_unstale":"2024-03-09T15:25:09.647743+0000","last_undegraded":"2024-03-09T15:25:09.647743+0000","last_fullsized":"2024-03-09T15:25:09.647743+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'175","last_scrub_stamp":"2024-03-09T15:25:09.647618+0000","last_deep_scrub":"260'175","last_deep_scrub_stamp":"2024-03-09T15:25:09.647618+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.647618+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:48.900051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":31184,"num_write":930,"num_write_kb":34750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.604965+0000","last_change":"2024-03-09T15:24:58.604965+0000","last_active":"2024-03-09T15:24:58.604965+0000","last_peered":"2024-03-09T15:24:58.604965+0000","last_clean":"2024-03-09T15:24:58.604965+0000","last_became_active":"2024-03-09T14:21:58.375681+0000","last_became_peered":"2024-03-09T14:21:58.375681+0000","last_unstale":"2024-03-09T15:24:58.604965+0000","last_undegraded":"2024-03-09T15:24:58.604965+0000","last_fullsized":"2024-03-09T15:24:58.604965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:58.604810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:58.604810+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.604810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:23.444330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"260'203","reported_seq":809,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.904105+0000","last_change":"2024-03-09T15:24:49.904105+0000","last_active":"2024-03-09T15:24:49.904105+0000","last_peered":"2024-03-09T15:24:49.904105+0000","last_clean":"2024-03-09T15:24:49.904105+0000","last_became_active":"2024-03-09T14:22:00.389481+0000","last_became_peered":"2024-03-09T14:22:00.389481+0000","last_unstale":"2024-03-09T15:24:49.904105+0000","last_undegraded":"2024-03-09T15:24:49.904105+0000","last_fullsized":"2024-03-09T15:24:49.904105+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'203","last_scrub_stamp":"2024-03-09T15:24:49.903932+0000","last_deep_scrub":"260'203","last_deep_scrub_stamp":"2024-03-09T15:24:49.903932+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.903932+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:42.211020+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9198,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":342,"num_write":152,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"260'490","reported_seq":4313,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:45.886883+0000","last_change":"2024-03-09T15:24:45.886883+0000","last_active":"2024-03-09T15:24:45.886883+0000","last_peered":"2024-03-09T15:24:45.886883+0000","last_clean":"2024-03-09T15:24:45.886883+0000","last_became_active":"2024-03-09T14:22:02.395291+0000","last_became_peered":"2024-03-09T14:22:02.395291+0000","last_unstale":"2024-03-09T15:24:45.886883+0000","last_undegraded":"2024-03-09T15:24:45.886883+0000","last_fullsized":"2024-03-09T15:24:45.886883+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'490","last_scrub_stamp":"2024-03-09T15:24:45.886735+0000","last_deep_scrub":"260'490","last_deep_scrub_stamp":"2024-03-09T15:24:45.886735+0000","last_clean_scrub_stamp":"2024-03-09T15:24:45.886735+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:22.443324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"260'206","reported_seq":739,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.404175+0000","last_change":"2024-03-09T15:24:50.404230+0000","last_active":"2024-03-09T15:24:50.404175+0000","last_peered":"2024-03-09T15:24:50.404175+0000","last_clean":"2024-03-09T15:24:50.404175+0000","last_became_active":"2024-03-09T14:22:04.405491+0000","last_became_peered":"2024-03-09T14:22:04.405491+0000","last_unstale":"2024-03-09T15:24:50.404175+0000","last_undegraded":"2024-03-09T15:24:50.404175+0000","last_fullsized":"2024-03-09T15:24:50.404175+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'206","last_scrub_stamp":"2024-03-09T15:24:50.404077+0000","last_deep_scrub":"260'206","last_deep_scrub_stamp":"2024-03-09T15:24:50.404077+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.404077+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:52.580530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":242,"num_read_kb":211,"num_write":390,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"260'264","reported_seq":880,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.177194+0000","last_change":"2024-03-09T15:25:13.177228+0000","last_active":"2024-03-09T15:25:13.177194+0000","last_peered":"2024-03-09T15:25:13.177194+0000","last_clean":"2024-03-09T15:25:13.177194+0000","last_became_active":"2024-03-09T14:21:56.356728+0000","last_became_peered":"2024-03-09T14:21:56.356728+0000","last_unstale":"2024-03-09T15:25:13.177194+0000","last_undegraded":"2024-03-09T15:25:13.177194+0000","last_fullsized":"2024-03-09T15:25:13.177194+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'264","last_scrub_stamp":"2024-03-09T15:25:13.177091+0000","last_deep_scrub":"260'264","last_deep_scrub_stamp":"2024-03-09T15:25:13.177091+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.177091+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:43:54.161576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1029,"num_read_kb":803,"num_write":419,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"260'173","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.244248+0000","last_change":"2024-03-09T15:25:21.244296+0000","last_active":"2024-03-09T15:25:21.244248+0000","last_peered":"2024-03-09T15:25:21.244248+0000","last_clean":"2024-03-09T15:25:21.244248+0000","last_became_active":"2024-03-09T14:21:54.363533+0000","last_became_peered":"2024-03-09T14:21:54.363533+0000","last_unstale":"2024-03-09T15:25:21.244248+0000","last_undegraded":"2024-03-09T15:25:21.244248+0000","last_fullsized":"2024-03-09T15:25:21.244248+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'173","last_scrub_stamp":"2024-03-09T15:25:21.244139+0000","last_deep_scrub":"260'173","last_deep_scrub_stamp":"2024-03-09T15:25:21.244139+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.244139+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:40:09.844295+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":987,"num_read_kb":38802,"num_write":973,"num_write_kb":36083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"260'4","reported_seq":1137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.695535+0000","last_change":"2024-03-09T15:25:10.695535+0000","last_active":"2024-03-09T15:25:10.695535+0000","last_peered":"2024-03-09T15:25:10.695535+0000","last_clean":"2024-03-09T15:25:10.695535+0000","last_became_active":"2024-03-09T14:21:58.370129+0000","last_became_peered":"2024-03-09T14:21:58.370129+0000","last_unstale":"2024-03-09T15:25:10.695535+0000","last_undegraded":"2024-03-09T15:25:10.695535+0000","last_fullsized":"2024-03-09T15:25:10.695535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-03-09T15:25:10.695408+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-03-09T15:25:10.695408+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.695408+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:51.943097+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":626,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"260'95","reported_seq":637,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.399573+0000","last_change":"2024-03-09T15:25:08.399607+0000","last_active":"2024-03-09T15:25:08.399573+0000","last_peered":"2024-03-09T15:25:08.399573+0000","last_clean":"2024-03-09T15:25:08.399573+0000","last_became_active":"2024-03-09T14:22:00.492294+0000","last_became_peered":"2024-03-09T14:22:00.492294+0000","last_unstale":"2024-03-09T15:25:08.399573+0000","last_undegraded":"2024-03-09T15:25:08.399573+0000","last_fullsized":"2024-03-09T15:25:08.399573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'95","last_scrub_stamp":"2024-03-09T15:25:08.399482+0000","last_deep_scrub":"260'95","last_deep_scrub_stamp":"2024-03-09T15:25:08.399482+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.399482+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:15.019711+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":102,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"260'507","reported_seq":2223,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.896169+0000","last_change":"2024-03-09T15:24:55.896169+0000","last_active":"2024-03-09T15:24:55.896169+0000","last_peered":"2024-03-09T15:24:55.896169+0000","last_clean":"2024-03-09T15:24:55.896169+0000","last_became_active":"2024-03-09T14:22:02.396080+0000","last_became_peered":"2024-03-09T14:22:02.396080+0000","last_unstale":"2024-03-09T15:24:55.896169+0000","last_undegraded":"2024-03-09T15:24:55.896169+0000","last_fullsized":"2024-03-09T15:24:55.896169+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'507","last_scrub_stamp":"2024-03-09T15:24:55.896044+0000","last_deep_scrub":"260'507","last_deep_scrub_stamp":"2024-03-09T15:24:55.896044+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.896044+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:57:53.777778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"260'106","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.985028+0000","last_change":"2024-03-09T15:24:48.985058+0000","last_active":"2024-03-09T15:24:48.985028+0000","last_peered":"2024-03-09T15:24:48.985028+0000","last_clean":"2024-03-09T15:24:48.985028+0000","last_became_active":"2024-03-09T14:22:04.402213+0000","last_became_peered":"2024-03-09T14:22:04.402213+0000","last_unstale":"2024-03-09T15:24:48.985028+0000","last_undegraded":"2024-03-09T15:24:48.985028+0000","last_fullsized":"2024-03-09T15:24:48.985028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'106","last_scrub_stamp":"2024-03-09T15:24:48.984934+0000","last_deep_scrub":"260'106","last_deep_scrub_stamp":"2024-03-09T15:24:48.984934+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.984934+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:04.370133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":97,"num_write":253,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"260'50","reported_seq":619,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.572515+0000","last_change":"2024-03-09T15:24:59.572515+0000","last_active":"2024-03-09T15:24:59.572515+0000","last_peered":"2024-03-09T15:24:59.572515+0000","last_clean":"2024-03-09T15:24:59.572515+0000","last_became_active":"2024-03-09T14:21:56.367842+0000","last_became_peered":"2024-03-09T14:21:56.367842+0000","last_unstale":"2024-03-09T15:24:59.572515+0000","last_undegraded":"2024-03-09T15:24:59.572515+0000","last_fullsized":"2024-03-09T15:24:59.572515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'50","last_scrub_stamp":"2024-03-09T15:24:59.572399+0000","last_deep_scrub":"260'50","last_deep_scrub_stamp":"2024-03-09T15:24:59.572399+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.572399+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:43.118034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":194,"num_write":71,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"260'191","reported_seq":835,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:30.386024+0000","last_change":"2024-03-09T15:25:30.386061+0000","last_active":"2024-03-09T15:25:30.386024+0000","last_peered":"2024-03-09T15:25:30.386024+0000","last_clean":"2024-03-09T15:25:30.386024+0000","last_became_active":"2024-03-09T14:21:54.368181+0000","last_became_peered":"2024-03-09T14:21:54.368181+0000","last_unstale":"2024-03-09T15:25:30.386024+0000","last_undegraded":"2024-03-09T15:25:30.386024+0000","last_fullsized":"2024-03-09T15:25:30.386024+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-03-09T15:25:30.385931+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-03-09T15:25:30.385931+0000","last_clean_scrub_stamp":"2024-03-09T15:25:30.385931+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:20:33.848186+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":444,"num_read_kb":26998,"num_write":1069,"num_write_kb":41113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"260'5","reported_seq":832,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.158784+0000","last_change":"2024-03-09T15:25:12.158836+0000","last_active":"2024-03-09T15:25:12.158784+0000","last_peered":"2024-03-09T15:25:12.158784+0000","last_clean":"2024-03-09T15:25:12.158784+0000","last_became_active":"2024-03-09T14:21:58.370998+0000","last_became_peered":"2024-03-09T14:21:58.370998+0000","last_unstale":"2024-03-09T15:25:12.158784+0000","last_undegraded":"2024-03-09T15:25:12.158784+0000","last_fullsized":"2024-03-09T15:25:12.158784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-03-09T15:25:12.158688+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-03-09T15:25:12.158688+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.158688+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:15.796742+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":782,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"260'297","reported_seq":925,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.823567+0000","last_change":"2024-03-09T15:25:16.823613+0000","last_active":"2024-03-09T15:25:16.823567+0000","last_peered":"2024-03-09T15:25:16.823567+0000","last_clean":"2024-03-09T15:25:16.823567+0000","last_became_active":"2024-03-09T14:22:00.385818+0000","last_became_peered":"2024-03-09T14:22:00.385818+0000","last_unstale":"2024-03-09T15:25:16.823567+0000","last_undegraded":"2024-03-09T15:25:16.823567+0000","last_fullsized":"2024-03-09T15:25:16.823567+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'297","last_scrub_stamp":"2024-03-09T15:25:16.823473+0000","last_deep_scrub":"260'297","last_deep_scrub_stamp":"2024-03-09T15:25:16.823473+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.823473+0000","objects_scrubbed":9,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:22:13.193080+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6907,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1015,"num_read_kb":1081,"num_write":1596,"num_write_kb":1438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508974,"num_omap_keys":1176,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":499,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.703264+0000","last_change":"2024-03-09T15:25:01.703264+0000","last_active":"2024-03-09T15:25:01.703264+0000","last_peered":"2024-03-09T15:25:01.703264+0000","last_clean":"2024-03-09T15:25:01.703264+0000","last_became_active":"2024-03-09T14:22:02.404039+0000","last_became_peered":"2024-03-09T14:22:02.404039+0000","last_unstale":"2024-03-09T15:25:01.703264+0000","last_undegraded":"2024-03-09T15:25:01.703264+0000","last_fullsized":"2024-03-09T15:25:01.703264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:01.703150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:01.703150+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.703150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:08.511551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"260'158","reported_seq":679,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.402684+0000","last_change":"2024-03-09T15:24:51.402738+0000","last_active":"2024-03-09T15:24:51.402684+0000","last_peered":"2024-03-09T15:24:51.402684+0000","last_clean":"2024-03-09T15:24:51.402684+0000","last_became_active":"2024-03-09T14:22:04.400246+0000","last_became_peered":"2024-03-09T14:22:04.400246+0000","last_unstale":"2024-03-09T15:24:51.402684+0000","last_undegraded":"2024-03-09T15:24:51.402684+0000","last_fullsized":"2024-03-09T15:24:51.402684+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'158","last_scrub_stamp":"2024-03-09T15:24:51.402553+0000","last_deep_scrub":"260'158","last_deep_scrub_stamp":"2024-03-09T15:24:51.402553+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.402553+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:26.705481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":205,"num_write":398,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"260'84","reported_seq":672,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.741570+0000","last_change":"2024-03-09T15:25:04.741609+0000","last_active":"2024-03-09T15:25:04.741570+0000","last_peered":"2024-03-09T15:25:04.741570+0000","last_clean":"2024-03-09T15:25:04.741570+0000","last_became_active":"2024-03-09T14:21:56.358749+0000","last_became_peered":"2024-03-09T14:21:56.358749+0000","last_unstale":"2024-03-09T15:25:04.741570+0000","last_undegraded":"2024-03-09T15:25:04.741570+0000","last_fullsized":"2024-03-09T15:25:04.741570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'84","last_scrub_stamp":"2024-03-09T15:25:04.741478+0000","last_deep_scrub":"260'84","last_deep_scrub_stamp":"2024-03-09T15:25:04.741478+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.741478+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:14.392332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":347,"num_read_kb":285,"num_write":115,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":530,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:29.570602+0000","last_change":"2024-03-09T15:25:29.570625+0000","last_active":"2024-03-09T15:25:29.570602+0000","last_peered":"2024-03-09T15:25:29.570602+0000","last_clean":"2024-03-09T15:25:29.570602+0000","last_became_active":"2024-03-09T14:21:39.159316+0000","last_became_peered":"2024-03-09T14:21:39.159316+0000","last_unstale":"2024-03-09T15:25:29.570602+0000","last_undegraded":"2024-03-09T15:25:29.570602+0000","last_fullsized":"2024-03-09T15:25:29.570602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:29.570471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:29.570471+0000","last_clean_scrub_stamp":"2024-03-09T15:25:29.570471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:07.151292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"260'155","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:33.386284+0000","last_change":"2024-03-09T15:25:33.386373+0000","last_active":"2024-03-09T15:25:33.386284+0000","last_peered":"2024-03-09T15:25:33.386284+0000","last_clean":"2024-03-09T15:25:33.386284+0000","last_became_active":"2024-03-09T14:21:54.358492+0000","last_became_peered":"2024-03-09T14:21:54.358492+0000","last_unstale":"2024-03-09T15:25:33.386284+0000","last_undegraded":"2024-03-09T15:25:33.386284+0000","last_fullsized":"2024-03-09T15:25:33.386284+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'155","last_scrub_stamp":"2024-03-09T15:25:33.386183+0000","last_deep_scrub":"260'155","last_deep_scrub_stamp":"2024-03-09T15:25:33.386183+0000","last_clean_scrub_stamp":"2024-03-09T15:25:33.386183+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:25.429148+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244523,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":7813,"num_write":928,"num_write_kb":22326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.606385+0000","last_change":"2024-03-09T15:25:22.606451+0000","last_active":"2024-03-09T15:25:22.606385+0000","last_peered":"2024-03-09T15:25:22.606385+0000","last_clean":"2024-03-09T15:25:22.606385+0000","last_became_active":"2024-03-09T14:21:58.372348+0000","last_became_peered":"2024-03-09T14:21:58.372348+0000","last_unstale":"2024-03-09T15:25:22.606385+0000","last_undegraded":"2024-03-09T15:25:22.606385+0000","last_fullsized":"2024-03-09T15:25:22.606385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:22.606287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:22.606287+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.606287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:58.412581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"260'304","reported_seq":1020,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.693795+0000","last_change":"2024-03-09T15:25:01.693832+0000","last_active":"2024-03-09T15:25:01.693795+0000","last_peered":"2024-03-09T15:25:01.693795+0000","last_clean":"2024-03-09T15:25:01.693795+0000","last_became_active":"2024-03-09T14:22:00.387049+0000","last_became_peered":"2024-03-09T14:22:00.387049+0000","last_unstale":"2024-03-09T15:25:01.693795+0000","last_undegraded":"2024-03-09T15:25:01.693795+0000","last_fullsized":"2024-03-09T15:25:01.693795+0000","mapping_epoch":26,"log_start":"257'200","ondisk_log_start":"257'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'304","last_scrub_stamp":"2024-03-09T15:25:01.693710+0000","last_deep_scrub":"260'304","last_deep_scrub_stamp":"2024-03-09T15:25:01.693710+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.693710+0000","objects_scrubbed":7,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:21.881360+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":594,"num_write":476,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89360,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.614033+0000","last_change":"2024-03-09T15:25:05.614058+0000","last_active":"2024-03-09T15:25:05.614033+0000","last_peered":"2024-03-09T15:25:05.614033+0000","last_clean":"2024-03-09T15:25:05.614033+0000","last_became_active":"2024-03-09T14:22:02.403320+0000","last_became_peered":"2024-03-09T14:22:02.403320+0000","last_unstale":"2024-03-09T15:25:05.614033+0000","last_undegraded":"2024-03-09T15:25:05.614033+0000","last_fullsized":"2024-03-09T15:25:05.614033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:05.613943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:05.613943+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.613943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:59:51.795750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"260'218","reported_seq":910,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.700252+0000","last_change":"2024-03-09T15:25:05.700308+0000","last_active":"2024-03-09T15:25:05.700252+0000","last_peered":"2024-03-09T15:25:05.700252+0000","last_clean":"2024-03-09T15:25:05.700252+0000","last_became_active":"2024-03-09T14:22:04.400675+0000","last_became_peered":"2024-03-09T14:22:04.400675+0000","last_unstale":"2024-03-09T15:25:05.700252+0000","last_undegraded":"2024-03-09T15:25:05.700252+0000","last_fullsized":"2024-03-09T15:25:05.700252+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'218","last_scrub_stamp":"2024-03-09T15:25:05.700156+0000","last_deep_scrub":"260'218","last_deep_scrub_stamp":"2024-03-09T15:25:05.700156+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.700156+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:26.306332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":403,"num_read_kb":400,"num_write":448,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"260'339","reported_seq":993,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.642929+0000","last_change":"2024-03-09T15:25:05.642956+0000","last_active":"2024-03-09T15:25:05.642929+0000","last_peered":"2024-03-09T15:25:05.642929+0000","last_clean":"2024-03-09T15:25:05.642929+0000","last_became_active":"2024-03-09T14:21:56.363930+0000","last_became_peered":"2024-03-09T14:21:56.363930+0000","last_unstale":"2024-03-09T15:25:05.642929+0000","last_undegraded":"2024-03-09T15:25:05.642929+0000","last_fullsized":"2024-03-09T15:25:05.642929+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'339","last_scrub_stamp":"2024-03-09T15:25:05.642847+0000","last_deep_scrub":"260'339","last_deep_scrub_stamp":"2024-03-09T15:25:05.642847+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.642847+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:04:47.163093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1349,"num_read_kb":1049,"num_write":543,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.901035+0000","last_change":"2024-03-09T15:25:18.901076+0000","last_active":"2024-03-09T15:25:18.901035+0000","last_peered":"2024-03-09T15:25:18.901035+0000","last_clean":"2024-03-09T15:25:18.901035+0000","last_became_active":"2024-03-09T14:21:39.159487+0000","last_became_peered":"2024-03-09T14:21:39.159487+0000","last_unstale":"2024-03-09T15:25:18.901035+0000","last_undegraded":"2024-03-09T15:25:18.901035+0000","last_fullsized":"2024-03-09T15:25:18.901035+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.900942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.900942+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.900942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:06.181007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"260'156","reported_seq":758,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.183183+0000","last_change":"2024-03-09T15:25:19.183225+0000","last_active":"2024-03-09T15:25:19.183183+0000","last_peered":"2024-03-09T15:25:19.183183+0000","last_clean":"2024-03-09T15:25:19.183183+0000","last_became_active":"2024-03-09T14:21:54.357259+0000","last_became_peered":"2024-03-09T14:21:54.357259+0000","last_unstale":"2024-03-09T15:25:19.183183+0000","last_undegraded":"2024-03-09T15:25:19.183183+0000","last_fullsized":"2024-03-09T15:25:19.183183+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'156","last_scrub_stamp":"2024-03-09T15:25:19.183077+0000","last_deep_scrub":"260'156","last_deep_scrub_stamp":"2024-03-09T15:25:19.183077+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.183077+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:18.345920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081389,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":315,"num_read_kb":1406,"num_write":852,"num_write_kb":22746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.534368+0000","last_change":"2024-03-09T15:25:12.534392+0000","last_active":"2024-03-09T15:25:12.534368+0000","last_peered":"2024-03-09T15:25:12.534368+0000","last_clean":"2024-03-09T15:25:12.534368+0000","last_became_active":"2024-03-09T14:21:58.372398+0000","last_became_peered":"2024-03-09T14:21:58.372398+0000","last_unstale":"2024-03-09T15:25:12.534368+0000","last_undegraded":"2024-03-09T15:25:12.534368+0000","last_fullsized":"2024-03-09T15:25:12.534368+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:12.534280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:12.534280+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.534280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:03.877837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"260'151","reported_seq":716,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.410371+0000","last_change":"2024-03-09T15:25:11.410457+0000","last_active":"2024-03-09T15:25:11.410371+0000","last_peered":"2024-03-09T15:25:11.410371+0000","last_clean":"2024-03-09T15:25:11.410371+0000","last_became_active":"2024-03-09T14:22:00.388552+0000","last_became_peered":"2024-03-09T14:22:00.388552+0000","last_unstale":"2024-03-09T15:25:11.410371+0000","last_undegraded":"2024-03-09T15:25:11.410371+0000","last_fullsized":"2024-03-09T15:25:11.410371+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'151","last_scrub_stamp":"2024-03-09T15:25:11.410269+0000","last_deep_scrub":"260'151","last_deep_scrub_stamp":"2024-03-09T15:25:11.410269+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.410269+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:56.413429+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":175,"num_read_kb":169,"num_write":126,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1630,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.817739+0000","last_change":"2024-03-09T15:24:57.817762+0000","last_active":"2024-03-09T15:24:57.817739+0000","last_peered":"2024-03-09T15:24:57.817739+0000","last_clean":"2024-03-09T15:24:57.817739+0000","last_became_active":"2024-03-09T14:22:02.400836+0000","last_became_peered":"2024-03-09T14:22:02.400836+0000","last_unstale":"2024-03-09T15:24:57.817739+0000","last_undegraded":"2024-03-09T15:24:57.817739+0000","last_fullsized":"2024-03-09T15:24:57.817739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.817646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.817646+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.817646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:33:44.573136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"260'104","reported_seq":621,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:49.552490+0000","last_change":"2024-03-09T15:24:49.552490+0000","last_active":"2024-03-09T15:24:49.552490+0000","last_peered":"2024-03-09T15:24:49.552490+0000","last_clean":"2024-03-09T15:24:49.552490+0000","last_became_active":"2024-03-09T14:22:04.408562+0000","last_became_peered":"2024-03-09T14:22:04.408562+0000","last_unstale":"2024-03-09T15:24:49.552490+0000","last_undegraded":"2024-03-09T15:24:49.552490+0000","last_fullsized":"2024-03-09T15:24:49.552490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'104","last_scrub_stamp":"2024-03-09T15:24:49.552331+0000","last_deep_scrub":"260'104","last_deep_scrub_stamp":"2024-03-09T15:24:49.552331+0000","last_clean_scrub_stamp":"2024-03-09T15:24:49.552331+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:53.826402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":235,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"260'62","reported_seq":633,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.698615+0000","last_change":"2024-03-09T15:25:07.698646+0000","last_active":"2024-03-09T15:25:07.698615+0000","last_peered":"2024-03-09T15:25:07.698615+0000","last_clean":"2024-03-09T15:25:07.698615+0000","last_became_active":"2024-03-09T14:21:56.362653+0000","last_became_peered":"2024-03-09T14:21:56.362653+0000","last_unstale":"2024-03-09T15:25:07.698615+0000","last_undegraded":"2024-03-09T15:25:07.698615+0000","last_fullsized":"2024-03-09T15:25:07.698615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'62","last_scrub_stamp":"2024-03-09T15:25:07.698514+0000","last_deep_scrub":"260'62","last_deep_scrub_stamp":"2024-03-09T15:25:07.698514+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.698514+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:36.666294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":258,"num_read_kb":212,"num_write":85,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":529,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:28.582661+0000","last_change":"2024-03-09T15:25:28.582687+0000","last_active":"2024-03-09T15:25:28.582661+0000","last_peered":"2024-03-09T15:25:28.582661+0000","last_clean":"2024-03-09T15:25:28.582661+0000","last_became_active":"2024-03-09T14:21:39.159320+0000","last_became_peered":"2024-03-09T14:21:39.159320+0000","last_unstale":"2024-03-09T15:25:28.582661+0000","last_undegraded":"2024-03-09T15:25:28.582661+0000","last_fullsized":"2024-03-09T15:25:28.582661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:28.582565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:28.582565+0000","last_clean_scrub_stamp":"2024-03-09T15:25:28.582565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:41.085380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"260'209","reported_seq":866,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.765007+0000","last_change":"2024-03-09T15:25:15.765071+0000","last_active":"2024-03-09T15:25:15.765007+0000","last_peered":"2024-03-09T15:25:15.765007+0000","last_clean":"2024-03-09T15:25:15.765007+0000","last_became_active":"2024-03-09T14:21:54.371117+0000","last_became_peered":"2024-03-09T14:21:54.371117+0000","last_unstale":"2024-03-09T15:25:15.765007+0000","last_undegraded":"2024-03-09T15:25:15.765007+0000","last_fullsized":"2024-03-09T15:25:15.765007+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'209","last_scrub_stamp":"2024-03-09T15:25:15.764908+0000","last_deep_scrub":"260'209","last_deep_scrub_stamp":"2024-03-09T15:25:15.764908+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.764908+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:29:58.109409+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1343543,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":33193,"num_write":1185,"num_write_kb":31212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"260'2","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.503768+0000","last_change":"2024-03-09T15:25:07.503828+0000","last_active":"2024-03-09T15:25:07.503768+0000","last_peered":"2024-03-09T15:25:07.503768+0000","last_clean":"2024-03-09T15:25:07.503768+0000","last_became_active":"2024-03-09T14:21:58.370896+0000","last_became_peered":"2024-03-09T14:21:58.370896+0000","last_unstale":"2024-03-09T15:25:07.503768+0000","last_undegraded":"2024-03-09T15:25:07.503768+0000","last_fullsized":"2024-03-09T15:25:07.503768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-03-09T15:25:07.503662+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-03-09T15:25:07.503662+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.503662+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:43:37.814904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"260'291","reported_seq":1600,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.501226+0000","last_change":"2024-03-09T15:25:08.501284+0000","last_active":"2024-03-09T15:25:08.501226+0000","last_peered":"2024-03-09T15:25:08.501226+0000","last_clean":"2024-03-09T15:25:08.501226+0000","last_became_active":"2024-03-09T14:22:00.494046+0000","last_became_peered":"2024-03-09T14:22:00.494046+0000","last_unstale":"2024-03-09T15:25:08.501226+0000","last_undegraded":"2024-03-09T15:25:08.501226+0000","last_fullsized":"2024-03-09T15:25:08.501226+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'291","last_scrub_stamp":"2024-03-09T15:25:08.501127+0000","last_deep_scrub":"260'291","last_deep_scrub_stamp":"2024-03-09T15:25:08.501127+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.501127+0000","objects_scrubbed":9,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:40.704832+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":252,"num_read_kb":240,"num_write":245,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.546936+0000","last_change":"2024-03-09T15:25:09.546994+0000","last_active":"2024-03-09T15:25:09.546936+0000","last_peered":"2024-03-09T15:25:09.546936+0000","last_clean":"2024-03-09T15:25:09.546936+0000","last_became_active":"2024-03-09T14:22:02.399984+0000","last_became_peered":"2024-03-09T14:22:02.399984+0000","last_unstale":"2024-03-09T15:25:09.546936+0000","last_undegraded":"2024-03-09T15:25:09.546936+0000","last_fullsized":"2024-03-09T15:25:09.546936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:09.546818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:09.546818+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.546818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:11.952986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"260'258","reported_seq":862,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.453607+0000","last_change":"2024-03-09T15:24:55.453607+0000","last_active":"2024-03-09T15:24:55.453607+0000","last_peered":"2024-03-09T15:24:55.453607+0000","last_clean":"2024-03-09T15:24:55.453607+0000","last_became_active":"2024-03-09T14:22:04.404362+0000","last_became_peered":"2024-03-09T14:22:04.404362+0000","last_unstale":"2024-03-09T15:24:55.453607+0000","last_undegraded":"2024-03-09T15:24:55.453607+0000","last_fullsized":"2024-03-09T15:24:55.453607+0000","mapping_epoch":30,"log_start":"260'200","ondisk_log_start":"260'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'258","last_scrub_stamp":"2024-03-09T15:24:55.453479+0000","last_deep_scrub":"260'258","last_deep_scrub_stamp":"2024-03-09T15:24:55.453479+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.453479+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:17:21.907096+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":468,"num_read_kb":491,"num_write":550,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"260'42","reported_seq":594,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.484921+0000","last_change":"2024-03-09T15:25:21.484948+0000","last_active":"2024-03-09T15:25:21.484921+0000","last_peered":"2024-03-09T15:25:21.484921+0000","last_clean":"2024-03-09T15:25:21.484921+0000","last_became_active":"2024-03-09T14:21:56.371337+0000","last_became_peered":"2024-03-09T14:21:56.371337+0000","last_unstale":"2024-03-09T15:25:21.484921+0000","last_undegraded":"2024-03-09T15:25:21.484921+0000","last_fullsized":"2024-03-09T15:25:21.484921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-03-09T15:25:21.484817+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-03-09T15:25:21.484817+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.484817+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:28:10.386548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":531,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.706812+0000","last_change":"2024-03-09T15:25:10.706853+0000","last_active":"2024-03-09T15:25:10.706812+0000","last_peered":"2024-03-09T15:25:10.706812+0000","last_clean":"2024-03-09T15:25:10.706812+0000","last_became_active":"2024-03-09T14:21:38.291657+0000","last_became_peered":"2024-03-09T14:21:38.291657+0000","last_unstale":"2024-03-09T15:25:10.706812+0000","last_undegraded":"2024-03-09T15:25:10.706812+0000","last_fullsized":"2024-03-09T15:25:10.706812+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.706721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.706721+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.706721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:22.457901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"260'119","reported_seq":680,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:30.555832+0000","last_change":"2024-03-09T15:25:30.555865+0000","last_active":"2024-03-09T15:25:30.555832+0000","last_peered":"2024-03-09T15:25:30.555832+0000","last_clean":"2024-03-09T15:25:30.555832+0000","last_became_active":"2024-03-09T14:21:39.589622+0000","last_became_peered":"2024-03-09T14:21:39.589622+0000","last_unstale":"2024-03-09T15:25:30.555832+0000","last_undegraded":"2024-03-09T15:25:30.555832+0000","last_fullsized":"2024-03-09T15:25:30.555832+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-03-09T15:25:30.555736+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-03-09T15:25:30.555736+0000","last_clean_scrub_stamp":"2024-03-09T15:25:30.555736+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:14.977871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"260'146","reported_seq":746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:31.488288+0000","last_change":"2024-03-09T15:25:31.488344+0000","last_active":"2024-03-09T15:25:31.488288+0000","last_peered":"2024-03-09T15:25:31.488288+0000","last_clean":"2024-03-09T15:25:31.488288+0000","last_became_active":"2024-03-09T14:21:54.370305+0000","last_became_peered":"2024-03-09T14:21:54.370305+0000","last_unstale":"2024-03-09T15:25:31.488288+0000","last_undegraded":"2024-03-09T15:25:31.488288+0000","last_fullsized":"2024-03-09T15:25:31.488288+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:25:31.488175+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:25:31.488175+0000","last_clean_scrub_stamp":"2024-03-09T15:25:31.488175+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:30.108594+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":13701,"num_write":831,"num_write_kb":17502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.716565+0000","last_change":"2024-03-09T15:25:08.716609+0000","last_active":"2024-03-09T15:25:08.716565+0000","last_peered":"2024-03-09T15:25:08.716565+0000","last_clean":"2024-03-09T15:25:08.716565+0000","last_became_active":"2024-03-09T14:21:58.369791+0000","last_became_peered":"2024-03-09T14:21:58.369791+0000","last_unstale":"2024-03-09T15:25:08.716565+0000","last_undegraded":"2024-03-09T15:25:08.716565+0000","last_fullsized":"2024-03-09T15:25:08.716565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:08.716469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:08.716469+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.716469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:58:38.379892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"260'741","reported_seq":2365,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.657812+0000","last_change":"2024-03-09T15:25:02.657866+0000","last_active":"2024-03-09T15:25:02.657812+0000","last_peered":"2024-03-09T15:25:02.657812+0000","last_clean":"2024-03-09T15:25:02.657812+0000","last_became_active":"2024-03-09T14:22:00.387764+0000","last_became_peered":"2024-03-09T14:22:00.387764+0000","last_unstale":"2024-03-09T15:25:02.657812+0000","last_undegraded":"2024-03-09T15:25:02.657812+0000","last_fullsized":"2024-03-09T15:25:02.657812+0000","mapping_epoch":26,"log_start":"260'700","ondisk_log_start":"260'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'741","last_scrub_stamp":"2024-03-09T15:25:02.657722+0000","last_deep_scrub":"260'741","last_deep_scrub_stamp":"2024-03-09T15:25:02.657722+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.657722+0000","objects_scrubbed":11,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:21:37.822889+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17200,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":996,"num_read_kb":1152,"num_write":364,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:05.567318+0000","last_change":"2024-03-09T15:25:05.567356+0000","last_active":"2024-03-09T15:25:05.567318+0000","last_peered":"2024-03-09T15:25:05.567318+0000","last_clean":"2024-03-09T15:25:05.567318+0000","last_became_active":"2024-03-09T14:22:02.392170+0000","last_became_peered":"2024-03-09T14:22:02.392170+0000","last_unstale":"2024-03-09T15:25:05.567318+0000","last_undegraded":"2024-03-09T15:25:05.567318+0000","last_fullsized":"2024-03-09T15:25:05.567318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:05.567209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:05.567209+0000","last_clean_scrub_stamp":"2024-03-09T15:25:05.567209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:38.466715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"260'162","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.466183+0000","last_change":"2024-03-09T15:24:53.466183+0000","last_active":"2024-03-09T15:24:53.466183+0000","last_peered":"2024-03-09T15:24:53.466183+0000","last_clean":"2024-03-09T15:24:53.466183+0000","last_became_active":"2024-03-09T14:22:04.397187+0000","last_became_peered":"2024-03-09T14:22:04.397187+0000","last_unstale":"2024-03-09T15:24:53.466183+0000","last_undegraded":"2024-03-09T15:24:53.466183+0000","last_fullsized":"2024-03-09T15:24:53.466183+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'162","last_scrub_stamp":"2024-03-09T15:24:53.466019+0000","last_deep_scrub":"260'162","last_deep_scrub_stamp":"2024-03-09T15:24:53.466019+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.466019+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:47.577441+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":216,"num_write":372,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"260'178","reported_seq":812,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.205478+0000","last_change":"2024-03-09T15:25:17.205502+0000","last_active":"2024-03-09T15:25:17.205478+0000","last_peered":"2024-03-09T15:25:17.205478+0000","last_clean":"2024-03-09T15:25:17.205478+0000","last_became_active":"2024-03-09T14:21:56.356382+0000","last_became_peered":"2024-03-09T14:21:56.356382+0000","last_unstale":"2024-03-09T15:25:17.205478+0000","last_undegraded":"2024-03-09T15:25:17.205478+0000","last_fullsized":"2024-03-09T15:25:17.205478+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'178","last_scrub_stamp":"2024-03-09T15:25:17.205381+0000","last_deep_scrub":"260'178","last_deep_scrub_stamp":"2024-03-09T15:25:17.205381+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.205381+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:49.670666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":721,"num_read_kb":581,"num_write":294,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"260'133","reported_seq":703,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.873015+0000","last_change":"2024-03-09T15:24:50.873015+0000","last_active":"2024-03-09T15:24:50.873015+0000","last_peered":"2024-03-09T15:24:50.873015+0000","last_clean":"2024-03-09T15:24:50.873015+0000","last_became_active":"2024-03-09T14:22:31.510260+0000","last_became_peered":"2024-03-09T14:22:31.510260+0000","last_unstale":"2024-03-09T15:24:50.873015+0000","last_undegraded":"2024-03-09T15:24:50.873015+0000","last_fullsized":"2024-03-09T15:24:50.873015+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'133","last_scrub_stamp":"2024-03-09T15:24:50.872869+0000","last_deep_scrub":"260'133","last_deep_scrub_stamp":"2024-03-09T15:24:50.872869+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.872869+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:54.055792+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506641,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":313,"num_read_kb":4172,"num_write":719,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":532,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:31.385861+0000","last_change":"2024-03-09T15:25:31.385888+0000","last_active":"2024-03-09T15:25:31.385861+0000","last_peered":"2024-03-09T15:25:31.385861+0000","last_clean":"2024-03-09T15:25:31.385861+0000","last_became_active":"2024-03-09T14:21:38.294214+0000","last_became_peered":"2024-03-09T14:21:38.294214+0000","last_unstale":"2024-03-09T15:25:31.385861+0000","last_undegraded":"2024-03-09T15:25:31.385861+0000","last_fullsized":"2024-03-09T15:25:31.385861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:31.385748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:31.385748+0000","last_clean_scrub_stamp":"2024-03-09T15:25:31.385748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:47.457494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:25.438535+0000","last_change":"2024-03-09T15:25:25.438562+0000","last_active":"2024-03-09T15:25:25.438535+0000","last_peered":"2024-03-09T15:25:25.438535+0000","last_clean":"2024-03-09T15:25:25.438535+0000","last_became_active":"2024-03-09T14:21:58.372008+0000","last_became_peered":"2024-03-09T14:21:58.372008+0000","last_unstale":"2024-03-09T15:25:25.438535+0000","last_undegraded":"2024-03-09T15:25:25.438535+0000","last_fullsized":"2024-03-09T15:25:25.438535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:25.438438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:25.438438+0000","last_clean_scrub_stamp":"2024-03-09T15:25:25.438438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:47:36.467606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"260'354","reported_seq":1092,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.504947+0000","last_change":"2024-03-09T15:25:11.504996+0000","last_active":"2024-03-09T15:25:11.504947+0000","last_peered":"2024-03-09T15:25:11.504947+0000","last_clean":"2024-03-09T15:25:11.504947+0000","last_became_active":"2024-03-09T14:22:00.492249+0000","last_became_peered":"2024-03-09T14:22:00.492249+0000","last_unstale":"2024-03-09T15:25:11.504947+0000","last_undegraded":"2024-03-09T15:25:11.504947+0000","last_fullsized":"2024-03-09T15:25:11.504947+0000","mapping_epoch":26,"log_start":"260'300","ondisk_log_start":"260'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'354","last_scrub_stamp":"2024-03-09T15:25:11.504860+0000","last_deep_scrub":"260'354","last_deep_scrub_stamp":"2024-03-09T15:25:11.504860+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.504860+0000","objects_scrubbed":8,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:38:40.112965+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24501,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":500,"num_read_kb":711,"num_write":258,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.418462+0000","last_change":"2024-03-09T15:25:00.418498+0000","last_active":"2024-03-09T15:25:00.418462+0000","last_peered":"2024-03-09T15:25:00.418462+0000","last_clean":"2024-03-09T15:25:00.418462+0000","last_became_active":"2024-03-09T14:22:02.400224+0000","last_became_peered":"2024-03-09T14:22:02.400224+0000","last_unstale":"2024-03-09T15:25:00.418462+0000","last_undegraded":"2024-03-09T15:25:00.418462+0000","last_fullsized":"2024-03-09T15:25:00.418462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:00.418360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:00.418360+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.418360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:58.612049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"260'146","reported_seq":646,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.642995+0000","last_change":"2024-03-09T15:24:53.642995+0000","last_active":"2024-03-09T15:24:53.642995+0000","last_peered":"2024-03-09T15:24:53.642995+0000","last_clean":"2024-03-09T15:24:53.642995+0000","last_became_active":"2024-03-09T14:22:04.400671+0000","last_became_peered":"2024-03-09T14:22:04.400671+0000","last_unstale":"2024-03-09T15:24:53.642995+0000","last_undegraded":"2024-03-09T15:24:53.642995+0000","last_fullsized":"2024-03-09T15:24:53.642995+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:24:53.642875+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:24:53.642875+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.642875+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:43:16.650237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":126,"num_write":335,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"260'152","reported_seq":767,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.319988+0000","last_change":"2024-03-09T15:25:19.320018+0000","last_active":"2024-03-09T15:25:19.319988+0000","last_peered":"2024-03-09T15:25:19.319988+0000","last_clean":"2024-03-09T15:25:19.319988+0000","last_became_active":"2024-03-09T14:21:56.366547+0000","last_became_peered":"2024-03-09T14:21:56.366547+0000","last_unstale":"2024-03-09T15:25:19.319988+0000","last_undegraded":"2024-03-09T15:25:19.319988+0000","last_fullsized":"2024-03-09T15:25:19.319988+0000","mapping_epoch":22,"log_start":"257'100","ondisk_log_start":"257'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'152","last_scrub_stamp":"2024-03-09T15:25:19.319889+0000","last_deep_scrub":"260'152","last_deep_scrub_stamp":"2024-03-09T15:25:19.319889+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.319889+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:31.174513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":597,"num_read_kb":479,"num_write":232,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"260'187","reported_seq":849,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:32.362742+0000","last_change":"2024-03-09T15:25:32.362773+0000","last_active":"2024-03-09T15:25:32.362742+0000","last_peered":"2024-03-09T15:25:32.362742+0000","last_clean":"2024-03-09T15:25:32.362742+0000","last_became_active":"2024-03-09T14:21:54.358024+0000","last_became_peered":"2024-03-09T14:21:54.358024+0000","last_unstale":"2024-03-09T15:25:32.362742+0000","last_undegraded":"2024-03-09T15:25:32.362742+0000","last_fullsized":"2024-03-09T15:25:32.362742+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'187","last_scrub_stamp":"2024-03-09T15:25:32.362647+0000","last_deep_scrub":"260'187","last_deep_scrub_stamp":"2024-03-09T15:25:32.362647+0000","last_clean_scrub_stamp":"2024-03-09T15:25:32.362647+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:38.068563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":496,"num_read_kb":43067,"num_write":1018,"num_write_kb":22018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":537,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.160181+0000","last_change":"2024-03-09T15:25:18.160205+0000","last_active":"2024-03-09T15:25:18.160181+0000","last_peered":"2024-03-09T15:25:18.160181+0000","last_clean":"2024-03-09T15:25:18.160181+0000","last_became_active":"2024-03-09T14:21:39.067714+0000","last_became_peered":"2024-03-09T14:21:39.067714+0000","last_unstale":"2024-03-09T15:25:18.160181+0000","last_undegraded":"2024-03-09T15:25:18.160181+0000","last_fullsized":"2024-03-09T15:25:18.160181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.160083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.160083+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.160083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:44:33.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":517,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.160598+0000","last_change":"2024-03-09T15:25:16.160623+0000","last_active":"2024-03-09T15:25:16.160598+0000","last_peered":"2024-03-09T15:25:16.160598+0000","last_clean":"2024-03-09T15:25:16.160598+0000","last_became_active":"2024-03-09T14:21:58.372824+0000","last_became_peered":"2024-03-09T14:21:58.372824+0000","last_unstale":"2024-03-09T15:25:16.160598+0000","last_undegraded":"2024-03-09T15:25:16.160598+0000","last_fullsized":"2024-03-09T15:25:16.160598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:16.160499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:16.160499+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.160499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:29.796635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"260'128","reported_seq":691,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.082977+0000","last_change":"2024-03-09T15:24:58.083018+0000","last_active":"2024-03-09T15:24:58.082977+0000","last_peered":"2024-03-09T15:24:58.082977+0000","last_clean":"2024-03-09T15:24:58.082977+0000","last_became_active":"2024-03-09T14:22:00.385736+0000","last_became_peered":"2024-03-09T14:22:00.385736+0000","last_unstale":"2024-03-09T15:24:58.082977+0000","last_undegraded":"2024-03-09T15:24:58.082977+0000","last_fullsized":"2024-03-09T15:24:58.082977+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'128","last_scrub_stamp":"2024-03-09T15:24:58.082889+0000","last_deep_scrub":"260'128","last_deep_scrub_stamp":"2024-03-09T15:24:58.082889+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.082889+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:51.050199+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":150,"num_read_kb":144,"num_write":102,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"260'548","reported_seq":4170,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.384356+0000","last_change":"2024-03-09T15:25:06.384380+0000","last_active":"2024-03-09T15:25:06.384356+0000","last_peered":"2024-03-09T15:25:06.384356+0000","last_clean":"2024-03-09T15:25:06.384356+0000","last_became_active":"2024-03-09T14:22:02.398673+0000","last_became_peered":"2024-03-09T14:22:02.398673+0000","last_unstale":"2024-03-09T15:25:06.384356+0000","last_undegraded":"2024-03-09T15:25:06.384356+0000","last_fullsized":"2024-03-09T15:25:06.384356+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'548","last_scrub_stamp":"2024-03-09T15:25:06.384283+0000","last_deep_scrub":"260'548","last_deep_scrub_stamp":"2024-03-09T15:25:06.384283+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.384283+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:00:52.327053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"260'184","reported_seq":676,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.604719+0000","last_change":"2024-03-09T15:24:55.604719+0000","last_active":"2024-03-09T15:24:55.604719+0000","last_peered":"2024-03-09T15:24:55.604719+0000","last_clean":"2024-03-09T15:24:55.604719+0000","last_became_active":"2024-03-09T14:22:04.404763+0000","last_became_peered":"2024-03-09T14:22:04.404763+0000","last_unstale":"2024-03-09T15:24:55.604719+0000","last_undegraded":"2024-03-09T15:24:55.604719+0000","last_fullsized":"2024-03-09T15:24:55.604719+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'184","last_scrub_stamp":"2024-03-09T15:24:55.604578+0000","last_deep_scrub":"260'184","last_deep_scrub_stamp":"2024-03-09T15:24:55.604578+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.604578+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:15.803844+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":103,"num_write":407,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"260'343","reported_seq":1023,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:25.557861+0000","last_change":"2024-03-09T15:25:25.557914+0000","last_active":"2024-03-09T15:25:25.557861+0000","last_peered":"2024-03-09T15:25:25.557861+0000","last_clean":"2024-03-09T15:25:25.557861+0000","last_became_active":"2024-03-09T14:21:56.370518+0000","last_became_peered":"2024-03-09T14:21:56.370518+0000","last_unstale":"2024-03-09T15:25:25.557861+0000","last_undegraded":"2024-03-09T15:25:25.557861+0000","last_fullsized":"2024-03-09T15:25:25.557861+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'343","last_scrub_stamp":"2024-03-09T15:25:25.557743+0000","last_deep_scrub":"260'343","last_deep_scrub_stamp":"2024-03-09T15:25:25.557743+0000","last_clean_scrub_stamp":"2024-03-09T15:25:25.557743+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:33.364992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1394,"num_read_kb":1167,"num_write":558,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"260'211","reported_seq":897,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.730734+0000","last_change":"2024-03-09T15:25:14.730781+0000","last_active":"2024-03-09T15:25:14.730734+0000","last_peered":"2024-03-09T15:25:14.730734+0000","last_clean":"2024-03-09T15:25:14.730734+0000","last_became_active":"2024-03-09T14:21:54.370375+0000","last_became_peered":"2024-03-09T14:21:54.370375+0000","last_unstale":"2024-03-09T15:25:14.730734+0000","last_undegraded":"2024-03-09T15:25:14.730734+0000","last_fullsized":"2024-03-09T15:25:14.730734+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'211","last_scrub_stamp":"2024-03-09T15:25:14.730645+0000","last_deep_scrub":"260'211","last_deep_scrub_stamp":"2024-03-09T15:25:14.730645+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.730645+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:22.608834+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117883,"num_write":1122,"num_write_kb":46713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.638840+0000","last_change":"2024-03-09T15:25:08.638864+0000","last_active":"2024-03-09T15:25:08.638840+0000","last_peered":"2024-03-09T15:25:08.638840+0000","last_clean":"2024-03-09T15:25:08.638840+0000","last_became_active":"2024-03-09T14:21:39.159253+0000","last_became_peered":"2024-03-09T14:21:39.159253+0000","last_unstale":"2024-03-09T15:25:08.638840+0000","last_undegraded":"2024-03-09T15:25:08.638840+0000","last_fullsized":"2024-03-09T15:25:08.638840+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:08.638753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:08.638753+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.638753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:34.351820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.865681+0000","last_change":"2024-03-09T15:24:56.865719+0000","last_active":"2024-03-09T15:24:56.865681+0000","last_peered":"2024-03-09T15:24:56.865681+0000","last_clean":"2024-03-09T15:24:56.865681+0000","last_became_active":"2024-03-09T14:21:58.371469+0000","last_became_peered":"2024-03-09T14:21:58.371469+0000","last_unstale":"2024-03-09T15:24:56.865681+0000","last_undegraded":"2024-03-09T15:24:56.865681+0000","last_fullsized":"2024-03-09T15:24:56.865681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.865592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.865592+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.865592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:13.969932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"260'245","reported_seq":831,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.683480+0000","last_change":"2024-03-09T15:25:04.683527+0000","last_active":"2024-03-09T15:25:04.683480+0000","last_peered":"2024-03-09T15:25:04.683480+0000","last_clean":"2024-03-09T15:25:04.683480+0000","last_became_active":"2024-03-09T14:22:00.492311+0000","last_became_peered":"2024-03-09T14:22:00.492311+0000","last_unstale":"2024-03-09T15:25:04.683480+0000","last_undegraded":"2024-03-09T15:25:04.683480+0000","last_fullsized":"2024-03-09T15:25:04.683480+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'245","last_scrub_stamp":"2024-03-09T15:25:04.683390+0000","last_deep_scrub":"260'245","last_deep_scrub_stamp":"2024-03-09T15:25:04.683390+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.683390+0000","objects_scrubbed":8,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:53:43.615136+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":294,"num_read_kb":287,"num_write":280,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"260'541","reported_seq":2701,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.661233+0000","last_change":"2024-03-09T15:24:58.661257+0000","last_active":"2024-03-09T15:24:58.661233+0000","last_peered":"2024-03-09T15:24:58.661233+0000","last_clean":"2024-03-09T15:24:58.661233+0000","last_became_active":"2024-03-09T14:22:02.395195+0000","last_became_peered":"2024-03-09T14:22:02.395195+0000","last_unstale":"2024-03-09T15:24:58.661233+0000","last_undegraded":"2024-03-09T15:24:58.661233+0000","last_fullsized":"2024-03-09T15:24:58.661233+0000","mapping_epoch":28,"log_start":"260'500","ondisk_log_start":"260'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'541","last_scrub_stamp":"2024-03-09T15:24:58.661130+0000","last_deep_scrub":"260'541","last_deep_scrub_stamp":"2024-03-09T15:24:58.661130+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.661130+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:40.797801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"260'118","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.502386+0000","last_change":"2024-03-09T15:24:54.502386+0000","last_active":"2024-03-09T15:24:54.502386+0000","last_peered":"2024-03-09T15:24:54.502386+0000","last_clean":"2024-03-09T15:24:54.502386+0000","last_became_active":"2024-03-09T14:22:04.403771+0000","last_became_peered":"2024-03-09T14:22:04.403771+0000","last_unstale":"2024-03-09T15:24:54.502386+0000","last_undegraded":"2024-03-09T15:24:54.502386+0000","last_fullsized":"2024-03-09T15:24:54.502386+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'118","last_scrub_stamp":"2024-03-09T15:24:54.502257+0000","last_deep_scrub":"260'118","last_deep_scrub_stamp":"2024-03-09T15:24:54.502257+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.502257+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:35.717063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":93,"num_write":272,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"260'90","reported_seq":683,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:09.739165+0000","last_change":"2024-03-09T15:25:09.739188+0000","last_active":"2024-03-09T15:25:09.739165+0000","last_peered":"2024-03-09T15:25:09.739165+0000","last_clean":"2024-03-09T15:25:09.739165+0000","last_became_active":"2024-03-09T14:21:56.358974+0000","last_became_peered":"2024-03-09T14:21:56.358974+0000","last_unstale":"2024-03-09T15:25:09.739165+0000","last_undegraded":"2024-03-09T15:25:09.739165+0000","last_fullsized":"2024-03-09T15:25:09.739165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'90","last_scrub_stamp":"2024-03-09T15:25:09.739074+0000","last_deep_scrub":"260'90","last_deep_scrub_stamp":"2024-03-09T15:25:09.739074+0000","last_clean_scrub_stamp":"2024-03-09T15:25:09.739074+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:17:14.880002+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":317,"num_write":130,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"260'197","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.786576+0000","last_change":"2024-03-09T15:25:13.786637+0000","last_active":"2024-03-09T15:25:13.786576+0000","last_peered":"2024-03-09T15:25:13.786576+0000","last_clean":"2024-03-09T15:25:13.786576+0000","last_became_active":"2024-03-09T14:21:54.371338+0000","last_became_peered":"2024-03-09T14:21:54.371338+0000","last_unstale":"2024-03-09T15:25:13.786576+0000","last_undegraded":"2024-03-09T15:25:13.786576+0000","last_fullsized":"2024-03-09T15:25:13.786576+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:25:13.786465+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:25:13.786465+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.786465+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:01:02.974753+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":52342,"num_write":1104,"num_write_kb":43930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":528,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.685725+0000","last_change":"2024-03-09T15:25:07.685762+0000","last_active":"2024-03-09T15:25:07.685725+0000","last_peered":"2024-03-09T15:25:07.685725+0000","last_clean":"2024-03-09T15:25:07.685725+0000","last_became_active":"2024-03-09T14:21:38.291236+0000","last_became_peered":"2024-03-09T14:21:38.291236+0000","last_unstale":"2024-03-09T15:25:07.685725+0000","last_undegraded":"2024-03-09T15:25:07.685725+0000","last_fullsized":"2024-03-09T15:25:07.685725+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:07.685604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:07.685604+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.685604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:04.564583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.557619+0000","last_change":"2024-03-09T15:25:11.557641+0000","last_active":"2024-03-09T15:25:11.557619+0000","last_peered":"2024-03-09T15:25:11.557619+0000","last_clean":"2024-03-09T15:25:11.557619+0000","last_became_active":"2024-03-09T14:21:58.369263+0000","last_became_peered":"2024-03-09T14:21:58.369263+0000","last_unstale":"2024-03-09T15:25:11.557619+0000","last_undegraded":"2024-03-09T15:25:11.557619+0000","last_fullsized":"2024-03-09T15:25:11.557619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:11.557532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:11.557532+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.557532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:50:37.941802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"260'287","reported_seq":967,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.499889+0000","last_change":"2024-03-09T15:25:18.499933+0000","last_active":"2024-03-09T15:25:18.499889+0000","last_peered":"2024-03-09T15:25:18.499889+0000","last_clean":"2024-03-09T15:25:18.499889+0000","last_became_active":"2024-03-09T14:22:00.386466+0000","last_became_peered":"2024-03-09T14:22:00.386466+0000","last_unstale":"2024-03-09T15:25:18.499889+0000","last_undegraded":"2024-03-09T15:25:18.499889+0000","last_fullsized":"2024-03-09T15:25:18.499889+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'287","last_scrub_stamp":"2024-03-09T15:25:18.499784+0000","last_deep_scrub":"260'287","last_deep_scrub_stamp":"2024-03-09T15:25:18.499784+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.499784+0000","objects_scrubbed":9,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:39.485013+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15555,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":412,"num_read_kb":552,"num_write":228,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.080772+0000","last_change":"2024-03-09T15:24:54.080795+0000","last_active":"2024-03-09T15:24:54.080772+0000","last_peered":"2024-03-09T15:24:54.080772+0000","last_clean":"2024-03-09T15:24:54.080772+0000","last_became_active":"2024-03-09T14:22:02.400055+0000","last_became_peered":"2024-03-09T14:22:02.400055+0000","last_unstale":"2024-03-09T15:24:54.080772+0000","last_undegraded":"2024-03-09T15:24:54.080772+0000","last_fullsized":"2024-03-09T15:24:54.080772+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:54.080680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:54.080680+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.080680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:08:50.163746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"260'189","reported_seq":693,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.667141+0000","last_change":"2024-03-09T15:24:57.667141+0000","last_active":"2024-03-09T15:24:57.667141+0000","last_peered":"2024-03-09T15:24:57.667141+0000","last_clean":"2024-03-09T15:24:57.667141+0000","last_became_active":"2024-03-09T14:22:04.401819+0000","last_became_peered":"2024-03-09T14:22:04.401819+0000","last_unstale":"2024-03-09T15:24:57.667141+0000","last_undegraded":"2024-03-09T15:24:57.667141+0000","last_fullsized":"2024-03-09T15:24:57.667141+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'189","last_scrub_stamp":"2024-03-09T15:24:57.667023+0000","last_deep_scrub":"260'189","last_deep_scrub_stamp":"2024-03-09T15:24:57.667023+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.667023+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:01.539204+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":395,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"260'135","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.677121+0000","last_change":"2024-03-09T15:25:01.677151+0000","last_active":"2024-03-09T15:25:01.677121+0000","last_peered":"2024-03-09T15:25:01.677121+0000","last_clean":"2024-03-09T15:25:01.677121+0000","last_became_active":"2024-03-09T14:22:04.400771+0000","last_became_peered":"2024-03-09T14:22:04.400771+0000","last_unstale":"2024-03-09T15:25:01.677121+0000","last_undegraded":"2024-03-09T15:25:01.677121+0000","last_fullsized":"2024-03-09T15:25:01.677121+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'135","last_scrub_stamp":"2024-03-09T15:25:01.677031+0000","last_deep_scrub":"260'135","last_deep_scrub_stamp":"2024-03-09T15:25:01.677031+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.677031+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:45:22.411149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":203,"num_read_kb":198,"num_write":305,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"260'4072","reported_seq":4682,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:25.182503+0000","last_change":"2024-03-09T15:25:25.182554+0000","last_active":"2024-03-09T15:25:25.182503+0000","last_peered":"2024-03-09T15:25:25.182503+0000","last_clean":"2024-03-09T15:25:25.182503+0000","last_became_active":"2024-03-09T14:21:56.355116+0000","last_became_peered":"2024-03-09T14:21:56.355116+0000","last_unstale":"2024-03-09T15:25:25.182503+0000","last_undegraded":"2024-03-09T15:25:25.182503+0000","last_fullsized":"2024-03-09T15:25:25.182503+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4072","last_scrub_stamp":"2024-03-09T15:25:25.182387+0000","last_deep_scrub":"260'4072","last_deep_scrub_stamp":"2024-03-09T15:25:25.182387+0000","last_clean_scrub_stamp":"2024-03-09T15:25:25.182387+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":3000,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:00.245070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14361,"num_read_kb":11653,"num_write":6115,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"260'149","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.213101+0000","last_change":"2024-03-09T15:25:20.213166+0000","last_active":"2024-03-09T15:25:20.213101+0000","last_peered":"2024-03-09T15:25:20.213101+0000","last_clean":"2024-03-09T15:25:20.213101+0000","last_became_active":"2024-03-09T14:21:54.361912+0000","last_became_peered":"2024-03-09T14:21:54.361912+0000","last_unstale":"2024-03-09T15:25:20.213101+0000","last_undegraded":"2024-03-09T15:25:20.213101+0000","last_fullsized":"2024-03-09T15:25:20.213101+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-03-09T15:25:20.212978+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-03-09T15:25:20.212978+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.212978+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:37:34.335711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":274,"num_read_kb":29246,"num_write":815,"num_write_kb":40591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":508,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.533737+0000","last_change":"2024-03-09T15:24:56.533737+0000","last_active":"2024-03-09T15:24:56.533737+0000","last_peered":"2024-03-09T15:24:56.533737+0000","last_clean":"2024-03-09T15:24:56.533737+0000","last_became_active":"2024-03-09T14:21:58.371146+0000","last_became_peered":"2024-03-09T14:21:58.371146+0000","last_unstale":"2024-03-09T15:24:56.533737+0000","last_undegraded":"2024-03-09T15:24:56.533737+0000","last_fullsized":"2024-03-09T15:24:56.533737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:56.533621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:56.533621+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.533621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:13:17.029403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"260'151","reported_seq":746,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:39.383723+0000","last_change":"2024-03-09T15:25:39.383788+0000","last_active":"2024-03-09T15:25:39.383723+0000","last_peered":"2024-03-09T15:25:39.383723+0000","last_clean":"2024-03-09T15:25:39.383723+0000","last_became_active":"2024-03-09T14:22:00.386227+0000","last_became_peered":"2024-03-09T14:22:00.386227+0000","last_unstale":"2024-03-09T15:25:39.383723+0000","last_undegraded":"2024-03-09T15:25:39.383723+0000","last_fullsized":"2024-03-09T15:25:39.383723+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'151","last_scrub_stamp":"2024-03-09T15:25:39.383610+0000","last_deep_scrub":"260'151","last_deep_scrub_stamp":"2024-03-09T15:25:39.383610+0000","last_clean_scrub_stamp":"2024-03-09T15:25:39.383610+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:31.860237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14229,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":208,"num_read_kb":294,"num_write":114,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":502,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.412083+0000","last_change":"2024-03-09T15:25:04.412130+0000","last_active":"2024-03-09T15:25:04.412083+0000","last_peered":"2024-03-09T15:25:04.412083+0000","last_clean":"2024-03-09T15:25:04.412083+0000","last_became_active":"2024-03-09T14:22:02.398779+0000","last_became_peered":"2024-03-09T14:22:02.398779+0000","last_unstale":"2024-03-09T15:25:04.412083+0000","last_undegraded":"2024-03-09T15:25:04.412083+0000","last_fullsized":"2024-03-09T15:25:04.412083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:04.411983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:04.411983+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.411983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:08:57.801480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"260'134","reported_seq":663,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:58.410479+0000","last_change":"2024-03-09T15:24:58.410504+0000","last_active":"2024-03-09T15:24:58.410479+0000","last_peered":"2024-03-09T15:24:58.410479+0000","last_clean":"2024-03-09T15:24:58.410479+0000","last_became_active":"2024-03-09T14:22:04.402874+0000","last_became_peered":"2024-03-09T14:22:04.402874+0000","last_unstale":"2024-03-09T15:24:58.410479+0000","last_undegraded":"2024-03-09T15:24:58.410479+0000","last_fullsized":"2024-03-09T15:24:58.410479+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'134","last_scrub_stamp":"2024-03-09T15:24:58.410391+0000","last_deep_scrub":"260'134","last_deep_scrub_stamp":"2024-03-09T15:24:58.410391+0000","last_clean_scrub_stamp":"2024-03-09T15:24:58.410391+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:52.946147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":175,"num_write":316,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"260'4079","reported_seq":4660,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.645255+0000","last_change":"2024-03-09T15:25:01.645309+0000","last_active":"2024-03-09T15:25:01.645255+0000","last_peered":"2024-03-09T15:25:01.645255+0000","last_clean":"2024-03-09T15:25:01.645255+0000","last_became_active":"2024-03-09T14:21:56.365276+0000","last_became_peered":"2024-03-09T14:21:56.365276+0000","last_unstale":"2024-03-09T15:25:01.645255+0000","last_undegraded":"2024-03-09T15:25:01.645255+0000","last_fullsized":"2024-03-09T15:25:01.645255+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4079","last_scrub_stamp":"2024-03-09T15:25:01.645158+0000","last_deep_scrub":"260'4079","last_deep_scrub_stamp":"2024-03-09T15:25:01.645158+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.645158+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":3000,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:47.461607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14344,"num_read_kb":11621,"num_write":6122,"num_write_kb":3052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"260'214","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.558956+0000","last_change":"2024-03-09T15:25:19.559011+0000","last_active":"2024-03-09T15:25:19.558956+0000","last_peered":"2024-03-09T15:25:19.558956+0000","last_clean":"2024-03-09T15:25:19.558956+0000","last_became_active":"2024-03-09T14:21:54.369606+0000","last_became_peered":"2024-03-09T14:21:54.369606+0000","last_unstale":"2024-03-09T15:25:19.558956+0000","last_undegraded":"2024-03-09T15:25:19.558956+0000","last_fullsized":"2024-03-09T15:25:19.558956+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-03-09T15:25:19.558867+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-03-09T15:25:19.558867+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.558867+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:34:30.154058+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46826,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":34568,"num_write":1093,"num_write_kb":30104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":510,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:27.381840+0000","last_change":"2024-03-09T15:25:27.381862+0000","last_active":"2024-03-09T15:25:27.381840+0000","last_peered":"2024-03-09T15:25:27.381840+0000","last_clean":"2024-03-09T15:25:27.381840+0000","last_became_active":"2024-03-09T14:21:58.372794+0000","last_became_peered":"2024-03-09T14:21:58.372794+0000","last_unstale":"2024-03-09T15:25:27.381840+0000","last_undegraded":"2024-03-09T15:25:27.381840+0000","last_fullsized":"2024-03-09T15:25:27.381840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:27.381744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:27.381744+0000","last_clean_scrub_stamp":"2024-03-09T15:25:27.381744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:36:55.093826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"260'47","reported_seq":558,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.473935+0000","last_change":"2024-03-09T15:25:22.473970+0000","last_active":"2024-03-09T15:25:22.473935+0000","last_peered":"2024-03-09T15:25:22.473935+0000","last_clean":"2024-03-09T15:25:22.473935+0000","last_became_active":"2024-03-09T14:22:00.389663+0000","last_became_peered":"2024-03-09T14:22:00.389663+0000","last_unstale":"2024-03-09T15:25:22.473935+0000","last_undegraded":"2024-03-09T15:25:22.473935+0000","last_fullsized":"2024-03-09T15:25:22.473935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'47","last_scrub_stamp":"2024-03-09T15:25:22.473789+0000","last_deep_scrub":"260'47","last_deep_scrub_stamp":"2024-03-09T15:25:22.473789+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.473789+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:14:14.792199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.572330+0000","last_change":"2024-03-09T15:25:03.572355+0000","last_active":"2024-03-09T15:25:03.572330+0000","last_peered":"2024-03-09T15:25:03.572330+0000","last_clean":"2024-03-09T15:25:03.572330+0000","last_became_active":"2024-03-09T14:22:02.397512+0000","last_became_peered":"2024-03-09T14:22:02.397512+0000","last_unstale":"2024-03-09T15:25:03.572330+0000","last_undegraded":"2024-03-09T15:25:03.572330+0000","last_fullsized":"2024-03-09T15:25:03.572330+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:03.572232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:03.572232+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.572232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:42:11.517223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"260'191","reported_seq":719,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.632264+0000","last_change":"2024-03-09T15:25:02.632296+0000","last_active":"2024-03-09T15:25:02.632264+0000","last_peered":"2024-03-09T15:25:02.632264+0000","last_clean":"2024-03-09T15:25:02.632264+0000","last_became_active":"2024-03-09T14:22:04.400806+0000","last_became_peered":"2024-03-09T14:22:04.400806+0000","last_unstale":"2024-03-09T15:25:02.632264+0000","last_undegraded":"2024-03-09T15:25:02.632264+0000","last_fullsized":"2024-03-09T15:25:02.632264+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'191","last_scrub_stamp":"2024-03-09T15:25:02.632158+0000","last_deep_scrub":"260'191","last_deep_scrub_stamp":"2024-03-09T15:25:02.632158+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.632158+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:36:41.257547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":289,"num_write":416,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"260'4088","reported_seq":4685,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.370131+0000","last_change":"2024-03-09T15:25:16.370155+0000","last_active":"2024-03-09T15:25:16.370131+0000","last_peered":"2024-03-09T15:25:16.370131+0000","last_clean":"2024-03-09T15:25:16.370131+0000","last_became_active":"2024-03-09T14:21:56.359679+0000","last_became_peered":"2024-03-09T14:21:56.359679+0000","last_unstale":"2024-03-09T15:25:16.370131+0000","last_undegraded":"2024-03-09T15:25:16.370131+0000","last_fullsized":"2024-03-09T15:25:16.370131+0000","mapping_epoch":22,"log_start":"260'4000","ondisk_log_start":"260'4000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4088","last_scrub_stamp":"2024-03-09T15:25:16.370033+0000","last_deep_scrub":"260'4088","last_deep_scrub_stamp":"2024-03-09T15:25:16.370033+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.370033+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:38.757088+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14374,"num_read_kb":11653,"num_write":6129,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"260'142","reported_seq":779,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.935873+0000","last_change":"2024-03-09T15:25:20.935985+0000","last_active":"2024-03-09T15:25:20.935873+0000","last_peered":"2024-03-09T15:25:20.935873+0000","last_clean":"2024-03-09T15:25:20.935873+0000","last_became_active":"2024-03-09T14:21:54.359782+0000","last_became_peered":"2024-03-09T14:21:54.359782+0000","last_unstale":"2024-03-09T15:25:20.935873+0000","last_undegraded":"2024-03-09T15:25:20.935873+0000","last_fullsized":"2024-03-09T15:25:20.935873+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-03-09T15:25:20.935779+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-03-09T15:25:20.935779+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.935779+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:57.842297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7716,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":378,"num_read_kb":77468,"num_write":821,"num_write_kb":32219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.553668+0000","last_change":"2024-03-09T15:25:20.553691+0000","last_active":"2024-03-09T15:25:20.553668+0000","last_peered":"2024-03-09T15:25:20.553668+0000","last_clean":"2024-03-09T15:25:20.553668+0000","last_became_active":"2024-03-09T14:21:58.371422+0000","last_became_peered":"2024-03-09T14:21:58.371422+0000","last_unstale":"2024-03-09T15:25:20.553668+0000","last_undegraded":"2024-03-09T15:25:20.553668+0000","last_fullsized":"2024-03-09T15:25:20.553668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:20.553566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:20.553566+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.553566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:26.478272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"260'177","reported_seq":787,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.372227+0000","last_change":"2024-03-09T15:25:12.372270+0000","last_active":"2024-03-09T15:25:12.372227+0000","last_peered":"2024-03-09T15:25:12.372227+0000","last_clean":"2024-03-09T15:25:12.372227+0000","last_became_active":"2024-03-09T14:22:00.388454+0000","last_became_peered":"2024-03-09T14:22:00.388454+0000","last_unstale":"2024-03-09T15:25:12.372227+0000","last_undegraded":"2024-03-09T15:25:12.372227+0000","last_fullsized":"2024-03-09T15:25:12.372227+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-03-09T15:25:12.372138+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-03-09T15:25:12.372138+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.372138+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:35.580718+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6773,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":299,"num_write":138,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.738952+0000","last_change":"2024-03-09T15:24:59.738952+0000","last_active":"2024-03-09T15:24:59.738952+0000","last_peered":"2024-03-09T15:24:59.738952+0000","last_clean":"2024-03-09T15:24:59.738952+0000","last_became_active":"2024-03-09T14:22:02.400844+0000","last_became_peered":"2024-03-09T14:22:02.400844+0000","last_unstale":"2024-03-09T15:24:59.738952+0000","last_undegraded":"2024-03-09T15:24:59.738952+0000","last_fullsized":"2024-03-09T15:24:59.738952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:59.738850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:59.738850+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.738850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:08:10.311280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"260'125","reported_seq":627,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.649935+0000","last_change":"2024-03-09T15:24:54.649967+0000","last_active":"2024-03-09T15:24:54.649935+0000","last_peered":"2024-03-09T15:24:54.649935+0000","last_clean":"2024-03-09T15:24:54.649935+0000","last_became_active":"2024-03-09T14:22:04.400352+0000","last_became_peered":"2024-03-09T14:22:04.400352+0000","last_unstale":"2024-03-09T15:24:54.649935+0000","last_undegraded":"2024-03-09T15:24:54.649935+0000","last_fullsized":"2024-03-09T15:24:54.649935+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'125","last_scrub_stamp":"2024-03-09T15:24:54.649852+0000","last_deep_scrub":"260'125","last_deep_scrub_stamp":"2024-03-09T15:24:54.649852+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.649852+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:31:06.812371+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":123,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"260'420","reported_seq":1195,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:24.434673+0000","last_change":"2024-03-09T15:25:24.434709+0000","last_active":"2024-03-09T15:25:24.434673+0000","last_peered":"2024-03-09T15:25:24.434673+0000","last_clean":"2024-03-09T15:25:24.434673+0000","last_became_active":"2024-03-09T14:21:56.353072+0000","last_became_peered":"2024-03-09T14:21:56.353072+0000","last_unstale":"2024-03-09T15:25:24.434673+0000","last_undegraded":"2024-03-09T15:25:24.434673+0000","last_fullsized":"2024-03-09T15:25:24.434673+0000","mapping_epoch":22,"log_start":"260'400","ondisk_log_start":"260'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'420","last_scrub_stamp":"2024-03-09T15:25:24.434577+0000","last_deep_scrub":"260'420","last_deep_scrub_stamp":"2024-03-09T15:25:24.434577+0000","last_clean_scrub_stamp":"2024-03-09T15:25:24.434577+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:30.533648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1831,"num_read_kb":1487,"num_write":741,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"260'178","reported_seq":794,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:29.468563+0000","last_change":"2024-03-09T15:25:29.468612+0000","last_active":"2024-03-09T15:25:29.468563+0000","last_peered":"2024-03-09T15:25:29.468563+0000","last_clean":"2024-03-09T15:25:29.468563+0000","last_became_active":"2024-03-09T14:21:54.368446+0000","last_became_peered":"2024-03-09T14:21:54.368446+0000","last_unstale":"2024-03-09T15:25:29.468563+0000","last_undegraded":"2024-03-09T15:25:29.468563+0000","last_fullsized":"2024-03-09T15:25:29.468563+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'178","last_scrub_stamp":"2024-03-09T15:25:29.468465+0000","last_deep_scrub":"260'178","last_deep_scrub_stamp":"2024-03-09T15:25:29.468465+0000","last_clean_scrub_stamp":"2024-03-09T15:25:29.468465+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:18.781115+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507990,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":372,"num_read_kb":57120,"num_write":931,"num_write_kb":65731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.896790+0000","last_change":"2024-03-09T15:24:54.896790+0000","last_active":"2024-03-09T15:24:54.896790+0000","last_peered":"2024-03-09T15:24:54.896790+0000","last_clean":"2024-03-09T15:24:54.896790+0000","last_became_active":"2024-03-09T14:21:58.371501+0000","last_became_peered":"2024-03-09T14:21:58.371501+0000","last_unstale":"2024-03-09T15:24:54.896790+0000","last_undegraded":"2024-03-09T15:24:54.896790+0000","last_fullsized":"2024-03-09T15:24:54.896790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:54.896671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:54.896671+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.896671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:02.977300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"260'151","reported_seq":735,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:24.610841+0000","last_change":"2024-03-09T15:25:24.610873+0000","last_active":"2024-03-09T15:25:24.610841+0000","last_peered":"2024-03-09T15:25:24.610841+0000","last_clean":"2024-03-09T15:25:24.610841+0000","last_became_active":"2024-03-09T14:22:00.383307+0000","last_became_peered":"2024-03-09T14:22:00.383307+0000","last_unstale":"2024-03-09T15:25:24.610841+0000","last_undegraded":"2024-03-09T15:25:24.610841+0000","last_fullsized":"2024-03-09T15:25:24.610841+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'151","last_scrub_stamp":"2024-03-09T15:25:24.610749+0000","last_deep_scrub":"260'151","last_deep_scrub_stamp":"2024-03-09T15:25:24.610749+0000","last_clean_scrub_stamp":"2024-03-09T15:25:24.610749+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:48:00.956916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8269,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":185,"num_read_kb":267,"num_write":100,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":493,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.573167+0000","last_change":"2024-03-09T15:25:06.573187+0000","last_active":"2024-03-09T15:25:06.573167+0000","last_peered":"2024-03-09T15:25:06.573167+0000","last_clean":"2024-03-09T15:25:06.573167+0000","last_became_active":"2024-03-09T14:22:02.402526+0000","last_became_peered":"2024-03-09T14:22:02.402526+0000","last_unstale":"2024-03-09T15:25:06.573167+0000","last_undegraded":"2024-03-09T15:25:06.573167+0000","last_fullsized":"2024-03-09T15:25:06.573167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:06.573100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:06.573100+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.573100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:45.788949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"260'146","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.711307+0000","last_change":"2024-03-09T15:25:06.711352+0000","last_active":"2024-03-09T15:25:06.711307+0000","last_peered":"2024-03-09T15:25:06.711307+0000","last_clean":"2024-03-09T15:25:06.711307+0000","last_became_active":"2024-03-09T14:21:56.355298+0000","last_became_peered":"2024-03-09T14:21:56.355298+0000","last_unstale":"2024-03-09T15:25:06.711307+0000","last_undegraded":"2024-03-09T15:25:06.711307+0000","last_fullsized":"2024-03-09T15:25:06.711307+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:25:06.711183+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:25:06.711183+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.711183+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:09:34.251726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":631,"num_read_kb":527,"num_write":219,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"260'190","reported_seq":833,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:36.390258+0000","last_change":"2024-03-09T15:25:36.390294+0000","last_active":"2024-03-09T15:25:36.390258+0000","last_peered":"2024-03-09T15:25:36.390258+0000","last_clean":"2024-03-09T15:25:36.390258+0000","last_became_active":"2024-03-09T14:21:54.360765+0000","last_became_peered":"2024-03-09T14:21:54.360765+0000","last_unstale":"2024-03-09T15:25:36.390258+0000","last_undegraded":"2024-03-09T15:25:36.390258+0000","last_fullsized":"2024-03-09T15:25:36.390258+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'190","last_scrub_stamp":"2024-03-09T15:25:36.390113+0000","last_deep_scrub":"260'190","last_deep_scrub_stamp":"2024-03-09T15:25:36.390113+0000","last_clean_scrub_stamp":"2024-03-09T15:25:36.390113+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:42.216651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":443,"num_read_kb":29766,"num_write":1073,"num_write_kb":38880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":505,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.567097+0000","last_change":"2024-03-09T15:25:10.567166+0000","last_active":"2024-03-09T15:25:10.567097+0000","last_peered":"2024-03-09T15:25:10.567097+0000","last_clean":"2024-03-09T15:25:10.567097+0000","last_became_active":"2024-03-09T14:21:58.370646+0000","last_became_peered":"2024-03-09T14:21:58.370646+0000","last_unstale":"2024-03-09T15:25:10.567097+0000","last_undegraded":"2024-03-09T15:25:10.567097+0000","last_fullsized":"2024-03-09T15:25:10.567097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.566993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.566993+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.566993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:06.632677+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"260'226","reported_seq":871,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.617210+0000","last_change":"2024-03-09T15:25:00.617246+0000","last_active":"2024-03-09T15:25:00.617210+0000","last_peered":"2024-03-09T15:25:00.617210+0000","last_clean":"2024-03-09T15:25:00.617210+0000","last_became_active":"2024-03-09T14:22:00.386512+0000","last_became_peered":"2024-03-09T14:22:00.386512+0000","last_unstale":"2024-03-09T15:25:00.617210+0000","last_undegraded":"2024-03-09T15:25:00.617210+0000","last_fullsized":"2024-03-09T15:25:00.617210+0000","mapping_epoch":26,"log_start":"260'200","ondisk_log_start":"260'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'226","last_scrub_stamp":"2024-03-09T15:25:00.617126+0000","last_deep_scrub":"260'226","last_deep_scrub_stamp":"2024-03-09T15:25:00.617126+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.617126+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:40.866463+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15733,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":333,"num_read_kb":495,"num_write":212,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":496,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.696961+0000","last_change":"2024-03-09T15:24:57.696994+0000","last_active":"2024-03-09T15:24:57.696961+0000","last_peered":"2024-03-09T15:24:57.696961+0000","last_clean":"2024-03-09T15:24:57.696961+0000","last_became_active":"2024-03-09T14:22:02.401756+0000","last_became_peered":"2024-03-09T14:22:02.401756+0000","last_unstale":"2024-03-09T15:24:57.696961+0000","last_undegraded":"2024-03-09T15:24:57.696961+0000","last_fullsized":"2024-03-09T15:24:57.696961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:57.696839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:57.696839+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.696839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:10.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"260'177","reported_seq":699,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:56.412926+0000","last_change":"2024-03-09T15:24:56.412926+0000","last_active":"2024-03-09T15:24:56.412926+0000","last_peered":"2024-03-09T15:24:56.412926+0000","last_clean":"2024-03-09T15:24:56.412926+0000","last_became_active":"2024-03-09T14:22:04.403929+0000","last_became_peered":"2024-03-09T14:22:04.403929+0000","last_unstale":"2024-03-09T15:24:56.412926+0000","last_undegraded":"2024-03-09T15:24:56.412926+0000","last_fullsized":"2024-03-09T15:24:56.412926+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'177","last_scrub_stamp":"2024-03-09T15:24:56.412779+0000","last_deep_scrub":"260'177","last_deep_scrub_stamp":"2024-03-09T15:24:56.412779+0000","last_clean_scrub_stamp":"2024-03-09T15:24:56.412779+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:12.170082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1060,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":230,"num_write":397,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"260'90","reported_seq":684,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:33.480105+0000","last_change":"2024-03-09T15:25:33.480130+0000","last_active":"2024-03-09T15:25:33.480105+0000","last_peered":"2024-03-09T15:25:33.480105+0000","last_clean":"2024-03-09T15:25:33.480105+0000","last_became_active":"2024-03-09T14:21:56.366215+0000","last_became_peered":"2024-03-09T14:21:56.366215+0000","last_unstale":"2024-03-09T15:25:33.480105+0000","last_undegraded":"2024-03-09T15:25:33.480105+0000","last_fullsized":"2024-03-09T15:25:33.480105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'90","last_scrub_stamp":"2024-03-09T15:25:33.480013+0000","last_deep_scrub":"260'90","last_deep_scrub_stamp":"2024-03-09T15:25:33.480013+0000","last_clean_scrub_stamp":"2024-03-09T15:25:33.480013+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:13.360136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":386,"num_read_kb":320,"num_write":132,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"260'317","reported_seq":1057,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.726890+0000","last_change":"2024-03-09T15:25:13.726934+0000","last_active":"2024-03-09T15:25:13.726890+0000","last_peered":"2024-03-09T15:25:13.726890+0000","last_clean":"2024-03-09T15:25:13.726890+0000","last_became_active":"2024-03-09T14:21:54.369667+0000","last_became_peered":"2024-03-09T14:21:54.369667+0000","last_unstale":"2024-03-09T15:25:13.726890+0000","last_undegraded":"2024-03-09T15:25:13.726890+0000","last_fullsized":"2024-03-09T15:25:13.726890+0000","mapping_epoch":20,"log_start":"260'300","ondisk_log_start":"260'300","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'317","last_scrub_stamp":"2024-03-09T15:25:13.726778+0000","last_deep_scrub":"260'317","last_deep_scrub_stamp":"2024-03-09T15:25:13.726778+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.726778+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:21.653177+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243080,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":990,"num_read_kb":20523,"num_write":1606,"num_write_kb":49379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":509,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.874942+0000","last_change":"2024-03-09T15:24:52.874964+0000","last_active":"2024-03-09T15:24:52.874942+0000","last_peered":"2024-03-09T15:24:52.874942+0000","last_clean":"2024-03-09T15:24:52.874942+0000","last_became_active":"2024-03-09T14:21:58.371917+0000","last_became_peered":"2024-03-09T14:21:58.371917+0000","last_unstale":"2024-03-09T15:24:52.874942+0000","last_undegraded":"2024-03-09T15:24:52.874942+0000","last_fullsized":"2024-03-09T15:24:52.874942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:52.874873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:52.874873+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.874873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:25:49.190884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"260'189","reported_seq":792,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:26.610884+0000","last_change":"2024-03-09T15:25:26.610953+0000","last_active":"2024-03-09T15:25:26.610884+0000","last_peered":"2024-03-09T15:25:26.610884+0000","last_clean":"2024-03-09T15:25:26.610884+0000","last_became_active":"2024-03-09T14:22:00.383894+0000","last_became_peered":"2024-03-09T14:22:00.383894+0000","last_unstale":"2024-03-09T15:25:26.610884+0000","last_undegraded":"2024-03-09T15:25:26.610884+0000","last_fullsized":"2024-03-09T15:25:26.610884+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'189","last_scrub_stamp":"2024-03-09T15:25:26.610783+0000","last_deep_scrub":"260'189","last_deep_scrub_stamp":"2024-03-09T15:25:26.610783+0000","last_clean_scrub_stamp":"2024-03-09T15:25:26.610783+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:38:16.707379+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9600,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":264,"num_read_kb":340,"num_write":176,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:08.724571+0000","last_change":"2024-03-09T15:25:08.724603+0000","last_active":"2024-03-09T15:25:08.724571+0000","last_peered":"2024-03-09T15:25:08.724571+0000","last_clean":"2024-03-09T15:25:08.724571+0000","last_became_active":"2024-03-09T14:22:02.397679+0000","last_became_peered":"2024-03-09T14:22:02.397679+0000","last_unstale":"2024-03-09T15:25:08.724571+0000","last_undegraded":"2024-03-09T15:25:08.724571+0000","last_fullsized":"2024-03-09T15:25:08.724571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:08.724486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:08.724486+0000","last_clean_scrub_stamp":"2024-03-09T15:25:08.724486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:51:46.809660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"260'174","reported_seq":1374,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.717279+0000","last_change":"2024-03-09T15:25:03.717279+0000","last_active":"2024-03-09T15:25:03.717279+0000","last_peered":"2024-03-09T15:25:03.717279+0000","last_clean":"2024-03-09T15:25:03.717279+0000","last_became_active":"2024-03-09T14:22:04.397726+0000","last_became_peered":"2024-03-09T14:22:04.397726+0000","last_unstale":"2024-03-09T15:25:03.717279+0000","last_undegraded":"2024-03-09T15:25:03.717279+0000","last_fullsized":"2024-03-09T15:25:03.717279+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'174","last_scrub_stamp":"2024-03-09T15:25:03.717114+0000","last_deep_scrub":"260'174","last_deep_scrub_stamp":"2024-03-09T15:25:03.717114+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.717114+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:10.125063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":900,"num_read_kb":898,"num_write":472,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"260'68","reported_seq":666,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:26.411067+0000","last_change":"2024-03-09T15:25:26.411114+0000","last_active":"2024-03-09T15:25:26.411067+0000","last_peered":"2024-03-09T15:25:26.411067+0000","last_clean":"2024-03-09T15:25:26.411067+0000","last_became_active":"2024-03-09T14:21:56.352108+0000","last_became_peered":"2024-03-09T14:21:56.352108+0000","last_unstale":"2024-03-09T15:25:26.411067+0000","last_undegraded":"2024-03-09T15:25:26.411067+0000","last_fullsized":"2024-03-09T15:25:26.411067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'68","last_scrub_stamp":"2024-03-09T15:25:26.410966+0000","last_deep_scrub":"260'68","last_deep_scrub_stamp":"2024-03-09T15:25:26.410966+0000","last_clean_scrub_stamp":"2024-03-09T15:25:26.410966+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:40.854418+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":333,"num_read_kb":287,"num_write":100,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"260'180","reported_seq":782,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:46.874089+0000","last_change":"2024-03-09T15:24:46.874089+0000","last_active":"2024-03-09T15:24:46.874089+0000","last_peered":"2024-03-09T15:24:46.874089+0000","last_clean":"2024-03-09T15:24:46.874089+0000","last_became_active":"2024-03-09T14:22:31.509321+0000","last_became_peered":"2024-03-09T14:22:31.509321+0000","last_unstale":"2024-03-09T15:24:46.874089+0000","last_undegraded":"2024-03-09T15:24:46.874089+0000","last_fullsized":"2024-03-09T15:24:46.874089+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'180","last_scrub_stamp":"2024-03-09T15:24:46.873902+0000","last_deep_scrub":"260'180","last_deep_scrub_stamp":"2024-03-09T15:24:46.873902+0000","last_clean_scrub_stamp":"2024-03-09T15:24:46.873902+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:58.769545+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079970,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":42859,"num_write":1107,"num_write_kb":40696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,5],"acting":[2,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":512,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.145721+0000","last_change":"2024-03-09T15:25:14.145747+0000","last_active":"2024-03-09T15:25:14.145721+0000","last_peered":"2024-03-09T15:25:14.145721+0000","last_clean":"2024-03-09T15:25:14.145721+0000","last_became_active":"2024-03-09T14:21:58.372993+0000","last_became_peered":"2024-03-09T14:21:58.372993+0000","last_unstale":"2024-03-09T15:25:14.145721+0000","last_undegraded":"2024-03-09T15:25:14.145721+0000","last_fullsized":"2024-03-09T15:25:14.145721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:14.145625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:14.145625+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.145625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:12:23.023977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"260'149","reported_seq":748,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.430482+0000","last_change":"2024-03-09T15:25:07.430516+0000","last_active":"2024-03-09T15:25:07.430482+0000","last_peered":"2024-03-09T15:25:07.430482+0000","last_clean":"2024-03-09T15:25:07.430482+0000","last_became_active":"2024-03-09T14:22:00.492464+0000","last_became_peered":"2024-03-09T14:22:00.492464+0000","last_unstale":"2024-03-09T15:25:07.430482+0000","last_undegraded":"2024-03-09T15:25:07.430482+0000","last_fullsized":"2024-03-09T15:25:07.430482+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'149","last_scrub_stamp":"2024-03-09T15:25:07.430387+0000","last_deep_scrub":"260'149","last_deep_scrub_stamp":"2024-03-09T15:25:07.430387+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.430387+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:34:51.892125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5866,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":204,"num_read_kb":270,"num_write":110,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.733282+0000","last_change":"2024-03-09T15:25:18.733311+0000","last_active":"2024-03-09T15:25:18.733282+0000","last_peered":"2024-03-09T15:25:18.733282+0000","last_clean":"2024-03-09T15:25:18.733282+0000","last_became_active":"2024-03-09T14:22:02.401966+0000","last_became_peered":"2024-03-09T14:22:02.401966+0000","last_unstale":"2024-03-09T15:25:18.733282+0000","last_undegraded":"2024-03-09T15:25:18.733282+0000","last_fullsized":"2024-03-09T15:25:18.733282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:18.733176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:18.733176+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.733176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:32.965896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"260'111","reported_seq":613,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.678427+0000","last_change":"2024-03-09T15:24:55.678427+0000","last_active":"2024-03-09T15:24:55.678427+0000","last_peered":"2024-03-09T15:24:55.678427+0000","last_clean":"2024-03-09T15:24:55.678427+0000","last_became_active":"2024-03-09T14:22:04.399988+0000","last_became_peered":"2024-03-09T14:22:04.399988+0000","last_unstale":"2024-03-09T15:24:55.678427+0000","last_undegraded":"2024-03-09T15:24:55.678427+0000","last_fullsized":"2024-03-09T15:24:55.678427+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'111","last_scrub_stamp":"2024-03-09T15:24:55.678295+0000","last_deep_scrub":"260'111","last_deep_scrub_stamp":"2024-03-09T15:24:55.678295+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.678295+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:14:19.579572+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":253,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"260'144","reported_seq":780,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:06.528533+0000","last_change":"2024-03-09T15:25:06.528556+0000","last_active":"2024-03-09T15:25:06.528533+0000","last_peered":"2024-03-09T15:25:06.528533+0000","last_clean":"2024-03-09T15:25:06.528533+0000","last_became_active":"2024-03-09T14:21:56.368448+0000","last_became_peered":"2024-03-09T14:21:56.368448+0000","last_unstale":"2024-03-09T15:25:06.528533+0000","last_undegraded":"2024-03-09T15:25:06.528533+0000","last_fullsized":"2024-03-09T15:25:06.528533+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'144","last_scrub_stamp":"2024-03-09T15:25:06.528450+0000","last_deep_scrub":"260'144","last_deep_scrub_stamp":"2024-03-09T15:25:06.528450+0000","last_clean_scrub_stamp":"2024-03-09T15:25:06.528450+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:58.803978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":520,"num_write":211,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"260'197","reported_seq":839,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.589642+0000","last_change":"2024-03-09T15:24:53.589692+0000","last_active":"2024-03-09T15:24:53.589642+0000","last_peered":"2024-03-09T15:24:53.589642+0000","last_clean":"2024-03-09T15:24:53.589642+0000","last_became_active":"2024-03-09T14:22:31.527186+0000","last_became_peered":"2024-03-09T14:22:31.527186+0000","last_unstale":"2024-03-09T15:24:53.589642+0000","last_undegraded":"2024-03-09T15:24:53.589642+0000","last_fullsized":"2024-03-09T15:24:53.589642+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:24:53.589537+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:24:53.589537+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.589537+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:24.871040+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322946,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":96221,"num_write":1020,"num_write_kb":42724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.501649+0000","last_change":"2024-03-09T15:24:55.501674+0000","last_active":"2024-03-09T15:24:55.501649+0000","last_peered":"2024-03-09T15:24:55.501649+0000","last_clean":"2024-03-09T15:24:55.501649+0000","last_became_active":"2024-03-09T14:21:58.369649+0000","last_became_peered":"2024-03-09T14:21:58.369649+0000","last_unstale":"2024-03-09T15:24:55.501649+0000","last_undegraded":"2024-03-09T15:24:55.501649+0000","last_fullsized":"2024-03-09T15:24:55.501649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.501552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.501552+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.501552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:17:49.656602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"260'110","reported_seq":659,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.069174+0000","last_change":"2024-03-09T15:24:57.069220+0000","last_active":"2024-03-09T15:24:57.069174+0000","last_peered":"2024-03-09T15:24:57.069174+0000","last_clean":"2024-03-09T15:24:57.069174+0000","last_became_active":"2024-03-09T14:22:00.492393+0000","last_became_peered":"2024-03-09T14:22:00.492393+0000","last_unstale":"2024-03-09T15:24:57.069174+0000","last_undegraded":"2024-03-09T15:24:57.069174+0000","last_fullsized":"2024-03-09T15:24:57.069174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'110","last_scrub_stamp":"2024-03-09T15:24:57.069084+0000","last_deep_scrub":"260'110","last_deep_scrub_stamp":"2024-03-09T15:24:57.069084+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.069084+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:48.543598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11222,"num_omap_keys":30,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"260'507","reported_seq":2255,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.884269+0000","last_change":"2024-03-09T15:24:51.884295+0000","last_active":"2024-03-09T15:24:51.884269+0000","last_peered":"2024-03-09T15:24:51.884269+0000","last_clean":"2024-03-09T15:24:51.884269+0000","last_became_active":"2024-03-09T14:22:02.395757+0000","last_became_peered":"2024-03-09T14:22:02.395757+0000","last_unstale":"2024-03-09T15:24:51.884269+0000","last_undegraded":"2024-03-09T15:24:51.884269+0000","last_fullsized":"2024-03-09T15:24:51.884269+0000","mapping_epoch":28,"log_start":"257'400","ondisk_log_start":"257'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'507","last_scrub_stamp":"2024-03-09T15:24:51.884180+0000","last_deep_scrub":"260'507","last_deep_scrub_stamp":"2024-03-09T15:24:51.884180+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.884180+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:19.318327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"260'119","reported_seq":646,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.655743+0000","last_change":"2024-03-09T15:25:00.655743+0000","last_active":"2024-03-09T15:25:00.655743+0000","last_peered":"2024-03-09T15:25:00.655743+0000","last_clean":"2024-03-09T15:25:00.655743+0000","last_became_active":"2024-03-09T14:22:04.400068+0000","last_became_peered":"2024-03-09T14:22:04.400068+0000","last_unstale":"2024-03-09T15:25:00.655743+0000","last_undegraded":"2024-03-09T15:25:00.655743+0000","last_fullsized":"2024-03-09T15:25:00.655743+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'119","last_scrub_stamp":"2024-03-09T15:25:00.655625+0000","last_deep_scrub":"260'119","last_deep_scrub_stamp":"2024-03-09T15:25:00.655625+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.655625+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:34.048316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":200,"num_read_kb":176,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"260'187","reported_seq":822,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:24.155059+0000","last_change":"2024-03-09T15:25:24.155084+0000","last_active":"2024-03-09T15:25:24.155059+0000","last_peered":"2024-03-09T15:25:24.155059+0000","last_clean":"2024-03-09T15:25:24.155059+0000","last_became_active":"2024-03-09T14:21:56.351908+0000","last_became_peered":"2024-03-09T14:21:56.351908+0000","last_unstale":"2024-03-09T15:25:24.155059+0000","last_undegraded":"2024-03-09T15:25:24.155059+0000","last_fullsized":"2024-03-09T15:25:24.155059+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'187","last_scrub_stamp":"2024-03-09T15:25:24.154938+0000","last_deep_scrub":"260'187","last_deep_scrub_stamp":"2024-03-09T15:25:24.154938+0000","last_clean_scrub_stamp":"2024-03-09T15:25:24.154938+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:40:30.344570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":746,"num_read_kb":598,"num_write":263,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"260'150","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.949370+0000","last_change":"2024-03-09T15:25:21.949441+0000","last_active":"2024-03-09T15:25:21.949370+0000","last_peered":"2024-03-09T15:25:21.949370+0000","last_clean":"2024-03-09T15:25:21.949370+0000","last_became_active":"2024-03-09T14:21:54.360958+0000","last_became_peered":"2024-03-09T14:21:54.360958+0000","last_unstale":"2024-03-09T15:25:21.949370+0000","last_undegraded":"2024-03-09T15:25:21.949370+0000","last_fullsized":"2024-03-09T15:25:21.949370+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'150","last_scrub_stamp":"2024-03-09T15:25:21.949279+0000","last_deep_scrub":"260'150","last_deep_scrub_stamp":"2024-03-09T15:25:21.949279+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.949279+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:04.038278+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":327,"num_read_kb":36416,"num_write":870,"num_write_kb":28851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.497811+0000","last_change":"2024-03-09T15:25:16.497849+0000","last_active":"2024-03-09T15:25:16.497811+0000","last_peered":"2024-03-09T15:25:16.497811+0000","last_clean":"2024-03-09T15:25:16.497811+0000","last_became_active":"2024-03-09T14:21:58.368249+0000","last_became_peered":"2024-03-09T14:21:58.368249+0000","last_unstale":"2024-03-09T15:25:16.497811+0000","last_undegraded":"2024-03-09T15:25:16.497811+0000","last_fullsized":"2024-03-09T15:25:16.497811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:16.497691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:16.497691+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.497691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:00:06.867807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"260'182","reported_seq":786,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:26.902681+0000","last_change":"2024-03-09T15:25:26.902744+0000","last_active":"2024-03-09T15:25:26.902681+0000","last_peered":"2024-03-09T15:25:26.902681+0000","last_clean":"2024-03-09T15:25:26.902681+0000","last_became_active":"2024-03-09T14:22:00.385871+0000","last_became_peered":"2024-03-09T14:22:00.385871+0000","last_unstale":"2024-03-09T15:25:26.902681+0000","last_undegraded":"2024-03-09T15:25:26.902681+0000","last_fullsized":"2024-03-09T15:25:26.902681+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'182","last_scrub_stamp":"2024-03-09T15:25:26.902551+0000","last_deep_scrub":"260'182","last_deep_scrub_stamp":"2024-03-09T15:25:26.902551+0000","last_clean_scrub_stamp":"2024-03-09T15:25:26.902551+0000","objects_scrubbed":7,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:39:47.982327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":241,"num_read_kb":303,"num_write":134,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":492,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:24.513576+0000","last_change":"2024-03-09T15:25:24.513609+0000","last_active":"2024-03-09T15:25:24.513576+0000","last_peered":"2024-03-09T15:25:24.513576+0000","last_clean":"2024-03-09T15:25:24.513576+0000","last_became_active":"2024-03-09T14:22:02.398044+0000","last_became_peered":"2024-03-09T14:22:02.398044+0000","last_unstale":"2024-03-09T15:25:24.513576+0000","last_undegraded":"2024-03-09T15:25:24.513576+0000","last_fullsized":"2024-03-09T15:25:24.513576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:24.513488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:24.513488+0000","last_clean_scrub_stamp":"2024-03-09T15:25:24.513488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:03:04.346715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"260'112","reported_seq":618,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.702326+0000","last_change":"2024-03-09T15:24:59.702360+0000","last_active":"2024-03-09T15:24:59.702326+0000","last_peered":"2024-03-09T15:24:59.702326+0000","last_clean":"2024-03-09T15:24:59.702326+0000","last_became_active":"2024-03-09T14:22:04.405646+0000","last_became_peered":"2024-03-09T14:22:04.405646+0000","last_unstale":"2024-03-09T15:24:59.702326+0000","last_undegraded":"2024-03-09T15:24:59.702326+0000","last_fullsized":"2024-03-09T15:24:59.702326+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'112","last_scrub_stamp":"2024-03-09T15:24:59.702244+0000","last_deep_scrub":"260'112","last_deep_scrub_stamp":"2024-03-09T15:24:59.702244+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.702244+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:16.961678+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":119,"num_read_kb":111,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"260'42","reported_seq":614,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.243472+0000","last_change":"2024-03-09T15:25:22.243495+0000","last_active":"2024-03-09T15:25:22.243472+0000","last_peered":"2024-03-09T15:25:22.243472+0000","last_clean":"2024-03-09T15:25:22.243472+0000","last_became_active":"2024-03-09T14:21:56.351356+0000","last_became_peered":"2024-03-09T14:21:56.351356+0000","last_unstale":"2024-03-09T15:25:22.243472+0000","last_undegraded":"2024-03-09T15:25:22.243472+0000","last_fullsized":"2024-03-09T15:25:22.243472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'42","last_scrub_stamp":"2024-03-09T15:25:22.243363+0000","last_deep_scrub":"260'42","last_deep_scrub_stamp":"2024-03-09T15:25:22.243363+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.243363+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:52:30.258003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":170,"num_write":59,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"260'167","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.735693+0000","last_change":"2024-03-09T15:25:11.735763+0000","last_active":"2024-03-09T15:25:11.735693+0000","last_peered":"2024-03-09T15:25:11.735693+0000","last_clean":"2024-03-09T15:25:11.735693+0000","last_became_active":"2024-03-09T14:21:54.371357+0000","last_became_peered":"2024-03-09T14:21:54.371357+0000","last_unstale":"2024-03-09T15:25:11.735693+0000","last_undegraded":"2024-03-09T15:25:11.735693+0000","last_fullsized":"2024-03-09T15:25:11.735693+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'167","last_scrub_stamp":"2024-03-09T15:25:11.735592+0000","last_deep_scrub":"260'167","last_deep_scrub_stamp":"2024-03-09T15:25:11.735592+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.735592+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:52.243408+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":54818,"num_write":999,"num_write_kb":32470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:14.809372+0000","last_change":"2024-03-09T15:25:14.809397+0000","last_active":"2024-03-09T15:25:14.809372+0000","last_peered":"2024-03-09T15:25:14.809372+0000","last_clean":"2024-03-09T15:25:14.809372+0000","last_became_active":"2024-03-09T14:21:58.373308+0000","last_became_peered":"2024-03-09T14:21:58.373308+0000","last_unstale":"2024-03-09T15:25:14.809372+0000","last_undegraded":"2024-03-09T15:25:14.809372+0000","last_fullsized":"2024-03-09T15:25:14.809372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:14.809288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:14.809288+0000","last_clean_scrub_stamp":"2024-03-09T15:25:14.809288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:28.122958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"260'140","reported_seq":718,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.514834+0000","last_change":"2024-03-09T15:25:16.514872+0000","last_active":"2024-03-09T15:25:16.514834+0000","last_peered":"2024-03-09T15:25:16.514834+0000","last_clean":"2024-03-09T15:25:16.514834+0000","last_became_active":"2024-03-09T14:22:00.384053+0000","last_became_peered":"2024-03-09T14:22:00.384053+0000","last_unstale":"2024-03-09T15:25:16.514834+0000","last_undegraded":"2024-03-09T15:25:16.514834+0000","last_fullsized":"2024-03-09T15:25:16.514834+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'140","last_scrub_stamp":"2024-03-09T15:25:16.514738+0000","last_deep_scrub":"260'140","last_deep_scrub_stamp":"2024-03-09T15:25:16.514738+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.514738+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:46.004423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":180,"num_read_kb":230,"num_write":94,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:53.879148+0000","last_change":"2024-03-09T15:24:53.879148+0000","last_active":"2024-03-09T15:24:53.879148+0000","last_peered":"2024-03-09T15:24:53.879148+0000","last_clean":"2024-03-09T15:24:53.879148+0000","last_became_active":"2024-03-09T14:22:02.395643+0000","last_became_peered":"2024-03-09T14:22:02.395643+0000","last_unstale":"2024-03-09T15:24:53.879148+0000","last_undegraded":"2024-03-09T15:24:53.879148+0000","last_fullsized":"2024-03-09T15:24:53.879148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:53.878965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:53.878965+0000","last_clean_scrub_stamp":"2024-03-09T15:24:53.878965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:10.584696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"260'99","reported_seq":656,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:59.415079+0000","last_change":"2024-03-09T15:24:59.415115+0000","last_active":"2024-03-09T15:24:59.415079+0000","last_peered":"2024-03-09T15:24:59.415079+0000","last_clean":"2024-03-09T15:24:59.415079+0000","last_became_active":"2024-03-09T14:22:04.402174+0000","last_became_peered":"2024-03-09T14:22:04.402174+0000","last_unstale":"2024-03-09T15:24:59.415079+0000","last_undegraded":"2024-03-09T15:24:59.415079+0000","last_fullsized":"2024-03-09T15:24:59.415079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'99","last_scrub_stamp":"2024-03-09T15:24:59.414984+0000","last_deep_scrub":"260'99","last_deep_scrub_stamp":"2024-03-09T15:24:59.414984+0000","last_clean_scrub_stamp":"2024-03-09T15:24:59.414984+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:31:06.423310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":965,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":224,"num_write":236,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"260'153","reported_seq":778,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.390866+0000","last_change":"2024-03-09T15:25:15.390911+0000","last_active":"2024-03-09T15:25:15.390866+0000","last_peered":"2024-03-09T15:25:15.390866+0000","last_clean":"2024-03-09T15:25:15.390866+0000","last_became_active":"2024-03-09T14:21:56.361563+0000","last_became_peered":"2024-03-09T14:21:56.361563+0000","last_unstale":"2024-03-09T15:25:15.390866+0000","last_undegraded":"2024-03-09T15:25:15.390866+0000","last_fullsized":"2024-03-09T15:25:15.390866+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'153","last_scrub_stamp":"2024-03-09T15:25:15.390721+0000","last_deep_scrub":"260'153","last_deep_scrub_stamp":"2024-03-09T15:25:15.390721+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.390721+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:11:14.405862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":517,"num_write":233,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"260'229","reported_seq":905,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:34.358267+0000","last_change":"2024-03-09T15:25:34.358341+0000","last_active":"2024-03-09T15:25:34.358267+0000","last_peered":"2024-03-09T15:25:34.358267+0000","last_clean":"2024-03-09T15:25:34.358267+0000","last_became_active":"2024-03-09T14:21:54.358552+0000","last_became_peered":"2024-03-09T14:21:54.358552+0000","last_unstale":"2024-03-09T15:25:34.358267+0000","last_undegraded":"2024-03-09T15:25:34.358267+0000","last_fullsized":"2024-03-09T15:25:34.358267+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'229","last_scrub_stamp":"2024-03-09T15:25:34.358171+0000","last_deep_scrub":"260'229","last_deep_scrub_stamp":"2024-03-09T15:25:34.358171+0000","last_clean_scrub_stamp":"2024-03-09T15:25:34.358171+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:12.836153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":476,"num_read_kb":44740,"num_write":1211,"num_write_kb":34484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":513,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.104612+0000","last_change":"2024-03-09T15:25:10.104638+0000","last_active":"2024-03-09T15:25:10.104612+0000","last_peered":"2024-03-09T15:25:10.104612+0000","last_clean":"2024-03-09T15:25:10.104612+0000","last_became_active":"2024-03-09T14:21:58.368346+0000","last_became_peered":"2024-03-09T14:21:58.368346+0000","last_unstale":"2024-03-09T15:25:10.104612+0000","last_undegraded":"2024-03-09T15:25:10.104612+0000","last_fullsized":"2024-03-09T15:25:10.104612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:10.104505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:10.104505+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.104505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:05.633704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"260'117","reported_seq":689,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.407630+0000","last_change":"2024-03-09T15:25:10.407663+0000","last_active":"2024-03-09T15:25:10.407630+0000","last_peered":"2024-03-09T15:25:10.407630+0000","last_clean":"2024-03-09T15:25:10.407630+0000","last_became_active":"2024-03-09T14:22:00.389728+0000","last_became_peered":"2024-03-09T14:22:00.389728+0000","last_unstale":"2024-03-09T15:25:10.407630+0000","last_undegraded":"2024-03-09T15:25:10.407630+0000","last_fullsized":"2024-03-09T15:25:10.407630+0000","mapping_epoch":26,"log_start":"260'100","ondisk_log_start":"260'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'117","last_scrub_stamp":"2024-03-09T15:25:10.407543+0000","last_deep_scrub":"260'117","last_deep_scrub_stamp":"2024-03-09T15:25:10.407543+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.407543+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:17:16.704015+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8155,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":194,"num_write":70,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":504,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:55.053602+0000","last_change":"2024-03-09T15:24:55.053626+0000","last_active":"2024-03-09T15:24:55.053602+0000","last_peered":"2024-03-09T15:24:55.053602+0000","last_clean":"2024-03-09T15:24:55.053602+0000","last_became_active":"2024-03-09T14:22:02.397501+0000","last_became_peered":"2024-03-09T14:22:02.397501+0000","last_unstale":"2024-03-09T15:24:55.053602+0000","last_undegraded":"2024-03-09T15:24:55.053602+0000","last_fullsized":"2024-03-09T15:24:55.053602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:24:55.053498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:24:55.053498+0000","last_clean_scrub_stamp":"2024-03-09T15:24:55.053498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:38.275368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"260'150","reported_seq":1819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.611849+0000","last_change":"2024-03-09T15:25:01.611893+0000","last_active":"2024-03-09T15:25:01.611849+0000","last_peered":"2024-03-09T15:25:01.611849+0000","last_clean":"2024-03-09T15:25:01.611849+0000","last_became_active":"2024-03-09T14:22:04.399159+0000","last_became_peered":"2024-03-09T14:22:04.399159+0000","last_unstale":"2024-03-09T15:25:01.611849+0000","last_undegraded":"2024-03-09T15:25:01.611849+0000","last_fullsized":"2024-03-09T15:25:01.611849+0000","mapping_epoch":30,"log_start":"260'100","ondisk_log_start":"260'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'150","last_scrub_stamp":"2024-03-09T15:25:01.611770+0000","last_deep_scrub":"260'150","last_deep_scrub_stamp":"2024-03-09T15:25:01.611770+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.611770+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:25.632376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1315,"num_read_kb":1315,"num_write":333,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"260'168","reported_seq":843,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.121729+0000","last_change":"2024-03-09T15:25:15.121756+0000","last_active":"2024-03-09T15:25:15.121729+0000","last_peered":"2024-03-09T15:25:15.121729+0000","last_clean":"2024-03-09T15:25:15.121729+0000","last_became_active":"2024-03-09T14:21:56.356640+0000","last_became_peered":"2024-03-09T14:21:56.356640+0000","last_unstale":"2024-03-09T15:25:15.121729+0000","last_undegraded":"2024-03-09T15:25:15.121729+0000","last_fullsized":"2024-03-09T15:25:15.121729+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'168","last_scrub_stamp":"2024-03-09T15:25:15.121631+0000","last_deep_scrub":"260'168","last_deep_scrub_stamp":"2024-03-09T15:25:15.121631+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.121631+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:15:50.426797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":733,"num_read_kb":609,"num_write":252,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"260'214","reported_seq":987,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:27.553685+0000","last_change":"2024-03-09T15:25:27.553728+0000","last_active":"2024-03-09T15:25:27.553685+0000","last_peered":"2024-03-09T15:25:27.553685+0000","last_clean":"2024-03-09T15:25:27.553685+0000","last_became_active":"2024-03-09T14:21:54.358270+0000","last_became_peered":"2024-03-09T14:21:54.358270+0000","last_unstale":"2024-03-09T15:25:27.553685+0000","last_undegraded":"2024-03-09T15:25:27.553685+0000","last_fullsized":"2024-03-09T15:25:27.553685+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-03-09T15:25:27.553596+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-03-09T15:25:27.553596+0000","last_clean_scrub_stamp":"2024-03-09T15:25:27.553596+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:59:32.468104+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":284795,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":699,"num_read_kb":64460,"num_write":1159,"num_write_kb":40353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"260'6","reported_seq":827,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.466144+0000","last_change":"2024-03-09T15:24:54.466144+0000","last_active":"2024-03-09T15:24:54.466144+0000","last_peered":"2024-03-09T15:24:54.466144+0000","last_clean":"2024-03-09T15:24:54.466144+0000","last_became_active":"2024-03-09T14:21:58.370405+0000","last_became_peered":"2024-03-09T14:21:58.370405+0000","last_unstale":"2024-03-09T15:24:54.466144+0000","last_undegraded":"2024-03-09T15:24:54.466144+0000","last_fullsized":"2024-03-09T15:24:54.466144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-03-09T15:24:54.466003+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-03-09T15:24:54.466003+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.466003+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:49:13.636187+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":478,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":479,"num_read_kb":477,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"260'170","reported_seq":775,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:26.203804+0000","last_change":"2024-03-09T15:25:26.203874+0000","last_active":"2024-03-09T15:25:26.203804+0000","last_peered":"2024-03-09T15:25:26.203804+0000","last_clean":"2024-03-09T15:25:26.203804+0000","last_became_active":"2024-03-09T14:22:00.380715+0000","last_became_peered":"2024-03-09T14:22:00.380715+0000","last_unstale":"2024-03-09T15:25:26.203804+0000","last_undegraded":"2024-03-09T15:25:26.203804+0000","last_fullsized":"2024-03-09T15:25:26.203804+0000","mapping_epoch":26,"log_start":"257'100","ondisk_log_start":"257'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'170","last_scrub_stamp":"2024-03-09T15:25:26.203699+0000","last_deep_scrub":"260'170","last_deep_scrub_stamp":"2024-03-09T15:25:26.203699+0000","last_clean_scrub_stamp":"2024-03-09T15:25:26.203699+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:28:56.155843+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20360,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":228,"num_read_kb":325,"num_write":126,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":491,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.563195+0000","last_change":"2024-03-09T15:25:07.563219+0000","last_active":"2024-03-09T15:25:07.563195+0000","last_peered":"2024-03-09T15:25:07.563195+0000","last_clean":"2024-03-09T15:25:07.563195+0000","last_became_active":"2024-03-09T14:22:02.401103+0000","last_became_peered":"2024-03-09T14:22:02.401103+0000","last_unstale":"2024-03-09T15:25:07.563195+0000","last_undegraded":"2024-03-09T15:25:07.563195+0000","last_fullsized":"2024-03-09T15:25:07.563195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:25:07.563107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:25:07.563107+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.563107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:11:45.978911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"260'109","reported_seq":630,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:50.022419+0000","last_change":"2024-03-09T15:24:50.022419+0000","last_active":"2024-03-09T15:24:50.022419+0000","last_peered":"2024-03-09T15:24:50.022419+0000","last_clean":"2024-03-09T15:24:50.022419+0000","last_became_active":"2024-03-09T14:22:04.401816+0000","last_became_peered":"2024-03-09T14:22:04.401816+0000","last_unstale":"2024-03-09T15:24:50.022419+0000","last_undegraded":"2024-03-09T15:24:50.022419+0000","last_fullsized":"2024-03-09T15:24:50.022419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'109","last_scrub_stamp":"2024-03-09T15:24:50.022263+0000","last_deep_scrub":"260'109","last_deep_scrub_stamp":"2024-03-09T15:24:50.022263+0000","last_clean_scrub_stamp":"2024-03-09T15:24:50.022263+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:01:53.310008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":141,"num_read_kb":117,"num_write":263,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"260'48","reported_seq":620,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.710380+0000","last_change":"2024-03-09T15:25:17.710444+0000","last_active":"2024-03-09T15:25:17.710380+0000","last_peered":"2024-03-09T15:25:17.710380+0000","last_clean":"2024-03-09T15:25:17.710380+0000","last_became_active":"2024-03-09T14:21:56.357411+0000","last_became_peered":"2024-03-09T14:21:56.357411+0000","last_unstale":"2024-03-09T15:25:17.710380+0000","last_undegraded":"2024-03-09T15:25:17.710380+0000","last_fullsized":"2024-03-09T15:25:17.710380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'48","last_scrub_stamp":"2024-03-09T15:25:17.710269+0000","last_deep_scrub":"260'48","last_deep_scrub_stamp":"2024-03-09T15:25:17.710269+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.710269+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:40.743258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":185,"num_write":70,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"260'182","reported_seq":1001,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.630869+0000","last_change":"2024-03-09T15:25:13.630920+0000","last_active":"2024-03-09T15:25:13.630869+0000","last_peered":"2024-03-09T15:25:13.630869+0000","last_clean":"2024-03-09T15:25:13.630869+0000","last_became_active":"2024-03-09T14:21:54.366709+0000","last_became_peered":"2024-03-09T14:21:54.366709+0000","last_unstale":"2024-03-09T15:25:13.630869+0000","last_undegraded":"2024-03-09T15:25:13.630869+0000","last_fullsized":"2024-03-09T15:25:13.630869+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'182","last_scrub_stamp":"2024-03-09T15:25:13.630775+0000","last_deep_scrub":"260'182","last_deep_scrub_stamp":"2024-03-09T15:25:13.630775+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.630775+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:38.097608+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342104,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":789,"num_read_kb":18311,"num_write":1113,"num_write_kb":29138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"260'231","reported_seq":865,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:57.575183+0000","last_change":"2024-03-09T15:24:57.575211+0000","last_active":"2024-03-09T15:24:57.575183+0000","last_peered":"2024-03-09T15:24:57.575183+0000","last_clean":"2024-03-09T15:24:57.575183+0000","last_became_active":"2024-03-09T14:21:56.366528+0000","last_became_peered":"2024-03-09T14:21:56.366528+0000","last_unstale":"2024-03-09T15:24:57.575183+0000","last_undegraded":"2024-03-09T15:24:57.575183+0000","last_fullsized":"2024-03-09T15:24:57.575183+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'231","last_scrub_stamp":"2024-03-09T15:24:57.575095+0000","last_deep_scrub":"260'231","last_deep_scrub_stamp":"2024-03-09T15:24:57.575095+0000","last_clean_scrub_stamp":"2024-03-09T15:24:57.575095+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:22:23.882512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":918,"num_read_kb":724,"num_write":394,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"260'271","reported_seq":1092,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:01.676663+0000","last_change":"2024-03-09T15:25:01.676707+0000","last_active":"2024-03-09T15:25:01.676663+0000","last_peered":"2024-03-09T15:25:01.676663+0000","last_clean":"2024-03-09T15:25:01.676663+0000","last_became_active":"2024-03-09T14:21:54.359417+0000","last_became_peered":"2024-03-09T14:21:54.359417+0000","last_unstale":"2024-03-09T15:25:01.676663+0000","last_undegraded":"2024-03-09T15:25:01.676663+0000","last_fullsized":"2024-03-09T15:25:01.676663+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'271","last_scrub_stamp":"2024-03-09T15:25:01.676568+0000","last_deep_scrub":"260'271","last_deep_scrub_stamp":"2024-03-09T15:25:01.676568+0000","last_clean_scrub_stamp":"2024-03-09T15:25:01.676568+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:03.427239+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1220,"num_read_kb":137737,"num_write":1250,"num_write_kb":25850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"260'60","reported_seq":635,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:07.715153+0000","last_change":"2024-03-09T15:25:07.715178+0000","last_active":"2024-03-09T15:25:07.715153+0000","last_peered":"2024-03-09T15:25:07.715153+0000","last_clean":"2024-03-09T15:25:07.715153+0000","last_became_active":"2024-03-09T14:21:56.359741+0000","last_became_peered":"2024-03-09T14:21:56.359741+0000","last_unstale":"2024-03-09T15:25:07.715153+0000","last_undegraded":"2024-03-09T15:25:07.715153+0000","last_fullsized":"2024-03-09T15:25:07.715153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'60","last_scrub_stamp":"2024-03-09T15:25:07.715064+0000","last_deep_scrub":"260'60","last_deep_scrub_stamp":"2024-03-09T15:25:07.715064+0000","last_clean_scrub_stamp":"2024-03-09T15:25:07.715064+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:02:18.286015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":259,"num_read_kb":219,"num_write":85,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"260'163","reported_seq":790,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:17.853916+0000","last_change":"2024-03-09T15:25:17.853947+0000","last_active":"2024-03-09T15:25:17.853916+0000","last_peered":"2024-03-09T15:25:17.853916+0000","last_clean":"2024-03-09T15:25:17.853916+0000","last_became_active":"2024-03-09T14:21:54.370417+0000","last_became_peered":"2024-03-09T14:21:54.370417+0000","last_unstale":"2024-03-09T15:25:17.853916+0000","last_undegraded":"2024-03-09T15:25:17.853916+0000","last_fullsized":"2024-03-09T15:25:17.853916+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'163","last_scrub_stamp":"2024-03-09T15:25:17.853829+0000","last_deep_scrub":"260'163","last_deep_scrub_stamp":"2024-03-09T15:25:17.853829+0000","last_clean_scrub_stamp":"2024-03-09T15:25:17.853829+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:21.627601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1468,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":450,"num_read_kb":5631,"num_write":926,"num_write_kb":16419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"260'170","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.656551+0000","last_change":"2024-03-09T15:25:03.656611+0000","last_active":"2024-03-09T15:25:03.656551+0000","last_peered":"2024-03-09T15:25:03.656551+0000","last_clean":"2024-03-09T15:25:03.656551+0000","last_became_active":"2024-03-09T14:21:56.364555+0000","last_became_peered":"2024-03-09T14:21:56.364555+0000","last_unstale":"2024-03-09T15:25:03.656551+0000","last_undegraded":"2024-03-09T15:25:03.656551+0000","last_fullsized":"2024-03-09T15:25:03.656551+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'170","last_scrub_stamp":"2024-03-09T15:25:03.656448+0000","last_deep_scrub":"260'170","last_deep_scrub_stamp":"2024-03-09T15:25:03.656448+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.656448+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:49:08.952959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":680,"num_read_kb":532,"num_write":270,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"260'146","reported_seq":727,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:54.598133+0000","last_change":"2024-03-09T15:24:54.598212+0000","last_active":"2024-03-09T15:24:54.598133+0000","last_peered":"2024-03-09T15:24:54.598133+0000","last_clean":"2024-03-09T15:24:54.598133+0000","last_became_active":"2024-03-09T14:22:31.511884+0000","last_became_peered":"2024-03-09T14:22:31.511884+0000","last_unstale":"2024-03-09T15:24:54.598133+0000","last_undegraded":"2024-03-09T15:24:54.598133+0000","last_fullsized":"2024-03-09T15:24:54.598133+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'146","last_scrub_stamp":"2024-03-09T15:24:54.598022+0000","last_deep_scrub":"260'146","last_deep_scrub_stamp":"2024-03-09T15:24:54.598022+0000","last_clean_scrub_stamp":"2024-03-09T15:24:54.598022+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:02.821961+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4226579,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":250,"num_read_kb":2407,"num_write":836,"num_write_kb":31220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"260'204","reported_seq":844,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:20.348527+0000","last_change":"2024-03-09T15:25:20.348559+0000","last_active":"2024-03-09T15:25:20.348527+0000","last_peered":"2024-03-09T15:25:20.348527+0000","last_clean":"2024-03-09T15:25:20.348527+0000","last_became_active":"2024-03-09T14:21:56.356376+0000","last_became_peered":"2024-03-09T14:21:56.356376+0000","last_unstale":"2024-03-09T15:25:20.348527+0000","last_undegraded":"2024-03-09T15:25:20.348527+0000","last_fullsized":"2024-03-09T15:25:20.348527+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'204","last_scrub_stamp":"2024-03-09T15:25:20.348434+0000","last_deep_scrub":"260'204","last_deep_scrub_stamp":"2024-03-09T15:25:20.348434+0000","last_clean_scrub_stamp":"2024-03-09T15:25:20.348434+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:25:39.962187+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":846,"num_read_kb":706,"num_write":297,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2875,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"260'227","reported_seq":974,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:35.391236+0000","last_change":"2024-03-09T15:25:35.391370+0000","last_active":"2024-03-09T15:25:35.391236+0000","last_peered":"2024-03-09T15:25:35.391236+0000","last_clean":"2024-03-09T15:25:35.391236+0000","last_became_active":"2024-03-09T14:21:54.359699+0000","last_became_peered":"2024-03-09T14:21:54.359699+0000","last_unstale":"2024-03-09T15:25:35.391236+0000","last_undegraded":"2024-03-09T15:25:35.391236+0000","last_fullsized":"2024-03-09T15:25:35.391236+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'227","last_scrub_stamp":"2024-03-09T15:25:35.391125+0000","last_deep_scrub":"260'227","last_deep_scrub_stamp":"2024-03-09T15:25:35.391125+0000","last_clean_scrub_stamp":"2024-03-09T15:25:35.391125+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:21:45.098509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079971,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":807,"num_read_kb":22283,"num_write":1154,"num_write_kb":19363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"260'143","reported_seq":759,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.082767+0000","last_change":"2024-03-09T15:25:02.082809+0000","last_active":"2024-03-09T15:25:02.082767+0000","last_peered":"2024-03-09T15:25:02.082767+0000","last_clean":"2024-03-09T15:25:02.082767+0000","last_became_active":"2024-03-09T14:21:56.363182+0000","last_became_peered":"2024-03-09T14:21:56.363182+0000","last_unstale":"2024-03-09T15:25:02.082767+0000","last_undegraded":"2024-03-09T15:25:02.082767+0000","last_fullsized":"2024-03-09T15:25:02.082767+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'143","last_scrub_stamp":"2024-03-09T15:25:02.082645+0000","last_deep_scrub":"260'143","last_deep_scrub_stamp":"2024-03-09T15:25:02.082645+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.082645+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:08.396801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":567,"num_read_kb":456,"num_write":218,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"260'197","reported_seq":868,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:16.737183+0000","last_change":"2024-03-09T15:25:16.737242+0000","last_active":"2024-03-09T15:25:16.737183+0000","last_peered":"2024-03-09T15:25:16.737183+0000","last_clean":"2024-03-09T15:25:16.737183+0000","last_became_active":"2024-03-09T14:21:54.371350+0000","last_became_peered":"2024-03-09T14:21:54.371350+0000","last_unstale":"2024-03-09T15:25:16.737183+0000","last_undegraded":"2024-03-09T15:25:16.737183+0000","last_fullsized":"2024-03-09T15:25:16.737183+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'197","last_scrub_stamp":"2024-03-09T15:25:16.737069+0000","last_deep_scrub":"260'197","last_deep_scrub_stamp":"2024-03-09T15:25:16.737069+0000","last_clean_scrub_stamp":"2024-03-09T15:25:16.737069+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:53:38.072969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":522,"num_read_kb":38599,"num_write":1107,"num_write_kb":23746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"260'371","reported_seq":1025,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:18.335355+0000","last_change":"2024-03-09T15:25:18.335390+0000","last_active":"2024-03-09T15:25:18.335355+0000","last_peered":"2024-03-09T15:25:18.335355+0000","last_clean":"2024-03-09T15:25:18.335355+0000","last_became_active":"2024-03-09T14:21:56.359349+0000","last_became_peered":"2024-03-09T14:21:56.359349+0000","last_unstale":"2024-03-09T15:25:18.335355+0000","last_undegraded":"2024-03-09T15:25:18.335355+0000","last_fullsized":"2024-03-09T15:25:18.335355+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'371","last_scrub_stamp":"2024-03-09T15:25:18.335257+0000","last_deep_scrub":"260'371","last_deep_scrub_stamp":"2024-03-09T15:25:18.335257+0000","last_clean_scrub_stamp":"2024-03-09T15:25:18.335257+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:48:51.442744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1495,"num_read_kb":1171,"num_write":642,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"260'214","reported_seq":851,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:10.703303+0000","last_change":"2024-03-09T15:25:10.703353+0000","last_active":"2024-03-09T15:25:10.703303+0000","last_peered":"2024-03-09T15:25:10.703303+0000","last_clean":"2024-03-09T15:25:10.703303+0000","last_became_active":"2024-03-09T14:21:54.364657+0000","last_became_peered":"2024-03-09T14:21:54.364657+0000","last_unstale":"2024-03-09T15:25:10.703303+0000","last_undegraded":"2024-03-09T15:25:10.703303+0000","last_fullsized":"2024-03-09T15:25:10.703303+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'214","last_scrub_stamp":"2024-03-09T15:25:10.703213+0000","last_deep_scrub":"260'214","last_deep_scrub_stamp":"2024-03-09T15:25:10.703213+0000","last_clean_scrub_stamp":"2024-03-09T15:25:10.703213+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:54:32.839461+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505039,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":1161,"num_write":1167,"num_write_kb":37780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"260'319","reported_seq":976,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:02.703687+0000","last_change":"2024-03-09T15:25:02.703712+0000","last_active":"2024-03-09T15:25:02.703687+0000","last_peered":"2024-03-09T15:25:02.703687+0000","last_clean":"2024-03-09T15:25:02.703687+0000","last_became_active":"2024-03-09T14:21:56.360321+0000","last_became_peered":"2024-03-09T14:21:56.360321+0000","last_unstale":"2024-03-09T15:25:02.703687+0000","last_undegraded":"2024-03-09T15:25:02.703687+0000","last_fullsized":"2024-03-09T15:25:02.703687+0000","mapping_epoch":22,"log_start":"260'300","ondisk_log_start":"260'300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'319","last_scrub_stamp":"2024-03-09T15:25:02.703601+0000","last_deep_scrub":"260'319","last_deep_scrub_stamp":"2024-03-09T15:25:02.703601+0000","last_clean_scrub_stamp":"2024-03-09T15:25:02.703601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:11.101908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1273,"num_read_kb":981,"num_write":494,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"260'187","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:37.366905+0000","last_change":"2024-03-09T15:25:37.366971+0000","last_active":"2024-03-09T15:25:37.366905+0000","last_peered":"2024-03-09T15:25:37.366905+0000","last_clean":"2024-03-09T15:25:37.366905+0000","last_became_active":"2024-03-09T14:21:54.365561+0000","last_became_peered":"2024-03-09T14:21:54.365561+0000","last_unstale":"2024-03-09T15:25:37.366905+0000","last_undegraded":"2024-03-09T15:25:37.366905+0000","last_fullsized":"2024-03-09T15:25:37.366905+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'187","last_scrub_stamp":"2024-03-09T15:25:37.366757+0000","last_deep_scrub":"260'187","last_deep_scrub_stamp":"2024-03-09T15:25:37.366757+0000","last_clean_scrub_stamp":"2024-03-09T15:25:37.366757+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:54.686603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":434,"num_read_kb":15052,"num_write":1039,"num_write_kb":35377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"260'131","reported_seq":728,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:51.526029+0000","last_change":"2024-03-09T15:24:51.526029+0000","last_active":"2024-03-09T15:24:51.526029+0000","last_peered":"2024-03-09T15:24:51.526029+0000","last_clean":"2024-03-09T15:24:51.526029+0000","last_became_active":"2024-03-09T14:23:32.139481+0000","last_became_peered":"2024-03-09T14:23:32.139481+0000","last_unstale":"2024-03-09T15:24:51.526029+0000","last_undegraded":"2024-03-09T15:24:51.526029+0000","last_fullsized":"2024-03-09T15:24:51.526029+0000","mapping_epoch":35,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'131","last_scrub_stamp":"2024-03-09T15:24:51.525912+0000","last_deep_scrub":"260'131","last_deep_scrub_stamp":"2024-03-09T15:24:51.525912+0000","last_clean_scrub_stamp":"2024-03-09T15:24:51.525912+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:07:26.494362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":536,"num_read_kb":435,"num_write":202,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"260'174","reported_seq":816,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:25.897010+0000","last_change":"2024-03-09T15:25:25.897055+0000","last_active":"2024-03-09T15:25:25.897010+0000","last_peered":"2024-03-09T15:25:25.897010+0000","last_clean":"2024-03-09T15:25:25.897010+0000","last_became_active":"2024-03-09T14:21:54.370327+0000","last_became_peered":"2024-03-09T14:21:54.370327+0000","last_unstale":"2024-03-09T15:25:25.897010+0000","last_undegraded":"2024-03-09T15:25:25.897010+0000","last_fullsized":"2024-03-09T15:25:25.897010+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'174","last_scrub_stamp":"2024-03-09T15:25:25.896920+0000","last_deep_scrub":"260'174","last_deep_scrub_stamp":"2024-03-09T15:25:25.896920+0000","last_clean_scrub_stamp":"2024-03-09T15:25:25.896920+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:34.988068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159793,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":2617,"num_write":1101,"num_write_kb":16523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"260'90","reported_seq":673,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.116636+0000","last_change":"2024-03-09T15:25:03.116665+0000","last_active":"2024-03-09T15:25:03.116636+0000","last_peered":"2024-03-09T15:25:03.116636+0000","last_clean":"2024-03-09T15:25:03.116636+0000","last_became_active":"2024-03-09T14:21:56.361716+0000","last_became_peered":"2024-03-09T14:21:56.361716+0000","last_unstale":"2024-03-09T15:25:03.116636+0000","last_undegraded":"2024-03-09T15:25:03.116636+0000","last_fullsized":"2024-03-09T15:25:03.116636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'90","last_scrub_stamp":"2024-03-09T15:25:03.116532+0000","last_deep_scrub":"260'90","last_deep_scrub_stamp":"2024-03-09T15:25:03.116532+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.116532+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:52.853288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":365,"num_read_kb":297,"num_write":130,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"260'212","reported_seq":811,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:48.869520+0000","last_change":"2024-03-09T15:24:48.869520+0000","last_active":"2024-03-09T15:24:48.869520+0000","last_peered":"2024-03-09T15:24:48.869520+0000","last_clean":"2024-03-09T15:24:48.869520+0000","last_became_active":"2024-03-09T14:22:31.509164+0000","last_became_peered":"2024-03-09T14:22:31.509164+0000","last_unstale":"2024-03-09T15:24:48.869520+0000","last_undegraded":"2024-03-09T15:24:48.869520+0000","last_fullsized":"2024-03-09T15:24:48.869520+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'212","last_scrub_stamp":"2024-03-09T15:24:48.869376+0000","last_deep_scrub":"260'212","last_deep_scrub_stamp":"2024-03-09T15:24:48.869376+0000","last_clean_scrub_stamp":"2024-03-09T15:24:48.869376+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:06.455688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":456,"num_read_kb":1538,"num_write":1089,"num_write_kb":24514,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"260'142","reported_seq":734,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:03.610226+0000","last_change":"2024-03-09T15:25:03.610226+0000","last_active":"2024-03-09T15:25:03.610226+0000","last_peered":"2024-03-09T15:25:03.610226+0000","last_clean":"2024-03-09T15:25:03.610226+0000","last_became_active":"2024-03-09T14:21:56.360591+0000","last_became_peered":"2024-03-09T14:21:56.360591+0000","last_unstale":"2024-03-09T15:25:03.610226+0000","last_undegraded":"2024-03-09T15:25:03.610226+0000","last_fullsized":"2024-03-09T15:25:03.610226+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'142","last_scrub_stamp":"2024-03-09T15:25:03.610105+0000","last_deep_scrub":"260'142","last_deep_scrub_stamp":"2024-03-09T15:25:03.610105+0000","last_clean_scrub_stamp":"2024-03-09T15:25:03.610105+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:40.358842+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":569,"num_read_kb":449,"num_write":211,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"260'157","reported_seq":773,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.898701+0000","last_change":"2024-03-09T15:25:19.898769+0000","last_active":"2024-03-09T15:25:19.898701+0000","last_peered":"2024-03-09T15:25:19.898701+0000","last_clean":"2024-03-09T15:25:19.898701+0000","last_became_active":"2024-03-09T14:21:54.359120+0000","last_became_peered":"2024-03-09T14:21:54.359120+0000","last_unstale":"2024-03-09T15:25:19.898701+0000","last_undegraded":"2024-03-09T15:25:19.898701+0000","last_fullsized":"2024-03-09T15:25:19.898701+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'157","last_scrub_stamp":"2024-03-09T15:25:19.898609+0000","last_deep_scrub":"260'157","last_deep_scrub_stamp":"2024-03-09T15:25:19.898609+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.898609+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:31:13.487231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262239,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":372,"num_read_kb":3591,"num_write":919,"num_write_kb":28379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"260'54","reported_seq":625,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:11.138914+0000","last_change":"2024-03-09T15:25:11.138966+0000","last_active":"2024-03-09T15:25:11.138914+0000","last_peered":"2024-03-09T15:25:11.138914+0000","last_clean":"2024-03-09T15:25:11.138914+0000","last_became_active":"2024-03-09T14:21:56.357318+0000","last_became_peered":"2024-03-09T14:21:56.357318+0000","last_unstale":"2024-03-09T15:25:11.138914+0000","last_undegraded":"2024-03-09T15:25:11.138914+0000","last_fullsized":"2024-03-09T15:25:11.138914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'54","last_scrub_stamp":"2024-03-09T15:25:11.138807+0000","last_deep_scrub":"260'54","last_deep_scrub_stamp":"2024-03-09T15:25:11.138807+0000","last_clean_scrub_stamp":"2024-03-09T15:25:11.138807+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:33.587801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":194,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"260'229","reported_seq":878,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:28.508765+0000","last_change":"2024-03-09T15:25:28.508855+0000","last_active":"2024-03-09T15:25:28.508765+0000","last_peered":"2024-03-09T15:25:28.508765+0000","last_clean":"2024-03-09T15:25:28.508765+0000","last_became_active":"2024-03-09T14:21:54.360872+0000","last_became_peered":"2024-03-09T14:21:54.360872+0000","last_unstale":"2024-03-09T15:25:28.508765+0000","last_undegraded":"2024-03-09T15:25:28.508765+0000","last_fullsized":"2024-03-09T15:25:28.508765+0000","mapping_epoch":20,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'229","last_scrub_stamp":"2024-03-09T15:25:28.508655+0000","last_deep_scrub":"260'229","last_deep_scrub_stamp":"2024-03-09T15:25:28.508655+0000","last_clean_scrub_stamp":"2024-03-09T15:25:28.508655+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:16.035672+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262213,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":6366,"num_write":1241,"num_write_kb":45424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"260'193","reported_seq":819,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:15.496497+0000","last_change":"2024-03-09T15:25:15.496525+0000","last_active":"2024-03-09T15:25:15.496497+0000","last_peered":"2024-03-09T15:25:15.496497+0000","last_clean":"2024-03-09T15:25:15.496497+0000","last_became_active":"2024-03-09T14:21:56.366192+0000","last_became_peered":"2024-03-09T14:21:56.366192+0000","last_unstale":"2024-03-09T15:25:15.496497+0000","last_undegraded":"2024-03-09T15:25:15.496497+0000","last_fullsized":"2024-03-09T15:25:15.496497+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'193","last_scrub_stamp":"2024-03-09T15:25:15.496413+0000","last_deep_scrub":"260'193","last_deep_scrub_stamp":"2024-03-09T15:25:15.496413+0000","last_clean_scrub_stamp":"2024-03-09T15:25:15.496413+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:43.755698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":797,"num_read_kb":634,"num_write":310,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"260'213","reported_seq":839,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:52.836015+0000","last_change":"2024-03-09T15:24:52.836015+0000","last_active":"2024-03-09T15:24:52.836015+0000","last_peered":"2024-03-09T15:24:52.836015+0000","last_clean":"2024-03-09T15:24:52.836015+0000","last_became_active":"2024-03-09T14:22:31.511900+0000","last_became_peered":"2024-03-09T14:22:31.511900+0000","last_unstale":"2024-03-09T15:24:52.836015+0000","last_undegraded":"2024-03-09T15:24:52.836015+0000","last_fullsized":"2024-03-09T15:24:52.836015+0000","mapping_epoch":33,"log_start":"260'200","ondisk_log_start":"260'200","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'213","last_scrub_stamp":"2024-03-09T15:24:52.835746+0000","last_deep_scrub":"260'213","last_deep_scrub_stamp":"2024-03-09T15:24:52.835746+0000","last_clean_scrub_stamp":"2024-03-09T15:24:52.835746+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:24.034553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343410,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":30999,"num_write":1210,"num_write_kb":31412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"260'188","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:19.478368+0000","last_change":"2024-03-09T15:25:19.478418+0000","last_active":"2024-03-09T15:25:19.478368+0000","last_peered":"2024-03-09T15:25:19.478368+0000","last_clean":"2024-03-09T15:25:19.478368+0000","last_became_active":"2024-03-09T14:21:56.371051+0000","last_became_peered":"2024-03-09T14:21:56.371051+0000","last_unstale":"2024-03-09T15:25:19.478368+0000","last_undegraded":"2024-03-09T15:25:19.478368+0000","last_fullsized":"2024-03-09T15:25:19.478368+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-03-09T15:25:19.478271+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-03-09T15:25:19.478271+0000","last_clean_scrub_stamp":"2024-03-09T15:25:19.478271+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:34.467178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":810,"num_read_kb":673,"num_write":283,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"260'188","reported_seq":799,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:23.623897+0000","last_change":"2024-03-09T15:25:23.623959+0000","last_active":"2024-03-09T15:25:23.623897+0000","last_peered":"2024-03-09T15:25:23.623897+0000","last_clean":"2024-03-09T15:25:23.623897+0000","last_became_active":"2024-03-09T14:21:54.364514+0000","last_became_peered":"2024-03-09T14:21:54.364514+0000","last_unstale":"2024-03-09T15:25:23.623897+0000","last_undegraded":"2024-03-09T15:25:23.623897+0000","last_fullsized":"2024-03-09T15:25:23.623897+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'188","last_scrub_stamp":"2024-03-09T15:25:23.623787+0000","last_deep_scrub":"260'188","last_deep_scrub_stamp":"2024-03-09T15:25:23.623787+0000","last_clean_scrub_stamp":"2024-03-09T15:25:23.623787+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:10:21.231942+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244348,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":358,"num_read_kb":8057,"num_write":1058,"num_write_kb":41536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"260'125","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:21.368946+0000","last_change":"2024-03-09T15:25:21.368976+0000","last_active":"2024-03-09T15:25:21.368946+0000","last_peered":"2024-03-09T15:25:21.368946+0000","last_clean":"2024-03-09T15:25:21.368946+0000","last_became_active":"2024-03-09T14:21:56.374540+0000","last_became_peered":"2024-03-09T14:21:56.374540+0000","last_unstale":"2024-03-09T15:25:21.368946+0000","last_undegraded":"2024-03-09T15:25:21.368946+0000","last_fullsized":"2024-03-09T15:25:21.368946+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'125","last_scrub_stamp":"2024-03-09T15:25:21.368852+0000","last_deep_scrub":"260'125","last_deep_scrub_stamp":"2024-03-09T15:25:21.368852+0000","last_clean_scrub_stamp":"2024-03-09T15:25:21.368852+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:53.127396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":409,"num_write":186,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"260'194","reported_seq":807,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:00.701458+0000","last_change":"2024-03-09T15:25:00.701513+0000","last_active":"2024-03-09T15:25:00.701458+0000","last_peered":"2024-03-09T15:25:00.701458+0000","last_clean":"2024-03-09T15:25:00.701458+0000","last_became_active":"2024-03-09T14:21:54.358223+0000","last_became_peered":"2024-03-09T14:21:54.358223+0000","last_unstale":"2024-03-09T15:25:00.701458+0000","last_undegraded":"2024-03-09T15:25:00.701458+0000","last_fullsized":"2024-03-09T15:25:00.701458+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'194","last_scrub_stamp":"2024-03-09T15:25:00.701355+0000","last_deep_scrub":"260'194","last_deep_scrub_stamp":"2024-03-09T15:25:00.701355+0000","last_clean_scrub_stamp":"2024-03-09T15:25:00.701355+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:44.493825+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867857,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":377,"num_read_kb":1771,"num_write":1080,"num_write_kb":40203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"260'130","reported_seq":745,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.472386+0000","last_change":"2024-03-09T15:25:13.472413+0000","last_active":"2024-03-09T15:25:13.472386+0000","last_peered":"2024-03-09T15:25:13.472386+0000","last_clean":"2024-03-09T15:25:13.472386+0000","last_became_active":"2024-03-09T14:21:56.366384+0000","last_became_peered":"2024-03-09T14:21:56.366384+0000","last_unstale":"2024-03-09T15:25:13.472386+0000","last_undegraded":"2024-03-09T15:25:13.472386+0000","last_fullsized":"2024-03-09T15:25:13.472386+0000","mapping_epoch":22,"log_start":"260'100","ondisk_log_start":"260'100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'130","last_scrub_stamp":"2024-03-09T15:25:13.472286+0000","last_deep_scrub":"260'130","last_deep_scrub_stamp":"2024-03-09T15:25:13.472286+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.472286+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:26.133764+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":535,"num_read_kb":433,"num_write":181,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"260'195","reported_seq":821,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:22.936483+0000","last_change":"2024-03-09T15:25:22.936570+0000","last_active":"2024-03-09T15:25:22.936483+0000","last_peered":"2024-03-09T15:25:22.936483+0000","last_clean":"2024-03-09T15:25:22.936483+0000","last_became_active":"2024-03-09T14:21:54.361972+0000","last_became_peered":"2024-03-09T14:21:54.361972+0000","last_unstale":"2024-03-09T15:25:22.936483+0000","last_undegraded":"2024-03-09T15:25:22.936483+0000","last_fullsized":"2024-03-09T15:25:22.936483+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-03-09T15:25:22.936372+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-03-09T15:25:22.936372+0000","last_clean_scrub_stamp":"2024-03-09T15:25:22.936372+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:30:23.820145+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":6618,"num_write":1000,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"260'208","reported_seq":869,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:24:47.458832+0000","last_change":"2024-03-09T15:24:47.458832+0000","last_active":"2024-03-09T15:24:47.458832+0000","last_peered":"2024-03-09T15:24:47.458832+0000","last_clean":"2024-03-09T15:24:47.458832+0000","last_became_active":"2024-03-09T14:22:31.500337+0000","last_became_peered":"2024-03-09T14:22:31.500337+0000","last_unstale":"2024-03-09T15:24:47.458832+0000","last_undegraded":"2024-03-09T15:24:47.458832+0000","last_fullsized":"2024-03-09T15:24:47.458832+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'208","last_scrub_stamp":"2024-03-09T15:24:47.458581+0000","last_deep_scrub":"260'208","last_deep_scrub_stamp":"2024-03-09T15:24:47.458581+0000","last_clean_scrub_stamp":"2024-03-09T15:24:47.458581+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:31:30.767151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":70161,"num_write":1223,"num_write_kb":36615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"260'276","reported_seq":929,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:13.532525+0000","last_change":"2024-03-09T15:25:13.532575+0000","last_active":"2024-03-09T15:25:13.532525+0000","last_peered":"2024-03-09T15:25:13.532525+0000","last_clean":"2024-03-09T15:25:13.532525+0000","last_became_active":"2024-03-09T14:21:56.373226+0000","last_became_peered":"2024-03-09T14:21:56.373226+0000","last_unstale":"2024-03-09T15:25:13.532525+0000","last_undegraded":"2024-03-09T15:25:13.532525+0000","last_fullsized":"2024-03-09T15:25:13.532525+0000","mapping_epoch":22,"log_start":"260'200","ondisk_log_start":"260'200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'276","last_scrub_stamp":"2024-03-09T15:25:13.532414+0000","last_deep_scrub":"260'276","last_deep_scrub_stamp":"2024-03-09T15:25:13.532414+0000","last_clean_scrub_stamp":"2024-03-09T15:25:13.532414+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:49:11.083550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1169,"num_read_kb":946,"num_write":462,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"260'195","reported_seq":859,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:12.769635+0000","last_change":"2024-03-09T15:25:12.769701+0000","last_active":"2024-03-09T15:25:12.769635+0000","last_peered":"2024-03-09T15:25:12.769635+0000","last_clean":"2024-03-09T15:25:12.769635+0000","last_became_active":"2024-03-09T14:21:54.366325+0000","last_became_peered":"2024-03-09T14:21:54.366325+0000","last_unstale":"2024-03-09T15:25:12.769635+0000","last_undegraded":"2024-03-09T15:25:12.769635+0000","last_fullsized":"2024-03-09T15:25:12.769635+0000","mapping_epoch":20,"log_start":"260'100","ondisk_log_start":"260'100","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'195","last_scrub_stamp":"2024-03-09T15:25:12.769519+0000","last_deep_scrub":"260'195","last_deep_scrub_stamp":"2024-03-09T15:25:12.769519+0000","last_clean_scrub_stamp":"2024-03-09T15:25:12.769519+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:41:45.905992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":29809,"num_write":1056,"num_write_kb":48529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"260'82","reported_seq":657,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-03-09T15:25:04.754758+0000","last_change":"2024-03-09T15:25:04.754782+0000","last_active":"2024-03-09T15:25:04.754758+0000","last_peered":"2024-03-09T15:25:04.754758+0000","last_clean":"2024-03-09T15:25:04.754758+0000","last_became_active":"2024-03-09T14:21:56.373658+0000","last_became_peered":"2024-03-09T14:21:56.373658+0000","last_unstale":"2024-03-09T15:25:04.754758+0000","last_undegraded":"2024-03-09T15:25:04.754758+0000","last_fullsized":"2024-03-09T15:25:04.754758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'82","last_scrub_stamp":"2024-03-09T15:25:04.754671+0000","last_deep_scrub":"260'82","last_deep_scrub_stamp":"2024-03-09T15:25:04.754671+0000","last_clean_scrub_stamp":"2024-03-09T15:25:04.754671+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:48:22.436199+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":342,"num_read_kb":279,"num_write":121,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5338,"num_read_kb":3800,"num_write":2094,"num_write_kb":750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5640,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1228,"ondisk_log_size":1228,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":12747,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":15539,"num_read_kb":15315,"num_write":16236,"num_write_kb":4749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2106,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":483328,"data_stored":25494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2039,"ondisk_log_size":2039,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":248436,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":9145,"num_read_kb":11177,"num_write":6541,"num_write_kb":2993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":679644,"num_omap_keys":1578,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1884,"ondisk_log_size":1884,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1583,"num_read_kb":1885,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":87067,"num_read_kb":70690,"num_write":34973,"num_write_kb":17611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32820,"num_omap_keys":136,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3758,"ondisk_log_size":3758,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":112174806,"num_objects":222,"num_object_clones":0,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":32019,"num_read_kb":2295864,"num_write":68252,"num_write_kb":2136612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":170090496,"data_stored":170090496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4240,"ondisk_log_size":4240,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":131,"num_read_kb":170575,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":132,"num_read_kb":174957,"num_write":150,"num_write_kb":116581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575622,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303052,"kb_used_data":23364,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94068788,"statfs":{"total":96636764160,"available":96326438912,"internally_reserved":0,"allocated":23924736,"data_stored":21980799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":286390730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575622,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":275968,"kb_used_data":37944,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94095872,"statfs":{"total":96636764160,"available":96354172928,"internally_reserved":0,"allocated":38854656,"data_stored":36958563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575623,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126900,"kb_used_data":37484,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94244940,"statfs":{"total":96636764160,"available":96506818560,"internally_reserved":0,"allocated":38383616,"data_stored":36419893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575623,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118904,"kb_used_data":43312,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94252936,"statfs":{"total":96636764160,"available":96515006464,"internally_reserved":0,"allocated":44351488,"data_stored":42475464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575625,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":241172,"kb_used_data":29516,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94130668,"statfs":{"total":96636764160,"available":96389804032,"internally_reserved":0,"allocated":30224384,"data_stored":28300435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575624,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110248,"kb_used_data":24992,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94261592,"statfs":{"total":96636764160,"available":96523870208,"internally_reserved":0,"allocated":25591808,"data_stored":23689459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575623,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141856,"kb_used_data":34392,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94229984,"statfs":{"total":96636764160,"available":96491503616,"internally_reserved":0,"allocated":35217408,"data_stored":33306448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575621,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254404,"kb_used_data":34428,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94117436,"statfs":{"total":96636764160,"available":96376254464,"internally_reserved":0,"allocated":35254272,"data_stored":33315187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":225245637},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30007296,"data_stored":30007296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25214976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16187392,"data_stored":16187392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":23441408,"data_stored":23441408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18432000,"data_stored":18432000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":24215552,"data_stored":24215552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18083840,"data_stored":18083840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":2814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:25:47.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-09T15:25:47.611 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-09T15:25:47.611 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-09T15:25:47.612 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-09T15:25:47.612 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:47.658 INFO:tasks.ceph.osd.0:Stopped 2024-03-09T15:25:47.659 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-09T15:25:47.659 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:47.698 INFO:tasks.ceph.osd.1:Stopped 2024-03-09T15:25:47.698 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-09T15:25:47.698 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:47.780 INFO:tasks.ceph.osd.2:Stopped 2024-03-09T15:25:47.780 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-09T15:25:47.781 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:47.869 INFO:tasks.ceph.osd.3:Stopped 2024-03-09T15:25:47.870 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-09T15:25:47.870 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:47.909 INFO:tasks.ceph.osd.4:Stopped 2024-03-09T15:25:47.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-09T15:25:47.910 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:47.995 INFO:tasks.ceph.osd.5:Stopped 2024-03-09T15:25:47.996 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-09T15:25:47.996 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.045 INFO:tasks.ceph.osd.6:Stopped 2024-03-09T15:25:48.045 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-09T15:25:48.045 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.094 INFO:tasks.ceph.osd.7:Stopped 2024-03-09T15:25:48.094 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-09T15:25:48.095 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-09T15:25:48.095 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.122 INFO:tasks.ceph.mgr.y:Stopped 2024-03-09T15:25:48.123 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-09T15:25:48.123 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.149 INFO:tasks.ceph.mgr.x:Stopped 2024-03-09T15:25:48.149 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-09T15:25:48.149 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-09T15:25:48.149 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.179 INFO:tasks.ceph.mon.a:Stopped 2024-03-09T15:25:48.179 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-09T15:25:48.179 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.233 INFO:tasks.ceph.mon.c:Stopped 2024-03-09T15:25:48.233 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-09T15:25:48.233 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:25:48.246 INFO:tasks.ceph.mon.b:Stopped 2024-03-09T15:25:48.246 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-09T15:25:48.247 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-03-09T15:25:48.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T15:25:48.315 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-09T15:25:48.611 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T15:25:48.611 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-09T15:25:48.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T15:25:48.745 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-09T15:25:48.817 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T15:25:48.817 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-09T15:25:48.898 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T15:25:48.899 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-09T15:25:49.152 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T15:25:49.152 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-09T15:25:49.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T15:25:49.239 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-09T15:25:49.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T15:25:49.322 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-09T15:25:49.403 INFO:tasks.ceph:Archiving mon data... 2024-03-09T15:25:49.405 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/data/mon.a.tgz 2024-03-09T15:25:49.405 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-03-09T15:25:49.435 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.FRQk7yfBPT 2024-03-09T15:25:49.435 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FRQk7yfBPT 2024-03-09T15:25:49.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.FRQk7yfBPT 2024-03-09T15:25:49.750 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.FRQk7yfBPT is 486KB 2024-03-09T15:25:49.848 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.FRQk7yfBPT 2024-03-09T15:25:49.875 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/data/mon.c.tgz 2024-03-09T15:25:49.875 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-03-09T15:25:49.941 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.VrdT5gCMyr 2024-03-09T15:25:49.941 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VrdT5gCMyr 2024-03-09T15:25:50.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.VrdT5gCMyr 2024-03-09T15:25:50.240 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.VrdT5gCMyr is 491KB 2024-03-09T15:25:50.337 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.VrdT5gCMyr 2024-03-09T15:25:50.363 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/data/mon.b.tgz 2024-03-09T15:25:50.364 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-03-09T15:25:50.396 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.BPXJ4SBht8 2024-03-09T15:25:50.397 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BPXJ4SBht8 2024-03-09T15:25:50.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.BPXJ4SBht8 2024-03-09T15:25:50.713 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.BPXJ4SBht8 is 491KB 2024-03-09T15:25:50.810 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.BPXJ4SBht8 2024-03-09T15:25:50.838 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-09T15:25:50.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-09T15:25:50.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-09T15:25:51.019 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-09T15:25:51.047 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-09T15:25:51.047 INFO:tasks.ceph:Archiving crash dumps... 2024-03-09T15:25:51.049 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/remote/smithi046/crash 2024-03-09T15:25:51.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-09T15:25:51.089 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/remote/smithi159/crash 2024-03-09T15:25:51.090 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-09T15:25:51.128 INFO:tasks.ceph:Compressing logs... 2024-03-09T15:25:51.128 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-09T15:25:51.133 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-09T15:25:51.229 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-09T15:25:51.229 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-09T15:25:51.229 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34075.log 2024-03-09T15:25:51.229 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-09T15:25:51.229 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.34075.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34075.log.gz 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33987.log 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33855.log 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.33987.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33987.log.gz 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34031.log 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-09T15:25:51.230 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.33855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33855.log.gz 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.34031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33943.log 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34031.log.gz 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.33943.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33943.log.gz 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33899.log 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.33899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33811.log 2024-03-09T15:25:51.231 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33899.log.gz 2024-03-09T15:25:51.232 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mon.b.log: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-09T15:25:51.232 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33767.log 2024-03-09T15:25:51.232 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.33811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33811.log.gz 2024-03-09T15:25:51.232 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.33767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33767.log.gz 2024-03-09T15:25:51.260 INFO:teuthology.orchestra.run.smithi159.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-09T15:25:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87591.log 2024-03-09T15:25:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144035.log 2024-03-09T15:25:51.261 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87591.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87591.log.gz 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34045.log 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144035.log.gz 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70439.log 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34045.log.gz 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40811.log 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.70439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62970.log 2024-03-09T15:25:51.262 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143805.log 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40811.log.gz 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41515.log 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.62970.log.gz 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143805.log.gz 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134349.log 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70439.log.gz 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.41515.log: /var/log/ceph/ceph-client.0.134349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143575.log 2024-03-09T15:25:51.263 INFO:teuthology.orchestra.run.smithi046.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.134349.log.gz 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62908.log 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120672.log 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143575.log.gz 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.41515.log.gz 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144403.log 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.62908.log.gz 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.120672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69205.log 2024-03-09T15:25:51.264 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120672.log.gz 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144403.log.gz 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.69205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58240.log 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143482.log 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.58240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89358.log 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.58240.log.gz 2024-03-09T15:25:51.265 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40453.log 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143482.log.gz 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.89358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84646.log 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89358.log.gz 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112332.log 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40453.log.gz 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.69205.log.gz 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143713.log 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.84646.log.gz 2024-03-09T15:25:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143713.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112332.log.gz 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75926.log 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143713.log.gz 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.46905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104675.log 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.75926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44542.log 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104675.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.75926.log.gz 2024-03-09T15:25:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.134958.log 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.44542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40086.log 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.44542.log.gz 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.134958.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.134958.log.gz 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40086.log.gz 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114688.log 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.104675.log.gz 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2024-03-09T15:25:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54069.log 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr: 62.6%/var/log/ceph/ceph-client.admin.114688.log: -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62778.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114688.log.gz 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55836.log 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.54069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41448.log 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.54069.log.gz 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.55836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60007.log 2024-03-09T15:25:51.269 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.55836.log.gz 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144449.log 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41448.log.gz 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.60007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42124.log 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60007.log.gz 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144173.log 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144449.log.gz 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.42124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55247.log 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.42124.log.gz 2024-03-09T15:25:51.270 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144265.log 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144173.log.gz 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.55247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.139830.log 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144265.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.55247.log.gz 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144265.log.gz 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72192.log 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.139830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65503.log 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.72192.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.139830.log.gz 2024-03-09T15:25:51.271 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39878.log 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.72192.log.gz 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.65503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62131.log 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.39878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144311.log 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39878.log.gz 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94071.log 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.62131.log.gz 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40087.log 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144311.log.gz 2024-03-09T15:25:51.272 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95838.log 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94071.log.gz 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41360.log 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40087.log.gz 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123359.log 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.95838.log.gz 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52891.log 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41360.log.gz 2024-03-09T15:25:51.273 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.123359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34487.log 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.123359.log.gz 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.52891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82879.log 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.52891.log.gz 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63680.log 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34487.log.gz 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40091.log 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.82879.log.gz 2024-03-09T15:25:51.274 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.63680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118244.log 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.63680.log.gz 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49261.log 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40091.log.gz 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88180.log 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.118244.log.gz 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103495.log 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49261.log.gz 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96427.log 2024-03-09T15:25:51.275 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88180.log: /var/log/ceph/ceph-client.admin.103495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127592.log 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.88180.log.gz 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.103495.log.gz 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.96427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124617.log 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.127592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64886.log 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.127592.log.gz 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.124617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40719.log 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.65503.log.gz 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.64886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98783.log 2024-03-09T15:25:51.276 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.124617.log.gz 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96427.log.gz 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121874.log 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40719.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.64886.log.gz 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40719.log.gz 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116477.log 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98783.log.gz 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.121874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76691.log 2024-03-09T15:25:51.277 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.121874.log.gz 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.116477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.142027.log 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.116477.log.gz 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.76691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144219.log 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111154.log 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.142027.log: /var/log/ceph/ceph-client.admin.144219.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.142027.log.gz 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144219.log.gz 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67354.log 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143943.log 2024-03-09T15:25:51.278 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111154.log: /var/log/ceph/ceph-client.admin.67354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144589.log 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.111154.log.gz 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143943.log.gz 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43336.log 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82290.log 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144589.log.gz 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.43336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105264.log 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43336.log.gz 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.76691.log.gz 2024-03-09T15:25:51.279 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.82290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45145.log 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67354.log.gz 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105264.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.82290.log.gz 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105264.log.gz 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.45145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.45145.log.gz 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.56425.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr: 80.2%/var/log/ceph/ceph-client.admin.39786.log: -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2024-03-09T15:25:51.280 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99961.log 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77300.log 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.99961.log.gz 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.77300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 2024-03-09T15:25:51.281 INFO:teuthology.orchestra.run.smithi046.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.0.77300.log.gz 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115888.log 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.57651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92304.log 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131884.log 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115888.log.gz 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128349.log 2024-03-09T15:25:51.282 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92304.log: /var/log/ceph/ceph-client.admin.131884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98194.log 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.92304.log.gz 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.128349.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.131884.log.gz 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58829.log 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.98194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107031.log 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.128349.log.gz 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8%/var/log/ceph/ceph-client.admin.58829.log: -- replaced with /var/log/ceph/ceph-client.admin.98194.log.gz 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60055.log 2024-03-09T15:25:51.283 INFO:teuthology.orchestra.run.smithi046.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.58829.log.gz 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92893.log 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.107031.log.gz 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.60055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112921.log 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.92893.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.60055.log.gz 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74557.log 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92893.log.gz 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.112921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50487.log 2024-03-09T15:25:51.284 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112921.log.gz 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.74557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120696.log 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.74557.log.gz 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.50487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63568.log 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.120696.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.50487.log.gz 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66120.log 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120696.log.gz 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.63568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95249.log 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.63568.log.gz 2024-03-09T15:25:51.285 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.66120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80523.log 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.95249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143529.log 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.95249.log.gz 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.80523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140439.log 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.80523.log.gz 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128957.log 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143529.log.gz 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.140439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40451.log 2024-03-09T15:25:51.286 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.140439.log.gz 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.128957.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73376.log 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40451.log.gz 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.128957.log.gz 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138612.log 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110565.log 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.73376.log: /var/log/ceph/ceph-client.0.138612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54658.log 2024-03-09T15:25:51.287 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.138612.log.gz 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.110565.log: gzip 91.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.73376.log.gz --verbose 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.81112.log 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.54658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144127.log 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.54658.log.gz 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.81112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62840.log 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81112.log.gz 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66120.log.gz 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40765.log 2024-03-09T15:25:51.288 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144127.log.gz 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62840.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.110565.log.gz 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39832.log 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40765.log.gz 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63504.log 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107620.log 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.39832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39832.log.gz 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.63504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67971.log 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr: 22.5% -- replaced with /var/log/ceph/ceph-client.admin.63504.log.gz 2024-03-09T15:25:51.289 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.107620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.107620.log.gz 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.67971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79934.log 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129565.log 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.39632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.79934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113510.log 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.129565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59418.log 80.9% 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79934.log.gz 2024-03-09T15:25:51.290 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.113510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40089.log 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.129565.log.gz 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr: 84.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71101.log 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113510.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67971.log.gz 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.59418.log: 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40089.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.59418.log.gz 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51689.log 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40089.log.gz 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.71101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93482.log 2024-03-09T15:25:51.291 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.71101.log.gz 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115277.log 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51689.log.gz 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.93482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49309.log 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.93482.log.gz 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132522.log 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.115277.log.gz 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61233.log 2024-03-09T15:25:51.292 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49309.log: /var/log/ceph/ceph-client.0.132522.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.49309.log.gz 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91125.log 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.132522.log.gz 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.61233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144498.log 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.61233.log.gz 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.91125.log: /var/log/ceph/ceph-client.admin.144498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83468.log 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.91125.log.gz 2024-03-09T15:25:51.293 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144498.log.gz 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97016.log 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.83468.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114099.log 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83468.log.gz 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136176.log 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97016.log.gz 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.114099.log: /var/log/ceph/ceph-client.0.136176.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.114099.log.gz 2024-03-09T15:25:51.294 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.137394.log 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.136176.log.gz 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40857.log 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102906.log 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.137394.log: /var/log/ceph/ceph-client.admin.40857.log: 80.5%gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40857.log.gz -5 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.0.142720.log 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.0.137394.log.gz 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130173.log 2024-03-09T15:25:51.295 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102906.log: /var/log/ceph/ceph-client.0.142720.log: gzip -5 85.3% -- replaced with /var/log/ceph/ceph-client.admin.102906.log.gz 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.0.141048.log 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.130173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126984.log 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2%/var/log/ceph/ceph-client.0.141048.log: -- replaced with /var/log/ceph/ceph-client.admin.130173.log.gz 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102317.log 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.141048.log.gz 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.126984.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.142720.log.gz 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62493.log 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.126984.log.gz 2024-03-09T15:25:51.296 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.102317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40446.log 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102317.log.gz 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40088.log 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr: 49.3% -- replaced with /var/log/ceph/ceph-client.admin.62493.log.gz 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40446.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78756.log 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40446.log.gz 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-03-09T15:25:51.297 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72781.log 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.78756.log: 81.9%/var/log/ceph/ceph-client.admin.53480.log: -- replaced with /var/log/ceph/ceph-client.admin.78756.log.gz 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.72781.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62840.log.gz 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143621.log 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.72781.log.gz 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62383.log 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48083.log: /var/log/ceph/ceph-client.admin.143621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143851.log 2024-03-09T15:25:51.298 INFO:teuthology.orchestra.run.smithi046.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143621.log.gz 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84057.log 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr: 54.8% -- replaced with /var/log/ceph/ceph-client.admin.62383.log.gz 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143851.log.gz 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75148.log 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.84057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106442.log 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84057.log.gz 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.75148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94660.log 2024-03-09T15:25:51.299 INFO:teuthology.orchestra.run.smithi046.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.75148.log.gz 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.106442.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.106442.log.gz 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.94660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104086.log 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111743.log 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.94660.log.gz 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.104086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133131.log 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104086.log.gz 2024-03-09T15:25:51.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.111743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118857.log 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.133131.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.111743.log.gz 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.133131.log.gz 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118857.log.gz 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90536.log 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41492.log 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.90536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108798.log 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90536.log.gz/var/log/ceph/ceph-client.admin.41492.log: 2024-03-09T15:25:51.301 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41492.log.gz 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75317.log 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5/var/log/ceph/ceph-client.admin.108798.log: --verbose -- /var/log/ceph/ceph-client.admin.39740.log 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.75317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143667.log 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.108798.log.gz 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.75317.log.gz 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.39740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39740.log.gz 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136785.log 2024-03-09T15:25:51.302 INFO:teuthology.orchestra.run.smithi046.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143667.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143667.log.gz 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41404.log 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.136785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40090.log 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.136785.log.gz 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43939.log 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41404.log.gz 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121285.log 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40090.log.gz 2024-03-09T15:25:51.303 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.43939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41316.log 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43939.log.gz 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.121285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85824.log 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41316.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41316.log.gz 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr: 87.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.115867.log 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.121285.log.gz 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40949.log 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.85824.log.gz 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.115867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69822.log 2024-03-09T15:25:51.304 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115867.log.gz 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89947.log 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40949.log.gz 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.69822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108209.log 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.89947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143759.log 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.108209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119470.log 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108209.log.gz 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143759.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.69822.log.gz 2024-03-09T15:25:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60031.log 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143759.log.gz 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.119470.log: gzip -5 --verbose 86.2% -- replaced with /var/log/ceph/ceph-client.admin.89947.log.gz 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.0.42727.log 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119470.log.gz 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.60031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60031.log.gz 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52302.log 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.42727.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-09T15:25:51.306 INFO:teuthology.orchestra.run.smithi046.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.42727.log.gz 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.52302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49285.log 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.124009.log 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.52302.log.gz 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49285.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.40461.log 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49285.log.gz 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.124009.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40461.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118881.log 2024-03-09T15:25:51.307 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40461.log.gz 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.124009.log.gz 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88769.log 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105853.log 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.88769.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118881.log.gz 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88769.log.gz 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57627.log 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.105853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79345.log 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.57627.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.105853.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57627.log.gz 2024-03-09T15:25:51.308 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40458.log 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.79345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120648.log 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79345.log.gz 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40458.log.gz 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.138003.log 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.120648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120648.log.gz 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-09T15:25:51.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.138003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39696.log 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: 82.8% -- replaced with /var/log/ceph/ceph-client.0.138003.log.gz 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40448.log 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.39696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39696.log.gz 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40448.log.gz 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143989.log 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60644.log 2024-03-09T15:25:51.310 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143989.log.gz 2024-03-09T15:25:51.319 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68588.log 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.60644.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.60644.log.gz 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81701.log 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.68588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109976.log 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.81701.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.81701.log.gz 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.68588.log.gz 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101139.log 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109976.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109976.log.gz 2024-03-09T15:25:51.320 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40995.log 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101139.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.101139.log.gz 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133740.log 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40995.log.gz 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85235.log 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.133740.log: 83.0% -- replaced with /var/log/ceph/ceph-client.0.133740.log.gz 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34384.log 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.85235.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.85235.log.gz 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86413.log 2024-03-09T15:25:51.321 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.34384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34384.log.gz 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.135567.log 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.86413.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.86413.log.gz 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40092.log 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.135567.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.135567.log.gz 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40092.log.gz 2024-03-09T15:25:51.322 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27931.log 2024-03-09T15:25:51.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120059.log 2024-03-09T15:25:51.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.27931.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27931.log.gz 2024-03-09T15:25:51.334 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109387.log 2024-03-09T15:25:51.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.120059.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.120059.log.gz 2024-03-09T15:25:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57014.log 2024-03-09T15:25:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.109387.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109387.log.gz 2024-03-09T15:25:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91715.log 2024-03-09T15:25:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.57014.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.57014.log.gz 2024-03-09T15:25:51.365 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118833.log 2024-03-09T15:25:51.365 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.91715.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.91715.log.gz 2024-03-09T15:25:51.375 INFO:teuthology.orchestra.run.smithi046.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-09T15:25:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62701.log 2024-03-09T15:25:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.118833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118833.log.gz 2024-03-09T15:25:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131276.log 2024-03-09T15:25:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.62701.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62701.log.gz 2024-03-09T15:25:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99372.log 2024-03-09T15:25:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.131276.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.131276.log.gz 2024-03-09T15:25:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101728.log 2024-03-09T15:25:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.99372.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.99372.log.gz 2024-03-09T15:25:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100550.log 2024-03-09T15:25:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.101728.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.101728.log.gz 2024-03-09T15:25:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51665.log 2024-03-09T15:25:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.100550.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100550.log.gz 2024-03-09T15:25:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64269.log 2024-03-09T15:25:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51665.log.gz 2024-03-09T15:25:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144544.log 2024-03-09T15:25:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.64269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.139221.log 2024-03-09T15:25:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144544.log.gz 2024-03-09T15:25:51.401 INFO:teuthology.orchestra.run.smithi046.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.64269.log.gz 2024-03-09T15:25:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125768.log 2024-03-09T15:25:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.139221.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.139221.log.gz 2024-03-09T15:25:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143897.log 2024-03-09T15:25:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.125768.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.125768.log.gz 2024-03-09T15:25:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78167.log 2024-03-09T15:25:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.143897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143897.log.gz 2024-03-09T15:25:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76639.log 2024-03-09T15:25:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.78167.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.78167.log.gz 2024-03-09T15:25:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117066.log 2024-03-09T15:25:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.76639.log: 47.5% -- replaced with /var/log/ceph/ceph-client.admin.76639.log.gz 2024-03-09T15:25:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97605.log 2024-03-09T15:25:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.117066.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.117066.log.gz 2024-03-09T15:25:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51713.log 2024-03-09T15:25:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.97605.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.97605.log.gz 2024-03-09T15:25:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117655.log 2024-03-09T15:25:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.51713.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.51713.log.gz 2024-03-09T15:25:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57603.log 2024-03-09T15:25:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.117655.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.117655.log.gz 2024-03-09T15:25:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66737.log 2024-03-09T15:25:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.57603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57603.log.gz 2024-03-09T15:25:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87002.log 2024-03-09T15:25:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.66737.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.66737.log.gz 2024-03-09T15:25:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40459.log 2024-03-09T15:25:51.423 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.87002.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.87002.log.gz 2024-03-09T15:25:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144357.log 2024-03-09T15:25:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40459.log.gz 2024-03-09T15:25:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40903.log 2024-03-09T15:25:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144357.log.gz 2024-03-09T15:25:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126376.log 2024-03-09T15:25:51.424 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40903.log.gz 2024-03-09T15:25:51.428 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2024-03-09T15:25:51.428 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.126376.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.126376.log.gz 2024-03-09T15:25:51.428 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144081.log 2024-03-09T15:25:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2024-03-09T15:25:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-09T15:25:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.144081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144081.log.gz 2024-03-09T15:25:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73966.log 2024-03-09T15:25:51.437 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51076.log 2024-03-09T15:25:51.447 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.73966.log: 80.7%/var/log/ceph/ceph-client.admin.51076.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.51076.log.gz 2024-03-09T15:25:51.450 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73966.log.gz 2024-03-09T15:25:51.840 INFO:teuthology.orchestra.run.smithi046.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-09T15:25:52.246 INFO:teuthology.orchestra.run.smithi159.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-09T15:25:52.722 INFO:teuthology.orchestra.run.smithi046.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-09T15:25:54.249 INFO:teuthology.orchestra.run.smithi046.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-09T15:25:55.973 INFO:teuthology.orchestra.run.smithi046.stderr: 92.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-09T15:25:57.254 INFO:teuthology.orchestra.run.smithi046.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-09T15:25:58.040 INFO:teuthology.orchestra.run.smithi159.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-09T15:25:59.376 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-09T15:25:59.461 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-09T15:25:59.569 INFO:teuthology.orchestra.run.smithi159.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-09T15:26:01.901 INFO:teuthology.orchestra.run.smithi159.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-09T15:26:01.903 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-03-09T15:26:01.903 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m10.702s 2024-03-09T15:26:01.903 INFO:teuthology.orchestra.run.smithi159.stderr:user 0m33.904s 2024-03-09T15:26:01.904 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m1.261s 2024-03-09T15:26:03.161 INFO:teuthology.orchestra.run.smithi046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-09T15:26:09.306 INFO:teuthology.orchestra.run.smithi046.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-09T15:26:09.308 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-03-09T15:26:09.308 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m18.151s 2024-03-09T15:26:09.308 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m52.454s 2024-03-09T15:26:09.308 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m1.787s 2024-03-09T15:26:09.309 INFO:tasks.ceph:Archiving logs... 2024-03-09T15:26:09.309 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/remote/smithi046/log 2024-03-09T15:26:09.310 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-09T15:26:16.483 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/remote/smithi159/log 2024-03-09T15:26:16.484 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-09T15:26:21.659 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-09T15:26:21.671 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-09T15:26:21.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-09T15:26:21.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-09T15:26:21.776 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-09T15:26:21.787 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-09T15:26:21.787 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T15:26:21.790 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T15:26:21.818 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-03-09T15:26:21.820 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-03-09T15:26:21.822 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T15:26:21.823 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-03-09T15:26:21.823 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +1350us[+1369us] +/- 90ms 2024-03-09T15:26:21.823 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 -1215us[-1196us] +/- 63ms 2024-03-09T15:26:21.823 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 55 +384us[ +403us] +/- 59ms 2024-03-09T15:26:21.824 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T15:26:21.825 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-09T15:26:21.826 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-03-09T15:26:21.826 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 61 +1315us[+1315us] +/- 90ms 2024-03-09T15:26:21.826 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv02.front.sepia.ceph.com 3 8 377 61 -1202us[-1071us] +/- 63ms 2024-03-09T15:26:21.827 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 122 +420us[ +532us] +/- 77ms 2024-03-09T15:26:21.827 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-09T15:26:21.827 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-09T15:26:21.846 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-09T15:26:21.847 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-09T15:26:21.881 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-09T15:26:21.968 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-09T15:26:22.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T15:26:22.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:26:22.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-09T15:26:22.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:26:22.135 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-09T15:26:22.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-09T15:26:22.199 INFO:teuthology.task.internal:Duration was 4333.655951 seconds 2024-03-09T15:26:22.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-09T15:26:22.232 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-09T15:26:22.232 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-09T15:26:22.234 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-09T15:26:22.289 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T15:26:22.290 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-09T15:26:22.786 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-09T15:26:22.787 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-03-09T15:26:22.787 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-09T15:26:22.820 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-03-09T15:26:22.820 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-09T15:26:22.858 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-09T15:26:22.858 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-09T15:26:22.862 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-09T15:26:22.940 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-09T15:26:22.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-09T15:26:22.944 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-09T15:26:23.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-09T15:26:23.102 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-09T15:26:23.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-09T15:26:23.141 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-09T15:26:23.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-09T15:26:23.193 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:26:23.195 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:26:23.230 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-03-09T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-03-09T15:26:23.284 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:26:23.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:26:23.311 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:26:23.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:26:23.351 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-09T15:26:23.362 INFO:teuthology.task.internal:Transferring archived files... 2024-03-09T15:26:23.363 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/remote/smithi046 2024-03-09T15:26:23.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-09T15:26:23.414 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470/remote/smithi159 2024-03-09T15:26:23.414 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-09T15:26:23.461 INFO:teuthology.task.internal:Removing archive directory... 2024-03-09T15:26:23.461 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-09T15:26:23.463 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-09T15:26:23.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-09T15:26:23.536 INFO:teuthology.task.internal:Not uploading archives. 2024-03-09T15:26:23.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-09T15:26:23.556 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-09T15:26:23.557 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-09T15:26:23.559 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-09T15:26:23.582 INFO:teuthology.orchestra.run.smithi046.stdout: 265708 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 9 15:26 /home/ubuntu/cephtest 2024-03-09T15:26:23.589 INFO:teuthology.orchestra.run.smithi159.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 9 15:26 /home/ubuntu/cephtest 2024-03-09T15:26:23.590 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-09T15:26:23.602 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-09T15:26:23.656 INFO:teuthology.nuke:Checking targets against current locks 2024-03-09T15:26:23.682 DEBUG:teuthology.nuke:shortname: smithi046 2024-03-09T15:26:23.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T15:26:23.706 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:04:52.586235', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJrb6FTGJtDvBDWaeFF1C3SQqO9EKUCouJTkcJ9+56Y6H/XYPLqkVR4R0B3BEikUo6hCvhO/xEF22R960rgmtf0='} 2024-03-09T15:26:23.709 DEBUG:teuthology.nuke:shortname: smithi159 2024-03-09T15:26:23.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T15:26:23.730 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588470', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:04:52.583043', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBORt1zEJxAmg3WQdBX57TaeAzDsYGXN2P4AN6ZmxH+bEcJC24GUG3feFvTF8Zl1SRljfJIdrvg4g+Ii8y/XB1yg='} 2024-03-09T15:26:23.763 INFO:teuthology.orchestra.console.smithi046:Power off 2024-03-09T15:26:23.763 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:26:23.780 INFO:teuthology.orchestra.console.smithi159:Power off 2024-03-09T15:26:23.781 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:26:23.790 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-03-09T15:26:23.791 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:23.805 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2024-03-09T15:26:23.806 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:23.819 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-09T15:26:23.829 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-09T15:26:27.820 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:27.830 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:27.931 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-03-09T15:26:27.941 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-09T15:26:31.934 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:31.947 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:32.049 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-03-09T15:26:32.058 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-03-09T15:26:32.151 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-03-09T15:26:36.060 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:26:36.171 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-03-09T15:26:36.272 INFO:teuthology.orchestra.console.smithi159:Power off completed 2024-03-09T15:26:36.378 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4333.655951023102 failure_reason: 'Command failed (s3 tests against rgw) on smithi046 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e9bcf2424e3e428cad6114c635bf8440 status: fail success: false 2024-03-09T15:26:36.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:26:36.483 INFO:teuthology.run:FAIL